Image display method and apparatus, electronic device, and storage medium

Abstract

An image display method and apparatus, an electronic device, and a storage medium. The image display method can be applied to a head-up display device, the head-up display device comprising a display screen and a light splitting element. The method comprises: acquiring a pupillary distance of a target subject (S1001); on the basis of the pupillary distance of the target subject, a preset virtual image distance, and a preset object distance, determining a target image disparity between a left-eye virtual image and a right-eye virtual image, the preset object distance being an ideal distance between the target subject and a three-dimensional object observed by the target subject by means of the left-eye virtual image and the right-eye virtual image (S1003); on the basis of the difference between the target image disparity and an initial image disparity, adjusting an initial pixel assignment scheme of the display screen, and obtaining a target pixel assignment scheme, the initial pixel assignment scheme being used to enable the distance between the formed left-eye virtual image and right-eye virtual image to be equal to the initial image disparity (S1005); and, on the basis of the target pixel assignment scheme, displaying an image to be displayed (S1007). Using this method ensures the comfort of users with different pupillary distances when viewing an image having a three-dimensional effect.

Description

An image display method, apparatus, electronic device, and storage medium

[0001] This application claims priority to Chinese Patent Application No. 202410958140.3, filed on July 17, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of head-up display technology, such as an image display method, apparatus, electronic device, and storage medium. Background Technology

[0003] HUD (Head-Up Display) originated in the aviation industry, designed to provide pilots with a way to view critical flight information without looking down, thereby improving flight safety and mission efficiency. With technological advancements, HUDs have gradually been introduced into various fields such as automobiles, virtual reality (VR), and augmented reality (AR), becoming an important component in enhancing user experience.

[0004] When users with different interpupillary distances (IPDs) use HUD systems, their perception and comfort of the same 3D (3D) image are directly affected by their individual biological characteristics, especially the significant differences in IPD (the horizontal distance between the centers of the pupils of both eyes). HUD systems are typically designed with a fixed parallax image pair, P1 and P2, to create a stereoscopic visual effect with a sense of depth on the user's retina. However, this fixed parallax setting results in vastly different experiences for observers with different IPDs. Specifically, when users with wider IPDs view parallax images P1 and P2 designed for narrower IPDs, the 3D image may appear too close, while conversely, it may appear too far away. This mismatch causes a conflict when the human eye attempts to focus (accommodation) and converge (convergence). Normally, when observing near objects, the human eye naturally adjusts its focus and converges simultaneously; when observing distant objects, these adjustments are relaxed. However, if the 3D image presented by the HUD does not match the user's actual interpupillary distance, the human eye may not be able to complete this series of coordinated actions naturally and effectively, which is known as convergence-accommodation conflict.

[0005] Prolonged exposure to this visual disharmony can significantly increase user discomfort, manifesting as eye strain, headaches, and even severe dizziness. This phenomenon not only affects the quality of the user's immersive experience but may also have long-term adverse effects on their visual health. Summary of the Invention

[0006] To address the problems in related technologies, this application provides an image display method, apparatus, electronic device, and storage medium. The technical solution is as follows:

[0007] On one hand, an image display method is provided, applied to a head-up display device, the head-up display device including a display screen and a beam splitter, wherein light emitted from the display screen is split by the beam splitter to form a virtual image for the left eye and a virtual image for the right eye; the method includes:

[0008] Obtain the interpupillary distance of the target object;

[0009] Based on the interpupillary distance of the target object, the preset virtual image distance, and the preset object distance, the target distance between the left-eye virtual image and the right-eye virtual image is determined to obtain the target image parallax; the preset virtual image distance is the distance between the left-eye virtual image or the right-eye virtual image and the target object; the preset object distance is the ideal distance between the target object and the three-dimensional object observed by the target object through the left-eye virtual image and the right-eye virtual image.

[0010] The initial pixel allocation method of the display screen is adjusted based on the difference between the target image parallax and the initial image parallax to obtain the target pixel allocation method; the initial pixel allocation method is used to make the distance between the formed left-eye virtual image and the right-eye virtual image equal to the initial image parallax;

[0011] The image to be displayed is displayed based on the target pixel allocation method to form a left-eye virtual image and a right-eye virtual image corresponding to the image to be displayed, so that the distance between the three-dimensional object observed by the target object through the left-eye virtual image and the right-eye virtual image corresponding to the image to be displayed and the target object is equal to the preset object distance.

[0012] On the other hand, an image display device is provided for use in a head-up display (HUD) device, the HUD device including a display screen and a beam splitter, wherein light emitted from the display screen is split by the beam splitter to form a left-eye virtual image and a right-eye virtual image; the device includes:

[0013] The pupil distance acquisition module is set to acquire the pupil distance of the target object.

[0014] The parallax determination module is configured to determine the target distance between the left-eye virtual image and the right-eye virtual image based on the interpupillary distance of the target object, a preset virtual image distance, and a preset object distance, thereby obtaining the target image parallax; the preset virtual image distance is the distance between the left-eye virtual image or the right-eye virtual image and the target object; the preset object distance is the ideal distance between the target object and the three-dimensional object observed by the target object through the left-eye virtual image and the right-eye virtual image.

[0015] The pixel allocation module is configured to adjust the initial pixel allocation method of the display screen based on the difference between the target image parallax and the initial image parallax to obtain the target pixel allocation method; the initial pixel allocation method is used to make the distance between the formed left-eye virtual image and the right-eye virtual image equal to the initial image parallax;

[0016] The image display module is configured to display the image to be displayed based on the target pixel allocation method, so as to form a left-eye virtual image and a right-eye virtual image corresponding to the image to be displayed, so that the distance between the three-dimensional object observed by the target object through the left-eye virtual image and the right-eye virtual image corresponding to the image to be displayed and the target object is equal to the preset object distance.

[0017] In one exemplary embodiment, the pixel allocation module includes:

[0018] The physical size module is configured to determine the physical size of the left eye virtual image or the right eye virtual image to obtain the virtual image size;

[0019] The pixel size module is configured to determine the pixel size corresponding to the virtual image size based on the virtual image size and the visible pixels within a unit field of view.

[0020] The pixel distance module is configured to determine the pixel distance corresponding to the disparity of the target image based on the virtual image size and the pixel size corresponding to the virtual image size;

[0021] The pixel adjustment module is configured to adjust the initial pixel allocation method based on the difference between the pixel distance corresponding to the disparity of the target image and the pixel distance corresponding to the disparity of the initial image, thereby obtaining the target pixel allocation method.

[0022] In one exemplary embodiment, the physical size module includes:

[0023] The field of view acquisition module is configured to acquire the field of view of the head-up display device.

[0024] The first virtual image size module is configured to determine the physical size of the left-eye virtual image or the right-eye virtual image based on the field of view and the preset virtual image distance, thereby obtaining the virtual image size.

[0025] In one exemplary embodiment, the apparatus further includes a pixel segmentation module for determining visible pixels within a unit field of view, the pixel segmentation module comprising:

[0026] The resolution acquisition module is configured to acquire the resolution of the display screen;

[0027] The first ratio determination module is configured to determine the ratio of the resolution to the field of view, thereby obtaining the visible pixels within the unit field of view.

[0028] In one exemplary embodiment, the first virtual image size module includes:

[0029] The second virtual image size module is configured to determine the physical size of the left-eye virtual image or the right-eye virtual image in the horizontal direction based on the preset virtual image distance and the horizontal field of view in the field of view, thereby obtaining the virtual image size.

[0030] In one exemplary embodiment, the first ratio determination module includes:

[0031] A horizontal resolution module is configured to determine the horizontal resolution of the display screen based on the stated resolution.

[0032] The second ratio determination module is configured to determine the ratio of the horizontal resolution to the horizontal field of view, thereby obtaining the visible pixels within the unit field of view.

[0033] In one exemplary embodiment, the resolution acquisition module includes:

[0034] The region determination module is configured to determine the imaging region of the display screen based on the available pixels in the display screen;

[0035] The resolution determination module is configured to determine the resolution of the imaging area.

[0036] In one exemplary embodiment, the pixel adjustment module includes:

[0037] The pixel information module is configured to determine horizontal pixel change information based on the difference between the pixel distance corresponding to the disparity of the target image and the pixel distance corresponding to the disparity of the initial image.

[0038] The pixel translation module is configured to translate and adjust the initial pixel allocation method based on the horizontal pixel change information to obtain the target pixel allocation method.

[0039] In one exemplary embodiment, the disparity determination module includes:

[0040] The ratio determination module is configured to determine the ratio of the preset object distance to the interpupillary distance of the target object to obtain the target ratio;

[0041] The distance determination module is configured to determine the distance between the left-eye virtual image or the right-eye virtual image and the three-dimensional object based on the difference between the preset object distance and the preset virtual image distance, thereby obtaining the virtual image object distance;

[0042] The target disparity module is configured to determine the target image disparity based on the target scale and the distance between the virtual image object and the target image object; the ratio of the distance between the virtual image object and the target image disparity is equal to the target scale.

[0043] In one exemplary embodiment, the head-up display device is communicatively connected to an eye recognition device; the interpupillary distance acquisition module includes:

[0044] The eye position module is configured to acquire the eye position information of the target object sent by the eye recognition device;

[0045] The horizontal distance module is configured to determine the horizontal distance between the eyes of the target object based on the eye position information, thereby obtaining the interpupillary distance of the target object.

[0046] In one exemplary embodiment, the eye positioning module includes:

[0047] The periodic response module is configured to respond to the parallax adjustment command of the current period and obtain the eye position information of the target object sent by the eye recognition device.

[0048] On the other hand, an electronic device is provided, including a processor and a memory, wherein the memory stores at least one instruction or at least one program, the at least one instruction or the at least one program being loaded and executed by the processor to implement the image display method of any of the above aspects.

[0049] On the other hand, a computer-readable storage medium is provided, wherein at least one instruction or at least one program is stored therein, the at least one instruction or the at least one program being loaded and executed by a processor to implement the image display method as described above.

[0050] On the other hand, a computer program product or computer program is provided, which includes computer instructions stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the electronic device to perform the image display method of any of the above aspects.

[0051] This application embodiment obtains the interpupillary distance of the target object, determines the target image parallax matching the target object's interpupillary distance, adjusts the initial pixel allocation method of the display screen according to the target image parallax to obtain the target pixel allocation method, and displays the image to be displayed based on the target pixel allocation method. This ensures that the distance between the target object and the three-dimensional object observed by the target object through the virtual images of the left and right eyes during imaging is always the ideal distance. Maintaining the ideal distance makes the distance and layering of the three-dimensional object more distinct, ensuring the accuracy of depth perception of the three-dimensional effect image for users with different interpupillary distances. It also ensures that the virtual images received by the left and right eyes of users with different interpupillary distances can be perfectly blended, reducing eye fatigue, headaches, and dizziness caused by visual accommodation conflicts. Even with prolonged use, it maintains a high level of comfort, avoiding the visual misalignment and discomfort caused by traditional fixed parallax displays. This helps improve the universality and ease of use of head-up display devices, enabling more people to enjoy a high-quality stereoscopic visual experience. In automotive HUD applications, it ensures that the 3D display of navigation instructions, road warnings, and other information is highly consistent with the actual road conditions, allowing drivers to quickly and accurately understand and respond, reducing safety hazards caused by visual errors, and improving the overall driving safety factor. Attached Figure Description

[0052] Figure 1 is a schematic diagram of the application environment of a head-up display device provided in an embodiment of this application;

[0053] Figure 2 is a schematic diagram of a head-up display device provided in an embodiment of this application;

[0054] Figure 3 is a schematic diagram of the correspondence between an eye box and a virtual image provided in an embodiment of this application;

[0055] Figure 4 is a schematic diagram of the principle of naked-eye 3D provided in an embodiment of this application;

[0056] Figure 5 is a schematic diagram of the first type of three-dimensional imaging provided in an embodiment of this application;

[0057] Figure 6 is a schematic diagram of the second type of three-dimensional imaging provided in an embodiment of this application;

[0058] Figure 7 is a schematic diagram of the third type of three-dimensional imaging provided in the embodiments of this application;

[0059] Figure 8 is a schematic diagram of the implementation environment of an image display method provided in an embodiment of this application;

[0060] Figure 9 is a schematic diagram of the HUD display range provided in an embodiment of this application;

[0061] Figure 10 is a flowchart illustrating an image display method provided in an embodiment of this application;

[0062] Figure 11 is a schematic diagram of the fourth type of three-dimensional imaging provided in the embodiments of this application;

[0063] Figure 12 is a schematic diagram of the projection range of a HUD provided in an embodiment of this application;

[0064] Figure 13 is a schematic diagram of a field of view provided in an embodiment of this application;

[0065] Figure 14 is a schematic diagram of a virtual image distance provided in an embodiment of this application;

[0066] Figure 15 is a schematic diagram from a lower perspective provided in an embodiment of this application;

[0067] Figure 16 is a schematic diagram of the structure of a display screen provided in an embodiment of this application;

[0068] Figure 17 is a structural block diagram of an image display device provided in an embodiment of this application;

[0069] Figure 18 is a hardware structure block diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0070] The technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings.

[0071] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or server that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or devices.

[0072] It is understood that in the specific embodiments of this application, data such as user information are involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0073] Please refer to Figure 1, which shows a schematic diagram of the application environment of a head-up display device provided in an embodiment of this application. Head-up display devices can be used in automobiles as driving assistance instruments, and can also be applied to other vehicles, such as airplanes and high-speed trains. The technical solution of this application will be introduced below using an in-vehicle HUD as an example. Through the image display method of this application embodiment, the HUD can clearly and accurately project vehicle speed, navigation information, warning information, etc., in the form of images and characters, into front of the driver through optical components, forming a three-dimensional virtual image in front of the driver's line of sight, and has good imaging effect.

[0074] Please refer to Figure 2, which shows a schematic diagram of a head-up display device provided in an embodiment of this application. The 3D HUD includes an image generation unit, a lenticular lens grating (or slit grating) attached to the image generation unit, and a reflector assembly. The image generation unit consists of an LCD (Liquid Crystal Display) and a backlight. The reflector assembly may include multiple reflectors, as shown in Figure 2, which includes reflector 1 and reflector 2. Reflector 1 can be a plane mirror or a free-form curved mirror, and reflector 2 can be a free-form curved mirror. In implementing a 3D HUD, the light emitted from the image generation unit is constrained by the lenticular lens grating (or slit grating), resulting in different emission angles and beam splitting. The light emitted from the lenticular lens grating (or slit grating) is refracted sequentially by the reflector assembly and the vehicle's windshield before entering the user's left and right eyes, respectively, resulting in different images seen by the user's left and right eyes.

[0075] Please refer to Figure 3, which shows a schematic diagram of the correspondence between an eyebox and a virtual image provided in an embodiment of this application. It illustrates the process of a human eye observing a virtual image through a windshield, which is labeled "Windshield". The eyeboxes "upper eyebox", "center eyebox", and "lower eyebox" correspond to the virtual images "lower eyebox virtual image", "center eyebox virtual image", and "upper eyebox virtual image", respectively.

[0076] Please refer to Figure 4, which shows a schematic diagram of the principle of naked-eye 3D provided in an embodiment of this application. By optically designing the HUD, the user's left eye sees image P1 and the right eye sees image P2. Images P1 and P2 can be combined in the user's brain to form a stereoscopic image with a sense of depth. By changing the position between the two images and adjusting the binocular parallax, the distance of the virtual image perceived by the user can be changed (in reality, the distance of the virtual image remains constant). The closer the two images are, the closer the distance of the virtual image perceived by the user; conversely, the farther the two images are, the farther the distance of the virtual image perceived by the user.

[0077] Please refer to Figure 5, which shows a schematic diagram of the first type of three-dimensional imaging provided by an embodiment of this application. By splitting the light rays of adjacent pixels in the display screen through a beam splitter, the images seen by the user's left and right eyes through the imaging structure (such as a windshield) on the same virtual image plane are different. For example, when the user is looking at the same sphere, two images are presented to the user: the sphere seen by the left eye (L) is slightly to the left (P1), and the sphere seen by the right eye (R) is slightly to the right (P2). Due to the binocular parallax formed by P1 and P2, the object seen by the user has a sense of depth and space. When the left and right eyes converge to focus their gaze on position P3, the brain will attempt to combine these images of the sphere to form a continuous, three-dimensional sphere P3. Therefore, to experience this three-dimensional visual sensation, it is necessary to ensure that the gaze is accurately placed at position P3, that is, at the intersection of the line connecting L and P1 and the line connecting R and P2, so that the brain can process these visual inputs and transform them into a coherent overall view.

[0078] Please refer to Figure 6, which shows a second type of three-dimensional imaging schematic diagram provided by an embodiment of this application. On the same image plane, by adjusting the viewing angles of both eyes, the user's subjective perception of distance can be altered. For example, in the case shown in the figure, if the convergence angle of the object seen by both eyes is reduced to θf, the user will perceive the object as being farther away, i.e., position P3. This is because a smaller convergence angle means that the lines of sight of both eyes are more parallel, thus simulating the visual effect of a distant object. Conversely, if the sphere seen by the left eye is slightly deflected to the right, and the sphere seen by the right eye is slightly deflected to the left, a larger convergence angle θn is formed. At this time, the user will perceive the object as being closer, i.e., position P4. This is because when observing an object at close range, the lines of sight of both eyes need a larger convergence angle to align with the same target. Under normal circumstances, if there is no parallax, the object should be displayed at position P5, where the convergence angle of both eyes is θ0. The visual experience in this case is usually comfortable because our eyes do not need to over-adjust to adapt to this scenario. When θf is less than θ0, it indicates that the object seen by the user is farther away from the virtual image; while when θn is greater than θ0, it indicates that the object seen by the user is closer to the virtual image. However, if the values ​​of |θn-θ0| or |θ0-θf| are too large, it means that the human eye's convergence accommodation mechanism may not be able to effectively cope with this change, leading to symptoms such as eye discomfort or even dizziness in the user.

[0079] Please refer to Figure 7, which shows a schematic diagram of the third type of three-dimensional imaging provided in this application embodiment. For a given HUD system, its parallax images P1 and P2 are also fixed. Users with different interpupillary distances will perceive different depths and distances. For users with narrower interpupillary distances, the images of P1 and P2 will be successfully fused at a relatively distant position P5 to form a three-dimensional image. For user B with a wider interpupillary distance, the images of P1 and P2 need to be fused at a relatively closer position P6 to obtain the same three-dimensional effect. If the distance between P5 and P3 is too large, or the distance between P6 and P3 is too large, this means that the human eye's convergence accommodation mechanism may not be able to effectively cope with this change, leading to symptoms such as eye discomfort or even dizziness in the user.

[0080] In view of this, this application provides an image display method applied to a head-up display device. The head-up display device includes a display screen and a beam splitter. The light emitted from the display screen is split by the beam splitter to form a virtual image for the left eye and a virtual image for the right eye. Specifically, please refer to Figure 8, which shows a schematic diagram of the implementation environment of an image display method provided in this application embodiment. A DMS (Driver Monitoring System) is installed between the driver and the windshield. The DMS is used to identify the driver's interpupillary distance. The DMS is communicatively connected to the head-up display device and sends the interpupillary distance data to the head-up display device. The installation position of the DMS is not specifically limited in this application, but it needs to be able to be rigidly fixed between the driver's eyes and the windshield, without obstructing the driver's line of sight, and not blocked by the steering wheel or the driver's body posture while driving. Please refer to Figure 9, which is a schematic diagram of the HUD display range provided in an embodiment of this application. The HUD display range includes an AR area and a non-AR area. The AR area elements may include navigation, vehicles / obstacles, warnings, pedestrians, lanes, etc., while the non-AR area (indicator area) elements may include navigation heading, speed limit and vehicle speed, and other prompt information.

[0081] Please refer to Figure 10, which shows a flowchart of an image display method provided in an embodiment of this application. It should be noted that this specification provides method operation steps as shown in the embodiments or flowcharts, but based on conventional or non-inventive labor, more or fewer operation steps may be included. The order of steps listed in the embodiments is merely one possible execution order among many steps and does not represent the only execution order. In actual system or product execution, the method can be executed sequentially according to the embodiments or figures, or in parallel (e.g., in a parallel processor or multi-threaded processing environment). Specifically, as shown in Figure 10, the method may include:

[0082] S1001, obtain the interpupillary distance of the target object.

[0083] The target audience is the user currently using the head-up display device.

[0084] Interpupillary distance (IPD) is the distance between the pupils of the target object's two eyes.

[0085] In one exemplary embodiment, the head-up display device is communicatively connected to the eye recognition device; step S1001 above may include the following steps:

[0086] Obtain the eye position information of the target object sent by the eye recognition device;

[0087] Based on eye position information, the horizontal distance between the two eyes of the target object is determined, thus obtaining the interpupillary distance of the target object.

[0088] In practice, the eye recognition device can be set as a DMS (Dear Observation System). Specifically, the DMS is installed between the driver and the windshield. The DMS is used to identify the eye position of the target object. The DMS communicates with the head-up display (HUD) and sends the target object's eye position information to the HUD. The installation location of the DMS is not specifically limited in this application, but it needs to be able to be rigidly fixed between the driver's eyes and the windshield, without obstructing the driver's line of sight, and not being blocked by the steering wheel or the driver's body posture while driving.

[0089] Specifically, if the target object's head shifts, for example, tilts or turns slightly, the target object's interpupillary distance is equivalent to narrowing in the horizontal direction, which is considered a change in the target object's interpupillary distance. In other words, the target object's interpupillary distance is based on the data in the horizontal direction.

[0090] As can be seen from the above technical solutions of the embodiments of this application, the embodiments of this application calculate the distance between the eyes of the target object in the horizontal direction as the interpupillary distance of the target object. If the head of the target object shifts, it is considered that the interpupillary distance of the target object has changed. The parallax of the target image is determined according to the subsequent steps, and then the pixel allocation method is adjusted so that the target object can always ensure the accuracy of depth perception and maintain a high level of comfort when using the head-up display device, thereby improving the user's immersion.

[0091] In one exemplary embodiment, the step of obtaining the eye location information of the target object sent by the eye recognition device may include the following steps:

[0092] In response to the parallax adjustment command of the current cycle, acquire the eye position information of the target object sent by the eye recognition device.

[0093] The current cycle refers to the cycle for detecting the eye position of the target object. Specifically, during the operation of the head-up display device, the eye recognition device periodically detects the eye position of the target object and sends the data to the head-up display device.

[0094] Specifically, the head-up display device determines the target image parallax based on the eye position information sent by the eye recognition device in the current cycle, and then adjusts the pixel allocation method of the display screen so that the distance between the 3D object observed by the target through the left eye virtual image and the right eye virtual image in the current cycle is equal to the preset object distance.

[0095] As can be seen from the above technical solutions of the embodiments of this application, the embodiments of this application obtain the eye position information of the target object on a periodic basis, thereby determining the interpupillary distance of the target object, determining the parallax of the target image according to subsequent steps, and then adjusting the pixel allocation method, so that the target object can always ensure the accuracy of depth perception and maintain a high level of comfort when using the head-up display device, thereby enhancing the user's immersion.

[0096] S1003, based on the interpupillary distance of the target object, the preset virtual image distance, and the preset object distance, determine the target distance between the left-eye virtual image and the right-eye virtual image, and obtain the target image parallax.

[0097] The preset virtual image distance is the distance between the left-eye virtual image or the right-eye virtual image and the target object. Specifically, the preset virtual image distance refers to the distance between the position of the left-eye virtual image or the right-eye virtual image perceived by the user's eye and the user's eye under ideal conditions. This distance is preset to optimize the user's visual experience and comfort. Please refer to Figure 11, which shows a schematic diagram of the fourth type of three-dimensional imaging provided in this application embodiment. The preset virtual image distance is represented by VID (Virtual Image Distance) in the figure.

[0098] The preset object distance is the ideal distance between the target object and the 3D object as perceived by the virtual images of the left and right eyes. Specifically, the preset object distance is the straight-line distance between the center point of the user's eyes and the virtual image of the 3D object perceived by the user. This distance is preset to optimize the user's visual experience and comfort. As shown in Figure 11, the preset object distance is represented by VVID in the figure.

[0099] The virtual image in the left eye refers to the portion of the light emitted from the display screen that reaches the user's left eye after being processed by a beam splitter. This portion of the light is then focused by the eye's optical system and forms a virtual image at the visual center of the brain.

[0100] The right-eye virtual image refers to the portion of the light emitted from the display screen that reaches the user's right eye after being processed by a beam splitter. This portion of the light is then focused by the eye's optical system and forms a virtual image at the visual center of the brain.

[0101] The target distance refers to the positional difference of the same scene feature points on the left-eye and right-eye virtual images. Specifically, the positional difference is manifested as the difference in lateral distance.

[0102] In this context, target image disparity is used to ensure that the distance between the target object and its perceived 3D object is an ideal distance, i.e., a preset object distance. As shown in Figure 11, target image disparity is represented by d in the figure.

[0103] In practice, d can be calculated based on the geometric relationship between pupil distance D, target image parallax d, preset object distance VVID, and preset virtual image distance VID.

[0104] In one exemplary embodiment, step S1003 may include the following steps:

[0105] Determine the ratio of the preset object distance to the target object's interpupillary distance to obtain the target ratio;

[0106] Based on the difference between the preset object distance and the preset virtual image distance, the distance between the left-eye virtual image or the right-eye virtual image and the 3D object is determined, thus obtaining the virtual image object distance;

[0107] The disparity of the target image is determined based on the target scale and the distance to the virtual image object; the ratio of the distance to the virtual image object to the disparity of the target image is equal to the target scale.

[0108] The preset object distance is the ideal distance between the target object and the 3D object as perceived by the virtual images of the left and right eyes. Specifically, the preset object distance is the straight-line distance between the center point of the user's eyes and the virtual image of the 3D object perceived by the user. This distance is preset to optimize the user's visual experience and comfort.

[0109] Among them, the pupil distance of the target object is the distance between the pupils of the user's two eyes currently using the head-up display device.

[0110] The preset virtual image distance is the distance between the left-eye virtual image or the right-eye virtual image and the target object. Specifically, the preset virtual image distance refers to the distance between the position of the left-eye virtual image or the right-eye virtual image perceived by the user's eyes under ideal conditions and the user's eyes. This distance is preset to optimize the user's visual experience and comfort.

[0111] Among them, the distance between the virtual image object and the left eye virtual image or the right eye virtual image and the corresponding three-dimensional object.

[0112] Among them, target image parallax refers to the positional difference of the same scene feature points on the left-eye virtual image and the right-eye virtual image, which is manifested as a lateral distance difference and is used to make the distance between the target object and the perceived 3D object equal to the preset object distance.

[0113] Specifically, as shown in Figure 11, the left-eye virtual image P1, the right-eye virtual image P2, and the 3D object P3 form a first triangle, and the left-eye L, the right-eye R, and the 3D object P3 form a second triangle. The first and second triangles are similar triangles. Using the properties of similar triangles, the ratio of the preset object distance VVID to the interpupillary distance D of the target object is equal to the ratio of (preset object distance VVID - preset virtual image distance VID) to the disparity d of the target image. Based on this, the disparity d of the target image is obtained. Specifically, see formula (1):

[0114] As can be seen from the above technical solutions of the embodiments of this application, the embodiments of this application utilize the characteristics of similar triangles to calculate the parallax of the target image based on the interpupillary distance of the target object, the preset virtual image distance, and the preset object distance. This is used to adjust the pixel allocation method, ensuring the accuracy and comfort of depth perception for users with different interpupillary distances when viewing three-dimensional effect images, and helping to improve the universality and ease of use of head-up display devices.

[0115] S1005, adjust the initial pixel allocation method of the display screen based on the difference between the parallax of the target image and the parallax of the initial image to obtain the target pixel allocation method.

[0116] The initial pixel allocation method is used to ensure that the distance between the formed left-eye virtual image and the right-eye virtual image is equal to the initial image parallax.

[0117] The initial image parallax is designed based on standard interpupillary distance (IPD), ensuring that the distance between a user with a standard IPD and the perceived 3D object is a preset object distance. Specifically, the standard IPD here is the IPD reference value used when designing the HUD system.

[0118] The target pixel allocation method is used to ensure that the distance between the formed left-eye virtual image and the right-eye virtual image is equal to the parallax of the target image.

[0119] In one exemplary embodiment, step S1005 may include the following steps:

[0120] Determine the physical size of the virtual image in the left eye or the virtual image in the right eye to obtain the virtual image size;

[0121] The pixel size corresponding to the virtual image size is determined based on the virtual image size and the visible pixels within a unit field of view.

[0122] Based on the virtual image size and the corresponding pixel size, determine the pixel distance corresponding to the disparity of the target image;

[0123] Based on the difference between the pixel distance corresponding to the disparity of the target image and the pixel distance corresponding to the disparity of the initial image, the initial pixel allocation method is adjusted to obtain the target pixel allocation method.

[0124] The virtual image size refers to the physical size of the left-eye or right-eye virtual image in space. In practice, the virtual image size is usually expressed in units of length, such as millimeters.

[0125] Here, the visible pixels within a unit field of view are the number of pixels that can be seen within each degree of field of view.

[0126] The pixel size corresponding to the virtual image size indicates how many pixels, in pixels, make up the left-eye or right-eye virtual image in digital format.

[0127] Among them, the pixel distance corresponding to the parallax of the target image indicates how many pixels the same scene feature points in the left-eye virtual image and the right-eye virtual image are spaced apart in digital format, which is used to make the distance between the target object and the perceived 3D object equal to the preset object distance.

[0128] The pixel distance corresponding to the initial image parallax indicates how many pixels the same scene feature points in the left and right virtual images are separated in digital format, which is used to make the distance between the user with the standard interpupillary distance and the three-dimensional object they perceive equal to the preset object distance.

[0129] The initial pixel allocation method is used to ensure that the distance between the formed left-eye virtual image and the right-eye virtual image is equal to the initial image parallax.

[0130] The target pixel allocation method is used to ensure that the distance between the formed left-eye virtual image and the right-eye virtual image is equal to the parallax of the target image.

[0131] Specifically, determine how many units of field of view the virtual image of the left or right eye occupies, combine the visible pixels within the unit field of view to obtain the pixel size corresponding to the virtual image size, and obtain the conversion relationship between length units and pixel units based on the ratio of the virtual image size to its corresponding pixel size. Based on this conversion relationship, convert the target image disparity in length units to pixel units to obtain the pixel distance corresponding to the target image disparity.

[0132] As can be seen from the above technical solutions of the embodiments of this application, the embodiments of this application convert the target image disparity in length units into pixel units by using the proportional relationship between the physical size of the left-eye virtual image or the right-eye virtual image and its corresponding pixel size, so as to obtain the pixel distance corresponding to the target image disparity, so as to adjust the pixel allocation method in pixel units.

[0133] In one exemplary embodiment, the step of determining the physical size of the left-eye virtual image or the right-eye virtual image described above may include the following steps:

[0134] Obtain the field of view of the head-up display device;

[0135] Based on the field of view and the preset virtual image distance, the physical size of the left-eye virtual image or the right-eye virtual image is determined, and the virtual image size is obtained.

[0136] Specifically, please refer to Figures 12-15, which respectively illustrate a schematic diagram of the HUD projection range, a schematic diagram of the field of view, a schematic diagram of the virtual image distance, and a schematic diagram of the look-down angle provided in the embodiments of this application. The field of view describes the range of spatial angles that a user can see through a head-up display device, and is usually represented by the horizontal field of view (HFOV) and the vertical field of view (VFOV). Sometimes, the diagonal field of view (DFOV) is used to describe the angular range of the entire imaging area. The virtual image distance (VID) is the distance from the user's eye point to the virtual image, and the look-down angle (LDA) is the angle between the line connecting the user's eye point and the center point of the virtual image and the horizontal plane.

[0137] Specifically, Figure 12 shows the relationship between the field of view, the virtual image distance, and the virtual image size. Using this relationship, the virtual image size is determined based on the field of view and the preset virtual image distance.

[0138] As can be seen from the above technical solutions of the embodiments of this application, the embodiments of this application calculate the virtual image size by means of the relationship between the field of view, the preset virtual image distance and the virtual image size, and use it to convert the parallax of the target image in length units into pixel units.

[0139] In an exemplary embodiment, the step of determining the physical size of the left-eye virtual image or the right-eye virtual image based on the field of view and a preset virtual image distance, and obtaining the virtual image size, may include the following steps:

[0140] Based on the preset virtual image distance and the horizontal field of view, the physical size of the left-eye virtual image or the right-eye virtual image in the horizontal direction is determined, and the virtual image size is obtained.

[0141] Specifically, the physical dimensions of the virtual image in the horizontal direction can be calculated using formula (2):

[0142] Where VID is the preset virtual image distance and HFOV is the horizontal field of view.

[0143] In practice, the physical dimensions of the virtual image in the vertical direction can be calculated based on the same principle.

[0144] As can be seen from the above technical solutions of the embodiments of this application, the embodiments of this application calculate the physical size of the virtual image in the horizontal direction by the relationship between the horizontal field of view, the preset virtual image distance and the virtual image size, which is used to convert the parallax of the target image in length units into pixel units.

[0145] In one exemplary embodiment, the method for determining visible pixels within the aforementioned unit field of view may include the following steps:

[0146] Get the screen resolution;

[0147] Determine the ratio of resolution to field of view to obtain the visible pixels per unit field of view.

[0148] The resolution of a display screen refers to the number of pixels on the screen, both horizontally and vertically. For example, a 1920×1080 display means it has 1920 horizontal pixels and 1080 vertical pixels.

[0149] Here, the visible pixels within a unit field of view are the number of pixels that can be seen within each degree of field of view.

[0150] As can be seen from the above technical solutions of the embodiments of this application, the embodiments of this application calculate the visible pixels within a unit field of view by using the resolution and field of view of the display screen, so as to convert the virtual image size in units of length into pixel units.

[0151] In one exemplary embodiment, the step of determining the ratio of resolution to field of view to obtain visible pixels per unit field of view may include the following steps:

[0152] Determine the horizontal resolution of the display screen based on its resolution;

[0153] Determine the ratio of horizontal resolution to horizontal field of view to obtain the visible pixels per unit field of view.

[0154] Specifically, the visible pixels within a unit field of view here are represented by the data of visible pixels in the horizontal direction within a unit field of view.

[0155] Specifically, the number of visible pixels per unit field of view can be approximated as the ratio of horizontal resolution to horizontal field of view. In practice, this value may need further adjustment due to factors such as the resolution of the human eye and the sensitivity of the visual center region.

[0156] In practice, the same principle can be used to calculate the data of visible pixels in the vertical direction within a unit field of view.

[0157] As can be seen from the above technical solutions of the embodiments of this application, the embodiments of this application calculate the visible pixels within a unit field of view by using the horizontal resolution and horizontal field of view of the display screen, so as to convert the virtual image size in units of length into pixel units.

[0158] In one exemplary embodiment, the step of obtaining the resolution of the display screen described above may include the following steps:

[0159] The imaging area of ​​the display screen is determined based on the available pixels in the display screen;

[0160] Determine the resolution of the imaging area.

[0161] The imaging area of ​​the display screen refers to the area actually used for imaging on the display screen.

[0162] For example, please refer to Figure 16, which shows a schematic diagram of a display screen provided in an embodiment of this application. If a 4.1-inch liquid crystal display screen is used, the working area of ​​the display screen is 92.544mm × 46.272mm, the actual imaging area of ​​the display screen is 87.89mm × 36.46mm, and the resolution of the display screen is 1280 × 640 pixels. When all the pixels in the actual imaging area of ​​the display screen (the actual display area of ​​the image) are lit up, the horizontal resolution (the resolution of the actual display area) is 1200 pixels.

[0163] As can be seen from the above technical solutions of the embodiments of this application, the embodiments of this application improve the calculation accuracy by determining the resolution of the imaging area in the display screen to calculate the visible pixels within a unit field of view, thereby improving the accuracy of subsequent adjustment of pixel allocation method.

[0164] In an exemplary embodiment, the step of adjusting the initial pixel allocation method based on the difference between the pixel distance corresponding to the disparity of the target image and the pixel distance corresponding to the disparity of the initial image to obtain the target pixel allocation method may include the following steps:

[0165] Based on the difference between the pixel distance corresponding to the disparity of the target image and the pixel distance corresponding to the disparity of the initial image, the horizontal pixel change information is determined.

[0166] The initial pixel allocation method is shifted and adjusted based on the horizontal pixel change information to obtain the target pixel allocation method.

[0167] Among them, the pixel distance corresponding to the parallax of the target image indicates how many pixels the same scene feature points in the left-eye virtual image and the right-eye virtual image are spaced apart in digital format, which is used to make the distance between the target object and the perceived 3D object equal to the preset object distance.

[0168] The pixel distance corresponding to the initial image parallax indicates how many pixels the same scene feature points in the left and right virtual images are separated in digital format, which is used to make the distance between the user with the standard interpupillary distance and the three-dimensional object they perceive equal to the preset object distance.

[0169] Among them, the horizontal pixel change information indicates the pixel difference in the horizontal direction between the disparity of the target image and the disparity of the initial image.

[0170] The initial pixel allocation method is used to ensure that the distance between the formed left-eye virtual image and the right-eye virtual image is equal to the initial image parallax.

[0171] The target pixel allocation method is used to ensure that the distance between the formed left-eye virtual image and the right-eye virtual image is equal to the parallax of the target image.

[0172] As can be seen from the above technical solutions of the embodiments of this application, the embodiments of this application obtain a target pixel allocation method that matches the parallax of the target image by translating and adjusting the initial pixel allocation method. Since the parallax of the target image matches the interpupillary distance of the target object, the depth perception accuracy and comfort of users with different interpupillary distances when viewing the three-dimensional effect image are guaranteed, which helps to improve the universality and ease of use of the head-up display device.

[0173] S1007, Display the image to be displayed based on the target pixel allocation method to form a left-eye virtual image and a right-eye virtual image corresponding to the image to be displayed, so that the distance between the three-dimensional object observed by the target object through the left-eye virtual image and the right-eye virtual image corresponding to the image to be displayed is equal to the preset object distance.

[0174] The image to be displayed is the image that needs to be shown to the target object.

[0175] As can be seen from the above technical solutions of the embodiments of this application, the embodiments of this application obtain the interpupillary distance of the target object, determine the target image parallax that matches the interpupillary distance of the target object, adjust the initial pixel allocation method of the display screen according to the target image parallax to obtain the target pixel allocation method, and display the image to be displayed based on the target pixel allocation method, so that the distance between the three-dimensional object observed by the target object through the virtual image of the left eye and the virtual image of the right eye during imaging is always the ideal distance. The maintenance of the ideal distance makes the distance and level of the three-dimensional object more distinct, ensuring the accuracy of depth perception of users with different interpupillary distances when viewing the three-dimensional effect image; ensuring that the virtual images received by the left and right eyes of users with different interpupillary distances can be perfectly blended, reducing eye fatigue, headaches and dizziness caused by visual accommodation conflict, and maintaining a high level of comfort even after long-term use, avoiding the visual misalignment and discomfort caused by traditional fixed parallax display, helping to improve the universality and ease of use of head-up display devices, and enabling more people to enjoy a high-quality stereoscopic visual experience. In automotive HUD applications, the 3D display of navigation instructions, road warnings, and other information is ensured to be highly consistent with the actual road conditions, enabling drivers to quickly and accurately understand and respond to them. This reduces safety hazards caused by visual errors and improves the overall driving safety factor.

[0176] Corresponding to the image display methods provided in the above embodiments, this application also provides an image display device. Since the image display device provided in this application corresponds to the image display methods provided in the above embodiments, the implementation methods of the aforementioned image display methods are also applicable to the image display device provided in this embodiment, and will not be described in detail in this embodiment.

[0177] Please refer to Figure 17, which shows a schematic diagram of an image display device provided in an embodiment of this application. This device has the function of implementing the image display method described in the above-described method embodiments. This function can be implemented by hardware or by hardware executing corresponding software. This device can be applied to a head-up display device, which includes a display screen and a beam splitter. The light emitted from the display screen is split by the beam splitter to form a left-eye virtual image and a right-eye virtual image. As shown in Figure 17, the device may include:

[0178] The pupil distance acquisition module 1710 is configured to acquire the pupil distance of the target object.

[0179] The disparity determination module 1720 is configured to determine the target distance between the left-eye virtual image and the right-eye virtual image based on the interpupillary distance of the target object, the preset virtual image distance, and the preset object distance, thereby obtaining the target image disparity. The preset virtual image distance is the distance between the left-eye virtual image or the right-eye virtual image and the target object. The preset object distance is the ideal distance between the target object and the 3D object observed by the target object through the left-eye virtual image and the right-eye virtual image.

[0180] The pixel allocation module 1730 is configured to adjust the initial pixel allocation method of the display screen based on the difference between the target image parallax and the initial image parallax, thereby obtaining the target pixel allocation method; the initial pixel allocation method is used to make the distance between the formed left-eye virtual image and the right-eye virtual image equal to the initial image parallax;

[0181] The image display module 1740 is configured to display the image to be displayed based on the target pixel allocation method, so as to form a left-eye virtual image and a right-eye virtual image corresponding to the image to be displayed, so that the distance between the three-dimensional object observed by the target object through the left-eye virtual image and the right-eye virtual image corresponding to the image to be displayed is equal to the preset object distance.

[0182] In one exemplary embodiment, the pixel allocation module includes:

[0183] The physical size module is set to determine the physical size of the virtual image of the left eye or the virtual image of the right eye, and obtain the virtual image size;

[0184] The pixel size module is configured to determine the pixel size corresponding to the virtual image size based on the virtual image size and the visible pixels within a unit field of view.

[0185] The pixel distance module is configured to determine the pixel distance corresponding to the disparity of the target image based on the virtual image size and the pixel size corresponding to the virtual image size;

[0186] The pixel adjustment module is configured to adjust the initial pixel allocation method based on the difference between the pixel distance corresponding to the disparity of the target image and the pixel distance corresponding to the disparity of the initial image, so as to obtain the target pixel allocation method.

[0187] In one exemplary embodiment, the physical size module includes:

[0188] The field of view acquisition module is configured to acquire the field of view of the head-up display device.

[0189] The first virtual image size module is set to determine the physical size of the left-eye virtual image or the right-eye virtual image based on the field of view and the preset virtual image distance, so as to obtain the virtual image size.

[0190] In one exemplary embodiment, the apparatus further includes a pixel segmentation module for determining visible pixels within a unit field of view, the pixel segmentation module comprising:

[0191] The resolution acquisition module is configured to acquire the resolution of the display screen.

[0192] The first ratio determination module is configured to determine the ratio of resolution to field of view, thereby obtaining the visible pixels within a unit field of view.

[0193] In one exemplary embodiment, the first virtual image size module includes:

[0194] The second virtual image size module is set to determine the physical size of the left-eye virtual image or the right-eye virtual image in the horizontal direction based on the preset virtual image distance and the horizontal field of view angle, so as to obtain the virtual image size.

[0195] In one exemplary embodiment, the first ratio determination module includes:

[0196] The horizontal resolution module is configured to determine the horizontal resolution of the display screen based on the overall resolution.

[0197] The second ratio determination module is configured to determine the ratio of horizontal resolution to horizontal field of view, thereby obtaining the visible pixels within a unit field of view.

[0198] In one exemplary implementation, the resolution acquisition module includes:

[0199] The region determination module is configured to determine the imaging region of the display screen based on the available pixels in the display screen;

[0200] The resolution determination module is set to determine the resolution of the imaging area.

[0201] In one exemplary embodiment, the pixel adjustment module includes:

[0202] The pixel information module is configured to determine horizontal pixel change information based on the difference between the pixel distance corresponding to the disparity of the target image and the pixel distance corresponding to the disparity of the initial image.

[0203] The pixel translation module is configured to translate and adjust the initial pixel allocation method based on the horizontal pixel change information to obtain the target pixel allocation method.

[0204] In one exemplary embodiment, the disparity determination module includes:

[0205] The ratio determination module is set to determine the ratio of the preset object distance to the interpupillary distance of the target object to obtain the target ratio;

[0206] The distance determination module is set to determine the distance between the left-eye virtual image or the right-eye virtual image and the 3D object based on the difference between the preset object distance and the preset virtual image distance, thus obtaining the virtual image object distance;

[0207] The target parallax module is configured to determine the target image parallax based on the target scale and the distance between the virtual image and the object; the ratio of the distance between the virtual image and the target image parallax is equal to the target scale.

[0208] In one exemplary embodiment, the head-up display device is communicatively connected to an eye recognition device; the interpupillary distance acquisition module includes:

[0209] The eye position module is configured to acquire the eye position information of the target object sent by the eye recognition device.

[0210] The horizontal distance module is configured to determine the horizontal distance between the eyes of the target object based on the eye position information, thereby obtaining the interpupillary distance of the target object.

[0211] In one exemplary embodiment, the eye positioning module includes:

[0212] The periodic response module is configured to respond to the parallax adjustment command of the current period and obtain the eye position information of the target object sent by the eye recognition device.

[0213] It should be noted that the apparatus provided in the above embodiments is only illustrated by the division of the above functional modules when implementing its functions. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.

[0214] This application provides an electronic device, which includes a processor and a memory. The memory stores at least one instruction or at least one program segment, which is loaded and executed by the processor to implement any of the image display methods provided in the above method embodiments.

[0215] Memory is used to store software programs and modules. The processor executes these stored software programs and modules to perform various functional applications and data processing. Memory can primarily consist of a program storage area and a data storage area. The program storage area stores the operating system, application programs required for functionality, etc.; the data storage area stores data created based on device usage, etc. Furthermore, memory can include high-speed random access memory (RAM) and non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, memory can also include a memory controller to provide the processor with access to the memory.

[0216] The method embodiments provided in this application can be executed in a computer terminal, server, or similar computing device; that is, the aforementioned electronic device may include a computer terminal, server, or similar computing device. Figure 18 is a hardware structure block diagram of a computer device running an image display method according to an embodiment of this application. As shown in Figure 18, the internal structure of the computer device may include, but is not limited to, a processor, a network interface, and a memory. The processor, network interface, and memory within the computer device can be connected via a bus or other means; in the embodiments shown in Figure 18 of this specification, a bus connection is used as an example.

[0217] The processor (or CPU, Central Processing Unit) is the computing and control core of the computer device. The network interface may optionally include a standard wired interface or a wireless interface (such as Wi-Fi, mobile communication interface, etc.). Memory is the storage device in the computer device used to store programs and data. It is understood that the memory here can be a high-speed RAM storage device, or a non-volatile storage device, such as at least one disk storage device; optionally, it can also be at least one storage device located remotely from the aforementioned processor. The memory provides storage space, which stores the operating system of the electronic device, including but not limited to: Windows (an operating system), Linux (an operating system), Android (a mobile operating system), iOS (a mobile operating system), etc., which are not limited in this application; and the storage space also stores one or more instructions suitable for being loaded and executed by the processor, which can be one or more computer programs (including program code). In the embodiments of this specification, the processor loads and executes one or more instructions stored in the memory to implement the image display method provided in the above method embodiments.

[0218] Embodiments of this application also provide a computer-readable storage medium that can be disposed in an electronic device to store at least one instruction or at least one program related to implementing an image display method. The at least one instruction or the at least one program is loaded and executed by the processor to implement any of the image display methods provided in the above-described method embodiments.

[0219] Optionally, in this embodiment, the storage medium may include, but is not limited to, various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0220] It should be noted that the order of the embodiments described above is merely for descriptive purposes and does not represent the superiority or inferiority of the embodiments. Furthermore, specific embodiments have been described above. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps described in the claims can be performed in a different order than that shown in the embodiments and still achieve the desired result. Additionally, the processes depicted in the drawings do not necessarily require a specific or sequential order to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0221] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the apparatus embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions of the method embodiments.

[0222] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

Claims

1. An image display method applied to a head-up display device, the head-up display device comprising a display screen and a light splitting element, light emitted by the display screen being split by the light splitting element to form a left-eye virtual image and a right-eye virtual image; the method comprising: obtaining a pupillary distance of a target object; determining a target distance between the left-eye virtual image and the right-eye virtual image based on the pupillary distance of the target object, a preset virtual image distance and a preset object distance, to obtain a target image parallax; the preset virtual image distance being a distance between the left-eye virtual image or the right-eye virtual image and the target object; the preset object distance being an ideal distance between a three-dimensional object observed by the target object through the left-eye virtual image and the right-eye virtual image and the target object; adjusting an initial pixel allocation manner of the display screen based on a difference between the target image parallax and an initial image parallax, to obtain a target pixel allocation manner; the initial pixel allocation manner being used to make a distance between the left-eye virtual image and the right-eye virtual image formed equal to the initial image parallax; displaying a to-be-displayed image based on the target pixel allocation manner, to form a left-eye virtual image and a right-eye virtual image corresponding to the to-be-displayed image, so that a distance between a three-dimensional object observed by the target object through the left-eye virtual image and the right-eye virtual image corresponding to the to-be-displayed image and the target object is equal to the preset object distance. The adjusting of the initial pixel allocation manner of the display screen based on the difference between the target image parallax and the initial image parallax to obtain the target pixel allocation manner comprises: determining a physical size of the left-eye virtual image or the right-eye virtual image to obtain a virtual image size; determining a pixel size corresponding to the virtual image size based on the virtual image size and a visible pixel within a unit field of view; determining a pixel distance corresponding to the target image parallax based on the virtual image size and the pixel size corresponding to the virtual image size; and adjusting the initial pixel allocation manner based on a difference between the pixel distance corresponding to the target image parallax and a pixel distance corresponding to the initial image parallax, to obtain the target pixel allocation manner. The determining of the physical size of the left-eye virtual image or the right-eye virtual image to obtain the virtual image size comprises: obtaining a field of view of the head-up display device; and determining the physical size of the left-eye virtual image or the right-eye virtual image based on the field of view and the preset virtual image distance, to obtain the virtual image size.

4. The image display method according to claim 3, further comprising: obtaining a resolution of the display screen; and determining a ratio of the resolution to the field of view to obtain the visible pixel within the unit field of view. The determining of the physical size of the left-eye virtual image or the right-eye virtual image based on the field of view and the preset virtual image distance to obtain the virtual image size comprises: determining a physical size of the left-eye virtual image or the right-eye virtual image in a horizontal direction based on the preset virtual image distance and a horizontal field of view in the field of view, to obtain the virtual image size.

2. The image display method according to claim 1, wherein The determining of the ratio of the resolution to the field of view to obtain the visible pixel within the unit field of view comprises: ​ ​ ​ ​ 3. The image display method according to claim 2, wherein ​ ​ ​ ​ ​ ​ 5. The image display method according to claim 4, wherein ​ ​ 6. The image display method according to claim 5, wherein ​ determine a horizontal resolution of the display screen based on the resolution; determine a ratio of the horizontal resolution to the horizontal field of view to obtain a visible pixel within the unit field of view.

7. The image display method according to claim 4, wherein The resolution of the display screen is obtained by: determining an imaging area of the display screen based on available pixels in the display screen; determining a resolution of the imaging area.

8. The image display method according to claim 2, wherein The target pixel allocation mode is obtained by adjusting the initial pixel allocation mode based on a difference between the pixel distance corresponding to the target image parallax and the pixel distance corresponding to the initial image parallax, including: determining horizontal pixel change information based on the difference between the pixel distance corresponding to the target image parallax and the pixel distance corresponding to the initial image parallax; performing a translation adjustment on the initial pixel allocation mode based on the horizontal pixel change information to obtain the target pixel allocation mode.

9. The image display method according to claim 1, wherein The target distance between the left-eye virtual image and the right-eye virtual image is determined based on the interpupillary distance of the target object, a preset virtual image distance, and a preset object distance to obtain a target image parallax, including: determining a target ratio from a ratio of the preset object distance to the interpupillary distance of the target object; determining a virtual image object distance between the left-eye virtual image or the right-eye virtual image and the three-dimensional object based on a difference between the preset object distance and the preset virtual image distance; determining the target image parallax based on the target ratio and the virtual image object distance; a ratio of the virtual image object distance to the target image parallax is equal to the target ratio.

10. The image display method according to claim 1, wherein The head-up display device is in communication connection with the eye recognition device; the interpupillary distance of the target object is obtained by: obtaining eye position information of the target object sent by the eye recognition device; determining a distance between the two eyes of the target object in the horizontal direction based on the eye position information to obtain the interpupillary distance of the target object.

11. The image display method according to claim 10, wherein The eye position information of the target object sent by the eye recognition device is obtained by: in response to a parallax adjustment instruction of a current period, obtaining the eye position information of the target object sent by the eye recognition device.

12. An image display device applied to a head-up display device, the head-up display device comprising a display screen and a light splitting element, light emitted by the display screen is split by the light splitting element to form a left-eye virtual image and a right-eye virtual image; the device comprises: an interpupillary distance acquisition module configured to obtain an interpupillary distance of a target object; a parallax determination module configured to determine a target distance between the left-eye virtual image and the right-eye virtual image based on the interpupillary distance of the target object, a preset virtual image distance, and a preset object distance to obtain a target image parallax; the preset virtual image distance is a distance between the left-eye virtual image or the right-eye virtual image and the target object; the preset object distance is an ideal distance between a three-dimensional object observed by the target object through the left-eye virtual image and the right-eye virtual image and the target object. a pixel distribution module, configured to adjust an initial pixel distribution manner of the display screen based on a difference between the target image parallax and an initial image parallax, to obtain a target pixel distribution manner; the initial pixel distribution manner is used to make a distance between the left-eye virtual image and the right-eye virtual image equal to the initial image parallax; an image display module, configured to display a to-be-displayed image based on the target pixel distribution manner, to form a left-eye virtual image and a right-eye virtual image corresponding to the to-be-displayed image, so that a distance between a three-dimensional object observed by the target object through the left-eye virtual image and the right-eye virtual image corresponding to the to-be-displayed image and the target object is equal to the preset object distance.

13. An electronic device, comprising a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded and executed by the processor to implement the image display method in any one of claims 1-11.

14. A computer readable storage medium, wherein the storage medium stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded and executed by a processor to implement the image display method in any one of claims 1-11.

15. A computer program, which, when executed by a processor, implements the image display method in any one of claims 1-11.

Images