Image display method and device, electronic equipment and storage medium

Abstract

The invention discloses an image display method and device, electronic equipment and a storage medium, the image display method can be applied to head-up display equipment, and the head-up display equipment comprises a display screen and a light splitting element; the method comprises the following steps: acquiring the interpupillary distance of a target object; determining a target image parallax between the left-eye virtual image and the right-eye virtual image based on the pupil distance of the target object, a preset virtual image distance and a preset object distance; the preset object distance is an ideal distance between a three-dimensional object observed by the target object through the left eye virtual image and the right eye virtual image and the target object; adjusting an initial pixel distribution mode of the display screen based on the difference between the target image parallax and the initial image parallax to obtain a target pixel distribution mode; the initial pixel distribution mode is used for enabling the distance between the formed left-eye virtual image and the formed right-eye virtual image to be equal to the initial image parallax; and displaying the to-be-displayed image based on the target pixel distribution mode. According to the invention, the comfort of users with different interpupillary distances for watching the three-dimensional effect image is ensured.

Description

Technical Field

[0001] The present application relates to the field of head-up display technology, and in particular to an image display method, device, electronic device and storage medium. Background Art

[0002] HUD (Head-Up Display) originated in the aviation field, and is designed to provide pilots with a way to view key flight information without lowering their heads, thereby improving flight safety and mission efficiency. With the development of technology, HUD has gradually been introduced into multiple fields such as automobiles, virtual reality (VR), and augmented reality (AR), becoming an important part of improving user experience.

[0003] When users with different pupil distances use the HUD system, due to the different biological characteristics of each person, especially the significant difference in pupil distance (i.e., the horizontal distance between the centers of the pupils of the two eyes), their perception and comfort of the same 3D (3-dimension) image are directly affected. When designing the HUD system, a fixed parallax image pair P1 and P2 is usually set to form a stereoscopic visual effect with a sense of depth on the user's retina. However, this fixed parallax setting has very different actual experiences for observers with different pupil distances. Specifically, when users with a wider pupil distance watch the parallax images P1 and P2 designed for a narrower pupil distance, the 3D images they perceive may appear too close to them, and vice versa, they may feel that the images are too far away. This mismatch causes conflicts when the human eye tries to focus (accommodate) and converge (converge). Under normal circumstances, when observing close objects, the human eye will naturally adjust the focus and converge the eyeballs inward at the same time; when observing distant objects, these adjustments are relaxed. However, if the 3D image presented by the HUD does not match the user's actual pupil distance, the human eye may not be able to complete this series of coordinated actions naturally and effectively, which is the so-called convergence-accommodation conflict.

[0004] If users are in this state of visual disharmony for a long time, their discomfort will be significantly enhanced, manifested as eye fatigue, headache, and even severe dizziness. This phenomenon not only affects the quality of the user's immersive experience, but may also have a long-term adverse effect on the user's vision health. Summary of the invention

[0005] In order to solve the problems of the prior art, the embodiments of the present application provide an image display method, device, electronic device and storage medium. The technical solution is as follows:

[0006] On the one hand, an image display method is provided, which is applied to a head-up display device, wherein the head-up display device includes a display screen and a light splitting element, and light emitted from the display screen is split by the light splitting element to form a left-eye virtual image and a right-eye virtual image; the method includes:

[0007] Get the pupil distance of the target object;

[0008] Based on the pupil distance of the target object, the preset virtual image distance and the preset object distance, a target distance between the left eye virtual image and the right eye virtual image is determined to obtain a target image parallax; the preset virtual image distance is the distance between the left eye virtual image or the right eye virtual image and the target object; the preset object distance is the ideal distance between the three-dimensional object observed by the target object through the left eye virtual image and the right eye virtual image and the target object;

[0009] Adjusting the initial pixel allocation mode of the display screen based on the difference between the target image parallax and the initial image parallax to obtain a target pixel allocation mode; the initial pixel allocation mode is used to make the distance between the formed left-eye virtual image and the formed right-eye virtual image equal to the initial image parallax;

[0010] The image to be displayed is displayed based on the target pixel allocation method to form a left eye virtual image and a right eye virtual image corresponding to the image to be displayed, so that the distance between the three-dimensional object observed by the target object through the left eye virtual image and the right eye virtual image corresponding to the image to be displayed and the target object is equal to the preset object distance.

[0011] On the other hand, an image display device is provided, which is applied to a head-up display device, wherein the head-up display device comprises a display screen and a light splitting element, wherein light emitted from the display screen is split by the light splitting element to form a left eye virtual image and a right eye virtual image; the device comprises:

[0012] A pupil distance acquisition module, used to acquire the pupil distance of a target object;

[0013] a parallax determination module, configured to determine a target distance between the left-eye virtual image and the right-eye virtual image based on the pupil distance of the target object, a preset virtual image distance, and a preset object distance, to obtain a target image parallax; the preset virtual image distance is the distance between the left-eye virtual image or the right-eye virtual image and the target object; the preset object distance is an ideal distance between the three-dimensional object observed by the target object through the left-eye virtual image and the right-eye virtual image and the target object;

[0014] A pixel allocation module, configured to adjust an initial pixel allocation mode of the display screen based on a difference between the target image parallax and the initial image parallax, to obtain a target pixel allocation mode; the initial pixel allocation mode is configured to make the distance between the formed left-eye virtual image and the formed right-eye virtual image equal to the initial image parallax;

[0015] An image display module is used to display the image to be displayed based on the target pixel allocation method to form a left eye virtual image and a right eye virtual image corresponding to the image to be displayed, so that the distance between the three-dimensional object observed by the target object through the left eye virtual image and the right eye virtual image corresponding to the image to be displayed and the target object is equal to the preset object distance.

[0016] In an exemplary embodiment, the pixel allocation module includes:

[0017] A physical size module, used to determine the physical size of the left-eye virtual image or the right-eye virtual image to obtain the virtual image size;

[0018] A pixel size module, used to determine a pixel size corresponding to the virtual image size based on the virtual image size and visible pixels within a unit field of view;

[0019] A pixel distance module, used for determining the pixel distance corresponding to the parallax of the target image based on the virtual image size and the pixel size corresponding to the virtual image size;

[0020] The pixel adjustment module is used to adjust the initial pixel allocation mode based on the difference between the pixel distance corresponding to the target image parallax and the pixel distance corresponding to the initial image parallax to obtain the target pixel allocation mode.

[0021] In an exemplary embodiment, the physical size module includes:

[0022] A viewing angle acquisition module, used to acquire the viewing angle of the head-up display device;

[0023] The first virtual image size module is used to determine the physical size of the left eye virtual image or the right eye virtual image based on the field of view angle and the preset virtual image distance to obtain the virtual image size.

[0024] In an exemplary embodiment, the apparatus further includes a pixel division module for determining visible pixels within a unit field of view angle, the pixel division module including:

[0025] A resolution acquisition module, used to acquire the resolution of the display screen;

[0026] The first ratio determination module is used to determine the ratio of the resolution to the field of view angle to obtain visible pixels within the unit field of view angle.

[0027] In an exemplary embodiment, the first virtual image size module comprises:

[0028] The second virtual image size module is used to determine the physical size of the left eye virtual image or the right eye virtual image in the horizontal direction based on the preset virtual image distance and the horizontal field angle in the field angle to obtain the virtual image size.

[0029] In an exemplary embodiment, the first ratio determination module includes:

[0030] A horizontal resolution module, configured to determine a horizontal resolution of the display screen based on the resolution;

[0031] The second ratio determination module is used to determine the ratio of the horizontal resolution to the horizontal field of view angle to obtain visible pixels within the unit field of view angle.

[0032] In an exemplary embodiment, the resolution acquisition module includes:

[0033] An area determination module, configured to determine an imaging area of ​​the display screen based on available pixels in the display screen;

[0034] The resolution determination module is used to determine the resolution of the imaging area.

[0035] In an exemplary embodiment, the pixel adjustment module includes:

[0036] A pixel information module, configured to determine horizontal pixel change information based on a difference between a pixel distance corresponding to the target image parallax and a pixel distance corresponding to the initial image parallax;

[0037] The pixel translation module is used to perform translation adjustment on the initial pixel allocation method based on the horizontal pixel change information to obtain the target pixel allocation method.

[0038] In an exemplary embodiment, the disparity determination module includes:

[0039] A ratio determination module, used to determine the ratio of the preset object distance to the pupil distance of the target object to obtain a target ratio;

[0040] a distance determination module, configured to determine the distance between the left-eye virtual image or the right-eye virtual image and the three-dimensional object based on the difference between the preset object distance and the preset virtual image distance, so as to obtain a virtual image object distance;

[0041] The target disparity module is used to determine the target image disparity based on the target ratio and the virtual image object distance; the ratio of the virtual image object distance to the target image disparity is equal to the target ratio.

[0042] In an exemplary embodiment, the head-up display device is communicatively connected to an eye recognition device; the pupil distance acquisition module includes:

[0043] An eye position module, used for acquiring the eye position information of the target object sent by the eye recognition device;

[0044] The horizontal distance module is used to determine the distance between the eyes of the target object in the horizontal direction based on the eye position information to obtain the pupil distance of the target object.

[0045] In an exemplary embodiment, the eye position module includes:

[0046] The periodic response module is used to obtain the eye position information of the target object sent by the eye recognition device in response to the parallax adjustment instruction of the current period.

[0047] On the other hand, an electronic device is provided, including a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded and executed by the processor to implement the image display method of any of the above aspects.

[0048] On the other hand, a computer-readable storage medium is provided, in which at least one instruction or at least one program is stored, and the at least one instruction or the at least one program is loaded and executed by a processor to implement an image display method as described in any of the above aspects.

[0049] On the other hand, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the electronic device performs the image display method of any of the above aspects.

[0050] The embodiment of the present application obtains the pupil distance of the target object, determines the target image parallax that matches the pupil distance of the target object, adjusts the initial pixel allocation mode of the display screen according to the target image parallax to obtain the target pixel allocation mode, and displays the image to be displayed based on the target pixel allocation mode, so that the distance between the three-dimensional object observed by the target object through the left eye virtual image and the right eye virtual image during imaging is always the ideal distance. The maintenance of the ideal distance makes the distance and nearness of the three-dimensional object more distinct, ensuring the depth perception accuracy of users with different pupil distances when viewing the three-dimensional effect image; ensuring that the virtual images received by the left eye and the right eye of users with different pupil distances can be perfectly integrated, reducing eye fatigue, headache and dizziness caused by visual adjustment conflicts, maintaining a high degree of comfort even for long-term use, avoiding visual dislocation and discomfort caused by traditional fixed parallax display, helping to improve the universality and ease of use of head-up display equipment, so that more people can enjoy high-quality stereoscopic visual experience. In automotive HUD applications, it ensures that the 3D display of information such as navigation instructions and road warnings is highly consistent with the actual road conditions, and the driver can quickly and accurately understand and respond, reducing the safety hazards caused by visual errors and improving the overall driving safety factor. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0052] Figure 1 is a schematic diagram of an application environment of a head-up display device provided in an embodiment of the present application;

[0053] Figure 2 is a schematic diagram of the principle of a head-up display device provided in an embodiment of the present application;

[0054] Figure 3 is a schematic diagram of the correspondence between an eye box and a virtual image provided by an embodiment of the present application;

[0055] Figure 4 It is a schematic diagram of the principle of naked-eye 3D provided by an embodiment of the present application;

[0056] Figure 5 This is a first three-dimensional imaging schematic diagram provided in an embodiment of the present application;

[0057] Figure 6 This is a second three-dimensional imaging schematic diagram provided in an embodiment of the present application;

[0058] Figure 7This is a third three-dimensional imaging schematic diagram provided in an embodiment of the present application;

[0059] Figure 8 It is a schematic diagram of an implementation environment of an image display method provided in an embodiment of the present application;

[0060] Fig. 9 is a schematic diagram of a HUD display range provided in an embodiment of the present application;

[0061] Fig.10 It is a flowchart of an image display method provided in an embodiment of the present application;

[0062] Fig.11 This is a fourth three-dimensional imaging schematic diagram provided in an embodiment of the present application;

[0063] Fig.12 is a schematic diagram of a HUD projection range provided in an embodiment of the present application;

[0064] Fig.13 is a schematic diagram of a field of view provided in an embodiment of the present application;

[0065] Fig.14 is a schematic diagram of a virtual image distance provided in an embodiment of the present application;

[0066] Fig.15 This is a bottom-view schematic diagram provided in an embodiment of the present application;

[0067] Fig.16 It is a structural schematic diagram of a display screen provided in an embodiment of the present application;

[0068] Fig.17 is a structural block diagram of an image display device provided in an embodiment of the present application;

[0069] Fig.18 It is a hardware structure block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0070] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0071] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0072] It is understandable that in the specific implementation of this application, related data such as user information is involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0073] See also Figure 1 , which shows a schematic diagram of the application environment of a head-up display device provided by an embodiment of the present application. The head-up display device can be used in automobiles as a driving assistance instrument, and can also be applied to other vehicles, such as airplanes, high-speed railways, etc. The following will take the vehicle-mounted HUD as an example to introduce the technical solution of the present application. Through the image display method of the embodiment of the present application, the HUD can clearly and accurately project the vehicle speed, navigation information, warning information, etc. in the form of images and characters through optical components in front of the driver, forming a virtual image with a three-dimensional effect in front of the driver's line of sight, and has a good imaging effect.

[0074] See also Figure 2 , which is a schematic diagram of the principle of a head-up display device provided by an embodiment of the present application. 3DHUD includes an image generation unit, a cylindrical lens grating (or a slit grating) attached to the image generation unit, and a reflector assembly. The image generation unit is composed of an LCD (Liquid Crystal Display) and a backlight. The reflector assembly may include multiple reflectors, such as Figure 2 As shown, the figure includes a reflector 1 and a reflector 2, wherein the reflector 1 may be a plane mirror or a free-surface curved mirror, and the reflector 2 may be a free-surface curved mirror. When implementing 3D HUD, the outgoing light of the image generation unit is limited by the cylindrical grating (or slit grating), and the outgoing angles are different to achieve light splitting; the light emitted by the cylindrical grating (or slit grating) is refracted by the reflector assembly and the windshield of the vehicle in turn, and then enters the left eye and the right eye of the user respectively, and the images seen by the left eye and the right eye of the user are different.

[0075] See also Figure 3 , which shows a schematic diagram of the correspondence between an eyebox and a virtual image provided by an embodiment of the present application. It shows the process of human eyes observing a virtual image through a windshield, and the windshield is marked as "Windshield". The eyeboxes "uppereyebox", "center eyebox" and "lower eyebox" correspond to the virtual images "lower eyebox virtualimage", "center eyebox vitual image" and "upper eyebox virtual image" respectively.

[0076] See also Figure 4 , which is a schematic diagram of the principle of naked-eye 3D provided by an embodiment of the present application. By optically designing the HUD, the user's left eye sees image P1 and the right eye sees image P2. Image P1 and image P2 can be combined into a stereoscopic picture with a sense of depth in the user's brain; by changing the position between the two images and adjusting the binocular parallax, the virtual image distance subjectively felt by the user can change (in fact, the virtual image distance remains unchanged). The closer the two images are, the closer the virtual image distance subjectively felt by the user; conversely, the farther the two images are, the farther the virtual image distance subjectively felt by the user.

[0077] See also Figure 5 , which shows the first three-dimensional imaging schematic diagram provided by the embodiment of the present application. By splitting the light of adjacent pixels in the display screen through a splitting element, the images seen by the left and right eyes of the user through the imaging structure (such as a windshield) on the same virtual image plane are different. For example, when the user is looking at the same sphere, two images are given to the user. The sphere seen by the left eye L is biased to the left, such as P1, and the sphere seen by the right eye R is biased to the right, such as P2. Due to the binocular parallax formed by P1 and P2, the object seen by the user has a sense of depth and space. When the left and right eyes are converged and adjusted to focus on the P3 position, the brain will try to combine the images of these spheres together to form a continuous, three-dimensional sphere P3. Therefore, to experience this three-dimensional visual experience, it is necessary to ensure that the line of sight falls accurately on the P3 position, that is, the intersection of the line connecting L and P1 and the line connecting R and P2, so that the brain can be used to process these visual inputs and convert them into a coherent overall view.

[0078] See also Figure 6, which shows a second three-dimensional imaging schematic diagram provided by an embodiment of the present application. On the same image plane, by adjusting the viewing angle of both eyes, the user's subjective distance perception can be changed. For example, in the case shown in the figure, if the convergence angle of the object seen by the two eyes is reduced to θf, the user will feel that the object is located farther away, that is, at the P3 position; this is because a smaller convergence angle means that the sight lines of both eyes are more parallel, thereby simulating the visual effect of distant objects. On the contrary, if the sphere seen by the left eye is slightly biased to the right, and the sphere seen by the right eye is slightly biased to the left, a larger convergence angle θn is formed, and the user will feel that the object is closer to him, that is, at the P4 position; this is because when observing objects at close range, the sight lines of both eyes need a larger convergence angle to aim at the same target. Under normal circumstances, if there is no parallax, the object should be displayed at the P5 position, and the convergence angle of both eyes is θ0; the visual experience in this case is usually comfortable because our eyes do not need to adjust excessively to adapt to this scene. When θf is less than θ0, it means that the object seen by the user is farther away from the user relative to the virtual image; and when θn is greater than θ0, it means that the object seen by the user is closer to the user relative to the virtual image. However, if the value of |θn-θ0| or |θ0-θf| is too large, it means that the convergence accommodation mechanism of the human eye may not be able to effectively cope with this change, causing the user to experience eye discomfort or even dizziness.

[0079] See also Figure 7 , which shows a third three-dimensional imaging schematic diagram provided in an embodiment of the present application. For a certain HUD system, its parallax images P1 and P2 are also certain, and users with different pupil distances will perceive different depths and distances. For users with narrow pupil distances, the images of P1 and P2 will be successfully fused at a relatively distant position P5 to form a three-dimensional image. For user B with a wide pupil distance, he needs to fuse the images of P1 and P2 at a relatively close position P6 to obtain the same three-dimensional effect. If the distance between P5 and P3 is too large, or the distance between P6 and P3 is too large, this means that the convergence adjustment mechanism of the human eye may not be able to effectively cope with this change, causing the user to experience symptoms of eye discomfort or even dizziness.

[0080] In view of this, the present application provides an image display method, which is applied to a head-up display device, wherein the head-up display device includes a display screen and a beam splitter, and the light emitted by the display screen is split by the beam splitter to form a left eye virtual image and a right eye virtual image. Figure 8, which shows a schematic diagram of the implementation environment of an image display method provided by an embodiment of the present application. A DMS (Driver Monitoring System) is installed between the driver and the windshield. The DMS is used to identify the driver's pupil distance. The DMS is connected to the head-up display device for communication and sends the pupil distance data to the head-up display device. The installation position of the DMS is not specifically limited in this application. It is required that the DMS can be rigidly fixed between the human eye and the front windshield without blocking the human eye's line of sight and will not be blocked by the steering wheel or the body posture during driving. Please continue to refer to Fig. 9 , which is a schematic diagram of a HUD display range provided in an embodiment of the present application. The HUD display range includes an AR area and a non-AR area. The AR area elements may include navigation, vehicles / obstacles, warnings, pedestrians, lanes, etc., and the non-AR area (indicator area) elements may include navigation heading, speed limit and vehicle speed, and other prompt information.

[0081] See also Fig.10 , which shows a flow chart of an image display method provided by an embodiment of the present application. It should be noted that this specification provides method operation steps such as the embodiments or flow charts, but may include more or fewer operation steps based on conventional or non-creative labor. The order of steps listed in the embodiments is only one way of executing the steps among many orders, and does not represent the only order of execution. When the actual system or product is executed, it can be executed in the order of the methods shown in the embodiments or the drawings or in parallel (for example, in a parallel processor or multi-threaded processing environment). Specifically, Fig.10 As shown, the method may include:

[0082] S1001, obtaining the pupil distance of the target object.

[0083] The target object is the user who is currently using the head-up display device.

[0084] The pupil distance is the distance between the pupils of the target object.

[0085] In an exemplary embodiment, the head-up display device is communicatively connected to the eye recognition device; the above step S1001 may include the following steps:

[0086] Obtaining eye position information of the target object sent by the eye recognition device;

[0087] The distance between the eyes of the target object in the horizontal direction is determined based on the eye position information to obtain the pupil distance of the target object.

[0088] In a specific implementation, the eye recognition device can be set as a DMS. Specifically, the DMS is installed between the driver and the windshield, and the DMS is used to identify the eye position of the target object. The DMS is connected to the head-up display device for communication, and the eye position information of the target object is sent to the head-up display device. The installation position of the DMS is not specifically limited in this application, and it is required to meet the requirement that the DMS can be rigidly fixed between the human eye and the front windshield, does not block the human eye's line of sight, and will not be blocked by the steering wheel or the body posture during driving.

[0089] Specifically, if the head of the target object is offset, for example, the head is slightly tilted or tilted, the pupil distance of the target object is equivalent to being narrowed in the horizontal direction, and the pupil distance of the target object is regarded as changed, that is, the pupil distance of the target object is based on the data in the horizontal direction.

[0090] It can be seen from the above technical solutions of the embodiment of the present application that the embodiment of the present application calculates the horizontal distance between the two eyes of the target object as the pupil distance of the target object. If the head of the target object is offset, it is regarded as a change in the pupil distance of the target object. The target image parallax is determined according to subsequent steps, and then the pixel allocation method is adjusted, so that the target object can always ensure the accuracy of depth perception and maintain a high degree of comfort during the use of the head-up display device, thereby enhancing the user's sense of immersion.

[0091] In an exemplary embodiment, the step of obtaining the eye position information of the target object sent by the eye recognition device may include the following steps:

[0092] In response to the parallax adjustment instruction of the current cycle, the eye position information of the target object sent by the eye recognition device is obtained.

[0093] The current cycle is a cycle for detecting the eye position of the target object. Specifically, during the operation of the head-up display device, the eye recognition device detects the eye position of the target object periodically and sends it to the head-up display device.

[0094] Specifically, the head-up display device determines the target image parallax based on the eye position information sent by the eye recognition device in the current cycle, and then adjusts the pixel allocation method of the display screen so that the distance between the three-dimensional object observed by the target through the left eye virtual image and the right eye virtual image in the current cycle and the target object is equal to the preset object distance.

[0095] It can be seen from the above technical solutions of the embodiment of the present application that the embodiment of the present application obtains the eye position information of the target object in a periodic manner, thereby determining the pupil distance of the target object, determines the target image parallax according to subsequent steps, and then adjusts the pixel allocation method, so that the target object can always ensure depth perception accuracy and maintain a high level of comfort during the use of the head-up display device, thereby enhancing the user's sense of immersion.

[0096] S1003, determining a target distance between a left-eye virtual image and a right-eye virtual image based on the pupil distance of the target object, a preset virtual image distance, and a preset object distance, and obtaining a target image parallax.

[0097] The preset virtual image distance is the distance between the left eye virtual image or the right eye virtual image and the target object. Specifically, the preset virtual image distance refers to the distance between the position of the left eye virtual image or the right eye virtual image perceived by the user's eyes and the user's eyes under ideal conditions. This distance is preset to optimize the user's visual experience and comfort. Please refer to Fig.11 , which shows a fourth three-dimensional imaging schematic diagram provided in an embodiment of the present application, and the preset virtual image distance is expressed as VID (Virtual Image Distance) in the figure.

[0098] The preset object distance is the ideal distance between the three-dimensional object and the target object observed by the target object through the left eye virtual image and the right eye virtual image. Specifically, the preset object distance is the straight-line distance between the center point of the user's eyes and the three-dimensional object virtual image perceived by the user. This distance is pre-set to optimize the user's visual experience and comfort. Fig.11 As shown, the preset object distance is represented as VVID in the figure.

[0099] Among them, the left eye virtual image refers to the part of the light emitted by the display screen that reaches the user's left eye after being processed by the spectroscopic element. It is a virtual image formed in the visual center of the brain after being focused by the optical system of the eye.

[0100] Among them, the right eye virtual image refers to the part of the light emitted by the display screen that reaches the user's right eye after being processed by the spectroscopic element. It is a virtual image formed in the visual center of the brain after being focused by the optical system of the eye.

[0101] The target distance refers to the position difference between the same scene feature point on the left eye virtual image and the right eye virtual image. Specifically, the position difference is manifested as a horizontal distance difference.

[0102] The target image parallax is used to make the distance between the target object and the perceived three-dimensional object an ideal distance, that is, a preset object distance. Fig.11 As shown, the target image disparity is represented by d in the figure.

[0103] In a specific implementation, d may be calculated according to a geometric relationship among the pupil distance D, the target image parallax d, the preset object distance VVID, and the preset virtual image distance VID.

[0104] In an exemplary implementation, the above step S1003 may include the following steps:

[0105] Determine the ratio of the preset object distance to the pupil distance of the target object to obtain a target ratio;

[0106] Based on the difference between the preset object distance and the preset virtual image distance, determine the distance between the left eye virtual image or the right eye virtual image and the three-dimensional object to obtain the virtual image object distance;

[0107] The target image disparity is determined based on the target scale and the virtual image object distance; the ratio of the virtual image object distance to the target image disparity is equal to the target scale.

[0108] The preset object distance is the ideal distance between the three-dimensional object and the target object observed by the target object through the left eye virtual image and the right eye virtual image. Specifically, the preset object distance is the straight-line distance between the center point of the user's eyes and the virtual image of the three-dimensional object perceived by the user. This distance is pre-set to optimize the user's visual experience and comfort.

[0109] The pupil distance of the target object is the distance between the pupils of both eyes of a user who is currently using the head-up display device.

[0110] The preset virtual image distance is the distance between the left eye virtual image or the right eye virtual image and the target object. Specifically, the preset virtual image distance refers to the distance between the position of the left eye virtual image or the right eye virtual image perceived by the user's eyes and the user's eyes under ideal conditions. This distance is pre-set to optimize the user's visual experience and comfort.

[0111] The virtual image object distance is the distance between the left eye virtual image or the right eye virtual image and the corresponding three-dimensional object.

[0112] Among them, the target image parallax refers to the position difference of the same scene feature point in the left eye virtual image and the right eye virtual image, which is expressed as a lateral distance difference and is used to make the distance between the target object and its perceived three-dimensional object equal to the preset object distance.

[0113] Specifically, Fig.11 As shown, the left eye virtual image P1, the right eye virtual image P2 and the three-dimensional object P3 form a first triangle, the left eye L, the right eye R and the three-dimensional object P3 form a second triangle, the first triangle and the second triangle are similar triangles, and using the characteristics of similar triangles, it can be obtained that the ratio of the preset object distance VVID to the pupil distance D of the target object is equal to the ratio of (preset object distance VVID-preset virtual image distance VID) to the target image disparity d, based on which the target image disparity d is obtained. Specifically, see formula (1):

[0114]

[0115] It can be seen from the above technical solutions of the embodiments of the present application that the embodiments of the present application utilize the characteristics of similar triangles to calculate the target image parallax based on the pupil distance of the target object, the preset virtual image distance and the preset object distance, which is used to adjust the pixel allocation method, thereby ensuring the depth perception accuracy and comfort of users with different pupil distances viewing three-dimensional effect images, and helping to improve the universality and ease of use of head-up display devices.

[0116] S1005, adjusting the initial pixel allocation mode of the display screen based on the difference between the target image parallax and the initial image parallax to obtain a target pixel allocation mode.

[0117] The initial pixel allocation method is used to make the distance between the formed left-eye virtual image and the formed right-eye virtual image equal to the initial image disparity.

[0118] The initial image parallax is designed based on the standard pupil distance, so that the distance between a user with the standard pupil distance and the three-dimensional object perceived by the user is the preset object distance. Specifically, the standard pupil distance here is a pupil distance reference value used in designing the HUD system.

[0119] The target pixel allocation method is used to make the distance between the formed left-eye virtual image and the formed right-eye virtual image equal to the target image parallax.

[0120] In an exemplary implementation, the above step S1005 may include the following steps:

[0121] Determine the physical size of the left eye virtual image or the right eye virtual image to obtain the virtual image size;

[0122] Determine the pixel size corresponding to the virtual image size based on the virtual image size and the visible pixels within the unit field of view;

[0123] Determine the pixel distance corresponding to the parallax of the target image based on the virtual image size and the pixel size corresponding to the virtual image size;

[0124] Based on the difference between the pixel distance corresponding to the target image parallax and the pixel distance corresponding to the initial image parallax, the initial pixel allocation method is adjusted to obtain the target pixel allocation method.

[0125] The virtual image size is the physical size of the left eye virtual image or the right eye virtual image in space. In a specific implementation, the virtual image size is usually expressed in length units, such as millimeters.

[0126] The visible pixels within a unit field of view angle are the number of pixels that can be seen within each degree of field of view angle.

[0127] The pixel size corresponding to the virtual image size indicates how many pixels the left-eye virtual image or the right-eye virtual image is composed of in a digital format, with pixels as the unit.

[0128] The pixel distance corresponding to the target image parallax indicates how many pixels are separated in digital format between the same scene feature points in the left eye virtual image and the right eye virtual image, so as to make the distance between the target object and the perceived three-dimensional object equal to the preset object distance.

[0129] The pixel distance corresponding to the initial image parallax indicates how many pixels are separated in digital format from the same scene feature points in the left-eye virtual image and the right-eye virtual image, so as to make the distance between a user with a standard pupil distance and the three-dimensional object they perceive equal to the preset object distance.

[0130] The initial pixel allocation method is used to make the distance between the formed left-eye virtual image and the formed right-eye virtual image equal to the initial image disparity.

[0131] The target pixel allocation method is used to make the distance between the formed left-eye virtual image and the formed right-eye virtual image equal to the target image parallax.

[0132] Specifically, determine how many units of field of view angle the left eye virtual image or the right eye virtual image occupies, and obtain the pixel size corresponding to the virtual image size based on the visible pixels within the unit field of view. Based on the ratio of the virtual image size to the corresponding pixel size, obtain the conversion relationship between the length unit and the pixel unit. Based on this conversion relationship, convert the target image disparity in length units into pixel units to obtain the pixel distance corresponding to the target image disparity.

[0133] It can be seen from the above technical solutions of the embodiments of the present application that the embodiments of the present application convert the target image parallax in length units into pixel units through the proportional relationship between the physical size of the left-eye virtual image or the right-eye virtual image and its corresponding pixel size, and obtain the pixel distance corresponding to the target image parallax, so as to adjust the pixel allocation method in pixel units.

[0134] In an exemplary embodiment, the step of determining the physical size of the left eye virtual image or the right eye virtual image may include the following steps:

[0135] Get the field of view angle of the head-up display device;

[0136] Based on the field of view angle and the preset virtual image distance, the physical size of the left eye virtual image or the right eye virtual image is determined to obtain the virtual image size.

[0137] For details, please refer to Figures 12 to 15, which respectively show a schematic diagram of a HUD projection range provided in an embodiment of the present application, a schematic diagram of a field of view angle, a schematic diagram of a virtual image distance, and a schematic diagram of a downward viewing angle. The field of view angle is used to describe the spatial angle range that a user can see through a head-up display device, usually expressed in terms of a horizontal field of view angle (Horizontal Field of View, HFOV) and a vertical field of view angle (Vertical Field of View, VFOV). Sometimes the diagonal field of view angle (Diagonal Field of View, DFOV) is used to describe the angle range of the entire imaging area. The virtual image distance (Virtual Image Distance, VID) is the distance from the user's eye point (Eye Point) to the virtual image, and the downward viewing angle (Look Down Angle, LDA) is the angle between the line connecting the user's eye point and the center point of the virtual image and the horizontal plane.

[0138] Specifically, Fig.12 The relationship between the field of view angle, virtual image distance and virtual image size is demonstrated. By using this relationship, the virtual image size is determined based on the field of view angle and the preset virtual image distance.

[0139] It can be seen from the above technical solutions of the embodiments of the present application that the embodiments of the present application calculate the virtual image size through the relationship between the field of view angle, the preset virtual image distance and the virtual image size, so as to convert the target image parallax in length units into pixel units.

[0140] In an exemplary embodiment, the step of determining the physical size of the left eye virtual image or the right eye virtual image based on the field of view angle and the preset virtual image distance to obtain the virtual image size may include the following steps:

[0141] Based on the preset virtual image distance and the horizontal field angle in the field angle, the physical size of the left eye virtual image or the right eye virtual image in the horizontal direction is determined to obtain the virtual image size.

[0142] Specifically, the physical size of the virtual image in the horizontal direction can be calculated by formula (2):

[0143]

[0144] Among them, VID is the preset virtual image distance, and HFOV is the horizontal field of view angle.

[0145] In a specific implementation, the physical size of the virtual image in the vertical direction can be calculated based on the same principle.

[0146] It can be seen from the above technical solutions of the embodiments of the present application that the embodiments of the present application calculate the physical size of the virtual image in the horizontal direction through the relationship between the horizontal field of view angle, the preset virtual image distance and the virtual image size, so as to convert the target image parallax in length units into pixel units.

[0147] In an exemplary embodiment, the method for determining the visible pixels within the above-mentioned unit field of view angle may include the following steps:

[0148] Get the resolution of the display;

[0149] Determine the ratio of resolution to field of view to obtain the visible pixels per unit field of view.

[0150] The resolution of a display refers to the number of horizontal and vertical pixels on the display. For example, a 1920×1080 display means it has 1920 horizontal pixels and 1080 vertical pixels.

[0151] The visible pixels within a unit field of view angle are the number of pixels that can be seen within each degree of field of view angle.

[0152] It can be seen from the above technical solutions of the embodiments of the present application that the embodiments of the present application calculate the visible pixels within a unit field of view angle through the resolution and field of view angle of the display screen, so as to convert the virtual image size in length units into pixel units.

[0153] In an exemplary embodiment, the step of determining the ratio of the resolution to the field of view angle to obtain visible pixels within a unit field of view angle may include the following steps:

[0154] Determining a horizontal resolution of the display based on the resolution;

[0155] Determine the ratio of horizontal resolution to horizontal field of view to obtain the visible pixels per unit field of view.

[0156] Specifically, the visible pixels within the unit field of view here are reflected as data of the visible pixels within the unit field of view in the horizontal direction.

[0157] Specifically, the number of visible pixels within a unit field of view can be approximately calculated as the ratio of the horizontal resolution to the horizontal field of view. In specific implementations, this value may need to be further adjusted due to factors such as the resolution of the human eye and the sensitivity of the central area of ​​vision.

[0158] In a specific implementation, the data of visible pixels in the vertical direction within a unit field of view angle may be calculated based on the same principle.

[0159] It can be seen from the above technical solutions of the embodiment of the present application that the embodiment of the present application calculates the visible pixels within a unit field of view angle through the horizontal resolution and horizontal field of view angle of the display screen, so as to convert the virtual image size in length units into pixel units.

[0160] In an exemplary embodiment, the step of obtaining the resolution of the display screen may include the following steps:

[0161] Determining an imaging area of ​​the display screen based on available pixels in the display screen;

[0162] Determines the resolution of the imaged area.

[0163] The imaging area of ​​the display screen refers to the area actually used for imaging in the display screen.

[0164] For example, see Fig.16 , which is a schematic diagram of the structure of a display screen provided in an embodiment of the present application. If a 4.1-inch LCD screen is used, the working area of ​​the display screen is 92.544mm×46.272mm, the area actually used for imaging of the display screen is 87.89mm×36.46mm, and the resolution of the display screen is 1280×640pixels; all pixels in the area actually used for imaging of the display screen (the actual display area range of the image) are lit, and the horizontal resolution (the resolution of the actual display area) is 1200pixel.

[0165] It can be seen from the above technical solutions of the embodiments of the present application that the embodiments of the present application improve the calculation accuracy by determining the resolution of the imaging area in the display screen to calculate the visible pixels within the unit field of view angle, thereby improving the accuracy of the subsequent adjustment of the pixel allocation method.

[0166] In an exemplary embodiment, the step of adjusting the initial pixel allocation mode based on the difference between the pixel distance corresponding to the target image parallax and the pixel distance corresponding to the initial image parallax to obtain the target pixel allocation mode may include the following steps:

[0167] Determining horizontal pixel change information based on a difference between a pixel distance corresponding to the target image disparity and a pixel distance corresponding to the initial image disparity;

[0168] The initial pixel allocation mode is adjusted by translation based on the horizontal pixel change information to obtain the target pixel allocation mode.

[0169] The pixel distance corresponding to the target image parallax indicates how many pixels are separated in digital format between the same scene feature points in the left eye virtual image and the right eye virtual image, so as to make the distance between the target object and the perceived three-dimensional object equal to the preset object distance.

[0170] The pixel distance corresponding to the initial image parallax indicates how many pixels are separated in digital format from the same scene feature points in the left-eye virtual image and the right-eye virtual image, so as to make the distance between a user with a standard pupil distance and the three-dimensional object they perceive equal to the preset object distance.

[0171] The horizontal pixel change information indicates the pixel difference between the target image disparity and the initial image disparity in the horizontal direction.

[0172] The initial pixel allocation method is used to make the distance between the formed left-eye virtual image and the formed right-eye virtual image equal to the initial image disparity.

[0173] The target pixel allocation method is used to make the distance between the formed left-eye virtual image and the formed right-eye virtual image equal to the target image parallax.

[0174] It can be seen from the above technical solutions of the embodiments of the present application that the embodiments of the present application obtain a target pixel allocation method that matches the target image parallax by performing a translation adjustment on the initial pixel allocation method. Since the target image parallax matches the pupil distance of the target object, the depth perception accuracy and comfort of users with different pupil distances when viewing the three-dimensional effect image are guaranteed, which helps to improve the universality and ease of use of the head-up display device.

[0175] S1007, displaying the image to be displayed based on the target pixel allocation method to form a left eye virtual image and a right eye virtual image corresponding to the image to be displayed, so that the distance between the three-dimensional object observed by the target object through the left eye virtual image and the right eye virtual image corresponding to the image to be displayed and the target object is equal to the preset object distance.

[0176] The image to be displayed is an image that needs to be shown to the target object.

[0177] It can be seen from the above technical solutions of the embodiments of the present application that the embodiments of the present application obtain the pupil distance of the target object, determine the target image parallax that matches the pupil distance of the target object, adjust the initial pixel allocation method of the display screen according to the target image parallax to obtain the target pixel allocation method, and display the image to be displayed based on the target pixel allocation method, so that the distance between the three-dimensional object observed by the target object through the left eye virtual image and the right eye virtual image during imaging is always the ideal distance. The maintenance of the ideal distance makes the far and near layers of the three-dimensional object clearer, and ensures the accuracy of depth perception of users with different pupil distances when viewing three-dimensional effect images; ensures that the virtual images received by the left eye and the right eye of users with different pupil distances can be perfectly integrated, reduces eye fatigue, headache and dizziness caused by visual adjustment conflicts, and maintains a high degree of comfort even after long-term use, avoiding visual dislocation and discomfort caused by traditional fixed parallax display, which helps to improve the universality and ease of use of head-up display devices, so that more people can enjoy high-quality stereoscopic visual experience. In automotive HUD applications, the 3D display of navigation instructions, road warnings and other information is ensured to be highly consistent with actual road conditions. Drivers can understand and respond quickly and accurately, reducing safety hazards caused by visual errors and improving the overall driving safety factor.

[0178] Corresponding to the image display methods provided in the above-mentioned embodiments, an embodiment of the present application also provides an image display device. Since the image display device provided in the embodiment of the present application corresponds to the image display methods provided in the above-mentioned embodiments, the implementation methods of the aforementioned image display methods are also applicable to the image display device provided in this embodiment and will not be described in detail in this embodiment.

[0179] See also Fig.17 , which is a schematic diagram of the structure of an image display device provided in an embodiment of the present application, the device has the function of implementing the image display method in the above method embodiment, the function can be implemented by hardware, or by hardware executing corresponding software. The device can be applied to a head-up display device, the head-up display device includes a display screen and a beam splitter, the light emitted by the display screen is split by the beam splitter to form a left eye virtual image and a right eye virtual image; Fig.17 As shown, the device may include:

[0180] The pupil distance acquisition module 1710 is used to acquire the pupil distance of the target object;

[0181] The parallax determination module 1720 is used to determine the target distance between the left eye virtual image and the right eye virtual image based on the pupil distance of the target object, the preset virtual image distance and the preset object distance to obtain the target image parallax; the preset virtual image distance is the distance between the left eye virtual image or the right eye virtual image and the target object; the preset object distance is the ideal distance between the three-dimensional object observed by the target object through the left eye virtual image and the right eye virtual image and the target object;

[0182] The pixel allocation module 1730 is used to adjust the initial pixel allocation mode of the display screen based on the difference between the target image parallax and the initial image parallax to obtain the target pixel allocation mode; the initial pixel allocation mode is used to make the distance between the formed left eye virtual image and the formed right eye virtual image equal to the initial image parallax;

[0183] The image display module 1740 is used to display the image to be displayed based on the target pixel allocation method to form a left eye virtual image and a right eye virtual image corresponding to the image to be displayed, so that the distance between the three-dimensional object observed by the target object through the left eye virtual image and the right eye virtual image corresponding to the image to be displayed and the target object is equal to the preset object distance.

[0184] In an exemplary embodiment, the pixel allocation module includes:

[0185] A physical size module is used to determine the physical size of the left eye virtual image or the right eye virtual image to obtain the virtual image size;

[0186] A pixel size module, used for determining a pixel size corresponding to the virtual image size based on the virtual image size and visible pixels within a unit field of view;

[0187] A pixel distance module, used for determining a pixel distance corresponding to a parallax of a target image based on a virtual image size and a pixel size corresponding to the virtual image size;

[0188] The pixel adjustment module is used to adjust the initial pixel allocation mode based on the difference between the pixel distance corresponding to the target image parallax and the pixel distance corresponding to the initial image parallax to obtain the target pixel allocation mode.

[0189] In an exemplary embodiment, the physical size module includes:

[0190] A field of view angle acquisition module, used to obtain the field of view angle of the head-up display device;

[0191] The first virtual image size module is used to determine the physical size of the left eye virtual image or the right eye virtual image based on the field of view angle and the preset virtual image distance to obtain the virtual image size.

[0192] In an exemplary embodiment, the apparatus further includes a pixel division module for determining visible pixels within a unit field of view angle, the pixel division module including:

[0193] A resolution acquisition module, used to acquire the resolution of the display screen;

[0194] The first ratio determination module is used to determine the ratio of the resolution to the field of view angle to obtain visible pixels within a unit field of view angle.

[0195] In an exemplary embodiment, the first virtual image size module includes:

[0196] The second virtual image size module is used to determine the physical size of the left eye virtual image or the right eye virtual image in the horizontal direction based on the preset virtual image distance and the horizontal field angle in the field angle to obtain the virtual image size.

[0197] In an exemplary embodiment, the first ratio determination module includes:

[0198] A horizontal resolution module, used to determine the horizontal resolution of the display screen based on the resolution;

[0199] The second ratio determination module is used to determine the ratio of the horizontal resolution to the horizontal field of view angle to obtain visible pixels within a unit field of view angle.

[0200] In an exemplary embodiment, the resolution acquisition module includes:

[0201] An area determination module, used to determine an imaging area of ​​the display screen based on available pixels in the display screen;

[0202] The resolution determination module is used to determine the resolution of the imaging area.

[0203] In an exemplary embodiment, the pixel adjustment module includes:

[0204] A pixel information module, for determining horizontal pixel change information based on a difference between a pixel distance corresponding to the target image parallax and a pixel distance corresponding to the initial image parallax;

[0205] The pixel translation module is used to perform translation adjustment on the initial pixel allocation method based on the horizontal pixel change information to obtain the target pixel allocation method.

[0206] In an exemplary embodiment, the disparity determination module includes:

[0207] A ratio determination module, used to determine the ratio of the preset object distance to the pupil distance of the target object to obtain a target ratio;

[0208] A distance determination module, used to determine the distance between the left eye virtual image or the right eye virtual image and the three-dimensional object based on the difference between the preset object distance and the preset virtual image distance, and obtain the virtual image object distance;

[0209] The target disparity module is used to determine the target image disparity based on the target ratio and the virtual image object distance; the ratio of the virtual image object distance to the target image disparity is equal to the target ratio.

[0210] In an exemplary embodiment, the head-up display device is communicatively connected to the eye recognition device; the pupil distance acquisition module includes:

[0211] An eye position module, used to obtain the eye position information of the target object sent by the eye recognition device;

[0212] The horizontal distance module is used to determine the distance between the eyes of the target object in the horizontal direction based on the eye position information to obtain the pupil distance of the target object.

[0213] In an exemplary embodiment, the eye position module includes:

[0214] The periodic response module is used to obtain the eye position information of the target object sent by the eye recognition device in response to the parallax adjustment instruction of the current period.

[0215] It should be noted that the device provided in the above embodiment, when implementing its functions, is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0216] An embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded and executed by the processor to implement any one of the image display methods provided in the above method embodiments.

[0217] The memory can be used to store software programs and modules. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, application programs required for functions, etc.; the data storage area can store data created according to the use of the device, etc. In addition, the memory can include a high-speed random access memory and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory can also include a memory controller to provide the processor with access to the memory.

[0218] The method embodiments provided in the embodiments of the present application may be executed in a computer terminal, a server or a similar computing device, that is, the above-mentioned electronic device may include a computer terminal, a server or a similar computing device. Fig.18 is a hardware structure block diagram of a computer device running an image display method provided by an embodiment of the present invention, such as Fig.18 As shown, the internal structure of the computer device may include but is not limited to: a processor, a network interface and a memory. The processor, network interface and memory in the computer device may be connected via a bus or other means. Fig.18 The example of connecting through bus is taken in the following.

[0219] Among them, the processor (or CPU (Central Processing Unit)) is the computing core and control core of the computer device. The network interface may optionally include a standard wired interface, a wireless interface (such as WI-FI, a mobile communication interface, etc.). Memory is a memory device in a computer device for storing programs and data. It is understandable that the memory here can be a high-speed RAM storage device or a non-volatile memory device (non-volatile memory), such as at least one disk storage device; optionally, it can also be at least one storage device located away from the aforementioned processor. The memory provides a storage space, which stores the operating system of the electronic device, including but not limited to: Windows system (an operating system), Linux (an operating system), Android (Android, a mobile operating system) system, IOS (a mobile operating system) system, etc., and the present invention is not limited to this; and, in the storage space, one or more instructions suitable for being loaded and executed by the processor are also stored, and these instructions can be one or more computer programs (including program codes). In the embodiment of this specification, the processor loads and executes one or more instructions stored in the memory to implement the image display method provided in the above method embodiment.

[0220] An embodiment of the present application also provides a computer-readable storage medium, which can be set in an electronic device to store at least one instruction or at least one program related to implementing an image display method. The at least one instruction or the at least one program is loaded and executed by the processor to implement any one of the image display methods provided in the above method embodiments.

[0221] Optionally, in this embodiment, the above-mentioned storage medium may include but is not limited to: a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and other media that can store program codes.

[0222] It should be noted that the above-mentioned sequence of the embodiments of the present application is for description only and does not represent the advantages and disadvantages of the embodiments. The above-mentioned specific embodiments of this specification are described. Other embodiments are within the scope of the attached claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0223] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0224] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0225] The above are only preferred embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. An image display method, characterized in that: Applied to a head-up display device, the head-up display device includes a display screen and a light splitting element, and the light emitted by the display screen is split by the light splitting element to form a left eye virtual image and a right eye virtual image; the method includes: Get the pupil distance of the target object; Based on the pupil distance of the target object, the preset virtual image distance and the preset object distance, a target distance between the left eye virtual image and the right eye virtual image is determined to obtain a target image parallax; the preset virtual image distance is the distance between the left eye virtual image or the right eye virtual image and the target object; the preset object distance is the ideal distance between the three-dimensional object observed by the target object through the left eye virtual image and the right eye virtual image and the target object; Adjusting the initial pixel allocation mode of the display screen based on the difference between the target image parallax and the initial image parallax to obtain a target pixel allocation mode; the initial pixel allocation mode is used to make the distance between the formed left-eye virtual image and the formed right-eye virtual image equal to the initial image parallax; The image to be displayed is displayed based on the target pixel allocation method to form a left eye virtual image and a right eye virtual image corresponding to the image to be displayed, so that the distance between the three-dimensional object observed by the target object through the left eye virtual image and the right eye virtual image corresponding to the image to be displayed and the target object is equal to the preset object distance.

2. The image display method according to claim 1, characterized in that: The step of adjusting the initial pixel allocation mode of the display screen based on the difference between the target image parallax and the initial image parallax to obtain the target pixel allocation mode includes: Determine the physical size of the left-eye virtual image or the right-eye virtual image to obtain the virtual image size; Determining a pixel size corresponding to the virtual image size based on the virtual image size and visible pixels within a unit field of view; Determining a pixel distance corresponding to the parallax of the target image based on the virtual image size and a pixel size corresponding to the virtual image size; Based on the difference between the pixel distance corresponding to the target image parallax and the pixel distance corresponding to the initial image parallax, the initial pixel allocation method is adjusted to obtain the target pixel allocation method.

3. The image display method according to claim 2, characterized in that: The determining the physical size of the left-eye virtual image or the right-eye virtual image to obtain the virtual image size includes: Obtaining the field of view angle of the head-up display device; Based on the field of view angle and the preset virtual image distance, the physical size of the left-eye virtual image or the right-eye virtual image is determined to obtain the virtual image size.

4. The image display method according to claim 3, characterized in that: The method further comprises: Obtaining the resolution of the display screen; A ratio of the resolution to the field of view angle is determined to obtain visible pixels within the unit field of view angle.

5. The image display method according to claim 4, characterized in that: The determining the physical size of the left-eye virtual image or the right-eye virtual image based on the field of view angle and the preset virtual image distance to obtain the virtual image size includes: Based on the preset virtual image distance and the horizontal field angle in the field angles, the physical size of the left eye virtual image or the right eye virtual image in the horizontal direction is determined to obtain the virtual image size.

6. The image display method according to claim 5, characterized in that: The determining the ratio of the resolution to the field of view angle to obtain visible pixels within the unit field of view angle includes: determining a horizontal resolution of the display screen based on the resolution; The ratio of the horizontal resolution to the horizontal field of view is determined to obtain visible pixels within the unit field of view.

7. The image display method according to claim 4, characterized in that: The obtaining the resolution of the display screen includes: Determining an imaging area of ​​the display screen based on available pixels in the display screen; The resolution of the imaged area is determined.

8. The image display method according to claim 2, characterized in that: The adjusting the initial pixel allocation method based on the difference between the pixel distance corresponding to the target image parallax and the pixel distance corresponding to the initial image parallax to obtain the target pixel allocation method includes: Determining horizontal pixel change information based on a difference between a pixel distance corresponding to the target image disparity and a pixel distance corresponding to the initial image disparity; The initial pixel allocation mode is adjusted by translation based on the horizontal pixel change information to obtain the target pixel allocation mode.

9. The image display method according to claim 1, characterized in that: The method of determining the target distance between the left-eye virtual image and the right-eye virtual image based on the pupil distance of the target object, the preset virtual image distance and the preset object distance, and obtaining the target image disparity, comprises: Determine the ratio of the preset object distance to the pupil distance of the target object to obtain a target ratio; Based on the difference between the preset object distance and the preset virtual image distance, determining the distance between the left eye virtual image or the right eye virtual image and the three-dimensional object to obtain the virtual image object distance; The target image disparity is determined based on the target ratio and the virtual image object distance; a ratio of the virtual image object distance to the target image disparity is equal to the target ratio.

10. The image display method according to claim 1, characterized in that: The head-up display device is communicatively connected with the eye recognition device; and obtaining the pupil distance of the target object includes: Acquire the eye position information of the target object sent by the eye recognition device; The distance between the eyes of the target object in the horizontal direction is determined based on the eye position information to obtain the pupil distance of the target object.

11. The image display method according to claim 10, characterized in that: The acquiring the eye position information of the target object sent by the eye recognition device includes: In response to the parallax adjustment instruction of the current cycle, the eye position information of the target object sent by the eye recognition device is acquired.

12. An image display device, characterized in that: Applied to a head-up display device, the head-up display device includes a display screen and a light splitting element, and the light emitted by the display screen is split by the light splitting element to form a left eye virtual image and a right eye virtual image; the device includes: A pupil distance acquisition module, used to acquire the pupil distance of a target object; a parallax determination module, configured to determine a target distance between the left-eye virtual image and the right-eye virtual image based on the pupil distance of the target object, a preset virtual image distance, and a preset object distance, to obtain a target image parallax; the preset virtual image distance is the distance between the left-eye virtual image or the right-eye virtual image and the target object; the preset object distance is an ideal distance between the three-dimensional object observed by the target object through the left-eye virtual image and the right-eye virtual image and the target object; A pixel allocation module, configured to adjust an initial pixel allocation mode of the display screen based on a difference between the target image parallax and the initial image parallax, to obtain a target pixel allocation mode; the initial pixel allocation mode is configured to make the distance between the formed left-eye virtual image and the formed right-eye virtual image equal to the initial image parallax; An image display module is used to display the image to be displayed based on the target pixel allocation method to form a left eye virtual image and a right eye virtual image corresponding to the image to be displayed, so that the distance between the three-dimensional object observed by the target object through the left eye virtual image and the right eye virtual image corresponding to the image to be displayed and the target object is equal to the preset object distance.

13. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or at least one program is loaded and executed by the processor to implement the image display method according to any one of claims 1 to 11.

14. A computer-readable storage medium, wherein at least one instruction or at least one program is stored in the storage medium, and the at least one instruction or the at least one program is loaded and executed by a processor to implement the image display method according to any one of claims 1 to 11.

15. A computer program, characterized in that When the computer program is executed by a processor, the image display method according to any one of claims 1 to 11 is implemented.

Images