Image display method and apparatus, and electronic device and storage medium

Abstract

Disclosed in the present application are an image display method and apparatus, and an electronic device and a storage medium. The image display method may be applied to a head-up display device, wherein the head-up display device is in communication connection with an eye recognition device, and the head-up display device comprises a display screen and a light splitting element. The method comprises: on the basis of eye position information of a target object, which eye position information is sent by an eye recognition device, determining the interpupillary distance of the target object and eyebox partitions in which eyes of the target object are located, so as to obtain a target eyebox partition; determining whether the interpupillary distance of the target object complies with a standard interpupillary distance; when a determination result is no, on the basis of the difference between the interpupillary distance of the target object and the standard interpupillary distance, adjusting a preset pixel allocation manner corresponding to the target eyebox partition, so as to obtain a target pixel allocation manner; and on the basis of the target pixel allocation manner, displaying an image to be displayed, such that light emitted from a display screen is split by a light splitting element so as to form a left-eye virtual image and a right-eye virtual image. The present application ensures that users with different interpupillary distances can view three-dimensional effect images in an ideal state.

Description

An image display method and device, electronic equipment and storage medium

[0001] The present application claims priority to the Chinese patent application No. 202410880165.6, filed on July 2, 2024, to the Chinese Patent Office, the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] The present application relates to the field of head-up display technology, and in particular to an image display method and device, electronic equipment and storage medium. BACKGROUND

[0003] Naked eye 3D (3-dimension) display technology refers to a 3D display technology that allows users to directly enjoy three-dimensional images with naked eyes without wearing special 3D glasses, and presents a 3D effect. For example, by setting a slit grating or a lenticular grating in front of a display screen, light emitted by the display screen is split by the slit grating or the lenticular grating, and then refracted by an imaging structure, and enters the left eye and the right eye of the driver, respectively. The images seen by the left eye and the right eye of the driver are different, forming binocular parallax, and a stereoscopic picture with depth is synthesized in the brain of the user, achieving 3D viewing experience.

[0004] In the optical path design of naked eye 3D HUD (Head Up Display, head-up display device), a certain pupil distance value is usually taken as a design reference for design, and light is uniformly distributed to the left and right eyes of the user, so that the user with the pupil distance equal to the pupil distance value can watch a very comfortable 3D effect image. However, when the user with the pupil distance greater than or less than the pupil distance value watches the same 3D effect image through the imaging structure, the left eye of the user may see the image intended for the right eye, or the right eye may see the image intended for the left eye, and crosstalk occurs between the images seen by the left eye and the right eye of the user, resulting in poor user experience and inability to fuse the 3D effect. SUMMARY

[0005] To solve the problems in the related art, the present application provides an image display method and device, electronic equipment and storage medium. The technical solution is as follows:

[0006] In one aspect, an image display method is provided, applied to a head-up display device, the head-up display device being in communication connection with an eye recognition device, the head-up display device including a display screen and a light splitting element; the method includes:

[0007] obtaining eye position information of a target object sent by the eye recognition device;

[0008] determine a pupillary distance of the target object based on the eye position information, and an eye box partition in which eyes of the target object are located, to obtain a target eye box partition;

[0009] determine whether the pupillary distance of the target object meets a standard pupillary distance;

[0010] in a case where the determination result is no, adjust a preset pixel allocation manner corresponding to the target eye box partition based on a difference between the pupillary distance of the target object and the standard pupillary distance, to obtain a target pixel allocation manner; the display screen is provided with display units arranged in an array, each of the display units corresponds to display a sub-pixel in a to-be-displayed image; the preset pixel allocation manner is set based on the standard pupillary distance, and indicates a correspondence between the display units and the sub-pixels of the to-be-displayed image;

[0011] display the to-be-displayed image based on the target pixel allocation manner, so that light emitted by the display screen forms left-eye virtual images and right-eye virtual images after being split by the light splitting element.

[0012] In another aspect, an image display device is provided, which is applied to a head-up display device that is in communication connection with an eye recognition device, and the head-up display device includes a display screen and a light splitting element; the device includes:

[0013] a position acquisition module configured to acquire eye position information of a target object sent by the eye recognition device;

[0014] an information determination module configured to determine a pupillary distance of the target object based on the eye position information, and an eye box partition in which eyes of the target object are located, to obtain a target eye box partition;

[0015] a pupillary distance determination module configured to determine whether the pupillary distance of the target object meets a standard pupillary distance;

[0016] a pixel allocation module configured to, in a case where the determination result is no, adjust a preset pixel allocation manner corresponding to the target eye box partition based on a difference between the pupillary distance of the target object and the standard pupillary distance, to obtain a target pixel allocation manner; the display screen is provided with display units arranged in an array, each of the display units corresponds to display a sub-pixel in a to-be-displayed image; the preset pixel allocation manner is set based on the standard pupillary distance, and indicates a correspondence between the display units and the sub-pixels of the to-be-displayed image;

[0017] a first image display module configured to display the to-be-displayed image based on the target pixel allocation manner, so that light emitted by the display screen forms left-eye virtual images and right-eye virtual images after being split by the light splitting element.

[0018] In an example implementation, the pixel assignment module comprises:

[0019] a first pixel adjustment module configured to adjust a preset pixel assignment mode corresponding to the target eyebox partition based on a difference between the target interpupillary distance and the standard interpupillary distance, to obtain an adjusted pixel assignment mode;

[0020] a pixel fusion module configured to fuse the preset pixel assignment mode and the adjusted pixel assignment mode, to obtain the target pixel assignment mode.

[0021] In an example implementation, the preset pixel assignment mode further indicates luminance information of each display unit; the preset pixel assignment mode corresponding to the eyebox partition is fused from an initial pixel assignment mode corresponding to the eyebox partition and an initial pixel assignment mode corresponding to a neighboring eyebox partition of the eyebox partition; the pixel fusion module comprises:

[0022] a pixel superposition module configured to superimpose the preset pixel assignment mode and the adjusted pixel assignment mode, to obtain a pixel assignment mode to be processed;

[0023] a unit determination module configured to determine, in the pixel assignment mode to be processed, a display unit between a fusion boundary in the preset pixel assignment mode and a fusion boundary in the adjusted pixel assignment mode, to obtain a display unit to be identified;

[0024] a target determination module configured to, for each display unit to be identified, determine the display unit to be identified as a target display unit in a case that luminance information of the display unit to be identified matches target luminance information in the pixel assignment mode to be processed; the fusion boundary is a boundary between the initial pixel assignment mode corresponding to the eyebox partition and the initial pixel assignment mode corresponding to the neighboring eyebox partition of the eyebox partition in the preset pixel assignment mode corresponding to the eyebox partition;

[0025] a boundary fitting module configured to fit a plurality of target display units, to obtain a target fusion boundary;

[0026] a boundary coincidence module configured to adjust the preset pixel assignment mode until a fusion boundary in the preset pixel assignment mode coincides with the target fusion boundary, to obtain the target pixel assignment mode.

[0027] In an example implementation, the fusion boundary is determined based on luminance information of a display unit indicated by the initial pixel assignment mode; the apparatus further comprises a target luminance module configured to determine target luminance information, the target luminance module comprising:

[0028] a brightness determination module configured to determine brightness information of display units corresponding to the fusion boundary in the preset pixel distribution mode, to obtain first brightness information;

[0029] and determine brightness information of display units corresponding to the fusion boundary in the adjusted pixel distribution mode, to obtain second brightness information;

[0030] a brightness evaluation module configured to evaluate an average value based on the first brightness information and the second brightness information, to obtain the target brightness information.

[0031] In an exemplary embodiment, the pixel distribution module comprises:

[0032] a parameter acquisition module configured to send a difference between the interpupillary distance of the target object and the standard interpupillary distance to a user terminal, so that the user terminal returns an adjustment parameter for a preset pixel distribution mode;

[0033] a second pixel adjustment module configured to adjust the preset pixel distribution mode based on the adjustment parameter, to obtain the target pixel distribution mode.

[0034] In an exemplary embodiment, the second pixel adjustment module comprises:

[0035] a third pixel adjustment module configured to adjust the preset pixel distribution mode based on the adjustment parameter, to obtain a pixel distribution mode to be confirmed;

[0036] a second image display module configured to display the image to be displayed based on the pixel distribution mode to be confirmed, so that light emitted by the display screen forms left-eye and right-eye virtual images after being split by the light splitting element;

[0037] a clarity confirmation module configured to send a virtual image clarity confirmation request to the user terminal, so that the user terminal returns a confirmation result of the virtual image clarity confirmation request; the confirmation result indicates whether the left-eye and right-eye virtual images are clear; in the case where the confirmation result indicates that the left-eye and right-eye virtual images are not clear, the confirmation result also indicates a re-adjustment parameter for the pixel distribution mode to be confirmed;

[0038] a fourth pixel adjustment module configured to, in the case where the confirmation result indicates that the left-eye and right-eye virtual images are not clear, adjust the pixel distribution mode to be confirmed based on the re-adjustment parameter, display the image to be displayed based on the adjusted pixel distribution mode to be confirmed, update the confirmation result, and determine the adjusted pixel distribution mode to be confirmed as the target pixel distribution mode when the updated confirmation result indicates that the left-eye and right-eye virtual images are clear.

[0039] In an example embodiment, the information determining module comprises:

[0040] a pupil distance determining module configured to determine a distance between the two eyes of the target object in a horizontal direction based on the eye position information, to obtain a pupil distance of the target object.

[0041] In another aspect, an electronic device is provided, comprising a processor and a memory having at least one instruction or at least one program stored therein, the at least one instruction or the at least one program being loaded and executed by the processor to implement the image display method of any of the above aspects.

[0042] In another aspect, a computer-readable storage medium is provided, having at least one instruction or at least one program stored therein, the at least one instruction or the at least one program being loaded and executed by a processor to implement the image display method of any of the above aspects.

[0043] In another aspect, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the electronic device to perform the image display method of any of the above aspects.

[0044] The embodiments of the present application obtain the eye position information of the target object sent by the eye recognition device through communication connection with the eye recognition device; determine the pupil distance of the target object and the target eye box partition in which the eyes of the target object are located based on the eye position information, to obtain the target eye box partition; in the case that the pupil distance of the target object does not conform to the standard pupil distance, adjust the preset pixel allocation mode corresponding to the target eye box partition based on the difference between the pupil distance of the target object and the standard pupil distance, to obtain the target pixel allocation mode; the display screen is provided with display units arranged in an array, each display unit corresponding to a sub-pixel in the to-be-displayed image; the preset pixel allocation mode is set based on the standard pupil distance, and indicates the correspondence between the display unit and the sub-pixel of the to-be-displayed image; display the to-be-displayed image based on the target pixel allocation mode, so that the light emitted by the display screen forms left-eye virtual images and right-eye virtual images after being split by the light splitting element. By obtaining the pupil distance of the target object in real time and adjusting the pixel allocation mode in real time, the target pixel allocation mode obtained after adjustment matches the pupil distance of the target object, which ensures that users with different pupil distances can watch the three-dimensional effect image in an ideal state, and even if the pupil distance changes during the watching process, there is no need to worry about the decline of the 3D experience quality, realizing self-adaptation with the change of the pupil distance and improving the immersion of the user. BRIEF DESCRIPTION OF DRAWINGS

[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments will be briefly introduced. Obviously, the drawings in the following description only constitute some embodiments of the present application, and for those skilled in the art, other drawings can be obtained based on these drawings without any creative effort.

[0046] Fig. 1 is a schematic diagram of an application environment of a head-up display device according to an embodiment of the present application;

[0047] Fig. 2 is a schematic diagram of a principle of a head-up display device according to an embodiment of the present application;

[0048] Fig. 3 is a schematic diagram of a principle of naked-eye 3D according to an embodiment of the present application;

[0049] Fig. 4 is a schematic diagram of an illumination map, a waveform map and a luminance map of a simulation optical system according to an embodiment of the present application;

[0050] Fig. 5 is a schematic diagram of a pupil distance according to an embodiment of the present application;

[0051] Fig. 6 is a schematic diagram of a virtual image seen by a user when the user's pupil distance is equal to a standard pupil distance according to an embodiment of the present application;

[0052] Fig. 7 is a schematic diagram of a processing method of a first pixel distribution mode according to an embodiment of the present application;

[0053] Fig. 8 is a schematic diagram of a processing method of a second pixel distribution mode according to an embodiment of the present application;

[0054] Fig. 9 is a schematic diagram of a pixel distribution state according to an embodiment of the present application;

[0055] Fig. 10 is a schematic diagram of a processing method of a third pixel distribution mode according to an embodiment of the present application;

[0056] Fig. 11 is a schematic diagram of a virtual image seen by a user when the user's pupil distance is greater than a standard pupil distance according to an embodiment of the present application;

[0057] Fig. 12 is a schematic diagram of a virtual image in a non-ideal state according to an embodiment of the present application;

[0058] Fig. 13 is a schematic diagram of an implementation environment of an image display method according to an embodiment of the present application;

[0059] Fig. 14 is a schematic diagram of a flow of an image display method according to an embodiment of the present application;

[0060] Fig. 15 is a schematic diagram of another pupil distance according to an embodiment of the present application;

[0061] Fig. 16 is a schematic diagram of an adjusted pixel distribution mode according to an embodiment of the present application;

[0062] FIG. 17 is a schematic diagram of determining a target fusion boundary according to an embodiment of the present application;

[0063] FIG. 18 is a schematic diagram of determining a target pixel distribution manner according to a first embodiment of the present application;

[0064] FIG. 19 is a schematic diagram of determining a target pixel distribution manner according to a second embodiment of the present application;

[0065] FIG. 20 is a schematic diagram of determining a target pixel distribution manner according to a third embodiment of the present application;

[0066] FIG. 21 is a structural block diagram of an image display device according to an embodiment of the present application;

[0067] FIG. 22 is a hardware structural block diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0068] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of the present application.

[0069] It should be noted that the terms "first", "second", and the like in the specification and claims of the present application and the above-described drawings are used to distinguish similar objects, and do not necessarily indicate a specific order or a chronological sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product, or server including a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to the process, method, product, or device.

[0070] It can be understood that in the specific embodiments of the present application, data related to user information and the like is involved, and when the above embodiments of the present application are applied to specific products or technologies, the user's permission or consent needs to be obtained, and the collection, use, and processing of related data need to comply with relevant laws, regulations, and standards of relevant countries and regions.

[0071] Please refer to Fig. 1, which is an application environment schematic diagram of a head-up display device provided by an embodiment of the present application. The head-up display device can be applied to a car as a driving assistant instrument, and can also be applied to other vehicles, such as an airplane, a high-speed train, etc. In the following, a car-mounted HUD will be taken as an example to introduce the technical solution of the present application. Through the image display method of the embodiment of the present application, the HUD can clearly and accurately project the speed, navigation information, warning information, etc. in the form of an image or a character to the front of the driver through an optical component, to form a virtual image with a stereoscopic effect in front of the driver's line of sight, and has a good imaging effect.

[0072] Please refer to Fig. 2, which is a principle schematic diagram of a head-up display device provided by an embodiment of the present application. The 3D HUD includes an image generation unit, a cylindrical lens grating (or a slit grating) attached to the image generation unit, a mirror assembly, etc. The image generation unit is composed of an LCD (Liquid Crystal Display) and a backlight. The mirror assembly can include a plurality of mirrors, as shown in Fig. 2, which includes a mirror 1 and a mirror 2. The mirror 1 can be a plane mirror or a free-form curved mirror, and the mirror 2 can be a free-form curved mirror. In the implementation of the 3D HUD, the outgoing light rays of the image generation unit are limited after passing through the cylindrical lens grating (or the slit grating), and different outgoing angles are achieved to realize light splitting; the light rays emitted by the cylindrical lens grating (or the slit grating) pass through the mirror assembly and the windshield of the vehicle in turn after refraction, and enter the left eye and the right eye of the user respectively, and the images seen by the left eye and the right eye of the user are different.

[0073] Please refer to Fig. 3, which is a principle schematic diagram of a naked-eye 3D provided by an embodiment of the present application. Through optical design of the HUD, the user's left eye sees an image P1 and the right eye sees an image P2. The image P1 and the image P2 can be synthesized into a stereoscopic picture with a sense of depth in the user's brain; by changing the position between the two images and adjusting the binocular parallax, the user can subjectively feel that the virtual image distance changes (in fact, the virtual image distance is constant). The closer the two images are, the closer the user subjectively feels the virtual image distance to be; on the contrary, the farther the two images are, the farther the user subjectively feels the virtual image distance to be.

[0074] Please refer to FIG. 4, which shows a simulation optical system illumination diagram, waveform diagram and luminance diagram provided by the embodiment of the present application, which is simulated and designed by using LightTools software. Specifically, different pixel widths are designed, a cylindrical lens grating and a display screen thickness are set, a cylindrical lens surface type is optimized, and finally the required eye point spacing and pupil distance numerical results can be obtained. In a specific implementation, a complete set of optical systems is simulated and analyzed by using a series of optical parameters (such as: eyebox range 130*50, field of view angle 13*5°, display screen thickness, etc.) and optical devices (such as curved mirror, plane mirror, etc.), the imaging design of the HUD is determined, the grating is designed in the subsequent stage, such as selection, surface type, thickness adjustment, etc., and finally the required eyebox partition is obtained. That is, how many partitions an eyebox can be divided into determines the distribution state of each light beam in the eyebox. From the figure, it can be seen that the eye point spacing is approximately 129.911mm, which is basically the same as the standard pupil distance of 65mm (in the present application, 65mm is taken as the standard pupil distance for description, and other pupil distance values can be selected as the standard pupil distance in a specific implementation). The simulation result is the state that the user can see through the imaging structure reflected to the eyebox of the user's eyes. If one cylindrical lens covers 6 sub-pixels, there are 3 eye points on the picture, representing the left eye, the right eye and the left eye, respectively. The left eye is the black part of 3 unlit sub-pixels, and the right eye is the red part of 3 lit sub-pixels. Through the simulation result, the required eye point spacing can be obtained by directly subtracting the distance between the two eye points.

[0075] Please refer to FIG. 5, which shows a pupil distance schematic diagram provided by the embodiment of the present application. If the standard pupil distance is 65mm, the left and right eyes are at the positions of the two eye points in the above-mentioned eyebox (one is in the middle of the dark area and the middle of the bright area), and the left and right eye boundaries can be complementary, the left eye (without stripes) represents the virtual image that can be seen when the pixels are not lit, and the right eye (with stripes) represents the virtual image that can be seen when the pixels are lit. Please continue to refer to FIG. 6, which shows a virtual image schematic diagram seen by the user when the pupil distance is equal to the standard pupil distance provided by the embodiment of the present application. If the HUD takes the left and right eye pupil distance of the user as 65mm as the design reference, the left eye just sees the image P1 intended for the left eye to watch, and the right eye just sees the image P2 intended for the right eye to watch.

[0076] Referring to FIG. 7, a schematic diagram of a processing method of a first pixel distribution manner provided by an embodiment of the present application is shown. It is assumed that an eyebox is divided into 8 sub-areas, e1-e8. The virtual images shown in state 1, state 2, state 3 and state 4 are shown. For e3, a picture actually showing the sub-pixel distribution state is taken at e3, and pictures actually showing the sub-pixel distribution state are taken at e1, e2 and e4 adjacent to e3. Image fusion is performed on the four virtual images, and a virtual image seen at e3 is obtained. The virtual image is converted to a coordinate system of a display screen, and a visible area corresponding to e3 in the display screen is obtained. The visible area is provided with display units arranged in an array. Each display unit corresponds to a sub-pixel in a to-be-displayed image, and the obtained pixel distribution manner is taken as a preset pixel distribution manner corresponding to e3. Referring to FIG. 8, a schematic diagram of a processing method of a second pixel distribution manner provided by an embodiment of the present application is shown. The virtual image shown in state 1 is superimposed on the virtual image shown in state 2, and a fusion boundary is determined. The virtual image shown in state 2 is superimposed on the virtual image shown in state 3, and a fusion boundary is determined. The virtual image shown in state 3 is superimposed on the virtual image shown in state 4, and a fusion boundary is determined. The images P1 and P2 are obtained, and the eye point positions of the images P1 and P2 correspond to the preset pixel distribution manners of the eyebox partitions, respectively. Similarly, the preset pixel distribution manners corresponding to other eyebox partitions can be obtained, and the preset pixel distribution manners corresponding to the eye point positions of the respective eyebox partitions are displayed.

[0077] Referring to FIG. 9, a schematic diagram of a pixel distribution state provided by an embodiment of the present application is shown. FIG. 9-1 is a pixel distribution state corresponding to the virtual image shown in state 3, and FIG. 9-2 is a pixel distribution state corresponding to the virtual image shown in state 4. If one lenticular lens covers 8 sub-pixels, 4 sub-pixels L correspond to an image viewed by a left eye, and the other 4 sub-pixels R correspond to an image viewed by a right eye. An eyebox is divided into 8 viewing zones. The arrangement manner is an arrangement manner when a grating is inclined relative to a display screen. Referring to FIG. 10, a schematic diagram of a processing method of a third pixel distribution manner provided by an embodiment of the present application is shown. The pixel distribution state is obtained by combining the pixel distribution states of state 3 and state 4. When a user's pupil distance is a standard pupil distance, the pixels viewed by the left and right eyes can be complementary. When a user views a virtual image under a standard 65 mm pupil distance, two images are given to the left and right eyes of the user. The left eye views the image intended for the left eye, and the right eye views the image intended for the right eye. The two images are two images with parallax.

[0078] Please refer to Fig. 11, which shows a schematic diagram of a virtual image seen by a user when the user's pupil distance is greater than the standard pupil distance according to an embodiment of the present application. When the user's pupil distance is greater than 65 mm, if the left eye observation point position is unchanged, the pupil distance changes from 65 mm to 70 mm, the left eye can see the image intended for the left eye, but the image seen by the right eye will be crosstalk, such as image P2'. Please continue to refer to Fig. 12, which shows a schematic diagram of a virtual image in a non-ideal state according to an embodiment of the present application. If the user's eyes are left-right translation, the fusion boundary is also left-right translation, and the change in pupil distance is equivalent to moving to the left or right on the basis of the original right eye, which is equivalent to moving from R to R'. The fusion boundary is extracted according to the brightness, and the brightness is not uniform at 80%, but there may be other camera positions with image brightness values of 60%, 70%, etc. In this way, the user's eyes can see the brightness difference at the fusion boundary.

[0079] In view of this, the present application provides an image display method, which is applied to a head-up display device, the head-up display device is in communication connection with an eye recognition device, and the head-up display device includes a display screen and a light splitting element. Specifically, please refer to Fig. 13, which shows a schematic diagram of an implementation environment of an image display method according to an embodiment of the present application. The eye recognition device can be specifically set as a DMS (Driver Monitoring System, driver monitoring system). The installation position of the DMS is not specifically limited in the present application, and needs to meet the requirements that the DMS can be rigidly fixed between the human eye and the front windshield, does not block the line of sight of the human eye, and will not be blocked by the steering wheel or the body posture in driving.

[0080] Please refer to Fig. 14, which shows a schematic diagram of a flow of an image display method according to an embodiment of the present application. It should be noted that the present specification provides method operation steps such as embodiments or flowcharts, but more or fewer operation steps can be included based on conventional or non-creative labor. The order of steps listed in the embodiments is only one of the many execution orders, and does not represent the only execution order. In actual system or product execution, the method order shown in the embodiments or the drawings can be executed in sequence or in parallel (for example, in a parallel processor or multi-thread processing environment). Specifically, the method is applied to a head-up display device, the head-up display device is in communication connection with an eye recognition device, and the head-up display device includes a display screen and a light splitting element; as shown in Fig. 14, the method can include:

[0081] S1401, obtaining eye position information of a target object sent by an eye recognition device.

[0082] The target object is a user currently using the head-up display device.

[0083] The eye position information includes a left eye position and a right eye position. Specifically, the left eye position is coordinate information corresponding to a left eye of the target object, and the right eye position is coordinate information corresponding to a right eye of the target object.

[0084] In S1403, a pupillary distance of the target object is determined based on the eye position information, and an eye box partition in which the eyes of the target object are located is obtained, to obtain a target eye box partition.

[0085] The target eye box partition includes a left eye box partition and a right eye box partition. Specifically, the left eye box partition is an eye box partition in which a left eye of the target object is located, and the right eye box partition is an eye box partition in which a right eye of the target object is located.

[0086] In an exemplary embodiment, the process of determining the pupillary distance of the target object in S1403 can include the following steps:

[0087] The distance between the eyes of the target object in the horizontal direction is determined based on the eye position information, to obtain the pupillary distance of the target object.

[0088] Specifically, if the head of the target object is offset, for example, the head is slightly tilted or skewed, the pupillary distance of the target object is equivalent to being narrowed in the horizontal direction, and is considered to change, that is, the pupillary distance of the target object is considered to change according to the data in the horizontal direction.

[0089] As can be seen from the above technical solutions of the embodiments of the present application, the distance between the eyes of the target object in the horizontal direction is calculated as the pupillary distance of the target object. If the head of the target object is offset, the pupillary distance of the target object is considered to change, and the pixel allocation mode is adjusted according to the subsequent steps, so that the target object can always watch the three-dimensional effect image in the ideal state during the use of the head-up display device, and the immersion of the user is improved.

[0090] In S1405, it is determined whether the pupillary distance of the target object meets a standard pupillary distance.

[0091] Specifically, the head-up display device is designed based on the standard pupillary distance. If the pupillary distance of the target object meets the standard pupillary distance, the target eye box partition is displayed based on the preset pixel allocation mode corresponding to the target eye box partition; if the pupillary distance of the target object does not meet the standard pupillary distance, the preset pixel allocation mode corresponding to the target eye box partition needs to be adjusted to match the pupillary distance of the target object.

[0092] In S1407, if the result of the determination is no, the target pixel allocation mode is obtained by adjusting the preset pixel allocation mode corresponding to the target eye box partition based on the difference between the pupillary distance of the target object and the standard pupillary distance.

[0093] Specifically, the display screen is provided with display units arranged in an array, each display unit corresponding to a sub-pixel in the image to be displayed, and the preset pixel allocation mode is set based on the standard interpupillary distance and indicates the correspondence between the display unit and the sub-pixel of the image to be displayed.

[0094] In specific implementation, the preset pixel allocation mode can be adjusted by moving the pixels, and the moving distance of the pixels is determined according to the difference between the interpupillary distance of the target object and the standard interpupillary distance.

[0095] The target pixel allocation mode matches the interpupillary distance of the target object, and when the eyes of the target object are in the target eye box partition, the target pixel allocation mode is used to make the left eye of the target object just be able to see the image intended for the left eye and the right eye just be able to see the image intended for the right eye.

[0096] In an exemplary embodiment, the above step S1407 can include the following steps:

[0097] Based on the difference between the interpupillary distance of the target object and the standard interpupillary distance, the preset pixel allocation mode corresponding to the target eye box partition is adjusted to obtain an adjusted pixel allocation mode;

[0098] The preset pixel allocation mode and the adjusted pixel allocation mode are fused to obtain a target pixel allocation mode.

[0099] The preset pixel allocation mode matches the standard interpupillary distance.

[0100] The target pixel allocation mode matches the interpupillary distance of the target object.

[0101] Specifically, please refer to FIG. 10, which shows a schematic diagram of a third pixel allocation mode processing method provided by an embodiment of the present application, and is the pixel distribution corresponding to the standard interpupillary distance (taking 65 mm as an example) in the display screen, specifically, the pixel distribution state obtained by combining state 3 and state 4. Please continue to refer to FIGS. 15 and 16, which respectively show another interpupillary distance diagram and a schematic diagram of an adjusted pixel allocation mode provided by an embodiment of the present application. In the case where the interpupillary distance of the target object (taking 63 mm as an example) is less than the standard interpupillary distance, it is equivalent to the left eye moving right relative to the right eye. On the basis of FIG. 10-1, the fusion boundary is moved right by two pixels to obtain the adjusted pixel allocation mode as shown in FIG. 16-1. On the basis of FIG. 10-2, the fusion boundary is moved right by two pixels to obtain the adjusted pixel allocation mode as shown in FIG. 16-2.

[0102] Specifically, the preset pixel allocation mode and the adjusted pixel allocation mode are fused, specifically, the two pixel allocation modes are neutralized to obtain an optimal pixel allocation mode as the target pixel allocation mode.

[0103] In a specific implementation, two cameras can be installed, and after optical design of the pupillary distance range (50-70 mm) of the target object, the fusion boundary in the preset pixel allocation mode corresponding to the left and right eyes is extracted after self-shooting at the left and right eye positions, and then the target fusion boundary is determined according to the brightness information, and the target pixel allocation mode is obtained.

[0104] As can be seen from the above technical solutions of the embodiments of the present application, the difference between the pupillary distance of the target object and the standard pupillary distance is used to adjust the preset pixel allocation mode, the preset pixel allocation mode and the adjusted pixel allocation mode are fused to obtain the target pixel allocation mode, so as to improve the imaging effect of the three-dimensional image and ensure that users with different pupillary distances can watch the three-dimensional effect image in an ideal state.

[0105] In an exemplary embodiment, the preset pixel allocation mode also indicates the brightness information of each display unit; the preset pixel allocation mode corresponding to the eyebox partition is formed by fusing the initial pixel allocation mode corresponding to the eyebox partition and the initial pixel allocation mode corresponding to the adjacent eyebox partition of the eyebox partition; the step of fusing the preset pixel allocation mode and the adjusted pixel allocation mode to obtain the target pixel allocation mode can include the following steps:

[0106] Superimposing the preset pixel allocation mode and the adjusted pixel allocation mode to obtain a pixel allocation mode to be processed;

[0107] In the pixel allocation mode to be processed, the display unit between the fusion boundary in the preset pixel allocation mode and the fusion boundary in the adjusted pixel allocation mode is determined to obtain a display unit to be identified;

[0108] For each display unit to be identified, in a case where the brightness information of the display unit to be identified matches the target brightness information in the pixel allocation mode to be processed, the display unit is determined to be a target display unit; the fusion boundary is the boundary between the initial pixel allocation mode corresponding to the eyebox partition and the initial pixel allocation mode corresponding to the adjacent eyebox partition of the eyebox partition in the preset pixel allocation mode corresponding to the eyebox partition;

[0109] Fitting the plurality of target display units to obtain a target fusion boundary;

[0110] Adjusting the preset pixel allocation mode until the fusion boundary in the preset pixel allocation mode coincides with the target fusion boundary to obtain the target pixel allocation mode.

[0111] The preset pixel allocation mode matches the standard pupillary distance.

[0112] The to-be-processed pixel allocation manner is a superimposed pixel allocation manner based on the preset pixel allocation manner and the adjusted pixel allocation manner. Specifically, as shown in FIG. 17, which is a schematic diagram of determining a target fusion boundary provided by an embodiment of the present application, in the case shown in FIG. 15, the preset pixel allocation manner corresponding to the eyebox partition in which the right eye is located does not need to be adjusted, and the preset pixel allocation manner corresponding to the eyebox partition in which the left eye is located is adjusted to obtain the adjusted pixel allocation manner corresponding to the left eye; the preset pixel allocation manner corresponding to the eyebox partition in which the left eye is located is superimposed with the adjusted pixel allocation manner corresponding to the left eye to obtain a to-be-processed pixel allocation manner, which includes the fusion boundary of the two pixel allocation manners. Since the pixel seen by the left eye and the right eye can be complementary when the interpupillary distance of the user is exactly the standard interpupillary distance, the fusion boundaries in the preset pixel allocation manners corresponding to the eyebox partitions in which the left eye and the right eye are located coincide.

[0113] The to-be-identified display unit is a display unit between the fusion boundary in the preset pixel allocation manner and the fusion boundary in the adjusted pixel allocation manner. Specifically, it is a display unit between a left fusion boundary in the two fusion boundaries (the right eye image boundary in the figure) in the preset pixel allocation manner corresponding to the eyebox partition in which the left eye is located and a right fusion boundary in the two fusion boundaries (the left eye image boundary in the figure) in the adjusted pixel allocation manner corresponding to the left eye.

[0114] The target brightness information can be determined based on the brightness information of the fusion boundaries on the two sides of the to-be-identified display unit.

[0115] The target display unit is a display unit on the target fusion boundary.

[0116] The target pixel allocation manner matches the interpupillary distance of the target object.

[0117] In specific implementation, please refer to FIGS. 18-20, which respectively show three schematic diagrams of determining a target pixel allocation manner provided by an embodiment of the present application. As shown in FIG. 18, FIG. 18-1 is an adjusted pixel allocation manner, and FIG. 18-2 is a preset pixel allocation manner. The two pixel allocation manners are superimposed to obtain the target fusion boundary shown in FIG. 18-3, and the target pixel allocation manner shown in FIG. 18-3 is determined based on the target fusion boundary. As shown in FIG. 19, FIG. 19-1 is an adjusted pixel allocation manner, and FIG. 19-2 is a preset pixel allocation manner. The two pixel allocation manners are superimposed to obtain the target fusion boundary shown in FIG. 19-3, and the target pixel allocation manner shown in FIG. 19-3 is determined based on the target fusion boundary. As shown in FIG. 20, the adjusted pixel allocation manner corresponding to the left eye is superimposed with the preset pixel allocation manner corresponding to the eyebox partition in which the left eye is located to determine the target fusion boundary and obtain the target pixel allocation manner.

[0118] In a specific implementation, the target fusion boundary can be moved left or right on the image frame according to the movement speed of the two eyes, and the target fusion boundary f(x, y, x D ,y D ,z D ) can be updated in real time to update the target pixel allocation manner, so that users with different interpupillary distances can always see the images intended for the left eye with the left eye and the images intended for the right eye with the right eye even if the interpupillary distance changes. Here, (x, y) is the coordinate of the target fusion boundary, and (x D ,y D ,z D ) is the eye position coordinate.

[0119] Specifically, when the left and right eyes move in the x direction in the eyebox, the target fusion boundary is offset in the x direction in the image coordinate system, and the offset relationship is shown in formulas (1) and (2): △x=k1△x D +b1 (1) b1=k3△z D (2)

[0120] Here, △x represents the movement distance in different directions; k is a movement conversion coefficient, representing that the image moves k in the corresponding direction when it moves 1 unit in the x / y / z axis; △x D , △z D represent the movement distances of the eye positions read by the DMS in the x, y, and z directions.

[0121] As can be seen from the above technical solutions of the embodiments of the present application, the embodiments of the present application fuse the preset pixel allocation manner and the adjusted pixel allocation manner, determine the target fusion boundary according to the brightness information, and then obtain the target pixel allocation manner, so as to improve the imaging effect of the three-dimensional image and ensure that users with different interpupillary distances can watch the three-dimensional effect image in an ideal state.

[0122] In an exemplary embodiment, the fusion boundary is determined based on the brightness information of the display unit indicated by the initial pixel allocation manner; the target brightness information can be determined by the following steps:

[0123] determining the brightness information of the display unit corresponding to the fusion boundary in the preset pixel allocation manner to obtain first brightness information;

[0124] and determining the brightness information of the display unit corresponding to the fusion boundary in the adjusted pixel allocation manner to obtain second brightness information;

[0125] obtaining the target brightness information based on the average of the first brightness information and the second brightness information.

[0126] The first luminance information includes luminance information corresponding to each display unit on the fusion boundary in the preset pixel allocation mode, and indicates the luminance of the fusion boundary in the preset pixel allocation mode.

[0127] The second luminance information includes luminance information corresponding to each display unit on the fusion boundary in the adjusted pixel allocation mode, and indicates the luminance of the fusion boundary in the adjusted pixel allocation mode.

[0128] The target luminance information is a basis for determining the target fusion boundary.

[0129] For example, if the adjusted pixel allocation mode is 50%, and the first luminance information is 100%, the state of the intermediate value 75% can be taken as the target luminance information.

[0130] According to the above technical solution of the embodiment of the present application, the embodiment of the present application obtains the target luminance information by averaging the luminance information of the display unit corresponding to the fusion boundary in the preset pixel allocation mode and the luminance information of the display unit corresponding to the fusion boundary in the adjusted pixel allocation mode, and uses the target luminance information as a basis for determining the target fusion boundary, so as to determine the target pixel allocation mode matching the pupil distance of the target object, and further realize the ideal three-dimensional effect image display.

[0131] In an exemplary embodiment, the above step S1407 can further include the following steps:

[0132] The difference between the pupil distance of the target object and the standard pupil distance is sent to the user terminal, so that the user terminal returns the adjustment parameter for the preset pixel allocation mode;

[0133] The preset pixel allocation mode is adjusted based on the adjustment parameter to obtain the target pixel allocation mode.

[0134] Specifically, the target object interacts with the head-up display device through the user terminal.

[0135] In a specific implementation, the adjustment parameter can be set by the user according to experience, can be a tentative data proposed by the user, or can be a plurality of options displayed by the user terminal for the target object to select.

[0136] According to the above technical solution of the embodiment of the present application, the embodiment of the present application determines the adjustment parameter for the preset pixel allocation mode according to the difference between the pupil distance of the target object and the standard pupil distance by interacting with the user terminal, and then the head-up display device adjusts the preset pixel allocation mode according to the adjustment parameter provided by the target object, so as to determine the target pixel allocation mode that satisfies the user, and improve the user experience.

[0137] In an example embodiment, the step of adjusting the preset pixel allocation manner based on the adjustment parameter to obtain a target pixel allocation manner can include the following steps:

[0138] adjusting the preset pixel allocation manner based on the adjustment parameter to obtain a to-be-confirmed pixel allocation manner;

[0139] displaying the to-be-displayed image based on the to-be-confirmed pixel allocation manner, so that the light emitted by the display screen forms left-eye and right-eye virtual images after being split by the light-splitting element;

[0140] sending a virtual image definition confirmation request to the user terminal, so that the user terminal returns a confirmation result of the virtual image definition confirmation request; the confirmation result indicates whether the left-eye and right-eye virtual images are clear; in the case where the confirmation result indicates that the left-eye and right-eye virtual images are not clear, the confirmation result also indicates a re-adjustment parameter for the to-be-confirmed pixel allocation manner;

[0141] in the case where the confirmation result indicates that the left-eye and right-eye virtual images are not clear, adjusting the to-be-confirmed pixel allocation manner based on the re-adjustment parameter, displaying the to-be-displayed image based on the adjusted to-be-confirmed pixel allocation manner, updating the confirmation result, and determining the adjusted to-be-confirmed pixel allocation manner as the target pixel allocation manner when the updated confirmation result indicates that the left-eye and right-eye virtual images are clear.

[0142] The to-be-confirmed pixel allocation manner is a pixel allocation manner obtained by adjusting the preset pixel allocation manner according to the adjustment parameter returned by the user terminal, and needs to be confirmed by the user whether the three-dimensional effect image formed based on the pixel allocation manner is clear.

[0143] Specifically, if the confirmation result of the virtual image definition confirmation request returned by the user terminal indicates that the left-eye and right-eye virtual images are clear, the to-be-confirmed pixel allocation manner is determined as the target pixel allocation manner; if the confirmation result of the virtual image definition confirmation request returned by the user terminal indicates that the left-eye and right-eye virtual images are not clear, the to-be-confirmed pixel allocation manner is adjusted based on the re-adjustment parameter indicated by the confirmation result, and the adjusted to-be-confirmed pixel allocation manner is determined as the target pixel allocation manner when the confirmation result returned by the user terminal indicates that the left-eye and right-eye virtual images are clear.

[0144] As can be seen from the above technical solutions of the embodiments of the present application, the embodiments of the present application interact with the user terminal, the target object determines the adjustment parameter for the preset pixel allocation manner according to the difference between the interpupillary distance and the standard interpupillary distance, and then the head-up display device adjusts the preset pixel allocation manner according to the adjustment parameter provided by the target object and displays the display effect to the user, and continuously adjusts until the three-dimensional effect image seen by the user is clear, so that the target pixel allocation manner that satisfies the user can be determined, and the user experience is improved.

[0145] S1409, display the to-be-displayed image based on the target pixel distribution manner, so that the light emitted by the display screen forms left-eye virtual images and right-eye virtual images after being split by the light splitting element.

[0146] Specifically, the target pixel distribution manner matches the interpupillary distance of the target object, and when the eyes of the target object are in the target eye box partition, the to-be-displayed image is displayed based on the target pixel distribution manner. At this time, the left-eye virtual images formed by the light emitted by the display screen after being split by the light splitting element correspond to the images intended for the left eye of the target object, and are just seen by the left eye of the user. The right-eye virtual images formed by the light emitted by the display screen after being split by the light splitting element correspond to the images intended for the right eye of the target object, and are just seen by the right eye of the user.

[0147] As can be seen from the above technical solutions of the embodiments of the present application, the interpupillary distance of the target object is acquired in real time through communication connection with the eye recognition device, and the pixel distribution manner is adjusted in real time. The target pixel distribution manner obtained after adjustment matches the interpupillary distance of the target object, which ensures that users with different interpupillary distances can watch three-dimensional effect images in an ideal state. Even if the interpupillary distance of the user changes during the watching process, there is no need to worry about the decline of 3D experience quality, and the self-adaptation with the change of interpupillary distance is realized, and the immersion of the user is improved.

[0148] Corresponding to the image display method provided in the above several embodiments, the embodiments of the present application also provide an image display device. Since the image display device provided by the embodiments of the present application corresponds to the image display method provided by the above several embodiments, the implementation manner of the foregoing image display method is also applicable to the image display device provided by the present embodiment, which will not be described in detail in the present embodiment.

[0149] Please refer to FIG. 21, which shows a structural schematic diagram of an image display device provided by an embodiment of the present application. The device has the function of implementing the image display method in the above method embodiments, which can be realized by hardware or by executing corresponding software by hardware. The device is applied to a head-up display device, the head-up display device is in communication connection with an eye recognition device, and the head-up display device includes a display screen and a light splitting element; as shown in FIG. 21, the device can include:

[0150] The position acquisition module 2110 is configured to acquire the eye position information of the target object sent by the eye recognition device.

[0151] The information determination module 2120 is configured to determine the interpupillary distance of the target object and the eye box partition in which the eyes of the target object are located based on the eye position information, and obtain the target eye box partition.

[0152] The pupil distance judgment module 2130 is configured to judge whether the pupil distance of the target object meets a standard pupil distance.

[0153] The pixel distribution module 2140 is configured to, in the case that the judgment result is no, adjust a preset pixel distribution mode corresponding to the target eyebox partition based on the difference between the pupil distance of the target object and the standard pupil distance, to obtain a target pixel distribution mode. The display screen is provided with display units arranged in an array, each display unit corresponding to a sub-pixel in the to-be-displayed image. The preset pixel distribution mode is set based on the standard pupil distance, and indicates a correspondence between the display units and the sub-pixels of the to-be-displayed image.

[0154] The first image display module 2150 is configured to display the to-be-displayed image based on the target pixel distribution mode, so that light emitted by the display screen forms left-eye and right-eye virtual images after being split by the light splitting element.

[0155] In an example implementation, the pixel distribution module comprises:

[0156] The first pixel adjustment module is configured to adjust a preset pixel distribution mode corresponding to the target eyebox partition based on the difference between the pupil distance of the target object and the standard pupil distance, to obtain an adjusted pixel distribution mode.

[0157] The pixel fusion module is configured to fuse the preset pixel distribution mode and the adjusted pixel distribution mode, to obtain the target pixel distribution mode.

[0158] In an example implementation, the preset pixel distribution mode further indicates luminance information of each display unit; the preset pixel distribution mode corresponding to the eyebox partition is fused from an initial pixel distribution mode corresponding to the eyebox partition and an initial pixel distribution mode corresponding to an adjacent eyebox partition of the eyebox partition; the pixel fusion module comprises:

[0159] The pixel superposition module is configured to superimpose the preset pixel distribution mode and the adjusted pixel distribution mode, to obtain a to-be-processed pixel distribution mode.

[0160] The unit determination module is configured to determine, in the to-be-processed pixel distribution mode, a display unit between a fusion boundary in the preset pixel distribution mode and a fusion boundary in the adjusted pixel distribution mode, to obtain a to-be-identified display unit.

[0161] The target determination module is configured to, for each to-be-identified display unit, determine the display unit as a target display unit in the case that luminance information of the to-be-identified display unit in the to-be-processed pixel distribution mode matches target luminance information. The fusion boundary is a boundary between the initial pixel distribution mode corresponding to the eyebox partition and the initial pixel distribution mode corresponding to the adjacent eyebox partition of the eyebox partition in the preset pixel distribution mode corresponding to the eyebox partition.

[0162] The boundary fitting module is configured to fit the plurality of target display units to obtain a target fusion boundary.

[0163] The boundary coincidence module is configured to adjust the preset pixel distribution manner until the fusion boundary in the preset pixel distribution manner coincides with the target fusion boundary to obtain a target pixel distribution manner.

[0164] In an exemplary embodiment, the fusion boundary is determined based on luminance information of the display units indicated by the initial pixel distribution manner; the apparatus further comprises a target luminance module configured to determine target luminance information, the target luminance module comprising:

[0165] The luminance determination module is configured to determine luminance information of the display units corresponding to the fusion boundary in the preset pixel distribution manner to obtain first luminance information;

[0166] and determine luminance information of the display units corresponding to the fusion boundary in the adjusted pixel distribution manner to obtain second luminance information;

[0167] The luminance evaluation module is configured to evaluate an average value based on the first luminance information and the second luminance information to obtain the target luminance information.

[0168] In an exemplary embodiment, the pixel distribution module comprises:

[0169] The parameter acquisition module is configured to send a difference between the interpupillary distance of the target object and the standard interpupillary distance to the user terminal, so that the user terminal returns an adjustment parameter for the preset pixel distribution manner;

[0170] The second pixel adjustment module is configured to adjust the preset pixel distribution manner based on the adjustment parameter to obtain the target pixel distribution manner.

[0171] In an exemplary embodiment, the second pixel adjustment module comprises:

[0172] The third pixel adjustment module is configured to adjust the preset pixel distribution manner based on the adjustment parameter to obtain a to-be-confirmed pixel distribution manner.

[0173] The second image display module is configured to display the to-be-displayed image based on the to-be-confirmed pixel distribution manner, so that the light emitted by the display screen forms left-eye and right-eye virtual images after being split by the light splitting element;

[0174] The clarity confirmation module is configured to send a virtual image clarity confirmation request to the user terminal, so that the user terminal returns a confirmation result of the virtual image clarity confirmation request; the confirmation result indicates whether the left-eye and right-eye virtual images are clear; in the case where the confirmation result indicates that the left-eye and right-eye virtual images are not clear, the confirmation result further indicates a re-adjustment parameter for the to-be-confirmed pixel distribution manner;

[0175] The fourth pixel adjustment module is configured to, in a case where the confirmation result indicates that the left-eye virtual image and the right-eye virtual image are not clear, adjust the to-be-confirmed pixel allocation manner based on the re-adjustment parameter, display the to-be-displayed image based on the adjusted to-be-confirmed pixel allocation manner, update the confirmation result, and determine the adjusted to-be-confirmed pixel allocation manner as the target pixel allocation manner when the updated confirmation result indicates that the left-eye virtual image and the right-eye virtual image are clear.

[0176] In an example embodiment, the information determination module comprises:

[0177] The interpupillary distance determination module is configured to determine a distance between the two eyes of the target object in a horizontal direction based on the eye position information, to obtain an interpupillary distance of the target object.

[0178] It should be noted that the apparatus provided in the above embodiments, in realizing its functions, is only exemplified by the above division of functional modules, and in actual application, the above functions can be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the above-described functions. In addition, the apparatus and method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process is detailed in the method embodiments, which will not be repeated here.

[0179] The electronic device provided in the embodiments of the present application comprises a processor and a memory, and the memory stores at least one instruction or at least one program, which is loaded and executed by the processor to implement any one of the image display methods provided in the above method embodiments.

[0180] The memory can be used to store software programs and modules, and the processor executes various functional applications and data processing by running the software programs and modules stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, application programs required by functions, etc.; the data storage area can store data created according to the use of the device, etc. In addition, the memory can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state memory device. Accordingly, the memory can also include a memory controller to provide access of the processor to the memory.

[0181] The method embodiments provided by the embodiments of the present application can be executed in a computer terminal, a server or a similar computing device, that is, the electronic device can include the computer terminal, the server or the similar computing device. FIG. 22 is a hardware structure block diagram of a computer device running an image display method according to an embodiment of the present application. As shown in FIG. 22, the internal structure of the computer device can include but is not limited to a processor, a network interface and a memory. The processor, the network interface and the memory in the computer device can be connected through a bus or other means, and in the embodiment of the present application, the connection through the bus is taken as an example.

[0182] The processor (or CPU (Central Processing Unit)) is the computing core and the control core of the computer device. The network interface can optionally include a standard wired interface, a wireless interface (such as WI-FI, a mobile communication interface, etc.). The memory is a memory device in the computer device, used for storing programs and data. It can be understood that the memory here can be a high-speed RAM memory device, or a non-volatile memory, for example, at least one disk storage device; optionally, it can also be at least one storage device located away from the aforementioned processor. The memory provides a storage space that stores the operating system of the electronic device, which can include but is not limited to a Windows system (an operating system), a Linux (an operating system), an Android (a mobile operating system) system, an IOS (a mobile operating system) system, etc., and the present application does not limit this; and in the storage space, one or more instructions suitable for being loaded and executed by the processor are also stored, and these instructions can be one or more computer programs (including program codes). In the embodiment of the present application, the processor loads and executes one or more instructions stored in the memory to implement the image display method provided by the method embodiments.

[0183] The embodiments of the present application also provide a computer readable storage medium, which can be arranged in an electronic device to save at least one instruction or at least one program related to an image display method, and the at least one instruction or the at least one program is loaded and executed by the processor to implement any one of the image display methods provided by the method embodiments.

[0184] Optionally, in the embodiment, the storage medium can include, but is not limited to, a U disk, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and various media that can store program codes.

[0185] It should be noted that the above-mentioned order of the embodiments of the present application is only for description, and does not represent the advantages and disadvantages of the embodiments. The above-mentioned specific embodiments of the present application are described. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multi-task processing and parallel processing are possible or can be advantageous.

[0186] Each of the embodiments in the specification is described in a progressive manner, and the same or similar parts between each embodiment can be referred to each other. Each embodiment focuses on the difference from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the part of the method embodiment.

[0187] A person of ordinary skill in the art can understand that all or part of the steps of the above-mentioned embodiments can be completed by hardware, or by program to instruct relevant hardware to complete, and the program can be stored in a computer readable storage medium. The storage medium mentioned above can be a read-only memory, a magnetic disk or an optical disk.

Claims

1. An image display method applied to a head-up display device, the head-up display device being communicatively connected with an eye recognition device, the head-up display device comprising a display screen and a light splitting element; the method comprising: obtaining eye position information of a target object sent by the eye recognition device; determining a pupillary distance of the target object and an eye box partition in which eyes of the target object are located based on the eye position information, to obtain a target eye box partition; determining whether the pupillary distance of the target object conforms to a standard pupillary distance; in a case where the determination result is no, adjusting a preset pixel allocation mode corresponding to the target eye box partition based on a difference between the pupillary distance of the target object and the standard pupillary distance, to obtain a target pixel allocation mode; the display screen is provided with display units arranged in an array, and each display unit corresponds to a sub-pixel in a to-be-displayed image; the preset pixel allocation mode is set based on the standard pupillary distance, and indicates a correspondence between the display units and the sub-pixels of the to-be-displayed image; displaying the to-be-displayed image based on the target pixel allocation mode, so that light emitted by the display screen forms left-eye virtual images and right-eye virtual images after being split by the light splitting element.

2. The image display method according to claim 1, wherein The adjusting of the preset pixel allocation mode corresponding to the target eye box partition based on the difference between the pupillary distance of the target object and the standard pupillary distance, to obtain the target pixel allocation mode, comprises: adjusting the preset pixel allocation mode corresponding to the target eye box partition based on the difference between the pupillary distance of the target object and the standard pupillary distance, to obtain an adjusted pixel allocation mode; fusing the preset pixel allocation mode and the adjusted pixel allocation mode to obtain the target pixel allocation mode.

3. The image display method according to claim 2, wherein The preset pixel allocation mode further indicates luminance information of each display unit; the preset pixel allocation mode corresponding to the eye box partition is formed by fusing an initial pixel allocation mode corresponding to the eye box partition and an initial pixel allocation mode corresponding to a neighboring eye box partition of the eye box partition; the fusing of the preset pixel allocation mode and the adjusted pixel allocation mode to obtain the target pixel allocation mode comprises: superimposing the preset pixel allocation mode and the adjusted pixel allocation mode to obtain a to-be-processed pixel allocation mode; in the to-be-processed pixel allocation mode, determining display units between a fusion boundary in the preset pixel allocation mode and a fusion boundary in the adjusted pixel allocation mode, to obtain to-be-identified display units; for each to-be-identified display unit, in a case where luminance information of the to-be-identified display unit in the to-be-processed pixel allocation mode matches target luminance information, determining that the display unit is a target display unit; the fusion boundary is a boundary between the initial pixel allocation mode corresponding to the eye box partition and the initial pixel allocation mode corresponding to the neighboring eye box partition of the eye box partition in the preset pixel allocation mode corresponding to the eye box partition; fitting a plurality of target display units to obtain a target fusion boundary; adjust the preset pixel allocation mode until a fusion boundary in the preset pixel allocation mode coincides with the target fusion boundary, to obtain the target pixel allocation mode.

4. The image display method according to claim 3, wherein The fusion boundary is determined based on luminance information of the display unit indicated by the initial pixel allocation mode; and the method further comprises: determining luminance information of the display unit corresponding to the fusion boundary in the preset pixel allocation mode, to obtain first luminance information; determining luminance information of the display unit corresponding to the fusion boundary in the adjusted pixel allocation mode, to obtain second luminance information; and calculating an average value based on the first luminance information and the second luminance information, to obtain the target luminance information.

5. The image display method according to claim 1, wherein The adjusting the preset pixel allocation mode corresponding to the target eyebox partition based on the difference between the interpupillary distance of the target object and the standard interpupillary distance comprises: sending the difference between the interpupillary distance of the target object and the standard interpupillary distance to a user terminal, so that the user terminal returns an adjustment parameter for the preset pixel allocation mode; adjusting the preset pixel allocation mode based on the adjustment parameter, to obtain the target pixel allocation mode.

6. The image display method according to claim 5, wherein The adjusting the preset pixel allocation mode based on the adjustment parameter, to obtain the target pixel allocation mode comprises: adjusting the preset pixel allocation mode based on the adjustment parameter, to obtain a pixel allocation mode to be confirmed; displaying the to-be-displayed image based on the pixel allocation mode to be confirmed, so that light emitted by the display screen forms left-eye virtual images and right-eye virtual images after being split by the light-splitting element; sending a virtual image definition confirmation request to the user terminal, so that the user terminal returns a confirmation result of the virtual image definition confirmation request; the confirmation result indicates whether the left-eye virtual images and the right-eye virtual images are clear; in a case where the confirmation result indicates that the left-eye virtual images and the right-eye virtual images are not clear, the confirmation result further indicates a re-adjustment parameter for the pixel allocation mode to be confirmed; in a case where the confirmation result indicates that the left-eye virtual images and the right-eye virtual images are not clear, adjusting the pixel allocation mode to be confirmed based on the re-adjustment parameter, displaying the to-be-displayed image based on the adjusted pixel allocation mode to be confirmed, updating the confirmation result, and determining the adjusted pixel allocation mode to be confirmed as the target pixel allocation mode when the updated confirmation result indicates that the left-eye virtual images and the right-eye virtual images are clear.

7. The image display method according to claim 1, wherein The determining the interpupillary distance of the target object based on the eye position information comprises: determining a distance between two eyes of the target object in a horizontal direction based on the eye position information, to obtain the interpupillary distance of the target object. 8.An image display device applied to a head-up display device, the head-up display device being communicatively connected to an eye recognition device, the head-up display device comprising a display screen and a light-splitting element; the device comprising: an eye position information acquisition module configured to acquire eye position information of a target object sent by the eye recognition device; The information determining module is configured to determine a pupillary distance of the target object and an eye box partition in which eyes of the target object are located based on the eye position information, and obtain a target eye box partition. The pupillary distance determining module is configured to determine whether the pupillary distance of the target object conforms to a standard pupillary distance. The pixel assigning module is configured to, in a case where the determination result is no, adjust a preset pixel assigning mode corresponding to the target eye box partition based on a difference between the pupillary distance of the target object and the standard pupillary distance, and obtain a target pixel assigning mode; and each display unit of the display screen is arranged in an array and corresponds to a sub-pixel in the to-be-displayed image. The preset pixel assigning mode is set based on the standard pupillary distance and indicates a corresponding relationship between the display unit and the sub-pixel of the to-be-displayed image. The first image display module is configured to display the to-be-displayed image based on the target pixel assigning mode, so that light emitted by the display screen forms left-eye virtual images and right-eye virtual images after being split by the light splitting element.

9. An electronic device, comprising a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded and executed by the processor to implement the image display method according to any one of claims 1-7.

10. A computer readable storage medium, wherein the storage medium stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded and executed by a processor to implement the image display method according to any one of claims 1-7.

Images