Image display method and device, electronic equipment and storage medium
By communicating and connecting with the eye recognition device, the eye box partition is updated in real time and the image is displayed, which solves the crosstalk problem of head-up display devices in dynamic environments, and improves the driver's judgment and response speed of road conditions.
Patent Information
- Application Number
- CN202410880161.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-02
- Publication Date
- 2024-11-12
AI Technical Summary
In dynamic environments, especially in complex and changing driving situations, existing head-up display devices are difficult to effectively eliminate crosstalk between users' eyes, affecting the driver's accurate judgment and response speed of road conditions.
Through communication and connection with the eye recognition device, the eye position information of the target object is obtained in real time, the eye box partition is updated, and the images to be displayed are displayed on the display screen to ensure that the light emitted by the display screen passes through the spectrometer and forms a virtual image of the left eye. The right eye is virtually image to avoid crosstalk.
It realizes that the three-dimensional effect images are always provided in the ideal state when the eye position changes, which improves the driver's judgment and response speed on road conditions, and provides strong guarantees for driving safety.
Smart Images

Figure CN118938481A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of head-up display technology, and in particular to an image display method, device, electronic device and storage medium. Background Art
[0002] Naked-eye 3D (3-dimension) display technology refers to a 3D display technology that allows users to directly watch three-dimensional images with their naked eyes without wearing special 3D glasses, presenting a 3D effect. For example, by setting a slit grating or a cylindrical grating in front of the display screen, the light emitted by the display screen is split by the slit grating or the cylindrical grating, and then refracted by the imaging structure to enter the driver's left eye and right eye respectively. The driver's left eye and right eye see different images, forming binocular parallax, and synthesizing a three-dimensional picture with a sense of depth in the user's brain to achieve a 3D viewing experience. However, the head-up display (HUD) itself is a non-uniform system with distortion or processing tolerances. Even if the pixel spacing and the grating design are uniform, there will still be certain differences, resulting in translation, tilt, distortion and other problems in the image seen by the human eye; for example, crosstalk occurs between the images seen by the user's left eye and right eye.
[0003] When dealing with the crosstalk problem of head-up displays, existing technologies are mainly optimized for static scenes. That is, when the user's eyes are located in the preset eye box partition and remain relatively still, the system can effectively correct the corresponding visible area in the display screen to eliminate image crosstalk and ensure that the user has a clear and undisturbed visual experience. However, this solution faces severe challenges in dynamic environments, especially in complex and changeable driving scenarios.
[0004] In actual driving, the user's action state is highly dynamic and multi-dimensional, which means that the position of the user's eyes changes frequently. This dynamic change makes it difficult to accurately maintain the correspondence between the pre-set eye box partitions and the preset visual area. Once the user's eyes exceed the original preset range or move quickly, the original crosstalk correction mechanism may fail, causing the left and right eyes to begin to receive the image information that the other eye should receive, that is, crosstalk occurs, affecting the driver's accurate judgment and reaction speed of road conditions. Summary of the invention
[0005] In order to solve the problems of the prior art, the embodiments of the present application provide an image display method, device, electronic device and storage medium. The technical solution is as follows:
[0006] In one aspect, an image display method is provided, which is applied to a head-up display device, wherein the head-up display device is communicatively connected to an eye recognition device, and the head-up display device includes a display screen and a light splitting element; the method includes:
[0007] Acquire current eye position information of the target object sent by the eye recognition device in a current cycle, wherein the current eye position information includes a current left eye position and a current right eye position;
[0008] Based on the current eye position information, it is determined whether the eyes of the target object are beyond the current eye box partition; the current eye box partition is determined based on the eye position information of the target object in the previous cycle, and the current eye box partition includes a left eye box partition and a right eye box partition;
[0009] If the result of the judgment is yes, updating the current eye box partition based on the current eye position information;
[0010] Based on the visible area corresponding to the left eye box partition in the updated current eye box partition in the display screen, and the visible area corresponding to the right eye box partition in the updated current eye box partition in the display screen, the images to be displayed are respectively displayed, so that the light emitted from the display screen forms a left eye virtual image and a right eye virtual image after being split by the splitting element; the visible area is provided with display units distributed in an array, and each of the display units corresponds to displaying a sub-pixel in the image to be displayed.
[0011] On the other hand, an image display device is provided, which is applied to a head-up display device, wherein the head-up display device is communicatively connected to an eye recognition device, and the head-up display device includes a display screen and a light splitting element; the device includes:
[0012] A position acquisition module, used to acquire current eye position information of the target object sent by the eye recognition device in a current cycle, wherein the current eye position information includes a current left eye position and a current right eye position;
[0013] A position determination module, configured to determine whether the eyes of the target object are beyond a current eye box partition based on the current eye position information; the current eye box partition is determined based on the eye position information of the target object in the previous cycle, and the current eye box partition includes a left eye box partition and a right eye box partition;
[0014] An eye box updating module, configured to update the current eye box partition based on the current eye position information if the result of the judgment is yes;
[0015] An image display module is used to display the images to be displayed based on the visible area corresponding to the left eye box partition in the updated current eye box partition in the display screen, and the visible area corresponding to the right eye box partition in the updated current eye box partition in the display screen, so that the light emitted by the display screen forms a left eye virtual image and a right eye virtual image after being split by the splitting element; the visible area is provided with display units distributed in an array, and each of the display units corresponds to displaying a sub-pixel in the image to be displayed.
[0016] In an exemplary embodiment, the visible area corresponding to the eye box partition in the display screen is formed by merging the preset visible area corresponding to the eye box partition in the display screen and the preset visible area corresponding to the adjacent eye box partition of the eye box partition in the display screen; the device also includes a pixel adjustment module for adjusting the sub-pixels corresponding to the display unit in the visible area corresponding to the eye box partition where the target eye is located in the display screen when the target object's eye does not exceed the current eye box partition, and the pixel adjustment module includes:
[0017] A target determination module, for determining, when the result of the determination is no, the position information of the current eye position information that does not exceed the current eye box partition, and obtaining the target eye and the target eye position;
[0018] A first boundary moving module is used to move a fusion boundary of an eye box partition where the target eye is located in a visible area corresponding to the display screen based on the target eye position, so that the sub-pixels corresponding to the display unit in the visible area are switched as the fusion boundary moves; the fusion boundary is a boundary between a preset visible area corresponding to the eye box partition in the display screen and a preset visible area corresponding to an adjacent eye box partition of the eye box partition in the display screen in the visible area corresponding to the eye box partition in the display screen.
[0019] In an exemplary embodiment, the first boundary movement module includes:
[0020] a change rate determination module, configured to determine a change rate of the target eye position based on the target eye position and an eye position of the target eye corresponding to the previous cycle;
[0021] A second boundary movement module is used to move the fusion boundary of the eye box partition where the target eye is located in the visible area corresponding to the display screen based on the target eye position and the change rate of the target eye position, so that the sub-pixels corresponding to the display unit in the visible area are switched as the fusion boundary moves.
[0022] In an exemplary embodiment, the position determination module includes:
[0023] A range determination module is used to determine whether the eyes of the target object are beyond the spatial range corresponding to the current eye box partition based on the current eye position information.
[0024] In an exemplary embodiment, the apparatus further includes a first range determination module for determining a spatial range corresponding to each eye box partition, the first range determination module including:
[0025] A sampling point determination module, configured to determine, for each eye box partition, a plurality of target sampling points corresponding to the eye box partition based on a preset sampling density;
[0026] A sample display module, used for displaying a sample image in a visible area corresponding to the eye box partition in the display screen;
[0027] A virtual image acquisition module, used for acquiring virtual images at each target sampling point;
[0028] A target virtual image module, used to determine a virtual image having a crosstalk phenomenon in a virtual image corresponding to each target sampling point among the multiple target sampling points, and obtain multiple target virtual images;
[0029] The boundary determination module is used to determine the boundary points corresponding to the eye box partition based on the relative position relationship between the target sampling points corresponding to each target virtual image in the multiple target virtual images; the boundary points corresponding to the eye box partition enclose the space range corresponding to the eye box partition.
[0030] In an exemplary embodiment, the visible area corresponding to the eye box partition in the display screen is obtained based on the correction of the preset visible area corresponding to the key point in the eye box partition in the display screen; the device also includes a second range determination module for determining the spatial range corresponding to each eye box partition, and the second range determination module includes:
[0031] An adjacent determination module, configured to determine, for each eye box partition in a plurality of continuously distributed eye box partitions, a plurality of adjacent eye box partitions corresponding to the eye box partition;
[0032] A boundary point determination module, for determining, for each adjacent eye box partition, a midpoint between a key point in the eye box partition and a key point in the adjacent eye box partition, to obtain a boundary point;
[0033] The boundary fitting module is used to fit the boundary points corresponding to each adjacent eye box partition in the plurality of adjacent eye box partitions to obtain the spatial range corresponding to the eye box partition.
[0034] On the other hand, an electronic device is provided, including a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded and executed by the processor to implement the image display method of any of the above aspects.
[0035] On the other hand, a computer-readable storage medium is provided, in which at least one instruction or at least one program is stored, and the at least one instruction or the at least one program is loaded and executed by a processor to implement an image display method as described in any of the above aspects.
[0036] On the other hand, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the electronic device performs the image display method of any of the above aspects.
[0037] The embodiment of the present application establishes a communication connection with an eye recognition device to obtain the current eye position information of the target object in the current cycle; determines whether the eyes of the target object are beyond the current eye box partition based on the current eye position information; the current eye box partition is determined based on the eye position information of the target object in the previous cycle; if the result of the judgment is yes, the current eye box partition is updated based on the current eye position information; the image to be displayed is displayed based on the visual area corresponding to the updated left eye box partition in the display screen, and the visual area corresponding to the updated right eye box partition in the display screen, so that the light emitted by the display screen forms a left eye virtual image and a right eye virtual image after being split by the splitting element. By obtaining the eye position of the target object in real time, the eye box partition where the eye of the target object is located is updated in real time, and the image to be displayed is displayed based on the visual area corresponding to the updated eye box partition in the display screen, ensuring that the user can always see the three-dimensional effect image in the ideal state even if the eye position changes, and can always avoid crosstalk, thereby improving the driver's judgment and reaction speed on road conditions, and providing a strong guarantee for driving safety. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0039] Figure 1 is a schematic diagram of an application environment of a head-up display device provided in an embodiment of the present application;
[0040] Figure 2 is a schematic diagram of the principle of a head-up display device provided in an embodiment of the present application;
[0041] Figure 3 It is a schematic diagram of the principle of naked-eye 3D provided by an embodiment of the present application;
[0042] Figure 4 is a schematic diagram of a first pixel distribution provided in an embodiment of the present application;
[0043] Figure 5 is a schematic diagram of a second pixel distribution provided in an embodiment of the present application;
[0044] Figure 6 is a schematic diagram of a third pixel distribution provided in an embodiment of the present application;
[0045] Figure 7 is a schematic diagram of a fourth pixel distribution provided in an embodiment of the present application;
[0046] Figure 8 It is a schematic diagram of an implementation environment of a method for determining a visible area provided in an embodiment of the present application;
[0047] Fig. 9 is a schematic diagram of a method for determining a visible area provided in an embodiment of the present application;
[0048] Fig.10 This is a schematic diagram of eye box partitions provided in an embodiment of the present application;
[0049] Fig.11 is a schematic diagram of a change of a virtual image provided by an embodiment of the present application;
[0050] Fig.12 It is a schematic diagram of an implementation environment of an image display method provided in an embodiment of the present application;
[0051] Fig.13 It is a flowchart of an image display method provided in an embodiment of the present application;
[0052] Fig.14 It is a schematic diagram of a virtual image corresponding to an eye box partition provided in an embodiment of the present application;
[0053] Fig.15 It is a schematic diagram of the principle of an image display method provided in an embodiment of the present application;
[0054] Fig.16 is a schematic diagram of another virtual image change provided by an embodiment of the present application;
[0055] Fig.17 It is a schematic diagram of the principle of another image display method provided in an embodiment of the present application;
[0056] Fig.18 It is a schematic diagram of the principle of the first method for moving the fusion boundary provided in the embodiment of the present application;
[0057] Fig.19 is a schematic diagram of the principle of the second method for moving the fusion boundary provided in an embodiment of the present application;
[0058] Fig. 20 is a schematic diagram of the principle of the third method for moving the fusion boundary provided in the embodiment of the present application;
[0059] Fig.21 is a structural block diagram of an image display device provided in an embodiment of the present application;
[0060] Fig. 22 It is a hardware structure block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0061] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.
[0062] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0063] It is understandable that in the specific implementation of this application, related data such as user information is involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.
[0064] See also Figure 1, which shows a schematic diagram of the application environment of a head-up display device provided by an embodiment of the present application. The head-up display device can be used in automobiles as a driving assistance instrument, and can also be applied to other vehicles, such as airplanes, high-speed railways, etc. The following will take the vehicle-mounted HUD as an example to introduce the technical solution of the present application. Through the image display method of the embodiment of the present application, the HUD can clearly and accurately project the vehicle speed, navigation information, warning information, etc. in the form of images and characters through optical components in front of the driver, forming a virtual image with a three-dimensional effect in front of the driver's line of sight, and has a good imaging effect.
[0065] See also Figure 2 , which is a schematic diagram of the principle of a head-up display device provided by an embodiment of the present application. The 3DHUD includes an image generation unit, a cylindrical lens grating (or a slit grating) attached to the image generation unit, and a reflector assembly. The image generation unit is composed of an LCD (Liquid Crystal Display) and a backlight. The reflector assembly may include multiple reflectors, such as Figure 2 As shown, the figure includes a reflector 1 and a reflector 2, wherein the reflector 1 may be a plane mirror or a free-surface curved mirror, and the reflector 2 may be a free-surface curved mirror. When implementing 3D HUD, the outgoing light of the image generation unit is limited by the cylindrical grating (or slit grating), and the outgoing angles are different to achieve light splitting; the light emitted by the cylindrical grating (or slit grating) is refracted by the reflector assembly and the windshield of the vehicle in turn, and then enters the left eye and the right eye of the user respectively, and the images seen by the left eye and the right eye of the user are different.
[0066] See also Figure 3 , which is a schematic diagram of the principle of a naked-eye 3D provided by an embodiment of the present application. By optically designing the HUD, the user's left eye sees image P1 and the right eye sees image P2. Image P1 and image P2 can be synthesized into a three-dimensional picture with a sense of depth in the user's brain; by changing the position between the two images and adjusting the binocular parallax, the virtual image distance subjectively felt by the user can change (in fact, the virtual image distance remains unchanged). The closer the two images are, the closer the virtual image distance subjectively felt by the user; conversely, the farther the two images are, the farther the virtual image distance subjectively felt by the user.
[0067] See also Figure 4 , which is a schematic diagram of the first pixel distribution provided in the embodiment of the present application, such as Figure 4-1 As shown in FIG. 1 , the sub-pixel distribution of the image itself is shown. The four sub-pixels A1a to A1d correspond to the white image (L) viewed by the left eye, and the other four sub-pixels correspond to the black image (R) viewed by the right eye. The light emitted from the four sub-pixels corresponds to only one eye box partition, which can meet the requirement of uniform brightness required by the left eye. Figure 4-2As shown, the case where the cylindrical grating (or slit grating) and the display screen are relatively tilted is used for explanation. The tilt angle of the grating is arctan (1 / 3), so that the grating when tilted matches the aspect ratio of its sub-pixel. The diagonal line of a certain sub-pixel is tilted to determine the distribution position of the pixel relative to the tilt of the grating. According to the distribution position, the image displayed by the image generation unit of the HUD is determined. However, because the entire grating area is tilted to the right, if the integrity of the image on the display screen viewed by the user's eyes is required, it can be seen that Figure 4-2 The sub-pixels in row A2 are shifted right by one sub-pixel relative to row A1, that is, the area seen by the left eye moves by one sub-pixel on the display screen when the spatial position relative to the display screen changes by one line. That is, the tilted pixels need to be shifted right by one sub-pixel for each upward row, and shifted left by one sub-pixel for each downward row, so that the left eye always sees the left image and the right eye always sees the right image when the human eye is viewing.
[0068] See also Figure 5-7 , which shows a schematic diagram of a second pixel distribution, a schematic diagram of a third pixel distribution, and a schematic diagram of a fourth pixel distribution provided in an embodiment of the present application, wherein Figure 5The sub-pixel distribution mode and position of the image itself are shown. In order to ensure that the left eye of the human eye must see the complete left image and the right eye must see the complete right image, this effect is achieved by changing the distribution mode of the sub-pixels on the display screen. Specifically, due to the different positions of the 8 sub-pixels, the light emitted by the sub-pixels into the eye box corresponds to different eye box partitions, and the image content information viewed by the human eye will be different. The sub-pixel distribution situation corresponds to the image displayed by the HUD one by one, and 8 images with different 8-sub-pixel distribution situations can be obtained. These 8 images are the results of making the user's left and right eyes see pure white / pure black images at different positions in the eye box. One image corresponds to a sub-pixel distribution state. If these 8 sub-pixels correspond to the 8 positions S1-S8 respectively, the 8 positions of the 8 sub-pixels S1-S8 (that is, the positions of the light emitted by the sub-pixels on the display screen) will be periodically arranged with the image top starting point L1 as the sub-pixel distribution arrangement, wherein, with the image top starting point pixel L1 as the reference center, when the starting point L1 is at any position S1-S8 on the LCD screen, the sub-pixel distribution arrangement is different. For example, when the starting point L1 is at position S1, its sub-pixel distribution state is L1, L2, L3, L4, R1, R2, R3, R4, which is the first sub-pixel distribution state; when the starting point L1 is at position S2, its sub-pixel distribution state is R4, L1, L2, L3, L4, R1, R2, R3, which is the second distribution state; when the starting point is at the other 6 positions (S3-S8), its sub-pixel distribution state is analogous. That is, the starting point position with a certain sub-pixel as the reference is changed from the pixel. With respect to the lenticular grating (or slit grating) attached to the display screen, the corresponding light distribution will also move after the relative position of the sub-pixel changes, and the corresponding left and right eyes of the human eye can see different white / black areas at different positions in the eye box. From the image level, it is equivalent to that the pixels on these 8 different image frames need to be moved one sub-pixel to the left for each row up, and one sub-pixel to the right for each row down. That is, because the left and right eyes can only see pure white / pure black image effects at a certain position in the eye box, if the human eye moves to the left or right, the image needs to be switched, and the distribution state of the remaining sub-pixels can be changed to ensure that the left eye sees a white image and the right eye sees a black image. For details, refer to Figure 7 , is a schematic diagram of the specific arrangement of images in 8 states, L is the white image area viewed by the left eye, and R is the black image area viewed by the right eye.
[0069] See also Figure 8 , which is a schematic diagram of the implementation environment of a method for determining a visible area provided by an embodiment of the present application. If a camera is placed at the center of the eye box partition to capture an actual performance of an image of the distribution state of 8 sub-pixels, Figure 7Taking the sub-pixel distribution of state 4 in the example, a white image is given to the left eye. In theory, the center position of this eye box partition is the best observation position for the user's human eye. The user's left eye can see a completely white image with uniform image brightness. Taking the pupil distance interval of 60-70mm as an example, the corresponding right eye sees a completely black image with uniform image brightness in the corresponding complementary area (state 8). The actual image captured represents the virtual image seen by the human eye in the eye box partition through the HUD's spectroscopic element. However, due to the non-uniformity of the HUD, when the human eye is at the center position of the eye box partition, the human eye cannot fully see the pure black or pure white situation, but a little white in the lower left and upper right, a little black, or even a gradual change from black to gray to white. This effect is precisely because the black and white display of the image is not complete due to HUD distortion or processing tolerance, that is, the left eye cannot fully see the pure white image of the left eye, but a little pure black image of the right eye, that is, the crosstalk phenomenon. The above crosstalk phenomenon occurs not only at the center position 5 of the HUD eye box partition, but also at the rest of the eye box partition.
[0070] See also Fig. 9 , which is a schematic diagram of a method for determining a visible area provided by an embodiment of the present application. Assuming that the eye box is divided into 8 sub-areas, e1 to e8, the virtual images shown in states 1, 2, 3, and 4, for e3, an actual performance picture of the sub-pixel allocation state is taken at e3, and an actual performance picture of the sub-pixel allocation state is taken at its adjacent e1, e2, and e4, and these four virtual images are fused as the virtual image seen at e3, which is converted to the coordinate system of the display screen to obtain the visible area corresponding to e3 in the display screen. Please refer to Fig.10 , which shows a schematic diagram of eye box partition provided by an embodiment of the present application. Since the user's action state will not move only on one plane, the position of the eyes will also change with the change of the user's action state. Therefore, when defining the eye box in the naked eye 3D technology, the eye box is expanded in three dimensions, that is, a z-axis is added on the basis of the existing planar eye box to define the forward and backward movement of the user's eyes. In the specific implementation, the usual eye box size is 130mm*50mm, which is now expanded to 130mm*50mm*the width range of the forward and backward movement of the eyes. Specifically, taking a face with a length and width of 130mm*50mm as an example, there are 9 eye position shooting reference points, and 9 eye position shooting reference points are also taken on the front and rear two faces, that is, there are 27 eye position shooting reference points on an eye box. Specifically, when determining the visible area, the camera is placed at multiple positions in the eye box of the HUD system. The camera shoots the actual performance of the 8-seed pixel distribution state image at the same position, and 27*8 pictures will be obtained. The captured image represents the virtual image seen by the human eye through the eye box where the HUD's spectroscopic element is located.
[0071] See also Fig.11 , which is a schematic diagram of the change of a virtual image provided by an embodiment of the present application. Taking shooting at C5 camera position and C6 camera position as an example, if 4 images are captured from C5 camera position to C6 camera position (equivalent to the user's right eye moving from C5 position to C6 position), the image boundary after brightness extraction remains unchanged, and the 4 images captured at C5 camera position can be combined into a pure black image based on the boundary. However, when the human eye moves to the right, the black and white stripes on the 4 images at C6 camera position move regularly with the movement of the human eye. When moving to a certain image, the black / white stripes will exceed the extracted boundary, and the photos captured at C6 camera position cannot be combined into a pure black image based on the fixed boundary.
[0072] In view of this, the present application provides an image display method, which is applied to a head-up display device, the head-up display device is communicatively connected with an eye recognition device, and the head-up display device includes a display screen and a light splitting element. Fig.12 , which is a schematic diagram of the implementation environment of an image display method provided in an embodiment of the present application. The eye recognition device can be specifically set to a DMS (Driver Monitoring System). The installation position of the DMS is not specifically limited in the present application. It is required that the DMS can be rigidly fixed between the human eye and the front windshield, does not block the human eye's line of sight, and will not be blocked by the steering wheel or body posture during driving.
[0073] See also Fig.13 , which shows a flow chart of an image display method provided by an embodiment of the present application. It should be noted that this specification provides method operation steps such as the embodiments or flow charts, but may include more or fewer operation steps based on conventional or non-creative labor. The order of steps listed in the embodiments is only one way of executing the steps among many orders, and does not represent the only execution order. When the actual system or product is executed, it can be executed in sequence or in parallel according to the methods shown in the embodiments or drawings (for example, in a parallel processor or multi-threaded processing environment). Specifically, the method is applied to a head-up display device, which is communicatively connected to an eye recognition device, and the head-up display device includes a display screen and a spectroscopic element; such as Fig.13 As shown, the method may include:
[0074] S1301, obtaining current eye position information of the target object sent by the eye recognition device in the current cycle.
[0075] The current cycle is a cycle for detecting the eye position of the target object. Specifically, during the operation of the head-up display device, the eye recognition device detects the eye position of the target object periodically and sends it to the head-up display device.
[0076] The target object is the user who is currently using the head-up display device.
[0077] The current eye position information includes the current left eye position and the current right eye position. Specifically, the current left eye position is the coordinate information corresponding to the left eye of the target object, and the current right eye position is the coordinate information corresponding to the right eye of the target object.
[0078] S1303: Determine whether the eyes of the target object are beyond the current eye box partition based on the current eye position information.
[0079] Specifically, if the result of the judgment is no, step S1305 can be executed; otherwise, if the result of the judgment is yes, step S1309 can be executed.
[0080] The current eye box partition is determined based on the eye position information of the target object in the previous cycle, and the current eye box partition includes a left eye box partition and a right eye box partition. Specifically, the left eye box partition is the eye box partition where the left eye of the target object is located, and the right eye box partition is the eye box partition where the right eye of the target object is located.
[0081] Specifically, it is determined whether the left eye of the target object exceeds the left eye box partition according to the current left eye position, and it is determined whether the left eye of the target object exceeds the right eye box partition according to the current right eye position.
[0082] Specifically, if the eyes of the target object are beyond the current eye box partition, the eye box partition where the eyes of the target object are located is re-determined according to the current eye position information; if the eyes of the target object are not beyond the current eye box partition, the sub-pixels corresponding to the display units in the visible area corresponding to the current eye box partition in the display screen are adjusted according to the current eye position information.
[0083] In an exemplary implementation, the above step S1303 may include the following steps:
[0084] Based on the current eye position information, it is determined whether the eyes of the target object are beyond the spatial range corresponding to the current eye box partition.
[0085] Specifically, when an eye is within the spatial range corresponding to the eye box partition, crosstalk will not occur when an image to be seen by the eye is displayed in a visible area corresponding to the eye box partition in the display screen.
[0086] In a specific implementation, each eye box partition corresponds to a visible area on the display screen. Figures 8-9Specifically, for the preset visible area corresponding to each eye box partition in the display screen, the preset visible area corresponding to the adjacent eye box partition in the display screen is used for adjustment, thereby optimizing the display effect of the head-up display device, so that the user's eyes can achieve the effect of the left eye seeing the image intended for the left eye and the right eye seeing the image intended for the right eye at any position of the eye box, thereby avoiding crosstalk.
[0087] It can be seen from the above technical solutions of the embodiments of the present application that the embodiments of the present application limit the specific spatial range corresponding to the eye box partition to facilitate the judgment of whether the user's eyes are beyond the current eye box partition and whether the eye box partition needs to be re-determined.
[0088] In an exemplary embodiment, the spatial range corresponding to the eye box partitions can be determined by the following steps:
[0089] For each eye box partition, determining a plurality of target sampling points corresponding to the eye box partition based on a preset sampling density;
[0090] Displaying the sample image in a corresponding visible area of the display screen based on the eye box partition;
[0091] Collect virtual images at each target sampling point respectively;
[0092] Determine a virtual image having a crosstalk phenomenon in a virtual image corresponding to each target sampling point among a plurality of target sampling points, and obtain a plurality of target virtual images;
[0093] Based on the relative position relationship between the target sampling points corresponding to each target virtual image in the multiple target virtual images, the boundary points corresponding to the eye box partition are determined; the boundary points corresponding to the eye box partition are enclosed to form a spatial range corresponding to the eye box partition.
[0094] The preset sampling density indicates the number of target sampling points in an eye box partition.
[0095] The target virtual image is a virtual image with crosstalk.
[0096] Specifically, the image seen by the eyes is used as the basis for determination, that is, after the eyes see a virtual image without crosstalk at a position through image splicing, they move in the eye box until crosstalk appears in the visual image, and the eye coordinates at this time are recorded and used as the boundary point. In specific implementation, a camera can be used instead of the eyes to sample the virtual image.
[0097] Specifically, when an eye is within the spatial range corresponding to the eye box partition, crosstalk will not occur when an image to be seen by the eye is displayed in a visible area corresponding to the eye box partition in the display screen.
[0098] It can be seen from the above technical solutions of the embodiments of the present application that the embodiments of the present application sample virtual images in the eye box partitions, and determine the spatial range corresponding to the eye box partitions according to the target sampling points corresponding to the virtual images where the crosstalk phenomenon occurs, as a basis for judging whether the user's eyes are beyond the current eye box partitions, thereby improving the objectivity of the judgment and being able to accurately determine the eye box partitions in which the user's eyes are located.
[0099] In an exemplary embodiment, the visible area corresponding to the eye box partition in the display screen is obtained based on the correction of the preset visible area corresponding to the key points in the eye box partition in the display screen; the spatial range corresponding to the above eye box partition can also be determined by the following steps:
[0100] For each eye box partition of a plurality of continuously distributed eye box partitions, determining a plurality of adjacent eye box partitions corresponding to the eye box partition;
[0101] For each adjacent eye box partition, determine the midpoint between the key point in the eye box partition and the key point in the adjacent eye box partition to obtain a boundary point;
[0102] The boundary points corresponding to each adjacent eye box partition in a plurality of adjacent eye box partitions are fitted to obtain the spatial range corresponding to the eye box partition.
[0103] The multiple adjacent eye box partitions corresponding to the eye box partition are eye box partitions adjacent to the eye box partition.
[0104] In a specific implementation, the center point of the eye box partition is usually selected as the key point. The visible area corresponding to each eye box partition in the display screen passes through Figures 8-9 The method shown in the figure is modified. Specifically, for the preset visible area corresponding to each eye box partition in the display screen, the preset visible area corresponding to the adjacent eye box partition in the display screen is used for adjustment; in the specific implementation, the virtual image is collected at the key point of the eye box partition as the mapping of the preset visible area, and the image fusion is performed to obtain the adjusted visible area. The display effect of the head-up display device is optimized, so that the user's eyes can achieve the effect of the left eye seeing the image intended for the left eye and the right eye seeing the image intended for the right eye at any position of the eye box, and crosstalk can be avoided.
[0105] Specifically, when an eye is within the spatial range corresponding to the eye box partition, crosstalk will not occur when an image to be seen by the eye is displayed in a visible area corresponding to the eye box partition in the display screen.
[0106] Exemplarily, there is position A in eye box partition 1, and there is position B in eye box partition 2. At position A (x1, y1, z1), a virtual image with the best fusion state can be collected, and at position B (x2, y2, z2), another virtual image with the best fusion state can be collected. Therefore, the midpoint of the two positions ((x1+x2) / 2, (y1+y2) / 2, (z1+z2) / 2) is used as the boundary point between eye box partition 1 and eye box partition 2.
[0107] In a specific implementation, the spatial range corresponding to the eye box partition can also be obtained according to the optical theory design.
[0108] It can be seen from the above technical solutions of the embodiments of the present application that the embodiments of the present application obtain boundary points by determining the midpoint between the key points in the eye box partition and the key points in the adjacent eye box partitions, and fit the boundary points corresponding to each adjacent eye box partition in multiple adjacent eye box partitions to obtain the spatial range corresponding to the eye box partition as a basis for judging whether the user's eyes are beyond the current eye box partition, thereby improving the objectivity of the judgment and being able to accurately determine the eye box partition in which the user's eyes are located.
[0109] S1305: Update the current eye box partition based on the current eye position information.
[0110] Specifically, if the left eye of the target object exceeds the left eye box partition, the left eye box partition is redetermined based on the current left eye position; if the right eye of the target object exceeds the right eye box partition, the right eye box partition is redetermined based on the current right eye position.
[0111] S1307, based on the visible area corresponding to the left eye box partition in the updated current eye box partition in the display screen, and the visible area corresponding to the right eye box partition in the updated current eye box partition in the display screen, the images to be displayed are respectively displayed, so that the light emitted by the display screen forms a left eye virtual image and a right eye virtual image after being split by the splitting element.
[0112] The visible area is provided with display units distributed in an array, and each display unit corresponds to displaying a sub-pixel in the image to be displayed. Specifically, when the left eye or right eye of the target object is in a certain eye box partition, the area covered by the display unit in the display screen corresponding to the pixel point in the virtual image seen by the left eye or right eye of the target object is the visible area corresponding to the eye box partition in the display screen.
[0113] In a specific implementation, each eye box partition corresponds to a visible area on the display screen. Figures 8-9Specifically, for the preset visible area corresponding to each eye box partition in the display screen, the preset visible area corresponding to the adjacent eye box partition in the display screen is used for adjustment, thereby optimizing the display effect of the head-up display device, so that the user's eyes can see the image intended for the left eye and the right eye can see the image intended for the right eye at any position of the eye box, thereby avoiding crosstalk.
[0114] The left eye box partition in the updated current eye box partition matches the current left eye position of the target object, and the right eye box partition in the updated current eye box partition matches the current right eye position of the target object.
[0115] For details, please refer to Fig.14 , 15 , which respectively show a schematic diagram of a virtual image corresponding to an eye box partition provided in an embodiment of the present application, and a schematic diagram of the principle of an image display method provided in an embodiment of the present application. At the eye box partition e2, a non-crosstalk virtual image fused as shown in Figure a can be seen, and at the eye box partition e3, a non-crosstalk virtual image fused as shown in Figure b can be seen. If the eye moves from e2 to e3, it is necessary to switch Figure a to Figure b, and by adjusting the visible area in the display screen, the visible area corresponding to e2 is adjusted to the visible area corresponding to e3.
[0116] S1309, determining the position information of the current eye position information that does not exceed the position information of the current eye box partition, and obtaining the target eye and the target eye position.
[0117] The target eye is an eye that does not exceed the corresponding eye box partition in the current eye box partition. Specifically, if the left eye of the target object does not exceed the left eye box partition in the current eye box partition, the left eye of the target object is the target eye; if the right eye of the target object does not exceed the right eye box partition in the current eye box partition, the right eye of the target object is the target eye; the target eye may include both the left eye and the right eye of the target object.
[0118] The target eye position is the position of the eye that does not exceed the corresponding eye box partition in the current eye box partition. Specifically, if the left eye of the target object does not exceed the left eye box partition in the current eye box partition, the eye position is the current left eye position in the current eye position information; if the right eye of the target object does not exceed the right eye box partition in the current eye box partition, the eye position is the current right eye position in the current eye position information; the target eye position may include both the current left eye position and the current right eye position of the target object.
[0119] S1311, based on the target eye position, move the fusion boundary of the eye box partition where the target eye is located in the visible area corresponding to the display screen, so that the sub-pixels corresponding to the display units in the visible area are switched with the movement of the fusion boundary.
[0120] For details, please refer to Fig.16 , which is a schematic diagram of the change of another virtual image provided by an embodiment of the present application. When the eye is located at the midpoint of e2 or e3, there is a brightness difference at the fusion boundary seen by the eye. When the eye moves from e2 to e3, switching from Figure a to Figure b, the user will feel dizzy, and there is no guarantee whether crosstalk will occur during the switching process.
[0121] The visible area corresponding to the eye box partition in the display screen is formed by the fusion of the preset visible area corresponding to the eye box partition in the display screen and the preset visible area corresponding to the adjacent eye box partition of the eye box partition in the display screen.
[0122] The fusion boundary is the visible area corresponding to the eye box partition in the display screen, the boundary between the preset visible area corresponding to the eye box partition in the display screen and the preset visible area corresponding to the adjacent eye box partition in the display screen. The fusion boundary can be a curve or a straight line, which is not specifically limited here.
[0123] Specifically, the relative position relationship between the sub-pixels in the image to be displayed and the fusion boundary remains unchanged. In the process of moving the fusion boundary, the sub-pixels move accordingly, and the sub-pixels corresponding to the display units in the visible area are switched accordingly.
[0124] In a specific implementation, the moving direction of the fusion boundary is not necessarily the same as the moving direction of the eye. The eye may move to the left and the fusion boundary may move to the right; the eye may move to the right and the fusion boundary may move to the left; the eye may move to the left and the fusion boundary may move to the left, etc.
[0125] For details, please refer to Fig.17 , which is a schematic diagram of the principle of another image display method provided by an embodiment of the present application. In the process of the eye moving from e2 to e3, that is, in the process of switching from Figure a to Figure b, the fusion boundary in Figure a is moved toward the position of the corresponding fusion boundary in Figure b, and the specific moving distance is determined according to the moving distance of the eye. That is, when the eye moves from left to right, the three fusion boundaries of the four regions also move with the eye.
[0126] For details, please refer to Fig.18 , which are schematic diagrams of the principles of the three methods for moving the fusion boundary provided in the embodiments of the present application. The current eye position information is represented by the coordinates (x D ,y D ,z D ), fitting the corresponding fusion boundary coordinates of different camera positions to obtain the fusion boundary function f(x, y) related to the eye coordinates. This boundary can be a curve or a straight line, and no specific setting is made;
[0127] When the eye moves in the x-direction in the eye box, the fusion boundary is expressed as an x-direction offset in the image coordinate system. The offset relationship is shown in formula (1), with a moving rate proportional coefficient k1 and an initial offset b1:
[0128] △x=k1△x D +b1 (1)
[0129] When the eye moves in the y direction in the eye box, the fusion boundary is expressed as a y-direction offset in the image coordinate system. The offset relationship is shown in formula (2), with a moving rate proportional coefficient k2 and an initial offset b2:
[0130] △y=k2△y D +b2 (2)
[0131] When the eye moves in the z direction in the eye box, the fusion boundary is manifested as a y-direction offset in the image coordinate system, a change in slope, and a change in intercept. The change relationship is shown in formulas (3) to (). The slope / initial offset in the x / y direction formula will be affected by the z coordinate, and the spacing between the boundaries on the x / y axis will also change.
[0132] b1=k3△z D (3)
[0133] Or b2=k3△z D (4)
[0134] k1=k4△z D +b3 (5)
[0135] Or k2=k4△z D +b3 (6)
[0136] D=k5△z D +b4 (7)
[0137] Where △x represents the moving distance of the fusion boundary in the x direction, △y represents the moving distance of the fusion boundary in the y direction; k is a moving conversion coefficient, which means that for every 1 unit of movement on the x / y / z axis, the image moves k in the corresponding direction of the image; △x D , △y D , △z D Respectively represent the movement distance of the eye in the x, y, and z directions; D represents the intercept of the adjacent boundary in the x or y direction. Fig.19 As shown in , the intercept becomes narrower, the slope remains unchanged, and the fusion boundary becomes more; Fig. 20 As shown, the intercept remains unchanged, the slope becomes larger, and the fusion boundaries become more.
[0138] It can be seen from the above technical solutions of the embodiment of the present application that the embodiment of the present application obtains the eye position of the target object in real time to update the eye box partition where the target object's eyes are located in real time, and displays the image to be displayed in the corresponding visible area in the display screen based on the updated eye box partition; and in the process of updating the eye box partition, locks the movement of the eyes, and moves the fusion boundary in the visible area to prevent the user from feeling dizzy, or crosstalk occurs during the switching of eye box partitions; ensures that the user can always view the three-dimensional effect image in an ideal state even if the eye position changes, and can always prevent crosstalk, thereby improving the driver's judgment and reaction speed to road conditions, and providing a strong guarantee for driving safety.
[0139] In an exemplary implementation, the above step S1311 may include the following steps:
[0140] determining a rate of change of the target eye position based on the target eye position and the corresponding eye position of the target eye in the previous cycle;
[0141] Based on the target eye position and the rate of change of the target eye position, the fusion boundary of the eye box partition where the target eye is located in the visible area corresponding to the display screen is moved, so that the sub-pixels corresponding to the display units in the visible area are switched with the movement of the fusion boundary.
[0142] Among them, the rate of change of the target eye position indicates the moving speed of the target eye.
[0143] The visible area corresponding to the eye box partition in the display screen is formed by the fusion of the preset visible area corresponding to the eye box partition in the display screen and the preset visible area corresponding to the adjacent eye box partition of the eye box partition in the display screen.
[0144] The fusion boundary is the visible area corresponding to the eye box partition in the display screen, the boundary between the preset visible area corresponding to the eye box partition in the display screen and the preset visible area corresponding to the adjacent eye box partition in the display screen. The fusion boundary can be a curve or a straight line, which is not specifically limited here.
[0145] Specifically, the relative position relationship between the sub-pixels in the image to be displayed and the fusion boundary remains unchanged. In the process of moving the fusion boundary, the sub-pixels move accordingly, and the sub-pixels corresponding to the display units in the visible area are switched accordingly.
[0146] Specifically, the speed at which the fusion boundary moves leftward / rightward can be calculated according to the eye movement speed, and the fusion boundary is updated in real time.
[0147] It can be seen from the above technical solutions of the embodiments of the present application that the embodiments of the present application determine the movement speed of the user's eyes, and according to the position of the eyes and the movement speed of the eyes, move the fusion boundary in the visible area to prevent crosstalk from occurring during the switching of eye box partitions, thereby improving the real-time movement of the fusion boundary and further reducing the user's sense of dizziness.
[0148] Corresponding to the image display methods provided in the above-mentioned embodiments, an embodiment of the present application also provides an image display device. Since the image display device provided in the embodiment of the present application corresponds to the image display methods provided in the above-mentioned embodiments, the implementation methods of the aforementioned image display methods are also applicable to the image display device provided in this embodiment and will not be described in detail in this embodiment.
[0149] See also Fig.21 , which is a schematic diagram of the structure of an image display device provided in an embodiment of the present application, the device has the function of implementing the image display method in the above method embodiment, the function can be implemented by hardware, or by hardware executing corresponding software. The device is applied to a head-up display device, the head-up display device is connected to the eye recognition device, and the head-up display device includes a display screen and a light splitting element; Fig.21 As shown, the device may include:
[0150] A position acquisition module 2110 is used to acquire the current eye position information of the target object sent by the eye recognition device in the current cycle, where the current eye position information includes the current left eye position and the current right eye position;
[0151] A position determination module 2120 is used to determine whether the eyes of the target object are beyond the current eye box partition based on the current eye position information; the current eye box partition is determined based on the eye position information of the target object in the previous cycle, and the current eye box partition includes a left eye box partition and a right eye box partition;
[0152] The eye box update module 2130 is used to update the current eye box partition based on the current eye position information when the result of the judgment is yes;
[0153] The image display module 2140 is used to display the images to be displayed based on the visible area corresponding to the left eye box partition in the updated current eye box partition in the display screen, and the visible area corresponding to the right eye box partition in the updated current eye box partition in the display screen, so that the light emitted by the display screen forms a left eye virtual image and a right eye virtual image after being split by the splitting element; the visible area is provided with display units distributed in an array, and each display unit corresponds to displaying a sub-pixel in the image to be displayed.
[0154] In an exemplary embodiment, the visible area corresponding to the eye box partition in the display screen is formed by merging the preset visible area corresponding to the eye box partition in the display screen and the preset visible area corresponding to the adjacent eye box partition of the eye box partition in the display screen; the device also includes a pixel adjustment module for adjusting the sub-pixels corresponding to the display unit in the visible area corresponding to the eye box partition where the target eye is located in the display screen when the target object's eye does not exceed the current eye box partition, and the pixel adjustment module includes:
[0155] A target determination module, for determining, when the result of the determination is negative, the position information of the current eye position information that does not exceed the current eye box partition, and obtaining the target eye and the target eye position;
[0156] The first boundary moving module is used to move the fusion boundary of the eye box partition where the target eye is located in the visible area corresponding to the display screen based on the target eye position, so that the sub-pixels corresponding to the display unit in the visible area are switched with the movement of the fusion boundary; the fusion boundary is the boundary between the preset visible area corresponding to the eye box partition in the display screen and the preset visible area corresponding to the adjacent eye box partition of the eye box partition in the display screen.
[0157] In an exemplary embodiment, the first boundary movement module includes:
[0158] a change rate determination module, for determining a change rate of a target eye position based on the target eye position and an eye position corresponding to the target eye in a previous cycle;
[0159] The second boundary moving module is used to move the fusion boundary of the eye box partition where the target eye is located in the visible area corresponding to the display screen based on the target eye position and the change rate of the target eye position, so that the sub-pixels corresponding to the display units in the visible area are switched as the fusion boundary moves.
[0160] In an exemplary embodiment, the location determination module includes:
[0161] The range judgment module is used to judge whether the eyes of the target object are beyond the spatial range corresponding to the current eye box partition based on the current eye position information.
[0162] In an exemplary embodiment, the apparatus further includes a first range determination module for determining a spatial range corresponding to each eye box partition, the first range determination module including:
[0163] A sampling point determination module, used for determining, for each eye box partition, a plurality of target sampling points corresponding to the eye box partition based on a preset sampling density;
[0164] A sample display module, used to display a sample image in a corresponding visible area in the display screen based on the eye box partition;
[0165] A virtual image acquisition module, used for acquiring virtual images at each target sampling point;
[0166] A target virtual image module is used to determine a virtual image having a crosstalk phenomenon in a virtual image corresponding to each target sampling point among multiple target sampling points, and obtain multiple target virtual images;
[0167] The boundary determination module is used to determine the boundary points corresponding to the eye box partition based on the relative position relationship between the target sampling points corresponding to each target virtual image in the multiple target virtual images; the boundary points corresponding to the eye box partition enclose the space range corresponding to the eye box partition.
[0168] In an exemplary embodiment, the visible area corresponding to the eye box partition in the display screen is corrected based on the preset visible area corresponding to the key points in the eye box partition in the display screen; the device also includes a second range determination module for determining the spatial range corresponding to each eye box partition, and the second range determination module includes:
[0169] An adjacent determination module, configured to determine, for each eye box partition in a plurality of continuously distributed eye box partitions, a plurality of adjacent eye box partitions corresponding to the eye box partition;
[0170] A boundary point determination module is used to determine, for each adjacent eye box partition, a midpoint between a key point in the eye box partition and a key point in an adjacent eye box partition to obtain a boundary point;
[0171] The boundary fitting module is used to fit the boundary points corresponding to each adjacent eye box partition in a plurality of adjacent eye box partitions to obtain the spatial range corresponding to the eye box partition.
[0172] It should be noted that the device provided in the above embodiment, when implementing its functions, is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.
[0173] An embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded and executed by the processor to implement any one of the image display methods provided in the above method embodiments.
[0174] The memory can be used to store software programs and modules. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, application programs required for functions, etc.; the data storage area can store data created according to the use of the device, etc. In addition, the memory can include a high-speed random access memory and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory can also include a memory controller to provide the processor with access to the memory.
[0175] The method embodiments provided in the embodiments of the present application may be executed in a computer terminal, a server or a similar computing device, that is, the above-mentioned electronic device may include a computer terminal, a server or a similar computing device. Fig. 22 is a hardware structure block diagram of a computer device running an image display method provided by an embodiment of the present invention, such as Fig. 22 As shown, the internal structure of the computer device may include but is not limited to: a processor, a network interface and a memory. The processor, network interface and memory in the computer device may be connected via a bus or other means. Fig. 22 The example of connecting through bus is taken in the following.
[0176] Among them, the processor (or CPU (Central Processing Unit)) is the computing core and control core of the computer device. The network interface may optionally include a standard wired interface, a wireless interface (such as WI-FI, a mobile communication interface, etc.). Memory is a memory device in a computer device for storing programs and data. It is understandable that the memory here can be a high-speed RAM storage device or a non-volatile memory device (non-volatile memory), such as at least one disk storage device; optionally, it can also be at least one storage device located away from the aforementioned processor. The memory provides a storage space, which stores the operating system of the electronic device, including but not limited to: Windows system (an operating system), Linux (an operating system), Android (Android, a mobile operating system) system, IOS (a mobile operating system) system, etc., and the present invention is not limited to this; and, in the storage space, one or more instructions suitable for being loaded and executed by the processor are also stored, and these instructions can be one or more computer programs (including program codes). In the embodiment of this specification, the processor loads and executes one or more instructions stored in the memory to implement the image display method provided in the above method embodiment.
[0177] An embodiment of the present application also provides a computer-readable storage medium, which can be set in an electronic device to store at least one instruction or at least one program related to implementing an image display method. The at least one instruction or the at least one program is loaded and executed by the processor to implement any one of the image display methods provided in the above method embodiments.
[0178] Optionally, in this embodiment, the above-mentioned storage medium may include but is not limited to: a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and other media that can store program codes.
[0179] It should be noted that the above-mentioned sequence of the embodiments of the present application is for description only and does not represent the advantages and disadvantages of the embodiments. The above-mentioned specific embodiments of this specification are described. Other embodiments are within the scope of the attached claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0180] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
[0181] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.
[0182] The above are only preferred embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.
Claims
1. An image display method, characterized in that: Applied to a head-up display device, the head-up display device is communicatively connected with an eye recognition device, and the head-up display device includes a display screen and a light splitting element; the method includes: Acquire current eye position information of the target object sent by the eye recognition device in a current cycle, wherein the current eye position information includes a current left eye position and a current right eye position; Based on the current eye position information, it is determined whether the eyes of the target object are beyond the current eye box partition; the current eye box partition is determined based on the eye position information of the target object in the previous cycle, and the current eye box partition includes a left eye box partition and a right eye box partition; If the result of the judgment is yes, updating the current eye box partition based on the current eye position information; Based on the visible area corresponding to the left eye box partition in the updated current eye box partition in the display screen, and the visible area corresponding to the right eye box partition in the updated current eye box partition in the display screen, the images to be displayed are respectively displayed, so that the light emitted from the display screen forms a left eye virtual image and a right eye virtual image after being split by the splitting element; the visible area is provided with display units distributed in an array, and each of the display units corresponds to displaying a sub-pixel in the image to be displayed.
2. The image display method according to claim 1, characterized in that: The visible area corresponding to the eye box partition in the display screen is formed by merging the preset visible area corresponding to the eye box partition in the display screen and the preset visible area corresponding to the adjacent eye box partition of the eye box partition in the display screen; The method further comprises: If the result of the judgment is no, determine that the current eye position information does not exceed the position information of the current eye box partition, and obtain the target eye and the target eye position; Based on the target eye position, a fusion boundary of the eye box partition where the target eye is located in the visible area in the display screen is moved so that the sub-pixels corresponding to the display unit in the visible area are switched as the fusion boundary moves; the fusion boundary is a boundary between a preset visible area corresponding to the eye box partition in the display screen and a preset visible area corresponding to an adjacent eye box partition of the eye box partition in the display screen in the visible area corresponding to the eye box partition in the display screen.
3. The image display method according to claim 2, characterized in that: The method of moving the fusion boundary of the eye box partition where the target eye is located in the visible area corresponding to the display screen based on the target eye position, so that the sub-pixels corresponding to the display unit in the visible area are switched along with the movement of the fusion boundary, comprises: determining a rate of change of the target eye position based on the target eye position and an eye position of the target eye corresponding to the previous cycle; Based on the target eye position and the rate of change of the target eye position, a fusion boundary of the eye box partition where the target eye is located in the visible area corresponding to the display screen is moved, so that the sub-pixels corresponding to the display unit in the visible area are switched as the fusion boundary moves.
4. The image display method according to claim 1, characterized in that: The step of judging whether the eyes of the target object are beyond the current eye box partition based on the current eye position information includes: Based on the current eye position information, it is determined whether the eyes of the target object are beyond the spatial range corresponding to the current eye box partition.
5. The image display method according to claim 4, characterized in that: The method further comprises: For each eye box partition, determining a plurality of target sampling points corresponding to the eye box partition based on a preset sampling density; Displaying a sample image in a visible area corresponding to the eye box partition in the display screen; Collect virtual images at each target sampling point respectively; Determine a virtual image having a crosstalk phenomenon in a virtual image corresponding to each target sampling point among the multiple target sampling points, and obtain multiple target virtual images; Based on the relative position relationship between the target sampling points corresponding to each target virtual image in the multiple target virtual images, the boundary points corresponding to the eye box partition are determined; the boundary points corresponding to the eye box partition enclose a spatial range corresponding to the eye box partition.
6. The image display method according to claim 4, characterized in that: The visible area corresponding to the eye box partition in the display screen is obtained based on the correction of the preset visible area corresponding to the key point in the eye box partition in the display screen; The method further comprises: For each eye box partition of a plurality of continuously distributed eye box partitions, determining a plurality of adjacent eye box partitions corresponding to the eye box partition; For each adjacent eye box partition, determine the midpoint between the key point in the eye box partition and the key point in the adjacent eye box partition to obtain a boundary point; The boundary points corresponding to each adjacent eye box partition in the plurality of adjacent eye box partitions are fitted to obtain a spatial range corresponding to the eye box partition.
7. An image display device, characterized in that: Applied to a head-up display device, the head-up display device is communicatively connected with an eye recognition device, the head-up display device includes a display screen and a light splitting element; the device includes: A position acquisition module, used to acquire current eye position information of the target object sent by the eye recognition device in a current cycle, wherein the current eye position information includes a current left eye position and a current right eye position; A position determination module, configured to determine whether the eyes of the target object are beyond a current eye box partition based on the current eye position information; the current eye box partition is determined based on the eye position information of the target object in the previous cycle, and the current eye box partition includes a left eye box partition and a right eye box partition; An eye box updating module, configured to update the current eye box partition based on the current eye position information if the result of the judgment is yes; An image display module is used to display the images to be displayed based on the visible area corresponding to the left eye box partition in the updated current eye box partition in the display screen, and the visible area corresponding to the right eye box partition in the updated current eye box partition in the display screen, so that the light emitted by the display screen forms a left eye virtual image and a right eye virtual image after being split by the splitting element; the visible area is provided with display units distributed in an array, and each of the display units corresponds to displaying a sub-pixel in the image to be displayed.
8. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or at least one program is loaded and executed by the processor to implement the image display method according to any one of claims 1 to 6.
9. A computer-readable storage medium, wherein at least one instruction or at least one program is stored in the storage medium, and the at least one instruction or the at least one program is loaded and executed by a processor to implement the image display method according to any one of claims 1 to 6.
10. A computer program, characterized in that When the computer program is executed by a processor, the image display method according to any one of claims 1 to 6 is implemented.
Citation Information
Cited By
Image acquisition method and device, head-up display and storage medium
CN121708084A
Image display method and apparatus, and electronic device and storage medium
WO2026007440A1
