Display method and device of head-up display equipment, equipment and storage medium

Abstract

The invention belongs to the technical field of head-up display equipment, and particularly relates to a display method and device of head-up display equipment, equipment and a storage medium. Obtaining a to-be-displayed image and a display screen partitioning result; determining display offset information based on inclination data of a spectro-grating in the head-up display device relative to a display unit; based on the display screen partitioning result and the display offset information, determining a target pixel distribution mode when the display screen displays the to-be-displayed image; and displaying the to-be-displayed image based on the display screen and the target pixel distribution mode. The target pixel distribution mode when the display screen displays the to-be-displayed image is determined on the basis of the display screen partitioning result and the display offset information, so that when the display screen performs display according to the target pixel distribution mode, a user can observe a complete image with continuous colors, the generation of moire patterns can be reduced, and the user experience is improved. The display effect of the head-up display device is improved, and the vehicle driving safety is improved.

Description

Technical Field

[0001] This application belongs to the field of head-up display technology, specifically relating to a display method, apparatus, device, and storage medium for a head-up display. Background Technology

[0002] Currently, head-up displays (HUDs) are increasingly used in vehicles. HUDs project dashboard information, navigation information, and other images onto the vehicle's windshield, assisting drivers in better maneuvering. To provide an even better user experience, HUDs can be further developed using 3D (three-dimensional) display technology, creating 3D HUDs. 3D HUDs utilize glasses-free 3D display technology, allowing users to view 3D images directly with the naked eye without needing special 3D glasses.

[0003] There are several ways to achieve glasses-free 3D, among which using a grating to split the light displayed on the screen is a commonly used method. Specifically, by adding a grating in front of the screen, the light rays from adjacent pixels are constrained by the grating, and due to the different exit angles, the user's left and right eyes see different images, thus achieving light splitting.

[0004] However, when naked-eye 3D display technology is applied to HUDs, the grating, being an optical element composed of a series of parallel fine lines or sheets, causes interference and diffraction when incident parallel light rays pass through the finely spaced lines. Limited by the size of the HUD display, the line density and linewidth of the grating are typically small, resulting in a stronger interference effect and producing higher-frequency lines, ultimately forming moiré patterns. During driving, if the displayed image has many moiré patterns, it can cause dizziness, thus affecting driving safety. Summary of the Invention

[0005] To address the aforementioned technical problems, this application provides a display method, apparatus, device, and storage medium for a head-up display (HUD). When displaying an image, the HUD determines the target pixel allocation method for displaying the image based on the display screen partitioning results and display offset information. This reduces moiré patterns and improves the display effect of the HUD, thereby enhancing vehicle driving safety.

[0006] On one hand, this application proposes a display method for a head-up display device, the method comprising:

[0007] Obtain the image to be displayed and the display screen partitioning result; the image to be displayed is the image to be displayed on the display screen in the head-up display device; the display screen is provided with display units arranged in an array, each display unit corresponding to displaying a sub-pixel of the image to be displayed; the display screen partitioning result is used to characterize the correspondence between the preset eye box partition and each display unit;

[0008] Based on the tilt data of the beam splitter relative to the display unit in the head-up display device, the display offset information is determined; the beam splitter is set on the display screen and is used to divide the image displayed on the display screen into a left view image and a right view image; the left view image and the right view image are used to construct a stereoscopic image; the display offset information is used to characterize the target pixel allocation method of the display screen when displaying the image to be displayed, and the offset relative to the partitioning result of the display screen;

[0009] Based on the display screen partitioning results and display offset information, determine the target pixel allocation method when the display screen displays the image to be displayed;

[0010] The image to be displayed is determined based on the display screen and the target pixel allocation method.

[0011] In some optional embodiments, the method further includes, before obtaining the image to be displayed and the display screen partitioning results:

[0012] Get the preset eye box partitions; the preset eye box partitions include the left and right viewing areas arranged in a preset order;

[0013] Based on the arrangement of the left and right viewing areas in the preset eye box partitions, the partition information of each display unit is determined;

[0014] The display screen partitioning results are determined based on the partitioning information.

[0015] In some optional embodiments, the display screen includes a periodically arranged combination of display units; based on the tilt data of the beam splitter relative to the display units in the head-up display device, display offset information is determined, including:

[0016] Based on the tilt data of the beam splitter relative to the display unit in the head-up display device, the number of preset display units in each display unit combination is determined; the preset display units are the display units that are partially blocked by the beam splitter.

[0017] The display offset information is determined based on the preset number of display units.

[0018] In some optional embodiments, the target pixel allocation method for displaying an image on the display screen is determined based on the display screen partitioning results and display offset information, including:

[0019] Based on the display screen partitioning results, determine the initial pixel allocation method when the display screen displays the image to be displayed;

[0020] Based on the display offset information, the initial pixel allocation method is adjusted to obtain the target pixel allocation method.

[0021] In some optional embodiments, the initial pixel allocation method is adjusted based on display offset information to obtain the target pixel allocation method, including:

[0022] Based on the display offset information, determine the target pixel allocation method of the display screen when displaying the image to be displayed, and the offset data relative to the display screen partitioning result;

[0023] Based on the offset data, the initial pixel allocation method is shifted to obtain the target pixel allocation method.

[0024] In some optional embodiments, the image to be displayed is displayed based on the display screen and the target pixel allocation method, including:

[0025] Based on the target pixel allocation method, determine the light emission state of each display unit in the display screen;

[0026] Based on the light emission state of each display unit, the display screen is lit up, so that the light emitted from the display screen is split by a beam splitter to form a left view image and a right view image.

[0027] On the other hand, this application also proposes a display device for a head-up display, the device comprising:

[0028] The acquisition module is used to acquire the image to be displayed and the display screen partitioning results; the image to be displayed is the image to be displayed on the display screen in the head-up display device; the display screen is provided with display units arranged in an array, each display unit corresponding to displaying a sub-pixel of the image to be displayed; the display screen partitioning results are used to characterize the correspondence between the preset eye box partitions and each display unit;

[0029] The display offset information determination module is used to determine the display offset information based on the tilt data of the beam splitter relative to the display unit in the head-up display device. The beam splitter is set on the display screen and is used to divide the image displayed on the display screen into a left view image and a right view image. The left view image and the right view image are used to construct a stereoscopic image. The display offset information is used to characterize the target pixel allocation method of the display screen when displaying the image to be displayed, and the offset relative to the partitioning result of the display screen.

[0030] The target pixel allocation method determination module is used to determine the target pixel allocation method when the display screen displays the image to be displayed, based on the display screen partitioning results and display offset information.

[0031] The display module is used to display the image to be displayed based on the display screen and the target pixel allocation method.

[0032] In some alternative embodiments, the device further includes:

[0033] The preset eye box partition acquisition module is used to acquire preset eye box partitions; the preset eye box partitions include the left and right viewing areas arranged in a preset order.

[0034] The partition information determination module is used to determine the partition information of each display unit based on the arrangement of the left and right viewing areas in the preset eye box partitions;

[0035] The display screen partitioning result determination module is used to determine the display screen partitioning result based on the partitioning information.

[0036] In some optional embodiments, the display screen includes a periodically arranged combination of display units; the display offset information determination module includes:

[0037] The preset display unit is used to determine the number of preset display units in each display unit combination based on the tilt data of the beam splitter relative to the display unit in the head-up display device; the preset display unit is the display unit that is partially blocked by the beam splitter.

[0038] The display offset information determination unit is used to determine the display offset information based on the preset number of display units.

[0039] In some optional embodiments, the target pixel allocation method determination module includes:

[0040] The initial pixel allocation method determination submodule is used to determine the initial pixel allocation method when the display screen displays the image to be displayed, based on the display screen partitioning results.

[0041] The target pixel allocation method determination submodule is used to adjust the initial pixel allocation method based on the display offset information to obtain the target pixel allocation method.

[0042] In some optional embodiments, the target pixel allocation method determination submodule includes:

[0043] The offset data determination unit is used to determine the target pixel allocation method of the display screen when displaying the image to be displayed, based on the display offset information, and the offset data relative to the display screen partitioning result;

[0044] The target pixel allocation method determination unit is used to perform translation processing on the initial pixel allocation method based on offset data to obtain the target pixel allocation method.

[0045] In some optional embodiments, the display module includes:

[0046] The light emission state determination unit is used to determine the light emission state of each display unit in the display screen based on the target pixel allocation method.

[0047] The display screen lighting unit is used to light up the display screen based on the light emission state of each display unit, so that the light emitted from the display screen is split by the beam splitter to form the left view image and the right view image.

[0048] On the other hand, this application also proposes a head-up display device, including: a display screen, a beam splitter, a memory, and a processor;

[0049] The display screen is used to display the image to be displayed;

[0050] A beam splitter is installed on the display screen to divide the image displayed on the screen into a left view image and a right view image; the left view image and the right view image are used to construct a stereoscopic image;

[0051] Memory is used to store processor-executable instructions;

[0052] The processor is configured to execute instructions to implement the display method of the head-up display device as described above.

[0053] On the other hand, this application proposes a computer-readable storage medium storing at least one instruction or at least one program, which is loaded and executed by a processor to implement the display method of the head-up display device as described above.

[0054] On the other hand, this application proposes a computer program product that, when executed by a processor, implements the display method of the head-up display device as described above.

[0055] The head-up display (HUD) device, including its display unit, apparatus, electronic device, and storage medium, as proposed in this application, acquires the image to be displayed and the display screen partitioning results. Then, based on the tilt data of the beam splitter relative to the display unit in the HUD device, it determines display offset information. Based on the display screen partitioning results and the display offset information, it determines the target pixel allocation method when the display screen displays the image to be displayed. Thus, the image to be displayed can be displayed based on the display screen and the target pixel allocation method. Using the above display method with the HUD device can reduce moiré patterns and improve vehicle driving safety. Furthermore, the above display method enables users to view complete and color-continuous images, thereby improving the display effect of the HUD device. Attached Figure Description

[0056] In order to more clearly illustrate the technical solutions and advantages of the embodiments of the present application or the prior art, the following is a brief introduction to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0057] Figure 1 This is a schematic diagram illustrating the principle of a 3D HUD according to an exemplary embodiment.

[0058] Figure 2 This is a schematic diagram illustrating an implementation environment of a display method for a head-up display device according to an exemplary embodiment.

[0059] Figure 3 This is a flowchart illustrating a display method of a head-up display device according to an exemplary embodiment.

[0060] Figure 4 This is a schematic diagram illustrating the beam-splitting principle of a beam-splitting grating according to an exemplary embodiment.

[0061] Figure 5 This is a schematic diagram illustrating a 3D HUD effect according to an exemplary embodiment.

[0062] Figure 6 This is a schematic diagram illustrating the design principle of a head-up display device according to an exemplary embodiment.

[0063] Figure 7 This is a schematic diagram illustrating a display screen partitioning result according to an exemplary embodiment.

[0064] Figure 8 This is a schematic diagram illustrating the design principle of another head-up display device according to an exemplary embodiment.

[0065] Figure 9 This is a schematic diagram of the structure of a beam splitter according to an exemplary embodiment.

[0066] Figure 10 This is a schematic diagram illustrating the principle of beam splitting grating and sub-pixel matching according to an exemplary embodiment.

[0067] Figure 11 This is a schematic diagram illustrating a display screen offset according to an exemplary embodiment.

[0068] Figure 12 This is a block diagram of a head-up display device according to an exemplary embodiment.

[0069] Figure 13This is a hardware structure block diagram of a server for a display method of a head-up display device according to an exemplary embodiment. Detailed Implementation

[0070] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0071] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of the embodiments of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the present application described herein can be implemented in orders other than those illustrated or described herein. Thus, features defined with "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the embodiments, unless otherwise stated, "a plurality of" means two or more. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or server that includes a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to these processes, methods, products, or devices.

[0072] To make the objectives, technical solutions, and advantages disclosed in the embodiments of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely illustrative of the embodiments of this application and are not intended to limit the embodiments of this application.

[0073] Figure 1 This is a schematic diagram illustrating the principle of a 3D HUD according to an exemplary embodiment, such as... Figure 1 The 3D HUD shown includes an image source, a slit grating attached to the image source, and a mirror assembly. The mirror assembly may include multiple mirrors. Figure 1As shown in the figure, it includes reflector 1 and reflector 2. Reflector 1 can be a plane mirror or a free-form curved mirror, and reflector 2 can also be a free-form curved mirror. In implementing a 3D HUD, the slit grating attached to the image source is an optical element composed of a series of parallel fine lines or thin sheets. When incident parallel light rays pass through the finely etched lines at specific intervals, they are affected by the fine lines or thin sheets in the grating, resulting in interference and diffraction phenomena. These interference and diffraction phenomena cause the light beam to be dispersed and deflected, separating the light of different wavelengths contained in the beam, thereby achieving a beam splitting effect. The beam splitting effect is affected by manufacturing parameters such as the line density and line width of the slit grating. If the line spacing of the slit grating is too small, its interference effect is stronger, resulting in higher frequency lines and ultimately producing moiré patterns. In other words, the smaller the spacing of the slit grating, the more colored stripes will appear on the image displayed by the user through the imaging structure during driving, which can cause dizziness.

[0074] The head-up display (HUD) device, including its display unit, apparatus, electronic device, and storage medium, as proposed in this application, acquires the image to be displayed and the display screen partitioning results. Then, based on the tilt data of the beam splitter relative to the display unit in the HUD device, it determines display offset information. Based on the display screen partitioning results and the display offset information, it determines the target pixel allocation method when the display screen displays the image to be displayed. Thus, the image to be displayed can be displayed based on the display screen and the target pixel allocation method. Using the above display method with the HUD device can reduce moiré patterns and improve vehicle driving safety. Furthermore, the above display method enables users to view complete and color-continuous images, thereby improving the display effect of the HUD device.

[0075] Figure 2 This is a schematic diagram illustrating an implementation environment of a display method for a head-up display device according to an exemplary embodiment. For example... Figure 1 As shown, the implementation environment includes at least a vehicle. A HUD can be installed in the vehicle. A HUD is a driver assistance instrument used in automobiles, and is a comprehensive electronic display device composed of electronic components, display components, controllers, etc. Through the display method of the head-up display device provided in this application embodiment, the HUD can clearly and accurately project vehicle speed, navigation information, warning information, etc., in the form of images and characters, onto the driver's front through optical components, forming a three-dimensional virtual image in front of the driver's line of sight, with excellent imaging effect.

[0076] It should be noted that, Figure 2 This is just one example. Other implementation environments may also be included in other scenarios.

[0077] Figure 3This is a schematic flowchart illustrating a display method for a head-up display device according to an exemplary embodiment. The method can be used for... Figure 2 In the implementation environment described in this specification, the method operation steps are as illustrated in the embodiments or flowcharts. However, based on conventional or non-inventive labor, more or fewer operation steps may be included. The order of steps listed in the embodiments is merely one possible execution order among many and does not represent the only possible execution order. In actual system or server product execution, the method can be executed sequentially according to the embodiments or drawings, or in parallel (e.g., in a parallel processor or multi-threaded processing environment). Specifically, as shown in the embodiments or drawings... Figure 3 As shown, the method may include:

[0078] S101: Obtain the image to be displayed and the display screen partitioning results.

[0079] In this embodiment, the head-up display device includes a display screen. Optionally, the display screen may be a liquid crystal display (LCD). The display screen contains display units arranged in an array, such as in a row-column configuration. Optionally, these display units may have the same size and different shapes. Optionally, the luminous intensity of these display units may be the same or different. Each display unit corresponds to displaying a sub-pixel of the image to be displayed. A sub-pixel refers to the smallest graphic unit constituting the image to be displayed. When this smallest graphic unit is displayed on the display screen, it corresponds to the smallest light-emitting unit on the display screen. Generally, display units can be divided into R display units, used to display red light, corresponding to R sub-pixels; G display units, used to display green light, corresponding to G sub-pixels; and B display units, used to display blue light, corresponding to B sub-pixels. The image to be displayed consists of multiple pixels, each pixel including R / G / B sub-pixels. Accordingly, the R / G / B display units in the display screen must be combined to display a single pixel of the image to be displayed. In practical applications, common electronic device display panels, such as those for mobile phones and computers, typically use a vertical arrangement of the R / G / B display units. However, for HUDs, due to space limitations in the vehicle's infotainment system, to achieve better display results, the R / G / B display units are generally arranged horizontally. When displaying images, every three R / G / B sub-pixels in the horizontal direction are considered as one pixel. When displaying an image, the sub-pixels of the image are arranged horizontally with the R / G / B sub-pixels aligned.

[0080] In this embodiment, the image to be displayed is the image to be displayed on the screen of the head-up display (HUD). During 3D imaging in a HUD, the image to be displayed is typically obtained by fusing two images from different perspectives, namely, a left-eye image and a right-eye image. The screen displays the image to be displayed; the light emitted from the screen is split by a beam splitter, displaying a left-view image and a right-view image for the observer's binoculars to see. As an example, Figure 4 This is a schematic diagram illustrating the beam-splitting principle of a beam-splitting grating according to an exemplary embodiment, such as... Figure 4 As shown, the head-up display device also includes a beam splitter, which can optionally be a slit grating. The beam splitter is disposed on the surface of the display screen, so that light rays from adjacent sub-pixels in the display screen exit at different angles after being confined by the slits, thus achieving beam splitting. The light rays emitted from the beam splitter are refracted sequentially by a mirror assembly and an imaging structure (such as a vehicle's windshield) before entering the user's left and right eyes respectively, resulting in different images seen by the user's left and right eyes.

[0081] In the embodiments of this application, Figure 5 This is a schematic diagram illustrating a 3D HUD effect according to an exemplary embodiment. Figure 5 As shown, through optical design of the HUD, the user sees image P1 with their left eye and image P2 with their right eye. Images P1 and P2 can be combined in the user's brain to form a stereoscopic image with depth. By changing the position between the two images and adjusting the binocular parallax, the perceived distance of the virtual image can be altered (the actual virtual image distance remains constant). The closer the two images are, the closer the perceived virtual image distance. Conversely, the farther apart the two images are, the farther the perceived virtual image distance. To achieve this effect, a 3D HUD design can be based on the principle of a beam splitter. Figure 6 This is a schematic diagram illustrating the design principle of a head-up display device according to an exemplary embodiment, such as... Figure 6As shown, the eye box includes four preset eye box sections. The eye box is used to characterize the distribution area of ​​the focal point of the observed object's gaze. Of these four sections, sections 1 and 2 are left viewing areas, corresponding to the left eye of the observed object, and sections 3 and 4 are right viewing areas, corresponding to the right eye of the observed object. One grating cycle of the slit grating (one light-transmitting area and one light-blocking area) covers eight display units in the display screen, that is, it covers eight sub-pixels in the image to be displayed. It should be understood that in practical applications, the preset eye box sections can also be divided in other ways, such as including six sections, three of which are left viewing areas and the other three are right viewing areas. Furthermore, the correspondence between the beam-splitting grating and the display units can also be in other ways; for example, one grating cycle (one light-transmitting area and one light-blocking area) can cover 12 display units in the display screen. In addition, the widths of the light-transmitting and light-blocking areas in the beam-splitting grating can also be different, and can be selected according to design requirements. (Refer to...) Figure 6 As shown, after the display screen shows the image to be displayed, the slit grating splits the light emitted from the screen into two visible images, left and right. When the left-eye image seen by the observer's left eye in zones 1 and 2 is displayed on the screen, the slit grating's light-blocking area obscures the right-eye image in the displayed image, so the observer can only see the left-eye image. Similarly, when the right-eye image seen by the right eye in zones 3 and 4 is displayed on the screen, the slit grating's light-blocking area obscures the left-eye image in the displayed image, so the observer can only see the right-eye image.

[0082] In this embodiment, the display screen partitioning result is one of the key aspects of 3D HUD image display. The display screen partitioning result is used to characterize the correspondence between the preset eye box partitions and each display unit. The display screen partitioning result can be determined based on the preset eye box partitions. Specifically, when determining the eye box partitioning result, the preset eye box partitions are first obtained. The preset eye box partitions include a left viewing area and a right viewing area arranged in a preset order. Then, based on the arrangement of the left and right viewing areas in the preset eye box partitions, the partitioning information of each display unit is determined, thereby determining the display screen partitioning result based on the partitioning information. By determining the display screen partitioning result based on the preset eye box partitions, the mapping relationship of display units in the preset eye box partitioned display screen can be constructed. When the display screen displays an image to be displayed, it can easily determine the viewing area corresponding to each display unit, thereby quickly determining the light emission state of each display unit and realizing pixel allocation of the image to be displayed.

[0083] As an example, display units in a display screen are typically arranged in a row-column correspondence. When determining the display screen partitioning results, each partition in the preset eye-box partitions can be associated with a display unit on the display screen. By periodically arranging the preset eye-box partitions on the display screen, each display unit in the display screen is partitioned, thus obtaining the partitioning information for each display unit. For any given display unit, its partitioning information can be either a left viewing area or a right viewing area. The display unit in the left viewing area is used to display the image viewed by the left eye of the observer, and the display unit in the right viewing area is used to display the image viewed by the right eye of the observer.

[0084] Figure 7 This is a schematic diagram illustrating a display screen partitioning result according to an exemplary embodiment. Figure 7 The diagram shows two rows of display units, L1 and L2, on the screen. These display units can be arranged into eight columns: x1, x2, x3, x4, x5, x6, x7, and x8. Taking a preset eye-box partition with four sections as an example, namely, a continuously arranged left viewing area (L), a right viewing area (R), and a right viewing area (R), partitioning the display units on the screen according to the preset eye-box partitioning method yields the corresponding screen partitioning results.

[0085] S103: Determine display offset information based on the tilt data of the beam splitter relative to the display unit in the head-up display device.

[0086] In the embodiments of this application, Figure 8 This is a schematic diagram illustrating the design principle of another head-up display device according to an exemplary embodiment, such as... Figure 8 As shown, a beam splitter is positioned on the display screen to divide the image displayed on the screen into a left view image and a right view image. The left and right view images are used to construct a stereoscopic image. Figure 6 The difference is that the beam splitter is a slit grating with an inclined angle, and its light-blocking / light-transmitting area is tilted relative to the display unit in the display screen. Figure 9 This is a schematic diagram of a beam-splitting grating according to an exemplary embodiment, as shown below. Figure 9 As shown, the tilt direction of the beam splitter is along the arrangement direction of the sub-pixels in the display screen. The tilt angle can be determined according to the display effect. For example, the tilt angle of the beam splitter can be determined by simulating the display effect of the head-up display device.

[0087] In practical design, the tilt angle of the beam splitter can also be determined based on information such as the arrangement of sub-pixels in the display screen and the aspect ratio of the sub-pixels. For example, the diagonal of the sub-pixels can be used as a reference for the tilt angle design. Figure 10This is a schematic diagram illustrating the principle of beam-splitting grating and sub-pixel matching according to an exemplary embodiment, such as... Figure 10 As shown, the edge of the light-transmitting area of ​​the beam-splitter coincides with the diagonal of a sub-pixel. If the aspect ratio of the sub-pixel is 1:3, and the angle between the beam-splitter and the sub-pixel arrangement direction (horizontal arrangement of R / G / B sub-pixels) is α, then the tilt angle α of the beam-splitter is: 90 - arctan(1 / 3), i.e., 71.6°. Since the edge of the light-transmitting area of ​​the beam-splitter coincides with the diagonal of the sub-pixel, by designing the width of the light-blocking and light-transmitting areas of the beam-splitter, the light-blocking area covers all sub-pixels along the diagonal of a given sub-pixel; that is, the light-blocking area of ​​the beam-splitter covers half of that sub-pixel. For example... Figure 10 As shown, when the edge of the light-transmitting area of ​​the beam splitter coincides with the diagonal of a sub-pixel, a complete blue sub-pixel, a complete red sub-pixel, and two half-exposed green sub-pixels can be seen from the width of the light-transmitting area. These can be combined to form three complete R / G / B sub-pixels, meaning the observer can see a complete image. This is because when the display is normally lit, the blue and red sub-pixels are fully bright, while the half-green sub-pixel under the same voltage is only half bright, with the other half obscured. When the half-green sub-pixel is lit in the same proportion, the image is distorted because only half of the green color is visible. It needs to complement the other pixel to form a fully bright green sub-pixel. Although the spatial positions of the sub-pixels are different, their small size and distance from the observer's eye mean that the light emitted from them reaching the observer's eye is negligible. The observer's eye can approximate the light emanating from a single point, thus seeing a complete image and ensuring stable color reproduction. In some embodiments, the edge of the light-transmitting area of ​​the beam-splitting grating may also coincide with the diagonal of a rectangle formed by two or more horizontally arranged sub-pixels. In other embodiments, the edge of the light-transmitting area of ​​the beam-splitting grating may also coincide with the diagonal of a rectangle formed by two or more vertically arranged sub-pixels.

[0088] In this embodiment, when the display screen displays an image to be displayed, because the beam splitter is a grating with an inclined angle, the target pixel allocation method of the display screen when displaying the image to be displayed has a certain deviation from the display screen partitioning result. In order to ensure that the image viewed by the observer has integrity and image color stability, it is necessary to determine display offset information to correct this deviation. The display offset information is used to characterize the offset of the target pixel allocation method of the display screen when displaying the image to be displayed relative to the display screen partitioning result.

[0089] In this embodiment, the display screen includes periodically arranged combinations of display units, namely, combinations of display units corresponding to preset eye-box partitions. When determining display offset information, it can be determined based on the number of preset display units in the preset eye-box partition. Specifically, the number of preset display units in each display unit combination is determined based on the tilt data of the beam splitter relative to the display units in the head-up display device. The preset display units are those partially obscured by the beam splitter; the display offset information is determined based on the number of preset display units. Since the display unit combinations are periodically arranged in the display screen, by determining the number of display units partially obscured by the beam splitter in the display unit combination, the deviation of the target pixel allocation method of the display screen when displaying the image to be displayed relative to the display screen partitioning result can be determined. By simply and quickly determining the display offset information based on the number of display units partially obscured by the beam splitter in the display unit combination, the efficiency of determining the display offset information can be improved, and resource consumption can be saved.

[0090] In this embodiment, the tilt data of the beam splitter relative to the display unit can be the angle between the edge of the light-transmitting area of ​​the beam splitter and each row of display units, or the angle between the edge of the light-transmitting area of ​​the beam splitter and each column of display units. Based on the tilt data of the beam splitter relative to the display unit, as well as the size data of the grating and the size data of the sub-pixels, the number of display units partially obscured by the beam splitter in each display unit combination can be determined. Furthermore, based on the number of display units partially obscured by the beam splitter in each display unit combination, the display offset information can be determined. An image is composed of multiple rows of pixels. When the grating is tilted, it is necessary to ensure that the pixel distribution in the light-transmitting area of ​​the grating remains unchanged for the left and right eyes of the observer. This ensures that when the observer views the image, the image is complete and the image color is stable.

[0091] Figure 11 This is a schematic diagram illustrating a display screen offset according to an exemplary embodiment, such as... Figure 11 As shown, because the light-transmitting area of ​​the beam splitter is tilted to the right, if the integrity of the image and the stability of the image color on the display screen are required to be maintained by the user's eyes, it can be seen that the sub-pixels of the second row are shifted to the right by 1 sub-pixel relative to the first row. That is, when the spatial position of the LCD screen changes by one row, the light-transmitting area moves up and down by 1 pixel on the LCD screen. In other words, the tilted pixels need to be shifted to the right by 1 sub-pixel for each row up and to the left by 1 sub-pixel for each row down.

[0092] refer to Figure 11As shown, the width of one light-transmitting area in the beam splitter covers four display units in the display screen. The preset eye box partition includes four partitions: a continuously arranged left viewing area (L), a right viewing area (R), and a right viewing area (R). The four display units in the display screen corresponding to the preset eye box partitions are used to display the left-eye image, the right-eye image, and the right-eye image of the image to be displayed, respectively. If sub-pixels y1 and y2 in row L1 of the image to be displayed are the left-eye image (L), and pixels y3 and y4 are the right-eye image (R), the rest are periodically repeating adjacent pixels. Because the beam splitter is tilted relative to the display unit, when the display screen displays the image to be displayed, in order to keep the pixels of the L2 row and the L1 row in the same direction to ensure the integrity of the image and the stability of the image color, the L2 row needs to be shifted one sub-pixel to the right compared to the L1 row. Even if the image displayed in the L2 row display unit x2 is the left eye image, x3x4x5 is assigned the left eye image, right eye image, and right eye image in sequence. In this way, the distribution of pixels x2-x5 in the L2 row is LLRR, so that even if the beam splitter is tilted, the distribution of sub-pixels in the L1 row and the L2 row is consistent.

[0093] S105: Based on the display screen partitioning results and display offset information, determine the target pixel allocation method when the display screen displays the image to be displayed.

[0094] In this embodiment, after determining the display offset information, the target pixel allocation method for displaying the image to be displayed on the screen can be determined based on the display screen partitioning results and the display offset information. When determining the target pixel allocation method, an initial pixel allocation method can be determined first, and then adjusted to obtain the target pixel allocation method. Specifically, firstly, based on the display screen partitioning results, the initial pixel allocation method for displaying the image to be displayed on the screen is determined. Then, based on the display offset information, the initial pixel allocation method is adjusted to obtain the target pixel allocation method. By first determining the initial pixel allocation method and then adjusting it to obtain the target pixel allocation method, the head-up display device can achieve image display under tilted beam splitting conditions, thus solving the moiré pattern problem that occurs when displaying images in a 3D HUD.

[0095] In this embodiment, when adjusting the initial pixel allocation method based on display offset information to obtain the target pixel allocation method, specifically, the target pixel allocation method when the display screen is displaying the image to be displayed can be determined based on the display offset information, specifically the offset data of the target pixel allocation method relative to the display screen partitioning result. Then, based on the offset data, the initial pixel allocation method is translated to obtain the target pixel allocation method. By determining the offset data of the target pixel allocation method relative to the display screen partitioning result, and translating the initial pixel allocation method based on the offset data, the efficiency of adjusting the initial pixel allocation method can be improved, and the image display speed can be accelerated.

[0096] In this embodiment, in practical applications, when a head-up display device displays an image, it needs to fuse the left-eye and right-eye images to obtain the image to be displayed. Then, based on the display screen partitioning results, it determines the target pixel allocation method for displaying the image, that is, it determines the initial light-emitting state of each display unit on the display screen when displaying the image. The initial light-emitting state of each pixel includes whether each pixel emits light and the color information of the light to be emitted. Then, based on the display offset information, the initial pixel allocation method is adjusted along the horizontal direction of the display screen (i.e., the direction of repeated arrangement of R / G / B sub-pixels) to obtain the target pixel allocation method. The target pixel allocation method includes the light-emitting state of each display unit after the translation adjustment.

[0097] S107: Display the image to be displayed based on the display screen and the target pixel allocation method.

[0098] In this embodiment, after determining the target pixel allocation method, the display screen can display the image to be displayed according to the target pixel allocation method. Specifically, based on the target pixel allocation method, the light emission state of each display unit in the display screen is determined, and then the display screen is lit up based on the light emission state of each display unit, so that the light emitted from the display screen is split by a beam splitter to form a left view image and a right view image. By displaying the image to be displayed based on the target pixel allocation method, the display screen can ensure the integrity of the displayed image and the stability of the image colors.

[0099] This application also proposes a display device for a head-up display. Figure 12 This is a block diagram of a display device for a head-up display according to an exemplary embodiment. Figure 9 As shown, the device may include at least:

[0100] The acquisition module 201 is used to acquire the image to be displayed and the display screen partitioning result; the image to be displayed is the image to be displayed on the display screen in the head-up display device; the display screen is provided with display units arranged in an array, each display unit corresponding to displaying a sub-pixel of the image to be displayed; the display screen partitioning result is used to characterize the correspondence between the preset eye box partition and each display unit;

[0101] The display offset information determination module 203 is used to determine display offset information based on the tilt data of the beam splitter relative to the display unit in the head-up display device; the beam splitter is set on the display screen and is used to divide the image displayed on the display screen into a left view image and a right view image; the left view image and the right view image are used to construct a stereoscopic image; the display offset information is used to characterize the target pixel allocation method of the display screen when displaying the image to be displayed, and the offset relative to the partitioning result of the display screen.

[0102] The target pixel allocation method determination module 205 is used to determine the target pixel allocation method when the display screen displays the image to be displayed based on the display screen partitioning results and display offset information;

[0103] Display module 207 is used to display the image to be displayed based on the display screen and the target pixel allocation method.

[0104] In some alternative embodiments, the device further includes:

[0105] The preset eye box partition acquisition module is used to acquire preset eye box partitions; the preset eye box partitions include the left and right viewing areas arranged in a preset order.

[0106] The partition information determination module is used to determine the partition information of each display unit based on the arrangement of the left and right viewing areas in the preset eye box partitions;

[0107] The display screen partitioning result determination module is used to determine the display screen partitioning result based on the partitioning information.

[0108] In some optional embodiments, the display screen includes a periodically arranged combination of display units; the display offset information determination module includes:

[0109] The preset display unit is used to determine the number of preset display units in each display unit combination based on the tilt data of the beam splitter relative to the display unit in the head-up display device; the preset display unit is the display unit that is partially blocked by the beam splitter.

[0110] The display offset information determination unit is used to determine the display offset information based on the preset number of display units.

[0111] In some optional embodiments, the target pixel allocation method determination module includes:

[0112] The initial pixel allocation method determination submodule is used to determine the initial pixel allocation method when the display screen displays the image to be displayed, based on the display screen partitioning results.

[0113] The target pixel allocation method determination submodule is used to adjust the initial pixel allocation method based on the display offset information to obtain the target pixel allocation method.

[0114] In some optional embodiments, the target pixel allocation method determination submodule includes:

[0115] The offset data determination unit is used to determine the target pixel allocation method of the display screen when displaying the image to be displayed, based on the display offset information, and the offset data relative to the display screen partitioning result;

[0116] The target pixel allocation method determination unit is used to perform translation processing on the initial pixel allocation method based on offset data to obtain the target pixel allocation method.

[0117] In some optional embodiments, the display module includes:

[0118] The light emission state determination unit is used to determine the light emission state of each display unit in the display screen based on the target pixel allocation method.

[0119] The display screen lighting unit is used to light up the display screen based on the light emission state of each display unit, so that the light emitted from the display screen is split by the beam splitter to form the left view image and the right view image.

[0120] It should be noted that the display device embodiment of the head-up display device provided in this application is based on the same inventive concept as the above-described display method embodiment of the head-up display device.

[0121] This application also proposes a head-up display device, including: a display screen, a beam splitter, a memory, and a processor;

[0122] The display screen is used to display the image to be displayed;

[0123] A beam splitter is installed on the display screen to divide the image displayed on the screen into a left view image and a right view image; the left view image and the right view image are used to construct a stereoscopic image;

[0124] Memory is used to store processor-executable instructions;

[0125] The processor is configured to execute instructions to implement the display method of the head-up display device as described above.

[0126] Embodiments of this application also provide a computer-readable storage medium that can be disposed in a terminal to store at least one instruction or at least one program for implementing a display method of a head-up display device as described in the method embodiments. The at least one instruction or at least one program is loaded and executed by a processor to implement the display method of the head-up display device as described in the above method embodiments.

[0127] Optionally, in the embodiments of this specification, the storage medium may be located at at least one of the multiple network servers in a computer network. Optionally, in this embodiment, the storage medium may include, but is not limited to, various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0128] The memory described in this specification can be used to store software programs and modules. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory. The memory may primarily include a program storage area and a data storage area. The program storage area may store the operating system, applications required for functions, etc.; the data storage area may store data created based on the use of the device, etc. Furthermore, the memory may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory may also include a memory controller to provide the processor with access to the memory.

[0129] This application also provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the display method of the head-up display device provided in the above-described method embodiments.

[0130] The methods and embodiments provided in this application can be executed on a terminal, computer terminal, server, or similar computing device. Taking running on a server as an example, Figure 13 This is a hardware structure block diagram of a server for a display method of a head-up display device according to an exemplary embodiment. For example... Figure 13As shown, the server 300 can vary significantly due to different configurations or performance. It may include one or more Central Processing Units (CPUs) 310 (CPUs 310 may include, but are not limited to, microprocessors (MCUs) or programmable logic devices (FPGAs), a memory 330 for storing data, and one or more storage media 320 (e.g., one or more mass storage devices) for storing application programs 323 or data 322. The memory 330 and storage media 320 may be temporary or persistent storage. The program stored in the storage media 320 may include one or more modules, each module may include a series of instruction operations on the server. Furthermore, the CPU 310 may be configured to communicate with the storage media 320 and execute the series of instruction operations stored in the storage media 320 on the server 300. Server 300 may also include one or more power supplies 360, one or more wired or wireless network interfaces 350, one or more input / output interfaces 340, and / or one or more operating systems 321, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, etc.

[0131] The input / output interface 340 can be used to receive or send data via a network. Specific examples of the network described above may include a wireless network provided by the communication provider of server 300. In one example, the input / output interface 340 includes a network interface controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In another example, the input / output interface 340 may be a radio frequency (RF) module for wireless communication with the Internet.

[0132] Those skilled in the art will understand that Figure 13 The structure shown is for illustrative purposes only and does not limit the structure of the aforementioned electronic device. For example, server 300 may also include... Figure 13 More or fewer components than shown, or with Figure 13 Different configurations shown.

[0133] It should be noted that the order of the embodiments described above is merely for descriptive purposes and does not represent the superiority or inferiority of the embodiments. Furthermore, specific embodiments have been described above. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps described in the claims can be performed in a different order than that shown in the embodiments and still achieve the desired result. Additionally, the processes depicted in the drawings do not necessarily require a specific or sequential order to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0134] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the device and server embodiments are basically similar to the method embodiments, so the descriptions are relatively simple; relevant parts can be referred to the descriptions of the method embodiments.

[0135] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware, or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0136] The above are merely preferred embodiments of this application and are not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A display method of a head-up display device, characterized in that: The method comprises: Acquire an image to be displayed and a display screen partition result; the image to be displayed is an image to be displayed on a display screen in a head-up display device; the display screen is provided with display units distributed in an array, each of the display units corresponding to a sub-pixel in the image to be displayed; the display screen partition result is used to characterize the corresponding relationship between the preset eye box partition and each of the display units; Based on the tilt data of the spectral grating in the head-up display device relative to the display unit, display offset information is determined; the spectral grating is set on the display screen, and is used to divide the image displayed on the display screen into a left-view image and a right-view image; the left-view image and the right-view image are used to construct a stereoscopic image; the display offset information is used to characterize the target pixel allocation method of the display screen when displaying the image to be displayed, and the offset relative to the display screen partition result; Determining a target pixel allocation method when the display screen displays the image to be displayed based on the display screen partition result and the display offset information; Based on the display screen and the target pixel allocation method, the image to be displayed is displayed.

2. The method according to claim 1, characterized in that: Before obtaining the image to be displayed and the display screen partition result, the method further includes: Acquire the preset eye box partition; the preset eye box partition includes a left viewing area and a right viewing area arranged in a preset order; Determining partition information of each of the display units based on the arrangement of the left viewing area and the right viewing area in the preset eye box partition; The display screen partition result is determined based on the partition information.

3. The method according to claim 1 or 2, characterized in that: The display screen includes a periodically arranged display unit combination; the display offset information is determined based on the tilt data of the light splitting grating in the head-up display device relative to the display unit, including: Based on the tilt data of the beam splitter grating in the head-up display device relative to the display unit, determining the number of preset display units in each display unit combination; the preset display unit is a display unit partially blocked by the beam splitter grating; The display offset information is determined based on the number of the preset display units.

4. The method according to claim 1, characterized in that: The determining, based on the display screen partition result and the display offset information, a target pixel allocation method when the display screen displays the image to be displayed, comprises: Based on the display screen partition result, determining an initial pixel allocation method when the display screen displays the image to be displayed; Based on the display offset information, the initial pixel allocation mode is adjusted to obtain the target pixel allocation mode.

5. The method according to claim 4, characterized in that The adjusting the initial pixel allocation mode based on the display offset information to obtain the target pixel allocation mode includes: Based on the display offset information, determining a target pixel allocation mode of the display screen when displaying the image to be displayed, and offset data relative to a partition result of the display screen; Based on the offset data, the initial pixel allocation mode is translated to obtain the target pixel allocation mode.

6. The method according to claim 1, characterized in that The displaying the image to be displayed based on the display screen and the target pixel allocation method includes: Based on the target pixel allocation method, determining the light emitting state of each display unit in the display screen; Based on the light emitting state of each of the display units, the display screen is lit up, so that the light emitted from the display screen is split by the beam splitting grating to form the left-view image and the right-view image.

7. A display device of a head-up display device, characterized in that: The device comprises: An acquisition module is used to acquire an image to be displayed and a display screen partition result; the image to be displayed is an image to be displayed on a display screen in a head-up display device; the display screen is provided with display units distributed in an array, each of the display units corresponding to a sub-pixel in the image to be displayed; the display screen partition result is used to characterize the corresponding relationship between a preset eye box partition and each of the display units; A display offset information determination module, configured to determine display offset information based on tilt data of a spectral grating in the head-up display device relative to the display unit; the spectral grating is arranged on the display screen, configured to divide the image displayed on the display screen into a left-view image and a right-view image; the left-view image and the right-view image are used to construct a stereoscopic image; the display offset information is used to characterize the offset of a target pixel allocation method of the display screen when displaying the image to be displayed relative to a partition result of the display screen; A target pixel allocation mode determining module, used for determining a target pixel allocation mode when the display screen displays the image to be displayed based on the display screen partition result and the display offset information; A display module is used to display the image to be displayed based on the display screen and the target pixel allocation method.

8. A head-up display device, characterized in that: include: Display screen, beam splitter, memory and processor; The display screen is used to display the image to be displayed; The beam splitter grating is arranged on the display screen, and is used to divide the image displayed on the display screen into a left-view image and a right-view image; the left-view image and the right-view image are used to construct a stereoscopic image; The memory is a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the display method of the head-up display device according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The storage medium stores at least one instruction or at least one program, and the at least one instruction or at least one program is loaded and executed by the processor to implement the display method of the head-up display device according to any one of claims 1 to 6.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the display method of the head-up display device according to any one of claims 1 to 6 is implemented.

Images