Vehicle head-up display resolution control method, device, equipment and storage medium

Abstract

The application provides a vehicle head-up display resolution control method, device, equipment and storage medium. The specific implementation scheme is: obtaining to-be-displayed image data; judging whether the pixel of the to-be-displayed image data is a preset pixel; if the pixel of the to-be-displayed image data is the preset pixel, controlling a digital micromirror device (DMD) array to convert the to-be-displayed image data into a rhombus pixel array arrangement to obtain processed image data; and projecting the processed image data to a head-up display area of a vehicle through an optical assembly. Through the above scheme, the DMD array is controlled to convert the orthogonal pixel array arrangement with a length-width ratio of 1:1 of the to-be-displayed image data into a rhombus pixel array arrangement with a length-width ratio of 2:1, and the resolution of the image is improved through the way of supplementing pixel points, so that the high resolution requirement brought by a large field of view angle and a long imaging distance of an augmented reality head-up display can be met.

Description

Technical Field

[0001] This application relates to the field of vehicle head-up displays, and more particularly to a method, apparatus, device, and storage medium for controlling the resolution of a vehicle head-up display. Background Technology

[0002] Head-up displays (HUDs) can be installed in intelligent vehicles. These HUDs can be used to display virtual images, which may include image data of the road ahead.

[0003] In related technologies, the core of a head-up display (HUD) is the Picture Generation Unit (PGU), which typically displays a virtual image of the road ahead from the original image. However, due to its resolution limitations, the PGU can only display road images with a field of view (FOV) between 4° and 10°, and a virtual image distance (VID) of 2m to 5m. This is insufficient for Augmented Reality (AR-HUD), which requires displaying road images with an FOV of over 12° and a VID of over 7.5m, thus meeting the high-resolution requirements. Summary of the Invention

[0004] This application provides a method, apparatus, device, and storage medium for controlling the resolution of a vehicle head-up display (HUD) to meet the high-resolution requirements brought about by the large field of view and long imaging distance of AR-HUD.

[0005] In a first aspect, embodiments of this application provide a method for controlling the resolution of a vehicle head-up display, including:

[0006] Obtain the image data to be displayed;

[0007] Determine whether the pixels of the image data to be displayed are preset pixels;

[0008] If the pixels of the image data to be displayed are the preset pixels, then the DMD array is controlled to convert the image data to be displayed into a diamond-shaped pixel array arrangement to obtain the processed image data;

[0009] The processed image data is projected onto the vehicle's head-up display area using optical components.

[0010] In one possible implementation, the method further includes:

[0011] If the pixel of the image data to be displayed is not the pixel, then the image data to be displayed is preprocessed to convert the pixel into the preset pixel to obtain the preprocessed image data;

[0012] The DMD array is controlled to convert the preprocessed image data into a diamond-shaped pixel array arrangement to obtain the processed image data.

[0013] The processed image data is projected onto the vehicle's head-up display area using optical components.

[0014] In one possible implementation, before projecting the processed image data onto the vehicle's head-up display area via optical components, the method further includes:

[0015] The processed image data is subjected to pixel supplementation processing to obtain supplemented image data; wherein, the number of pixels in the horizontal direction of the supplemented image data is twice the number of pixels in the horizontal direction of the processed image data;

[0016] Accordingly, the projection of the processed image data onto the vehicle's head-up display area via optical components includes:

[0017] The supplemented image data is projected onto the vehicle's head-up display area via the optical components.

[0018] In one possible implementation, the image data to be displayed is preprocessed to convert pixels into preset pixels, resulting in preprocessed image data, including:

[0019] If the pixel count of the image data to be displayed is smaller than the preset pixel count, the image data to be displayed is scaled and edge-processed by the DMD controller to obtain the preprocessed image data with the pixel count of the preset pixel count.

[0020] If the number of pixels in the image data to be displayed is greater than the preset number of pixels, then the image data to be displayed is compressed and transformed using a preset algorithm to obtain the preprocessed image data with the number of pixels being the preset number of pixels.

[0021] In one possible implementation, acquiring the image data to be displayed includes:

[0022] The system receives the image data to be displayed sent by the vehicle host, wherein the pixels of the image data to be displayed include any of the following: 576px*288px, 1152px*576px, 1152px*1152px, and 2304px*1152px.

[0023] In one possible implementation, the preset pixel is 1152px*1152px.

[0024] Secondly, embodiments of this application provide a vehicle head-up display resolution control device, including: an acquisition module, a judgment module, a control module, and a projection module, wherein...

[0025] The acquisition module is used to acquire image data to be displayed;

[0026] The judgment module is used to determine whether the pixels of the image data to be displayed are preset pixels;

[0027] The control module is used to, if the pixels of the image data to be displayed are the preset pixels, control the DMD array to convert the image data to be displayed into a diamond-shaped pixel array arrangement to obtain the processed image data.

[0028] The projection module is used to project the processed image data onto the vehicle's head-up display area via optical components.

[0029] In one possible implementation, the apparatus further includes a preprocessing module.

[0030] The preprocessing module is used to preprocess the image data to be displayed if the pixel of the image data to be displayed is not the preset pixel, thereby converting the pixel into the preset pixel and obtaining the preprocessed image data.

[0031] The control module is used to control the DMD array to convert the preprocessed image data into a diamond-shaped pixel array arrangement to obtain processed image data.

[0032] The projection module is used to project the processed image data onto the vehicle's head-up display area via optical components.

[0033] In one possible implementation, before projecting the processed image data onto the vehicle's head-up display area via optical components, the device further includes a processing module.

[0034] The processing module is used to perform pixel supplementation processing on the processed image data to obtain supplemented image data; wherein, the number of pixels in the horizontal direction of the supplemented image data is twice the number of pixels in the horizontal direction of the processed image data;

[0035] Accordingly, the projection module is specifically used for:

[0036] The supplemented image data is projected onto the vehicle's head-up display area via the optical components.

[0037] In one possible implementation, the preprocessing module is specifically used for:

[0038] If the pixel count of the image data to be displayed is smaller than the preset pixel count, the image data to be displayed is scaled and edge-processed by the DMD controller to obtain the preprocessed image data with the pixel count of the preset pixel count.

[0039] If the number of pixels in the image data to be displayed is greater than the preset number of pixels, then the image data to be displayed is compressed and transformed using a preset algorithm to obtain the preprocessed image data with the number of pixels being the preset number of pixels.

[0040] In one possible implementation, the acquisition module is specifically used for:

[0041] The system receives the image data to be displayed sent by the vehicle host, wherein the pixels of the image data to be displayed include any of the following: 576px*288px, 1152px*576px, 1152px*1152px, and 2304px*1152px.

[0042] In one possible implementation, the preset pixel is 1152px*1152px.

[0043] Thirdly, a vehicle head-up display device is provided, comprising:

[0044] Processor, memory, and HUD optical lens assembly;

[0045] The memory stores a computer program, and the processor executes the computer program in the memory to cause the vehicle head-up display device to perform a method for controlling the vehicle head-up display resolution.

[0046] Fourthly, a vehicle is provided, including: the vehicle head-up display device described in the third aspect.

[0047] Fifthly, a computer program product is provided, the computer program product comprising: a computer program stored in a readable storage medium.

[0048] At least one processor of the vehicle head-up display device can read the computer program from the readable storage medium, and the at least one processor executes the computer program to cause the vehicle head-up display device to perform the vehicle head-up display resolution control method described in the first aspect.

[0049] In a sixth aspect, a computer-readable storage medium is provided, the computer-readable storage medium storing computer-executable instructions for causing the computer to perform the vehicle head-up display resolution control method described in the first aspect.

[0050] This application provides a method, apparatus, device, and storage medium for controlling the resolution of a vehicle head-up display (HUD). By acquiring image data to be displayed, the method determines whether the pixels in the image data are preset pixels. If the pixels are preset pixels, no processing is performed. If the pixels are not preset pixels, the image data is processed by a DMD controller or a preset algorithm. The DMD array is controlled to convert the image data that meets the preset pixel requirement (no processing) or the pre-processed image data into a diamond-shaped pixel array arrangement, resulting in processed image data. This processed image data can be projected onto the vehicle's HUD area using optical components. Alternatively, pixel supplementation processing can be performed on the processed image data to obtain supplemented image data, which is then projected onto the vehicle's HUD area. Through this scheme, the DMD array is controlled to transform the 1:1 aspect ratio orthogonal pixel array arrangement of the image data to be displayed into a 2:1 aspect ratio diamond-shaped pixel array arrangement, thus improving the image resolution and meeting the high-resolution requirements of the large field of view and long imaging distance of augmented reality HUDs. Attached Figure Description

[0051] The accompanying drawings, which are provided to further illustrate this application and form part of this application, illustrate exemplary embodiments of this application and are used to explain this application, but do not constitute an undue limitation of this application.

[0052] Figure 1 A schematic diagram of a vehicle head-up display scenario provided in an embodiment of this application;

[0053] Figure 2 A flowchart illustrating a vehicle head-up display resolution control method provided in an embodiment of this application;

[0054] Figure 3 This is a schematic diagram of a DMD array structure provided in an embodiment of this application;

[0055] Figure 4 A schematic diagram illustrating the transformation of an orthogonal pixel array into a rhombic pixel array, provided in an embodiment of this application;

[0056] Figure 5 A schematic diagram illustrating the projection of an image using an optical component, provided as an embodiment of this application;

[0057] Figure 6 This is a schematic flowchart illustrating a method for controlling the resolution of a vehicle head-up display, as provided in an embodiment of this application.

[0058] Figure 7 This is a schematic diagram of a pixel tilting structure provided in an embodiment of this application;

[0059] Figure 8 This is a schematic diagram of a pixel sample point supplementation structure provided in an embodiment of this application;

[0060] Figure 9 This is a schematic diagram of the structure of a vehicle head-up display resolution control device provided in an embodiment of this application;

[0061] Figure 10 This application provides a vehicle head-up display device. Detailed Implementation

[0062] The exemplary embodiments of this disclosure are described below with reference to the accompanying drawings, including various details of the embodiments to aid understanding. These drawings and descriptions are not intended to limit the scope of the concept in any way and should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of this disclosure.

[0063] Figure 1 This is a schematic diagram illustrating a vehicle head-up display scenario provided in an embodiment of this application. Please refer to [link / reference]. Figure 1 Car A is equipped with a head-up display, which can be a windshield-type head-up display (W-HUD) or an augmented reality head-up display (AR-HUD). The W-HUD can process images within a field of view (FOV) of FOV1, such as the image of car B, and can achieve an imaging distance (Virtual Image Distance, VID1). The AR-HUD can process images within a field of view of FOV2, such as the images of cars B and C, and can achieve an imaging distance of VID2.

[0064] In related technologies, the core of a head-up display (HUD) is the Picture Generation Unit (PGU), which typically displays a virtual image of the original road ahead. However, due to its resolution limitations, the PGU can only display road images with a field of view (FOV) between 4° and 10°, and a visual ID (VID) of 2m to 5m, which is insufficient for AR-HUD. AR-HUD requires displaying road images with a FOV greater than 12° and a VID greater than 7.5m, thus necessitating high resolution.

[0065] In this embodiment, the Augmented Reality Head-Up Display (AR-HUD) can acquire image data to be displayed and determine whether the pixels of the image data are preset pixels. If the pixels of the image data are preset pixels, the Digital Micromirror Devices (DMD) array is controlled to convert the image data into a diamond-shaped pixel array arrangement, obtaining processed image data. The processed image data is then projected onto the vehicle's head-up display area through optical components. Since the AR-HUD can control the DMD array to transform the 1:1 aspect ratio orthogonal pixel array arrangement of the image data to be displayed into a 2:1 aspect ratio diamond-shaped pixel array arrangement, and then supplement pixels, the image resolution is improved, thereby meeting the high resolution requirements of the large field of view and long imaging distance of the AR-HUD.

[0066] The technical solutions shown in this application will now be described in detail through specific embodiments. It should be noted that the following embodiments may exist independently or in combination with each other; for identical or similar content, the description will not be repeated in different embodiments.

[0067] Figure 2 This is a flowchart illustrating a vehicle head-up display resolution control method provided in an embodiment of this application. Please refer to... Figure 2 The method may include:

[0068] S201. Obtain the image data to be displayed.

[0069] The execution subject in this application embodiment can be an augmented reality head-up display (AR-HUD) or a vehicle head-up display resolution control device installed within the AR-HUD. The vehicle head-up display resolution control device can be implemented through software or a combination of software and hardware. For ease of understanding, the following description will use an AR-HUD as the execution subject.

[0070] In this step, to allow the driver to access driving-related data without taking their eyes off the road while the vehicle is in motion, it is necessary to provide the driver with image data of the road ahead, such as images of the road ahead, images of vehicles ahead, or navigation images. This image data is then displayed in the vehicle's head-up display (HUD), thus requiring the AR-HUD to acquire the image data to be displayed. Specifically, the AR-HUD can receive images of the road ahead sent by the vehicle's main unit, images of vehicles ahead sent by a camera, or navigation images sent by the navigation system.

[0071] Image data refers to data expressed in the form of images. Image data can include various types, such as commonly used photographs, pictures taken with a mobile phone, or images captured by a camera at a certain moment, as well as image frames from videos, etc., which can be projected onto the vehicle's head-up display. There are no restrictions on the specific data type and content.

[0072] Optionally, the image data to be displayed can be: images of vehicles ahead, pedestrians on the road ahead, forks in the road ahead, signs ahead, and other images that can be collected when the vehicle is moving or stopped.

[0073] Different images can have different resolutions.

[0074] Resolution typically refers to the number of pixels (Pixels, Px) that a screen can display. Resolution can be expressed by the number of pixels in the length (per row) and width (per column). For example, a resolution of 576px * 576px means that both the length and width directions can include 576px.

[0075] A pixel is the most basic unit and element in forming a digital image; it is the unit of resolution. A pixel is the smallest unit that constitutes an image.

[0076] Screen size is generally fixed. Higher resolution means denser pixels per unit distance, resulting in higher image quality. For example, a computer screen resolution of 1280px * 720px means it displays 1280 pixels per row and 720 pixels per column; an image resolution of 500px * 500px means each row and column has 500 pixels.

[0077] In one feasible implementation, the AR-HUD can receive an image of the road ahead sent to it by the vehicle's main unit, and this road image is the image data to be displayed. For example, the AR-HUD can receive a road condition image sent by the vehicle's main unit, where the image's pixels are pixel 1, and pixel 1 can be: 576px*288px, 1152px*576px, 1152px*1152px, or 2304px*1152px.

[0078] S202. Determine whether the pixels of the image data to be displayed are preset pixels.

[0079] In this step, after the AR-HUD acquires the image data to be displayed, it needs to determine the pixel size of the image data to see if it is suitable for inclusion in the DMD array. In practice, this can be achieved by setting a preset pixel size and comparing the pixel size of the image data to be displayed with that preset size to determine if the image data matches the preset pixel size.

[0080] The preset pixels can be manually set according to needs. For example, the preset pixels are 1152px*1152px.

[0081] Optionally, the preset pixels can be 1152px*1152px, 2304px*2304px, or 4096px*4096px.

[0082] In one specific implementation, the preset pixel size is 1152px*1152px.

[0083] For example, if the pixel of the road image received by the AR-HUD is pixel 1, and the preset pixel is 1152px*1152px, then the AR-HUD can determine whether pixel 1 is the preset pixel.

[0084] S203. If the pixels of the image data to be displayed are preset pixels, then control the DMD array to convert the image data to be displayed into a diamond pixel array arrangement to obtain the processed image data.

[0085] In this step, if the pixels of the image data to be displayed are determined to be preset pixels, it indicates that the pixels of the image data to be displayed cannot meet the high resolution requirements of AR-HUD. To assist the driver in better observing road conditions, the pixels of the image data to be displayed need to be processed to provide high-resolution image data. In a specific implementation, the DMD array can be controlled to convert the image data to be displayed into a diamond-shaped pixel array arrangement to increase the pixel count of the image data to be displayed, thereby obtaining processed image data.

[0086] Below, in conjunction with Figure 3 The structure of the DMD array will be explained.

[0087] Figure 3 This is a schematic diagram of a DMD array structure provided in an embodiment of this application. Please refer to [link / reference]. Figure 3 ,

[0088] A DMD is a microelectromechanical system with electronic input and optical output. It consists of many small aluminum mirrors, each called a pixel. The number of mirrors is determined by the display resolution, with one small mirror corresponding to one pixel.

[0089] The array has a rhomboid (rotated square) structure with 1152 rows and 1152 columns, an aspect ratio of 2:1, and a total of 1,327,104 micromirrors. This array corresponds to the preset pixel size of 1152px*1152px and can receive and convert 1152px*1152px orthogonal pixel arrays.

[0090] The aspect ratio of the DMD array provided in this embodiment can be 2:1. The aspect ratio of the array corresponds one-to-one with the aspect ratio of the preset pixel shape, and it can receive orthogonal pixel arrays that are converted to be consistent with the preset pixels.

[0091] Below, in conjunction with Figure 4 The following example illustrates how a 4x4 orthogonal pixel array can be transformed into a rhombus pixel array.

[0092] Figure 4 This is a schematic diagram illustrating the transformation of an orthogonal pixel array into a rhombic pixel array, as provided in an embodiment of this application. Please refer to... Figure 4 An orthogonal pixel array of 4px*4px is output after being reflected by a diamond structure array. At this time, the orthogonal pixel array of 4px*4px with an aspect ratio of 1:1 is transformed into a diamond pixel array with a pixel size of 4px*4px and an aspect ratio of 2:1. The output image pixels are the pixels after the DMD array is transformed, which have the pixels of the diamond pixel array.

[0093] If pixel 1 of the image to be displayed is a preset pixel size of 1152px*1152px, then the DMD array is controlled to output pixel 1, which is an orthogonal pixel array of 1152px*1152px, after reflection through a diamond structure array. At this time, the pixel is transformed from an image with an aspect ratio of 1:1 from an orthogonal pixel array of 1152px*1152px to an image with an aspect ratio of 2:1. The output pixel is the pixel transformed by the DMD array, which has a diamond pixel array.

[0094] S204. The processed image data is projected onto the vehicle's head-up display area using optical components.

[0095] After acquiring the processed image data, the AR-HUD can send the processed image data to the vehicle's head-up display area through optical components for the driver to observe and use.

[0096] To better illustrate how the optical components project processed image data onto the vehicle's head-up display area, the following section combines... Figure 5 Explanation of the projected images of the optical components.

[0097] Figure 5 This is a schematic diagram illustrating the projection of an image using optical components, as provided in an embodiment of this application. Please refer to [link / reference]. Figure 5 The optical components use the principle of optical reflection to create an image on the windshield, allowing the driver to view driving information without taking their eyes off the road.

[0098] Optical components may include secondary mirrors and curved mirrors. The secondary mirrors and curved mirrors in the optical components must be designed to achieve a field of view (FOV) ≥ 12° and a visual ID (VID) ≥ 7.5m.

[0099] FOV refers to the area of ​​view visible to the human eye; it is an angular concept. FOV includes the vertical field of view, horizontal field of view, and diagonal field of view. Unless otherwise specified, the horizontal field of view is usually the default FOV.

[0100] VID can be understood as the distance from the image focus to the eye. The farther the imaging can cover, the larger the image size.

[0101] The head-up display area refers to the area of ​​processed image data that the driver can see when looking straight ahead.

[0102] If the pixel 1 of the image to be displayed is 1152px*1152px, it is a diamond-shaped pixel array with an aspect ratio of 2:1. The image data is sent by the PGU, and after being reflected by the secondary mirror and curved mirror in the optical component, it enters the windshield, forms a virtual image on the windshield, and is then reflected into the driver's field of vision. The driver can see the projected image on the road ahead through the windshield.

[0103] The vehicle head-up display resolution control method provided in this application embodiment allows the AR-HUD to acquire image data to be displayed and determine whether the pixels of the image data are preset pixels. If the pixels of the image data are preset pixels, the DMD array can be controlled to convert the image data into a diamond-shaped pixel array arrangement to obtain processed image data; the processed image data is then projected onto the vehicle's head-up display area through optical components. Since the AR-HUD can control the DMD array to transform the image data to be displayed, which has an aspect ratio of 1:1 orthogonal pixel array arrangement, into an aspect ratio of 2:1 diamond-shaped pixel array arrangement, the image resolution is improved, thereby meeting the high resolution requirements of the large field of view and long imaging distance of the augmented reality head-up display.

[0104] Below, in Figure 2 Based on the illustrated embodiments, combined with Figure 6 The above-mentioned method for controlling the resolution of vehicle head-up display is explained in detail.

[0105] Figure 6 This is a schematic flowchart illustrating a vehicle head-up display resolution control method provided in an embodiment of this application. Please refer to... Figure 6 The method includes:

[0106] S601. Obtain the image data to be displayed.

[0107] It should be noted that the specific execution process of step S601 can be found in the specific execution process of step S201, and will not be repeated here.

[0108] S602. Determine whether the pixels of the image data to be displayed are preset pixels.

[0109] In this step, after the AR-HUD acquires the image data to be displayed, it needs to determine the pixel size of the image data to determine whether the image data to be displayed needs to be entered into the DMD array or needs to be preprocessed.

[0110] In practice, a preset pixel can be set, and the pixel size of the image data to be displayed can be compared with the preset pixel size to determine whether the pixel size of the image data to be displayed is the preset pixel size.

[0111] If the pixels of the image data to be displayed are preset pixels, then execute S603; if they are not preset pixels, then execute S604 and then execute S603.

[0112] If the pixel of the image data to be displayed is pixel 1, and the preset pixel is 1152px*1152px, then pixel 1 is the preset pixel, then execute S603; if pixel 1 is 576px*288px, 1152px*576px, or 2304px*1152px, and the preset pixel is 1152px*1152px, then pixel 1 is not the preset pixel, then execute S604.

[0113] S603: Control the DMD array to convert the preprocessed image data into a diamond-shaped pixel array arrangement to obtain the processed image data.

[0114] It should also be noted that the specific execution process of step S603 can be found in the specific execution process of step S203, and will not be repeated here.

[0115] S604. Preprocess the image data to be displayed by converting pixels into preset pixels to obtain preprocessed image data.

[0116] In this step, if it is determined that the pixels of the image data to be displayed are not preset pixels, it includes two cases: the pixels of the image data to be displayed are smaller than the preset pixels and the pixels of the image data to be displayed are larger than the preset pixels. Neither of these two cases meets the requirements for converting the DMD array into a diamond pixel array. Therefore, preprocessing is required to convert the pixels of the image data to be displayed into preset pixels, thereby obtaining preprocessed image data, which in turn meets the requirements for converting the DMD array into a diamond pixel array.

[0117] Optionally, preprocessing may include the following two cases:

[0118] Case 1: The number of pixels in the image data to be displayed is less than the preset number of pixels.

[0119] In this case, the DMD controller can be used to scale and edge-process the image data to be displayed, resulting in preprocessed image data with preset pixel values.

[0120] The pixel count of the image data to be displayed is less than the preset pixel count, which means that the pixel count in at least one direction of the length or width is less than the pixel count in the corresponding direction of the preset pixel count. For example, if the preset pixel count is 1152px*1152px, the pixel count smaller than the preset pixel count can be: 576px*288px, 2304px*576px, or 1150px*1152px.

[0121] A DMD controller is a chip that can process images and carries software that can scale pixels and perform edge processing on image data.

[0122] Taking the processing of a displayable image data by a DMD controller as an example, the pixel size of the displayable image data can be 576px*288px, 2304px*576px, or 1150px*1152px.

[0123] For example, if the pixel count of the image data to be displayed is 576px*288px, the DMD controller runs a scaling algorithm, which can directly double the number of pixels in the length direction and quadruple the number of pixels in the width direction, resulting in a scaled image data of 1152px*1152px.

[0124] For example, if the displayed image data has a pixel count of 576px * 288px, the DMD controller can run a scaling algorithm. It can first double the number of pixels in the width direction of 576px * 288px, resulting in a scaled image data with a pixel count of 576px * 576px. Then, it can double the number of pixels in both the length and width directions of 576px * 576px, resulting in a scaled image data with a pixel count of 1152px * 1152px.

[0125] For example, if the pixel count of the image data to be displayed is 576px * 288px, the DMD controller runs a scaling algorithm. It can first double the number of pixels in the length direction of 576px * 288px, resulting in a scaled image data of 1152px * 288px. Then, it can quadruple the number of pixels in the width direction of 1152px * 288px, resulting in a scaled image data of 1152px * 1152px.

[0126] For example, if the image data to be displayed has a pixel count of 2304px * 576px, the DMD controller runs a scaling algorithm, doubling the number of pixels in the width direction of 2304px * 576px, resulting in a scaled image data with a pixel count of 2304px * 1152px. The DMD controller then runs another scaling algorithm, halving the number of pixels in the length direction of 2304px * 1152px, resulting in a scaled image data with a pixel count of 1152px * 1152px.

[0127] For example, if the image data to be displayed has a pixel count of 2304px * 576px, the DMD controller runs a scaling algorithm, reducing the number of pixels in the length direction of 2304px * 576 by half, resulting in a scaled image data with a pixel count of 1152px * 576px. The DMD controller then continues to run a scaling algorithm, doubling the number of pixels in the width direction of 1152px * 576px, resulting in a scaled image data with a pixel count of 1152px * 1152px.

[0128] For example, if the image data to be displayed has 1150px*1151px pixels, the DMD controller runs an edge algorithm to add 2 pixels in the width direction and 1 pixel in the length direction of the 1150px*1152px image, resulting in an image data of 1152px*1152px pixels.

[0129] For example, if the image data to be displayed has a pixel size of 1150px * 1151px, the DMD controller runs an edge algorithm. First, it adds one pixel to the width direction of 1150px * 1151px, resulting in an image data size of 1150px * 1152px. Then, it adds one pixel to the length direction of 1150px * 1152px, resulting in an image data size of 1151px * 1152px. Finally, it adds one pixel to the length direction of 1151px * 1152px, resulting in an image data size of 1152px * 1152px.

[0130] For example, if the pixel size of the image data to be displayed is 1150px * 1151px, the DMD controller can run an edge algorithm to first add one pixel in the length direction of 1150px * 1151px, resulting in an image data size of 1151px * 1151px. Then, add one pixel in the length direction of 1151px * 1151px, resulting in an image data size of 1152px * 1151px. Finally, add one pixel in the width direction of 1151px * 1152px, resulting in an image data size of 1152px * 1152px.

[0131] In one feasible implementation, when the DMD controller performs scaling and edge processing calculations on the pixels of the image data, it is not limited whether the pixels of the image data to be displayed are scaled and edge-processed to the preset pixel size once or multiple times.

[0132] It should be noted that if the pixels of the image data to be displayed differ significantly from the pixels required by the DMD controller to run edge and scaling algorithms, a pixel processing algorithm can be used first to process the pixels in the length and width directions into pixels suitable for scaling and edge processing by the DMD controller. Pixels suitable for scaling and edge processing by the DMD controller can be 576px*288px, 2304px*576px, or 1150px*1152px. For example, the pixel processing algorithm can first process a pixel of 520px*240px into 576px*288px, and then the DMD controller can convert the 576px*288px pixel into the preset pixel of 1152px*1152px. In one specific implementation, the pixels of the image data to be displayed are pixels that the DMD controller can scale and process for edges.

[0133] Case 2: The number of pixels in the image data to be displayed is greater than the preset number of pixels.

[0134] In this case, a preset algorithm can be run to compress and transform the image data to be displayed, and then perform trapezoidal transformation to obtain the preprocessed image data with preset pixel values.

[0135] The image data to be displayed has pixels greater than the preset pixels, meaning that the pixels in both the length and width directions are greater than the corresponding pixels in the preset pixels; or the pixels in one of the length and width directions are equal to the corresponding pixels in the preset pixels, and the pixels in the other direction are greater than the corresponding pixels in the preset pixels. For example, if the preset pixels are 1152px * 1152px, the pixels greater than the preset pixels could be 2304px * 1152px or 2304px * 2304px.

[0136] The preset algorithm can include compression transformation algorithm and trapezoidal transformation algorithm. Taking the processing of image data to be displayed using the preset algorithm as an example, the image data to be displayed can be 2304px*1152px or 2304px*2304px in pixels.

[0137] For example, if the image data to be displayed has a pixel size of 2304px*2304px, running the preset algorithm will directly compress the number of pixels in the length direction of 2304px*2304px by half and the number of pixels in the width direction by half. The compressed image data will have a pixel size of 1152px*1152px.

[0138] For example, if the pixel count of the image data to be displayed is 2304px*2304px, the preset algorithm first compresses the number of pixels in the length direction of 2304px*2304px by half, and the compressed image data has a pixel count of 1152px*2304px. Then, the pixel count in the width direction of 1152px*2304px is compressed by half, and the compressed image data has a pixel count of 1152px*1152px.

[0139] For example, if the pixel count of the image data to be displayed is 2304px*2304px, the preset algorithm will first compress the number of pixels in the width direction of 2304px*2304px by half, and the compressed image data will have a pixel count of 2304px*1152px. Then, the pixel count in the length direction of 2304px*1152px will be compressed by half, and the compressed image data will have a pixel count of 1152px*1152px.

[0140] When running the preset algorithm to compress and transform the pixels of the image data, whether the pixel compression and trapezoidal transformation of the image data to be displayed is processed to the preset pixel size once, or the pixel compression and trapezoidal transformation of the image data to be displayed is processed to the preset pixel size multiple times, there is no restriction here.

[0141] It should also be noted that if the number of pixels in the image data to be displayed differs significantly from the number of pixels required to run the preset algorithm, a pixel processing algorithm can be used first to process the pixels in the length and width directions into pixels suitable for compression and trapezoidal transformation. The pixels suitable for running the preset algorithm can be 2304px * 1152px. For example, the pixel processing algorithm processes the pixel 2200px * 1152px into 2304x * 1152px, and then the preset algorithm transforms the 2304x * 1152px pixel into the preset pixel 1152px * 1152px. In one specific implementation, the pixels in the image data to be displayed are the pixels required for compression and trapezoidal transformation by running the preset algorithm.

[0142] At this point, the preprocessed image becomes the image data to be displayed.

[0143] For example, if the pixel of the image data to be displayed is pixel 1: 1152px * 576px, then the DMD controller will use a scaling algorithm to scale pixel 1, which has a resolution of 1152px * 576px, to obtain a scaled pixel of 1152px * 1152px. Then, step S603 will be executed.

[0144] S605. Perform pixel supplementation processing on the processed image data to obtain supplemented image data.

[0145] In this step, since the DMD array has already converted the image data to be displayed into a diamond-shaped pixel array arrangement, and the diamond-shaped pixel array structure is tilted, it is not easily perceived by the driver. Therefore, it is necessary to supplement the processed image data with pixels to obtain supplemented image data, which is easier for the driver to perceive. Specifically, this can be achieved by actively supplementing pixels when the driver observes visually or by actively supplementing pixels through AR-HUD.

[0146] Below, in conjunction with Figure 7 Explain the pixel tilt structure.

[0147] Figure 7 This is a schematic diagram of a pixel tilting structure provided in an embodiment of this application. Figure 7 As shown, since it is not easy to perceive the array structure in the tilt direction during visual observation, pixel sample points are actively added at the intersection of the two rhomboid structures to make the image data clearer.

[0148] Combination Figure 8 The specific process for supplementing the rhombus pixel array is explained. Figure 8 This is a schematic diagram of a pixel sample point supplementation structure provided in an embodiment of this application. Please refer to... Figure 8 The pixel sample points (circles) of the rhombus array image after DMD array conversion are arranged with the rhombus as the center and the odd and even positions are staggered. The pixel sample points are aligned with the center point of the micro-mirrors on the DMD rhombus array.

[0149] In one optional implementation, during observation and recognition, since the pixel array structure in the tilt direction is not sensitive and the aspect ratio of the rhombus pixels after reflection by the DMD array is 2:1, during visual recognition, pixel sample points (squares) will be actively added at the intersection of the two rhombus structures, so that the number of pixels in the length direction of the supplemented image data is twice that of the processed image data in the length direction.

[0150] For example, if the pixel of the image to be displayed is pixel 1, and pixel 1 is the processed image data pixel of 1152px*1152px with an aspect ratio of 2:1, then after identifying and actively supplementing pixel sample points, image data of 2304px*1152px can be obtained.

[0151] Optionally, pixel supplementation can be performed using a pixel supplementation algorithm before visual recognition actively supplements pixel sample points. This algorithm can run in an AR-HUD, which can actively supplement the rhombus-shaped pixel array after the DMD array is converted, adding pixel sample points (squares) at the intersections of the rhombus array. Since the aspect ratio of the DMD array is 2:1, after supplementing the pixel samples using AR-HUD, the number of pixels in the length direction of the supplemented image data can be twice that of the processed image data.

[0152] For example, if the pixel of the image to be displayed is pixel 1, and pixel 1 is the processed image data 1152px*1152px with an aspect ratio of 2:1, after pixel supplementation by AR-HUD, the image data with a pixel value of 2304px*1152px can be obtained.

[0153] S606: The processed image data is projected onto the vehicle's head-up display area via optical components.

[0154] In one feasible implementation, the pixels of the image data output by the PGU are of a preset pixel size with an aspect ratio of 2:1. When the processed image data is projected onto the head-up display area of ​​the vehicle through the optical components, the driver will automatically supplement the image pixels at the intersection of the diamond array when observing the virtual image in front, so that the observed image pixels are the final pixels that are desired.

[0155] For example, if the pixel of the image to be displayed is pixel 1, and pixel 1 is the processed image data pixel with a pixel size of 1152px*1152px and an aspect ratio of 2:1, after being projected onto the vehicle's head-up display area by the optical components, when the driver observes the vehicle's head-up display area, after visual supplementation of pixels, an image with a pixel size of 2304px*1152px can be observed.

[0156] In one alternative implementation, the pixels of the image output by the PGU are pixel images that have already been pixel-supplemented. After being projected onto the head-up display area of ​​the vehicle by the optical components, there is no need for further visual pixel supplementation.

[0157] For example, if pixel 1 is the supplemented image data pixel, with a pixel size of 2304px*1152px and an aspect ratio of 2:1, after being projected onto the vehicle's head-up display area by the optical components, the driver can see the image with a pixel size of 2304px*1152px without needing to go through visual supplementation pixels.

[0158] In a vehicle head-up display resolution control method provided in this application, the AR-HUD can acquire image data to be displayed and determine whether the pixels of the image data to be displayed are preset pixels. If the pixels of the image data to be displayed are preset pixels, the DMD array can be controlled to convert the image data to be displayed into a diamond-shaped pixel array arrangement to obtain processed image data; if the pixels of the image data to be displayed are not the preset pixels, the image data to be displayed is preprocessed to convert the pixels into preset pixels to obtain preprocessed image data.

[0159] The preprocessing process includes scaling and edge processing of the image data to be displayed if the number of pixels is less than a preset number of pixels, using the DMD controller; and compression and trapezoidal transformation of the image data to be displayed if the number of pixels is greater than the preset number of pixels, using a preset algorithm. Alternatively, the processed image data can be directly projected onto the vehicle's head-up display area, or pixel supplementation can be performed on the processed image data to obtain supplemented image data; wherein the number of pixels in the length direction of the supplemented image data is twice that of the processed image data in the length direction.

[0160] The supplemented image data is then projected onto the vehicle's head-up display area via the optical components. Since the AR-HUD can control the DMD array to transform the image data to be displayed, with pixels arranged in a 1:1 orthogonal pixel array with a preset aspect ratio, into a 2:1 rhombic pixel array, and then supplement pixels, the image resolution is improved, thus meeting the high-resolution requirements of the large field of view and long imaging distance of augmented reality head-up displays.

[0161] Below, in conjunction with Figure 9 The structure of a vehicle head-up display resolution control device is analyzed.

[0162] Figure 9 This is a schematic diagram of a vehicle head-up display resolution control device provided in an embodiment of this application. Please refer to... Figure 9 The vehicle head-up display resolution control device 10 provided in this embodiment includes: an acquisition module 11, a judgment module 12, a control module 13, and a projection module 14, wherein...

[0163] The acquisition module 11 is used to acquire image data to be displayed;

[0164] The judgment module 12 is used to determine whether the pixels of the image data to be displayed are preset pixels;

[0165] The control module 13 is used to control the DMD array to convert the image data to be displayed into a diamond pixel array arrangement if the pixels of the image data to be displayed are the preset pixels, so as to obtain the processed image data.

[0166] The projection module 14 is used to project the processed image data onto the vehicle's head-up display area through optical components.

[0167] The vehicle head-up display resolution control device provided in this application embodiment can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar, and will not be described again here.

[0168] In one possible implementation, the apparatus further includes a preprocessing module 15.

[0169] The preprocessing module 15 is used to preprocess the image data to be displayed if the pixel of the image data to be displayed is not the pixel, and convert the pixel into the preset pixel to obtain the preprocessed image data.

[0170] The control module 13 is used to control the DMD array to convert the preprocessed image data into a diamond-shaped pixel array arrangement to obtain processed image data.

[0171] The projection module 14 is used to project the processed image data onto the vehicle's head-up display area through optical components.

[0172] In one possible implementation, before projecting the processed image data onto the vehicle's head-up display area via optical components, the device further includes a processing module 16.

[0173] The processing module is used to perform pixel supplementation processing on the processed image data to obtain supplemented image data; wherein, the number of pixels in the horizontal direction of the supplemented image data is twice the number of pixels in the horizontal direction of the processed image data;

[0174] Accordingly, the projection module 14 is specifically used for:

[0175] The supplemented image data is projected onto the vehicle's head-up display area via the optical components.

[0176] In one possible implementation, the preprocessing module 15 is specifically used for:

[0177] If the pixel count of the image data to be displayed is smaller than the preset pixel count, the image data to be displayed is scaled and edge-processed by the DMD controller to obtain the preprocessed image data with the pixel count of the preset pixel count.

[0178] If the number of pixels in the image data to be displayed is greater than the preset number of pixels, then the image data to be displayed is compressed and transformed using a preset algorithm to obtain the preprocessed image data with the number of pixels being the preset number of pixels.

[0179] In one possible implementation, the acquisition module 11 is specifically used for:

[0180] The system receives the image data to be displayed sent by the vehicle host, wherein the pixels of the image data to be displayed include any of the following: 576px*288px, 1152px*576px, 1152px*1152px, and 2304px*1152px.

[0181] In one possible implementation, the preset pixel is 1152px*1152px.

[0182] The vehicle head-up display resolution control device provided in this application embodiment can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar, and will not be described again here.

[0183] Figure 10 This application provides a vehicle head-up display device as an embodiment. Please refer to [link to relevant documentation]. Figure 10 The vehicle head-up display device 20 includes: a processor 21, a memory 22, and a HUD optical lens group 23;

[0184] The memory 22 stores a computer program, and the processor 21 executes the computer program in the memory 22 to cause the vehicle head-up display device 20 to perform a vehicle head-up display resolution control method.

[0185] Accordingly, this application provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the vehicle head-up display resolution control method described in the above method embodiments.

[0186] Accordingly, embodiments of this application may also provide a computer program product, including a computer program, which, when executed by a processor, can implement the vehicle head-up display resolution control method shown in the above method embodiments.

[0187] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0188] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0189] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0190] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0191] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0192] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0193] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0194] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0195] The above description is merely an embodiment of this application and is not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A method for controlling the resolution of a vehicle head-up display, characterized in that, include: Obtain the image data to be displayed; Determine whether the pixels of the image data to be displayed are preset pixels; If the pixels of the image data to be displayed are the preset pixels, then the digital micromirror device (DMD) array is controlled to convert the image data to be displayed into a diamond-shaped pixel array arrangement to obtain the processed image data. If the pixel count of the image data to be displayed is smaller than the preset pixel count, the image data to be displayed is scaled and edge-processed by the DMD controller to obtain pre-processed image data with the pixel count of the preset pixel count. If the number of pixels in the image data to be displayed is greater than the preset number of pixels, then the image data to be displayed is compressed and transformed using a preset algorithm to obtain preprocessed image data with the number of pixels being the preset number of pixels. The DMD array is controlled to convert the preprocessed image data into a diamond-shaped pixel array arrangement to obtain the processed image data. The processed image data is projected onto the vehicle's head-up display area using optical components.

2. The method according to claim 1, characterized in that, Before projecting the processed image data onto the vehicle's head-up display area using optical components, the method further includes: The processed image data is subjected to pixel supplementation processing to obtain supplemented image data; wherein, the number of pixels in the horizontal direction of the supplemented image data is twice the number of pixels in the horizontal direction of the processed image data; Accordingly, the projection of the processed image data onto the vehicle's head-up display area via optical components includes: The supplemented image data is projected onto the vehicle's head-up display area via the optical components.

3. The method according to claim 1 or 2, characterized in that, The acquisition of the image data to be displayed includes: The system receives the image data to be displayed sent by the vehicle's main unit, wherein the pixels of the image data to be displayed include any of the following: 576px. 288px, 1152px 76px, 1152px 1152px and 2304px 1152px.

4. The method according to claim 3, characterized in that, The preset pixel is 1152px. 1152px.

5. A vehicle head-up display resolution control device, characterized in that, include: The image acquisition module is used to acquire image data to be displayed. The judgment module is used to determine whether the pixels of the image data to be displayed are preset pixels; The control module is used to control the DMD array to convert the image data to be displayed into a diamond-shaped pixel array arrangement if the pixels of the image data to be displayed are the preset pixels, so as to obtain the processed image data. The control module is further configured to: if the pixels of the image data to be displayed are smaller than the preset pixels, scale and perform edge processing on the image data to be displayed through the DMD controller to obtain preprocessed image data with the preset pixels; if the pixels of the image data to be displayed are larger than the preset pixels, compress and transform the image data to be displayed through a preset algorithm to obtain preprocessed image data with the preset pixels; and control the DMD array to convert the preprocessed image data into a diamond-shaped pixel array arrangement to obtain processed image data. A projection module is used to project the processed image data onto the vehicle's head-up display area via optical components.

6. A vehicle head-up display device, characterized in that, include: Processor, memory, and HUD optical lens assembly; The memory stores a computer program, and the processor executes the computer program in the memory to cause the vehicle head-up display device to perform the method according to any one of claims 1 to 4.

7. A vehicle, characterized in that, include: The vehicle head-up display device as described in claim 6.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of claims 1 to 4.

Images