Distortion correction method and apparatus for projection image, and computer storage medium

Abstract

Disclosed in embodiments of the present disclosure are a distortion correction method and apparatus for a projection image, and a computer storage medium, for use in solving the technical problem in the prior art of relatively low distortion correction accuracy. The distortion correction method for a projection image may comprise: determining the number of offset sub-pixels of a projection image on the basis of a projected image; adjusting a display position of the projected image on a display panel on the basis of the number of offset sub-pixels to obtain an initial corrected image; and on the basis of pixel information of the projected image, performing sub-pixel reordering on pixel units in the initial corrected image to obtain a target corrected image, so that display colors of the target corrected image and the projected image are the same. The distortion correction accuracy of the projection image can be improved.

Description

A method, apparatus, and computer storage medium for correcting distortion of projected images.

[0001] This disclosure claims priority to Chinese Patent Application No. 202510107023.0, filed on January 23, 2025, entitled "A method, apparatus and computer storage medium for distortion correction of a projected image", the entire contents of which are incorporated herein by reference.

[0002] Technical Field

[0003] This disclosure relates to the field of image processing technology, and in particular to a method, apparatus, and computer storage medium for correcting distortion of projected images. Background Technology

[0004] With the development of technology, the display effect of Head-Up Displays (HUDs) is receiving increasing attention. In a HUD system, an image source on the display panel emits light, which is magnified by the HUD lenses and projected to the viewing position. However, due to aberrations, manufacturing and assembly errors, the image seen by the human eye has certain distortions, including image skewing and warping. To ensure that the image seen by the human eye is free of skewing and warping, distortion correction methods are needed to process the image source. Existing distortion correction methods mainly involve preprocessing the image source to compensate for image distortions caused by aberrations, manufacturing and assembly errors, etc.

[0005] While existing distortion correction methods can reduce image distortion to some extent, the low resolution of HUDs means that even a half-pixel offset can cause significant distortion, resulting in substantial image rotation and negatively impacting display quality. Furthermore, existing distortion correction methods often apply distortion correction to the entire HUD image, neglecting improvements in local display quality. Summary of the Invention

[0006] In view of this, the present disclosure aims to provide a method, apparatus, and computer storage medium for correcting distortion of projected images, thereby solving the technical problem of insufficient accuracy in existing distortion correction methods.

[0007] The technical solution of this disclosure embodiment is implemented as follows:

[0008] In a first aspect, embodiments of this disclosure provide a method for correcting distortion in a projected image, including:

[0009] The number of offset sub-pixels of the projected image is determined based on the projected image;

[0010] The display position of the projected image on the display panel is adjusted according to the number of offset sub-pixels to obtain an initial corrected image;

[0011] Based on the pixel information of the projected image, the pixel units in the initial corrected image are rearranged in sub-pixel order to obtain the target corrected image, so that the display color of the target corrected image is the same as that of the projected image.

[0012] Secondly, embodiments of this disclosure provide a distortion correction device for projected images, comprising:

[0013] The offset determination module is configured to determine the number of offset sub-pixels of the projected image based on the projected image;

[0014] The position adjustment module is configured to adjust the display position of the projected image on the display panel according to the number of offset sub-pixels to obtain an initial corrected image;

[0015] The pixel rearrangement module is configured to rearrange the pixel units in the initial corrected image according to the pixel information of the projected image to obtain a target corrected image, so that the display color of the target corrected image is the same as that of the projected image.

[0016] Thirdly, embodiments of this disclosure provide a head-up display device, the head-up display device including: a processor and a memory; the processor is configured to execute instructions stored in the memory to implement the distortion correction method for projected images described in the first aspect.

[0017] Fourthly, embodiments of this disclosure provide a computer storage medium storing at least one instruction configured to be executed by a processor to implement the distortion correction method for projected images as described in the first aspect.

[0018] This disclosure provides a method, apparatus, and computer storage medium for correcting distortion in projected images. First, the number of offset sub-pixels in the projected image is precisely determined. Then, the display position of the image on the display panel is fine-tuned based on these offsets to generate an initial corrected image. Further, this method utilizes the pixel information of the projected image to perform sub-pixel-level sequential rearrangement of the pixel units in the initial corrected image to generate a target corrected image. This process ensures that the display color of the target corrected image remains unchanged while performing sub-pixel-level correction, thereby significantly improving the accuracy of image distortion correction and guaranteeing optimized image quality and true color reproduction. Attached Figure Description

[0019] Figure 1 is a schematic diagram of the optical path of a HUD provided in an embodiment of this disclosure.

[0020] Figure 2 is a schematic diagram of the pixel arrangement of a HUD display panel provided in an embodiment of this disclosure.

[0021] Figure 3 is a flowchart of a distortion correction method for a projected image provided in an embodiment of this disclosure.

[0022] Figure 4 is a schematic diagram of pixel rearrangement provided in an embodiment of this disclosure.

[0023] Figure 5 is a schematic diagram of a display element provided in an embodiment of this disclosure.

[0024] Figure 6 is a schematic diagram of an image corrected based on a mass point according to an embodiment of this disclosure.

[0025] Figure 7 is a schematic diagram of the pixel arrangement of another HUD display panel provided in an embodiment of this disclosure.

[0026] Figure 8 is a schematic diagram of another pixel rearrangement provided in an embodiment of this disclosure.

[0027] Figure 9 is a schematic diagram of the structure of a distortion correction device for projected images provided in an embodiment of this disclosure.

[0028] Figure 10 is a schematic diagram of the structure of a head-up display device provided in an embodiment of this disclosure.

[0029] The accompanying drawings have illustrated specific embodiments of this disclosure, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concepts of this disclosure to those skilled in the art through reference to particular embodiments. Embodiments of the present invention

[0030] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, they are provided so that this disclosure will be more comprehensive and complete, and will fully convey the concept of the exemplary embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0031] Furthermore, the accompanying drawings are merely illustrative of this disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and therefore repeated descriptions of them will be omitted. Some block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0032] A head-up display (HUD) is an innovative display technology that improves driving safety and convenience by projecting key driving information directly into the driver's line of sight. HUD systems were originally designed to reduce driver eye shifts while driving, ensuring they can continuously focus on the road. This technology was initially used in military and aviation fields and has since been introduced into the automotive industry, becoming an important tool for enhancing the driving experience.

[0033] Referring to Figure 1, the HUD system mainly consists of an image source 1, an imaging magnifying lens 21, a windshield 22, the driver's eye 3, and the windshield 4. The image source is responsible for generating projected images of key data such as vehicle speed and navigation information. The image source 1 includes a display panel on which the projected image is displayed. The projected image is magnified and adjusted by the imaging magnifying lens 21, and then projected onto the windshield 22 along the projection path. The driver views this information with their eyes without having to look down at the instrument panel, thus reducing the risk of distraction.

[0034] While HUD technology offers significant convenience, in practical applications, the image projected onto the human eye may be distorted due to factors such as the optical characteristics of the imaging magnifying lens 21, manufacturing and assembly errors, and the curvature of the windshield. These distortions may include image deformation, tilting, or warping, affecting the accurate transmission of information and potentially posing a threat to driving safety. Existing distortion correction methods primarily involve preprocessing the image source to compensate for image distortion caused by aberrations, manufacturing and assembly errors, etc. For example, image distortion can be compensated by adjusting the shape parameters of the image source. Additionally, image distortion caused by aberrations can be reduced through optimized design of the HUD lens.

[0035] Referring to Figure 2, the pixels of the HUD display panel are arranged in RGB sub-pixel order. Each pixel unit includes three sub-pixels arranged sequentially in one direction, and the pixel units are arranged in an array. Existing image distortion correction methods can only move the projected image one pixel unit at a time when correcting the projected image.

[0036] However, due to the low resolution of HUDs, even a half-pixel offset can cause significant distortion, resulting in a large amount of image rotation and affecting the display effect. Furthermore, existing distortion correction methods often correct the distortion of the entire image when processing HUD images, neglecting the improvement of local display quality.

[0037] To address the distortion problem in HUD systems, this solution proposes an innovative distortion correction method. Figure 3 shows a flowchart of the distortion correction method for projected images, which can be applied to the aforementioned HUD device. The distortion correction method for projected images may include steps S310 to S330.

[0038] In step S310, the number of offset sub-pixels of the projected image is determined based on the projected image.

[0039] In some exemplary embodiments of this disclosure, the projected image can be an image displayed on a display panel, serving as the image source for the projected image. The projected image is an RGB image and can display information such as navigation information, vehicle speed information, and vehicle status. The projected image is the image displayed after the projected image passes through a projection component.

[0040] In this example implementation, the projected image and the projected image can be compared to determine correction parameters for correcting the projected image. These correction parameters are used to make the projected image identical to the projected image before correction. The number of offset sub-pixels can then be determined based on the correction parameters.

[0041] Optionally, after calculating the number of offset sub-pixels, the corresponding offset direction can also be determined. The offset direction can be determined by comparing the projected image with the projected image. The specific determination method can be referred to relevant technologies, which will not be elaborated here.

[0042] Step S320: Adjust the display position of the projected image on the display panel according to the number of offset sub-pixels to obtain an initial corrected image.

[0043] In one example embodiment of this disclosure, after obtaining the number of offset sub-pixels, the display position of the projected image on the display panel can be adjusted. That is, the position of the area in the projected image that needs to be corrected is adjusted according to the number of offset sub-pixels. Specifically, the display position of the projected image is moved by the number of offset sub-pixels along the moving direction to obtain the initial corrected image.

[0044] In step S330, the pixel units in the initial corrected image are rearranged in sub-pixel order according to the pixel information of the projected image to obtain the target corrected image.

[0045] In one example embodiment of this disclosure, after obtaining the initial corrected image, the pixel information of the projected image can be obtained first. The pixel information includes the pixel values ​​of each display element in the projected image. Then, the pixel units in the initial corrected image can be rearranged in sub-pixel order according to the pixel values ​​to obtain the corrected image, so that the display color of each display unit in the target corrected image is the same as that of the projected image.

[0046] Specifically, after adjusting the display position of the initial corrected image, because the adjustment is based on subpixels, the subpixel arrangement of the pixel units in the initial corrected image cannot completely overlap with the subpixel arrangement of the pixel units in the display panel. Therefore, the subpixel order in the pixel units of the initial corrected image can be adjusted to match the subpixel order of the pixel units in the display panel. Then, based on the position of the initial corrected image in the display panel, values ​​are assigned to each subpixel in the display panel to obtain the target corrected image.

[0047] For example, referring to Figure 4, assume the offset sub-pixel count is 1. Before position adjustment, the first pixel unit P1 in the projected image coincides with pixel unit P2 on the display panel, with a corresponding RGB arrangement. After shifting the projected image one sub-pixel to the right, an initial corrected image is obtained. At this point, the sub-pixel corresponding to the first pixel unit P3 in the initial corrected image is arranged as GBR on the display panel. Therefore, the order of the sub-pixels in the first pixel unit P3 of the initial corrected image needs to be rearranged to ensure the display color remains unchanged, thus obtaining the target corrected image. The pixel unit corresponding to P1 in the target corrected image is P4. Specifically, if the pixel value of P1 is (0, 125, 256), then the pixel value of P4 is (125, 256, 0).

[0048] It should be noted that in Figure 4, the smaller RGB characters represent the subpixel order of the image, while the larger characters represent the subpixel order of the display panel.

[0049] The distortion correction method for projected images in this embodiment first precisely determines the number of offset sub-pixels in the projected image, and then fine-tunes the display position of the image on the display panel based on these offsets to generate an initial corrected image. Further, this method utilizes the pixel information of the projected image to perform sub-pixel-level sequential rearrangement of the pixel units in the initial corrected image to generate a target corrected image. This process ensures that the display color of the target corrected image remains unchanged while performing sub-pixel-level correction, thereby significantly improving the accuracy of image distortion correction and guaranteeing optimized image quality and true color reproduction.

[0050] In some exemplary embodiments of this disclosure, a first image feature matrix of the projected image can be obtained first. This first image feature matrix represents the positional and pixel information of each display element in the projected image. The pixel information may include the pixel value of each pixel. Then, a second image feature matrix of the projected image is obtained. A distortion correction matrix can then be determined based on the first and second image feature matrices. This distortion correction matrix includes the number of pixel units that need to be moved for each display element in the projected image. The number of offset sub-pixels can then be calculated based on the distortion correction matrix.

[0051] It should be noted that the number of pixel units to be moved can include decimals. Therefore, directly adjusting based on pixel units will result in a deviation of up to half a pixel. Thus, this disclosure calculates the number of offset sub-pixels based on the distortion correction matrix. Performing distortion correction based on sub-pixels improves the accuracy of image distortion correction. For example, in the display panel shown in Figure 2, if the number of pixel units to be moved is 2.6, the number of offset sub-pixels can be defined as 8. This indicates that the number of pixel units to be moved is a multiple of 1 / 3, and the rounded integer is used as the number of offset sub-pixels. Compared to moving three pixel units in the prior art, the number of units moved in this disclosure is closer to the calculated value, thus improving the accuracy of image distortion correction.

[0052] Optionally, referring to Figure 5, multiple display areas can be determined first in the projected image and the projected image. Each display area can include multiple display elements. The display area includes a background and a foreground. The display elements are located in the foreground area. The division between the background and the foreground can be determined based on grayscale values. The specific division method will not be elaborated here.

[0053] Display elements take different forms in different scenarios. For example, in a HUD scenario, display elements can be information used to assist the driver, such as speed icons, navigation icons, entertainment information icons, etc., which will not be elaborated here.

[0054] The number of offset sub-pixels corresponding to each display area in the projected image can be determined based on the offset between the display area in the projected image and the display area in the displayed image. The specific determination method has been explained in detail above, so it will not be repeated here. By dividing the display area, local area correction of the image can be achieved, which can improve the accuracy of distortion correction.

[0055] After determining the aforementioned offset sub-pixels, the position of each display area can be adjusted. Specifically, the coordinates of the mass point in the display area can be determined first. The mass point can be the coordinates of the geometric center of the display area, or the average of the coordinates of all pixels in the display area can be used as the coordinates of the mass point. Then, the coordinates of the mass point are corrected according to the aforementioned offset sub-pixel movement to adjust the display position of the display area in the display panel.

[0056] Before adjusting the position of the aforementioned display areas with offsets, it is also necessary to determine the pixel distance between the multiple display areas to determine the upper limit of the movable sub-pixels of each display area. The upper limit is to prevent the two display areas from overlapping after the display area is moved, which would cause the image to become disordered. If the upper limit is less than the number of offset sub-pixels, the upper limit is used as the number of offset sub-pixels to correct the projected image.

[0057] After adjusting the positions of all the display areas that need adjustment, an initial corrected image is obtained. After determining the initial corrected image, the number of sub-pixels in the pixel unit layout of the display panel in the position adjustment direction can be determined. If the number of offset sub-pixels is an integer multiple of the number of layout sub-pixels, the initial corrected image can be directly used as the target corrected image.

[0058] When the number of offset subpixels is an integer multiple of the number of layout pixels, the movement can be equivalent to moving in units of pixels, and will not affect the display color of the initial corrected image.

[0059] When the number of offset sub-pixels is not an integer multiple of the number of layout pixels, it is necessary to rearrange the pixel units in the initial corrected image according to the pixel information in the projected image to obtain the target corrected image.

[0060] For example, taking a HUD as an example, during the display process, the spacing between displayed elements is relatively large, and multiple blank pixels are included to correct the displayed elements. The pixel units and sub-pixel arrangement of the HUD display panel are shown in Figure 2.

[0061] Referring to Figure 6, the number of offset sub-pixels corresponding to the display area in the projected image is one-third of a pixel. During the movement, the coordinates of the centroid of the display area can be determined first, and then the coordinates of the centroid can be moved one-third of a pixel in the first direction (to the right in the figure) to obtain the initial corrected image. The sub-pixels in the pixel units of the display area in the projected image are arranged in RGB, which is the same as the sub-pixel arrangement of the pixel units in the display panel. After the movement, the sub-pixel order of the pixel units of the display panel covered by the pixel units in the initial corrected image is GBR. Therefore, the sub-pixel order of the pixel units in the initial corrected image needs to be rearranged to obtain the target corrected image.

[0062] For example, the subpixel order of the pixel units in the initial corrected image is arranged as GBR. After rearranging, the pixel units on the display panel are reassigned values ​​to display the target corrected image. Specifically, if the pixel value of a pixel unit in the initial pixel unit is (0, 125, 256), the corresponding pixel value in the target corrected image is (125, 256, 0). It should be noted that in Figure 4, the smaller RGB characters represent the subpixel order of the image, while the larger characters represent the subpixel order of the display panel.

[0063] In some examples, referring to Figure 7, when the sub-pixels in the pixel unit of the display panel include four pixels, namely RGBW, and are arranged in a square manner, the number of offset sub-pixels may include the number of offset sub-pixels in the first direction and the number of offset sub-pixels in the second direction. Position correction is performed in both the first and second directions. Then, the sub-pixel information of the display panel occupied by the position-corrected initial corrected image is used to rearrange the order of the sub-pixels in the pixel unit of the initial corrected image to obtain the target corrected image mentioned above.

[0064] For example, referring to Figure 8, suppose the projected image is first shifted one subpixel to the right, and then shifted one subpixel upward to obtain the initial corrected image. The subpixels in the pixel units of the projected image are arranged as follows: After the movement, the sub-pixels in the display panel pixel units covered by the pixel units in the initially corrected image are arranged as follows: Therefore, it is necessary to set the sub-pixel arrangement in the pixel unit of the initial corrected image to... This is done to obtain the target corrected image. It should be noted that in Figures 7 and 8, the smaller RGBW characters represent the subpixel arrangement order of the image, while the larger RGBW characters represent the subpixel arrangement order of the display panel.

[0065] It should be noted that the sub-pixel arrangement in the pixel unit of the display panel can also include other methods, and the corresponding rearrangement and other methods can also be adaptively adjusted, which will not be elaborated in this example implementation.

[0066] This disclosure provides a method for correcting distortion in projected images. The method generates an initial corrected image by precisely determining the number of offset sub-pixels in the projected image and fine-tuning the image's display position on a display panel based on these offsets. This step ensures the accuracy of the correction process, thereby significantly improving the precision of image distortion correction. Furthermore, the method utilizes the pixel information of the projected image to perform sub-pixel-level sequential rearrangement of pixel units in the initial corrected image to generate a target corrected image. This process ensures that the display color of the target corrected image remains unchanged while performing sub-pixel-level correction, optimizing image quality and ensuring true color reproduction. It also focuses on improving local display effects. By determining multiple display areas and correcting them separately, the overall display effect is improved.

[0067] Furthermore, referring to Figure 9, this example embodiment also provides a distortion correction device 900 for projected images, including an offset determination module 910, a position adjustment module 920, and a pixel rearrangement module 930. Wherein:

[0068] The offset determination module 910 can be configured to determine the number of offset sub-pixels of the projected image based on the projected image. The position adjustment module 920 is configured to adjust the display position of the projected image on the display panel based on the number of offset sub-pixels to obtain an initial corrected image. The pixel rearrangement module 930 is configured to rearrange the pixel units in the initial corrected image according to the pixel information of the projected image to obtain a target corrected image, so that the display color of the target corrected image is the same as that of the projected image.

[0069] In one example implementation, the offset determination module 910 can be configured to acquire a first image feature matrix in the projected image and a second image feature matrix of the projected image; obtain a distortion correction matrix based on the second image feature matrix and the first image feature matrix; and determine the number of offset sub-pixels based on the distortion correction matrix.

[0070] In one example implementation, the offset determination module 910 can be configured to determine multiple display areas in the projected image and the projected image; and determine the number of offset sub-pixels corresponding to each display area in the projected image based on the offset between the display areas in the projected image and the display areas in the projected image.

[0071] In one example implementation, the position adjustment module 920 can be configured to determine the coordinates of a calibration point on the display panel of the geometric center of the display area in the projected image; and adjust the position of the calibration point coordinates on the display panel according to the number of offset sub-pixels to adjust the position of the projected image and obtain an initial corrected image.

[0072] In one example implementation, the position adjustment module 920 can be configured to determine the positional relationship between each display area; determine an upper limit value for the number of movable sub-pixels in each display area based on the positional relationship; and adjust the display position of the projected image on the display panel based on the number of offset sub-pixels when the number of offset sub-pixels is less than the upper limit value, thereby obtaining an initial corrected image.

[0073] In one example implementation, the position adjustment module 920 can be configured to adjust the display position of the projected image on the display panel according to the maximum movable sub-pixels when the number of offset sub-pixels is greater than the upper limit, so as to obtain an initial corrected image.

[0074] In one example implementation, the pixel rearrangement module 930 can be configured to determine the number of layout sub-pixels of the pixel units of the display panel in the position adjustment direction; if the number of offset sub-pixels is not an integer multiple of the number of layout sub-pixels, the pixel units in the initial corrected image are rearranged in sub-pixel order according to the pixel information of the projected image to obtain the target corrected image.

[0075] In one example implementation, the pixel rearrangement module 930 can be configured to determine the pixel order in the pixel units of the initial corrected image based on the position of the initial corrected image in the display panel; and assign values ​​to the sub-pixels occupied by the initial corrected image in the display panel based on the pixel order and the pixel information of the projected image to obtain the target corrected image.

[0076] It should be understood that the above-described device embodiments are merely illustrative, and the device disclosed herein can be implemented in other ways. For example, the division of units / modules in the above embodiments is only a logical functional division, and there may be other division methods in actual implementation. For example, multiple units, modules, or components may be combined, integrated into another system, or some features may be ignored or not executed.

[0077] Furthermore, unless otherwise specified, the functional units / modules in the various embodiments of this disclosure can be integrated into one unit / module, or each unit / module can exist physically separately, or two or more units / modules can be integrated together. The integrated units / modules described above can be implemented in hardware or as software program modules.

[0078] When integrated units / modules are implemented in hardware, the hardware can be digital circuits, analog circuits, etc. The physical implementation of the hardware structure includes, but is not limited to, transistors, memristors, etc. Unless otherwise specified, the processor can be any suitable hardware processor, such as a CPU, GPU, FPGA, DSP, and ASIC, etc. Unless otherwise specified, the storage unit can be any suitable magnetic or magneto-optical storage medium, such as Resistive Random Access Memory (RRAM), Dynamic Random Access Memory (DRAM), Static Random Access Memory (SRAM), Enhanced Dynamic Random Access Memory (EDRAM), High-Bandwidth Memory (HBM), Hybrid Memory Cube (HMC), etc.

[0079] If the integrated unit / module is implemented as a software program module and sold or used as an independent product, it can be stored in a computer-readable storage device (CMSDD). Based on this understanding, the technical solution of this disclosure, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this disclosure. The aforementioned memory includes various media capable of storing program code, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard drive, magnetic disk, or optical disk.

[0080] An exemplary embodiment of this disclosure also provides a head-up display device for performing the above-described distortion correction method for projected images. As shown in FIG10, the head-up display device 1000 may include at least one processor 1010, a memory 1020, and a communication interface 1030.

[0081] The memory 1020 is configured to store a program. Specifically, the program may include program code, which includes computer operation instructions.

[0082] The memory 1020 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage.

[0083] The processor 1010 is configured to execute computer execution instructions stored in the memory 1020 to implement the distortion correction method for projected images described in the foregoing method embodiments. The processor 1010 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of this disclosure.

[0084] The head-up display device 1000 may also include a communication interface 1030 for communication and interaction with external devices. In specific implementations, if the communication interface 1030, memory 1020, and processor 1010 are implemented independently, they can be interconnected via a bus to complete communication. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc., but this does not imply a single bus or only one type of bus.

[0085] Optionally, in a specific implementation, if the communication interface 1030, memory 1020 and processor 1010 are integrated on a single chip, then the communication interface 1030, memory 1020 and processor 1010 can communicate through an internal interface.

[0086] Those skilled in the art will understand that various aspects of this disclosure can be implemented as a system, method, or program product. Therefore, various aspects of this disclosure can be specifically implemented in the following forms: a completely hardware implementation, a completely software implementation (including firmware, microcode, etc.), or a combination of hardware and software aspects, collectively referred to herein as a "circuit," "module," or "system."

[0087] Exemplary embodiments of this disclosure also provide a computer-readable storage medium having a program product stored thereon capable of implementing the methods described above in this specification. In some possible embodiments, various aspects of this disclosure may also be implemented as a program product including program code that, when the program product is run on a terminal device, causes the terminal device to perform the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of this disclosure.

[0088] It should be noted that the computer-readable medium disclosed herein may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium may be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof.

[0089] In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which can transmit, propagate, or transfer a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wireless, wireline, optical fiber, RF, etc., or any suitable combination thereof.

[0090] Furthermore, program code for performing the operations of this disclosure can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java and C++, and conventional procedural programming languages ​​such as C or similar languages. The program code can execute entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0091] In the above embodiments, the descriptions of each embodiment have their own emphasis. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments. The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as the combination of these technical features does not contradict each other, it should be considered within the scope of this specification.

[0092] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention applied herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not claimed herein.

[0093] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A method for correcting distortion in a projected image, comprising: The number of offset sub-pixels of the projected image is determined based on the projected image; The display position of the projected image on the display panel is adjusted according to the number of offset sub-pixels to obtain an initial corrected image; Based on the pixel information of the projected image, the pixel units in the initial corrected image are rearranged in sub-pixel order to obtain the target corrected image, so that the display color of the target corrected image is the same as that of the projected image.

2. The method of claim 1, wherein, The step of rearranging the sub-pixel order of pixel units in the initial corrected image according to the pixel information of the projected image to obtain the target corrected image includes: Determine the number of layout sub-pixels of the pixel units of the display panel in the position adjustment direction; If the number of offset sub-pixels is not an integer multiple of the number of layout sub-pixels, the pixel units in the initial corrected image are rearranged in sub-pixel order according to the pixel information of the projected image to obtain the target corrected image.

3. The method of claim 1, wherein, The number of offset sub-pixels of the projected image is determined based on the projected image, including: Multiple display areas are determined in the projected image and the projected image; The number of offset sub-pixels corresponding to each display area in the projected image is determined based on the offset between the display area in the projected image and the display area in the projected image.

4. The method of claim 3, wherein, The step of adjusting the display position of the projected image on the display panel according to the number of offset sub-pixels to obtain an initial corrected image includes: Determine the coordinates of the calibration point on the display panel for the geometric center of the display area in the projected image; The position of the calibration point coordinates in the display panel is adjusted according to the number of offset sub-pixels to adjust the position of the projected image and obtain an initial corrected image.

5. The method of claim 4, wherein, Before adjusting the display position of the projected image on the display panel according to the number of offset sub-pixels to obtain the initial corrected image, the method further includes: Determine the positional relationship between each of the display areas; The upper limit of the number of movable sub-pixels in each of the display areas is determined based on the positional relationship; If the number of offset sub-pixels is less than the upper limit, the display position of the projected image on the display panel is adjusted according to the number of offset sub-pixels to obtain the initial corrected image.

6. The method of claim 5, wherein, The method further includes: If the number of offset sub-pixels is greater than the upper limit value, the display position of the projected image on the display panel is adjusted according to the upper limit value to obtain the initial corrected image.

7. The method according to any one of claims 1 to 4, wherein, The step of determining the number of offset sub-pixels of the projected image based on the projected image includes: Obtain the first image feature matrix from the projected image and the second image feature matrix from the projected image; The distortion correction matrix is ​​obtained based on the second image feature matrix and the first image feature matrix; The number of offset sub-pixels is determined based on the distortion correction matrix.

8. The method according to any one of claims 1 to 4, wherein, The step of rearranging the sub-pixel order of the pixel units in the initial corrected image to obtain the target corrected image includes: The pixel order in the pixel unit of the initial corrected image is determined based on the position of the initial corrected image in the display panel; Based on the pixel order and the pixel information of the projected image, the sub-pixels occupied by the initial corrected image in the display panel are assigned values ​​to obtain the target corrected image.

9. A distortion correction device for a projected image, comprising: The offset determination module is configured to determine the number of offset sub-pixels of the projected image based on the projected image; The position adjustment module is configured to adjust the display position of the projected image on the display panel according to the number of offset sub-pixels to obtain an initial corrected image; The pixel rearrangement module is configured to rearrange the pixel units in the initial corrected image according to the pixel information of the projected image to obtain a target corrected image, so that the display color of the target corrected image is the same as that of the projected image.

10. A head-up display device, characterized by The head-up display device includes a processor and a memory; the processor is configured to execute instructions stored in the memory to implement the distortion correction method for the projected image as described in any one of claims 1 to 8.

11. A computer storage medium, characterized in that The storage medium stores at least one instruction configured to be executed by a processor to implement the distortion correction method for a projected image as described in any one of claims 1 to 8.

Images