Projection image distortion correction method and device and computer storage medium

Abstract

The embodiment of the invention discloses a projection image distortion correction method and device and a computer storage medium, and is used for solving the technical problem of low distortion correction precision in the prior art. The distortion correction method for the projection image can comprise the following steps: determining the number of offset sub-pixels of the projection image according to a projected image; adjusting the display position of the projected image on the display panel according to the number of the offset sub-pixels to obtain an initial corrected image; and according to the pixel information of the projected image, performing sub-pixel sequence rearrangement on the pixel units in the initial correction image to obtain a target correction image, so that the target correction image and the projected image have the same display color. The distortion correction precision of a projected image can be improved.

Description

Background Art

[0002] With the development of technology, the display effect of Head-Up Display (HUD) has attracted more and more attention. In the HUD system, the image source on the display panel emits light, which is magnified and projected to the viewing position of the human eye through the HUD lens. However, due to aberrations, processing and assembly errors and other reasons, the image seen by the human eye has certain distortions, including skew and distortion of the image. In order to make the image seen by the human eye without skew and distortion, it is necessary to use a distortion correction method to process the image source. The existing distortion correction method mainly pre-processes the image source to compensate for the image distortion caused by aberrations, processing and assembly errors and other reasons.

[0003] Although existing distortion correction methods can reduce image distortion to a certain extent, due to the low resolution of HUD, a half-pixel offset may cause greater distortion, resulting in a large rotation of the image, affecting the display effect. In addition, when processing HUD images, existing distortion correction methods often perform distortion correction on the entire image, ignoring the improvement of local display effects. Summary of the invention

[0004] In view of this, the embodiments of the present disclosure are intended to provide a method, device and computer storage medium for projected image distortion correction, which can solve the technical problem of insufficient accuracy of the distortion correction method in the prior art.

[0005] The technical solution of the embodiment of the present disclosure is implemented as follows: In a first aspect, an embodiment of the present disclosure provides a method for correcting distortion of a projected image, comprising: Determining the number of offset sub-pixels of the projected image according to the projected image; Adjusting the display position of the projected image on the display panel according to the number of the offset sub-pixels to obtain an initial corrected image; According to the pixel information of the projected image, the pixel units in the initial corrected image are rearranged in sub-pixel order to obtain a target corrected image, so that the display color of the target corrected image is the same as that of the projected image.

[0006] In a second aspect, an embodiment of the present disclosure provides a device for correcting distortion of a projected image, comprising: An offset determination module, used to determine the number of offset sub-pixels of the projected image according to the projected image; A position adjustment module, used for adjusting the display position of the projected image on the display panel according to the number of the offset sub-pixels to obtain an initial corrected image; The pixel rearrangement module is used to rearrange the pixel units in the initial corrected image in sub-pixel order according to the pixel information of the projected image to obtain a target corrected image, so that the display color of the target corrected image is the same as that of the projected image.

[0007] In a third aspect, an embodiment of the present disclosure provides a head-up display device, comprising: a processor and a memory; the processor is used to execute instructions stored in the memory to implement the distortion correction method of the projected image described in the first aspect.

[0008] In a fourth aspect, an embodiment of the present disclosure provides a computer storage medium, wherein the storage medium stores at least one instruction, and the at least one instruction is used to be executed by a processor to implement the method for correcting the distortion of a projection image as described in the first aspect.

[0009] The disclosed embodiments provide a method, device and computer storage medium for projected image distortion correction; first, the number of offset sub-pixels of the projected image is accurately determined, and then the display position of the image on the display panel is fine-tuned according to these offsets to generate an initial corrected image. Furthermore, the method uses the pixel information of the projected image to rearrange the pixel units in the initial corrected image at the sub-pixel level to generate a target corrected image. This process ensures that the display color of the target corrected image remains unchanged while performing sub-pixel level correction, thereby significantly improving the accuracy of image distortion correction and ensuring the optimization of image quality and the true reproduction of colors. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 A schematic diagram of the optical path of a HUD provided in an embodiment of the present disclosure.

[0011] Figure 2 A schematic diagram of pixel arrangement of a HUD display panel provided in an embodiment of the present disclosure.

[0012] Figure 3 A flowchart of a method for correcting distortion of a projected image provided in an embodiment of the present disclosure.

[0013] Figure 4 A schematic diagram of pixel rearrangement provided in an embodiment of the present disclosure.

[0014] Figure 5 A schematic diagram of a display element provided in an embodiment of the present disclosure.

[0015] Figure 6 A schematic diagram of correcting an image based on particles provided in an embodiment of the present disclosure.

[0016] Figure 7A schematic diagram of pixel arrangement of another HUD display panel provided in an embodiment of the present disclosure.

[0017] Figure 8 A schematic diagram of another pixel rearrangement provided in an embodiment of the present disclosure.

[0018] Fig. 9 A schematic diagram of the structure of a projection image distortion correction device provided in an embodiment of the present disclosure.

[0019] Fig.10 A schematic diagram of the structure of a head-up display device provided in an embodiment of the present disclosure.

[0020] The above drawings show clear embodiments of the present disclosure, which will be described in more detail below. These drawings and text descriptions are not intended to limit the scope of the present disclosure in any way, but to illustrate the concepts of the present disclosure to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0021] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that the disclosure will be more comprehensive and complete and to fully convey the concepts of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0022] In addition, the accompanying drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.

[0023] Head-up display (HUD) is an innovative display technology that improves driving safety and convenience by projecting key driving information directly into the driver's field of vision. The HUD system was originally designed to reduce the driver's line of sight while driving and ensure that they can continue to pay attention to the road conditions. This technology was first used in the military aviation field and was gradually introduced to the automotive industry, becoming an important tool to enhance the driving experience.

[0024] Reference Figure 1The HUD system mainly consists of an image source 1, an imaging magnifying lens 21, a windshield 22, human eyes 3 and a windshield 4. The image source 1 is responsible for generating projection images of key data such as vehicle speed and navigation information. The image source 1 includes a display panel, and the projection image is displayed on the display panel. The projection image is magnified and adjusted by the imaging magnifying lens 21, and then projected onto the windshield 22 along the projection path. The driver views this information through the human eye 3 without having to look down at the dashboard, thereby reducing the risk of distraction.

[0025] Although HUD technology provides significant convenience, in actual applications, due to factors such as the optical properties of the imaging magnifying lens 21, processing and assembly errors, and the curvature of the windshield, the image projected to the human eye may be distorted. These distortions may include deformation, tilt or twisting of the image, which affects the accurate transmission of information and may even pose a threat to driving safety. Existing distortion correction methods mainly pre-process the image source to compensate for image distortion caused by aberrations, processing and assembly errors, etc. For example, the shape parameters of the image source can be adjusted to compensate for image distortion. In addition, the HUD lens can be optimized to reduce image distortion caused by aberrations, etc.

[0026] Reference Figure 2 As shown, the pixel arrangement of the HUD display panel is arranged in the order of RGB sub-pixels, and one pixel unit includes three sub-pixels arranged in sequence along one direction, and the pixel units are arranged in an array. When correcting the projected image, the existing image distortion correction method can only move the projected image in units of one pixel unit.

[0027] However, due to the low resolution of HUD, a half-pixel offset may cause large distortion, resulting in a large rotation of the image, affecting the display effect. In addition, when processing HUD images, existing distortion correction methods often perform distortion correction on the entire image, ignoring the improvement of local display effects.

[0028] In order to solve the distortion problem in HUD, this scheme proposes an innovative distortion correction method. Figure 3 A flow chart of a method for correcting the distortion of a projected image is shown, which can be applied to the above-mentioned HUD, wherein the method for correcting the distortion of a projected image can include steps S310 to S330.

[0029] In step S310, the number of offset sub-pixels of the projected image is determined according to the projected image.

[0030] In some example embodiments of the present disclosure, the projected image may be an image displayed on a display panel, which is an image source of the projected image. The projected image is an RGB image, which may display navigation information, vehicle speed information, vehicle status, etc. The projected image is an image displayed after the projected image passes through the projection component.

[0031] In this example implementation, the projection image and the projected image may be compared to determine correction parameters for correcting the projected image, the correction parameters being used to make the projection image identical to the projected image before correction. The number of offset sub-pixels may then be determined based on the correction parameters.

[0032] Optionally, after calculating the number of offset sub-pixels, the corresponding offset direction can also be determined. The offset direction can be determined based on the comparison between the projected image and the projection image. The specific determination method can refer to related technologies and will not be described in detail here.

[0033] Step S320: adjusting the display position of the projected image on the display panel according to the number of the offset sub-pixels to obtain an initial corrected image.

[0034] In an example implementation of the present disclosure, after obtaining the above-mentioned number of offset sub-pixels, the display position of the projected image on the display panel can be adjusted, that is, the position of the area that needs to be corrected in the projected image is adjusted according to the number of offset sub-pixels. Specifically, the display position of the projected image is moved by the number of offset sub-pixels along the moving direction to obtain the above-mentioned initial corrected image.

[0035] In step S330, according to the pixel information of the projected image, the pixel units in the initial corrected image are rearranged in sub-pixel order to obtain a target corrected image.

[0036] In an example implementation of the present disclosure, after obtaining an initial corrected image, pixel information of the projected image may be first acquired, the pixel information including pixel values ​​in each display element in the projected image, and then the pixel units in the initial corrected image may be rearranged in sub-pixel order according to the pixel values ​​to obtain a corrected image, so that the display color of each display unit in the target corrected image is the same as that of the projected image.

[0037] Specifically, after the display position of the above-mentioned initial corrected image is adjusted, because the adjustment is based on sub-pixels, the sub-pixel arrangement of the pixel units in the initial corrected image and the sub-pixel arrangement of the pixel units in the display panel may not completely overlap. Therefore, the sub-pixel order in the pixel units in the above-mentioned initial corrected image may be adjusted to adapt to the sub-pixel order of the pixel units in the display panel, and then, according to the position of the above-mentioned initial corrected image in the display panel, each sub-pixel in the above-mentioned display panel is assigned a value to obtain the target corrected image.

[0038] For example, refer to Figure 4 , assuming that the number of offset sub-pixels is 1. At this time, before the position adjustment is performed, the first pixel unit P1 in the projected image coincides with the pixel unit P2 on the display panel, and the corresponding arrangement order is RGB. After the above-mentioned projected image is translated to the right by one sub-pixel, the initial corrected image is obtained. At this time, the sub-pixel corresponding to the first pixel unit P3 of the initial corrected image is the sub-pixel arrangement on the display panel is GBR. Therefore, it is necessary to rearrange the order of the sub-pixels in the first pixel unit P3 in the above-mentioned initial corrected image to ensure that the display color remains unchanged, so as to obtain the above-mentioned target corrected image. The pixel unit corresponding to P1 in the target corrected image is P4. Specifically, if the pixel value of P1 is (0, 125, 256), then the pixel value of P4 is (125, 256, 0).

[0039] It should be noted that Figure 4 The smaller RGB characters in the figure represent the sub-pixel order of the image, and the larger characters represent the sub-pixel order of the display panel.

[0040] The method for correcting the distortion of the projected image in the disclosed embodiment first accurately determines the number of offset sub-pixels of the projected image, and then fine-tunes the display position of the image on the display panel according to these offsets to generate an initial corrected image. Furthermore, the method uses the pixel information of the projected image to rearrange the pixel units in the initial corrected image at the sub-pixel level to generate a target corrected image. This process ensures that the display color of the target corrected image remains unchanged while performing sub-pixel level correction, thereby significantly improving the accuracy of image distortion correction and ensuring the optimization of image quality and the true reproduction of colors.

[0041] In some example embodiments of the present disclosure, the first image feature matrix of the projected image can be first obtained, and the first image feature matrix can represent the position information and pixel information of each display element in the projected image, and the pixel information can include the pixel value of each pixel point, and then the second image feature matrix of the projected image is obtained, and then the distortion correction matrix can be determined based on the first image feature matrix and the second image feature matrix, and the distortion correction matrix includes the number of pixel units that need to be moved for each display element in the projected image. Then, the number of offset sub-pixels can be calculated according to the distortion correction matrix.

[0042] It should be noted that the number of pixel units that need to be moved may include decimals, so directly adjusting based on the pixel units will result in a maximum deviation of half a pixel. Therefore, the present disclosure calculates the number of offset sub-pixels based on the distortion correction matrix, and performs distortion correction based on sub-pixels to improve the accuracy of image distortion correction. For example, in Figure 2 In the display panel shown, if the number of pixel units to be moved is 2.6, the number of offset sub-pixels can be defined as 8, and the number of pixel units to be moved can be determined to be a multiple of 1 / 3, and then the integer after rounding is used as the number of offset sub-pixels. Compared with moving three pixel units in the prior art, the movement number disclosed in the present invention is closer to the calculated value, which can improve the accuracy of image distortion correction.

[0043] Optional, see Figure 5 Alternatively, multiple display areas may be determined in the projected image and the projected image first. The display area may include multiple display elements. The display area includes a background and a foreground. The display elements are located in the foreground area. The division between the background and the foreground may be determined based on the grayscale value. The specific division method will not be described in detail here.

[0044] Display elements have different forms in different scenarios. For example, in the HUD scenario, the display elements may be information used to assist the driver in driving, such as a vehicle speed icon, a navigation icon, entertainment information icons, etc., which will not be elaborated here.

[0045] The number of offset sub-pixels corresponding to each display area in the projected image can be determined according to the offset between the display area in the projected image and the display area in the projected image. The specific determination method has been described in detail above, so it will not be repeated here. By dividing the display area to achieve local area correction of the image, the accuracy of distortion correction can be improved.

[0046] After determining the above-mentioned offset sub-pixel, the position of each display area can be adjusted. Specifically, the coordinates of the particle of the above-mentioned display area can be determined first. The particle can be the coordinates of the geometric center of the above-mentioned display area, or the average value of the coordinates of all pixel points in the display area can be taken as the coordinates of the particle. Then, the coordinates of the particle are corrected according to the above-mentioned offset sub-pixel movement to adjust the display position of the display area in the display panel.

[0047] Before adjusting the position of the above-mentioned display area with an offset, it is also necessary to determine the pixel distance between the above-mentioned multiple display areas to determine the upper limit value of the movable sub-pixel of each display area. The upper limit value is to prevent the two display areas from overlapping and causing image confusion after the display area is moved. If the above-mentioned upper limit value is less than the number of offset sub-pixels, the upper limit value will be used as the number of offset sub-pixels to correct the projected image.

[0048] After position adjustment is performed on each of the above-mentioned display areas that need to be adjusted, an initial correction image is obtained. After the initial correction image is determined, the number of sub-pixels in the pixel unit layout of the above-mentioned display panel in the position adjustment direction can be determined. When the number of offset sub-pixels is an integer multiple of the number of layout sub-pixels, the above-mentioned initial correction image can be directly used as the target correction image.

[0049] When the number of offset sub-pixels is an integer multiple of the number of layout pixels, the movement process can be equivalent to moving in units of pixel units, and will not affect the display color of the initial corrected image.

[0050] When the number of the offset sub-pixels is not an integer multiple of the number of layout pixels, it is necessary to perform sub-pixel rearrangement on the pixel units in the initial corrected image according to the pixel information in the projected image to obtain the target corrected image.

[0051] For example, taking HUD as an example, during the display process of HUD, the intervals between display elements are large, and multiple blank pixels are included to correct the display elements. The pixel units and sub-pixel arrangements of the HUD display panel are as follows: Figure 2 shown.

[0052] Reference Figure 6, the number of offset sub-pixels corresponding to the display area in the projected image is one-third of a pixel. During the movement, the coordinates of the center of mass of the above-mentioned display area can be first determined, and then the coordinates of the above-mentioned center of mass are moved in the first direction (to the right in the figure) by one-third of a pixel to obtain an initial corrected image. The sub-pixels in the pixel units of the display area in the projected image are arranged as RGB, which is the same as the sub-pixel arrangement of the pixel units in the display panel. After the movement, the sub-pixel order of the pixel units of the display panel covered by the pixel units in the initial corrected image is GBR. Therefore, the sub-pixel order in the pixel units in the initial corrected image needs to be rearranged to obtain the target corrected image.

[0053] For example, the sub-pixels in the pixel unit in the initial corrected image are arranged in GBR order, and after rearrangement, the pixel units on the display panel are re-assigned to display the target corrected image. Specifically, if the pixel value of one pixel unit in the initial pixel unit is (0, 125, 256), the pixel value of the pixel unit in the target corrected image corresponding to the initial corrected image is (125, 256, 0). It should be noted that Figure 6 The smaller RGB characters in the figure represent the sub-pixel order of the image, and the larger characters represent the sub-pixel order of the display panel.

[0054] In some examples, reference Figure 7 , when the sub-pixels in the pixel unit of the display panel include four, namely RGBW, and are arranged in a square manner, the number of offset sub-pixels may include the number of offset sub-pixels in a first direction and the number of offset sub-pixels in a second direction, and position correction is performed in the first direction and the second direction respectively, and then the sub-pixel information of the display panel occupied by the initial corrected image after the position correction is used, and the sub-pixel order of the pixel unit in the initial corrected image is rearranged to obtain the above-mentioned target corrected image.

[0055] For example, refer to Figure 8 , assuming that the projected image is first moved one sub-pixel to the right, and then moved one sub-pixel upward to obtain the initial corrected image, the sub-pixels in the pixel unit of the projected image are arranged as follows , after the movement, the sub-pixel arrangement in the pixel unit of the display panel covered by the pixel unit in the initial corrected image is Based on this, the sub-pixel arrangement in the pixel unit in the initial rectified image needs to be set to , to obtain the target corrected image. It should be noted that Figure 7 and Figure 8 The RGBW characters with smaller size represent the sub-pixel arrangement order of the image, and the RGBW characters with larger size represent the sub-pixel arrangement order of the display panel.

[0056] It should be noted that the arrangement of sub-pixels in the pixel unit of the display panel may also include other methods, and the corresponding rearrangement methods may also be adaptively adjusted, which will not be described in detail in this example implementation.

[0057] The disclosed embodiment provides a method for correcting the distortion of a projected image, which generates an initial corrected image by accurately determining the number of offset sub-pixels of the projected image and fine-tuning the display position of the image on the display panel according to these offsets. This step ensures the accuracy of the correction process, thereby significantly improving the accuracy of image distortion correction. Furthermore, the method uses the pixel information of the projected image to rearrange the order of the pixel units in the initial corrected image at the sub-pixel level to generate a target corrected image. This process ensures that while performing sub-pixel level correction, the display color of the target corrected image remains unchanged, optimizes the image quality, and ensures the true reproduction of colors. Focus on improving local display effects. By determining multiple display areas and correcting them separately, the overall display effect is improved.

[0058] For further reference, Fig. 9 As shown, in the implementation of this example, a projection image distortion correction device 900 is also provided, including an offset determination module 910, a position adjustment module 920, and a pixel rearrangement module 930. Among them: The offset determination module 910 can be used to determine the number of offset sub-pixels of the projected image according to the projected image. The position adjustment module 920 is used to adjust the display position of the projected image on the display panel according to the number of offset sub-pixels to obtain an initial corrected image. The pixel rearrangement module 930 is used to rearrange the sub-pixel sequence of the pixel units in the initial corrected image according to the pixel information of the projected image to obtain a target corrected image, so that the display color of the target corrected image is the same as that of the projected image.

[0059] In an example embodiment, the offset determination module 910 can be configured to obtain a first image feature matrix in the projected image and a second image feature matrix in the projected image; obtain a distortion correction matrix based on the second image feature matrix and the first image feature matrix; and determine the number of offset sub-pixels based on the distortion correction matrix.

[0060] In an example implementation, the offset determination module 910 may be configured to determine a plurality of display areas in the projected image and the projection image; and determine the number of offset sub-pixels corresponding to each display area in the projected image based on the offset between the display area in the projected image and the display area in the projection image.

[0061] In an example embodiment, the position adjustment module 920 can be configured to determine the coordinates of a calibration point on the display panel of the geometric center of the display area in the projected image; adjust the position of the calibration point coordinates in the display panel according to the number of offset sub-pixels to adjust the position of the projected image to obtain an initial corrected image.

[0062] In an example embodiment, the position adjustment module 920 can be configured to determine the positional relationship between the various display areas; determine the upper limit value of the number of movable sub-pixels in each display area based on the positional relationship; when the number of offset sub-pixels is less than the upper limit value, adjust the display position of the projected image on the display panel based on the number of offset sub-pixels to obtain an initial corrected image.

[0063] In an example implementation, the position adjustment module 920 may be configured to adjust the display position of the projected image on the display panel according to the maximum number of movable sub-pixels to obtain an initial corrected image when the number of offset sub-pixels is greater than an upper limit value.

[0064] In an example embodiment, the pixel rearrangement module 930 may be configured to determine the number of layout sub-pixels of a pixel unit of a display panel in a position adjustment direction; when the number of offset sub-pixels is not an integer multiple of the number of layout sub-pixels, the pixel units in the initial corrected image are rearranged in sub-pixel order according to the pixel information of the projected image to obtain a target corrected image.

[0065] In an example implementation, the pixel rearrangement module 930 may be configured to determine the pixel order in the pixel unit in the initial corrected image according to the position of the initial corrected image in the display panel; and assign values ​​to the sub-pixels occupied by the initial corrected image in the display panel based on the pixel order and the pixel information of the projected image to obtain a target corrected image.

[0066] It should be understood that the above-mentioned device embodiments are only illustrative, and the device of the present disclosure can also be implemented in other ways. For example, the division of units / modules in the above-mentioned embodiments is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units, modules or components can be combined, or can be integrated into another system, or some features can be ignored or not executed.

[0067] In addition, unless otherwise specified, each functional unit / module in each embodiment of the present disclosure may be integrated into one unit / module, or each unit / module may exist physically separately, or two or more units / modules may be integrated together. The above-mentioned integrated unit / module may be implemented in the form of hardware or in the form of a software program module.

[0068] If the integrated unit / module is implemented in the form of hardware, the hardware may be a digital circuit, an analog circuit, etc. The physical implementation of the hardware structure includes but is not limited to transistors, memristors, etc. Unless otherwise specified, the processor may be any appropriate hardware processor, such as a CPU, a GPU, an FPGA, a DSP, an ASIC, etc. Unless otherwise specified, the storage unit may be any appropriate magnetic storage medium or magneto-optical storage medium, such as a resistive random access memory (RRAM), a dynamic random access memory (DRAM), a static random access memory (SRAM), an enhanced dynamic random access memory (EDRAM), a high-bandwidth memory (HBM), a hybrid memory cube (HMC), etc.

[0069] If the integrated unit / module is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a memory and includes several instructions for a computer device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of the various embodiments of the present disclosure. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk, etc. Various media that can store program codes.

[0070] The exemplary embodiment of the present disclosure also provides a head-up display device for performing the above-mentioned projection image distortion correction method, such as Fig.10 As shown, the head-up display device 1000 may include: at least one processor 1010 , a memory 1020 , and a communication interface 1030 .

[0071] The memory 1020 is used to store programs. Specifically, the programs may include program codes, and the program codes include computer operation instructions.

[0072] The memory 1020 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0073] The processor 1010 is used to execute the computer-executable instructions stored in the memory 1020 to implement the method for correcting the distortion of the projection image described in the above method embodiment. The processor 1010 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present disclosure.

[0074] The head-up display device 1000 may also include a communication interface 1030, so that it can communicate and interact with external devices through the communication interface 1030. In a specific implementation, if the communication interface 1030, the memory 1020 and the processor 1010 are implemented independently, the communication interface 1030, the memory 1020 and the processor 1010 can be connected to each other through a bus and complete the communication between each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc., but it does not mean that there is only one bus or one type of bus.

[0075] Optionally, in a specific implementation, if the communication interface 1030, the memory 1020 and the processor 1010 are integrated on a chip, the communication interface 1030, the memory 1020 and the processor 1010 can communicate through an internal interface.

[0076] Those skilled in the art will appreciate that various aspects of the present disclosure may be implemented as systems, methods or program products. Therefore, various aspects of the present disclosure may be specifically implemented in the following forms, namely: complete hardware implementation, complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as "circuits", "modules" or "systems".

[0077] The exemplary embodiments of the present disclosure also provide a computer-readable storage medium on which a program product capable of implementing the above-mentioned method of the present specification is stored. In some possible implementations, various aspects of the present disclosure may also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary embodiments of the present disclosure described in the above-mentioned "Exemplary Method" section of the present specification.

[0078] It should be noted that the computer-readable medium shown in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0079] In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0080] In addition, program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., using an Internet service provider to connect through the Internet).

[0081] In the above embodiments, the description of each embodiment has its own emphasis. For the part not described in detail in a certain embodiment, please refer to the relevant description of other embodiments. The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0082] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the inventions claimed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not claimed in the present disclosure.

[0083] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for correcting distortion of a projected image, characterized in that: include: Determining the number of offset sub-pixels of the projected image according to the projected image; Adjusting the display position of the projected image on the display panel according to the number of the offset sub-pixels to obtain an initial corrected image; According to the pixel information of the projected image, the pixel units in the initial corrected image are rearranged in sub-pixel order to obtain a target corrected image, so that the display color of the target corrected image is the same as that of the projected image.

2. The method according to claim 1, characterized in that The step of rearranging the pixel units in the initial corrected image in sub-pixel order according to the pixel information of the projected image to obtain the target corrected image includes: Determining the number of layout sub-pixels of a pixel unit of the display panel in a position adjustment direction; In the case that the number of the offset sub-pixels is not an integer multiple of the number of the layout sub-pixels, the sub-pixel order of the pixel units in the initial corrected image is rearranged according to the pixel information of the projected image to obtain a target corrected image.

3. The method according to claim 1, characterized in that Determining the number of offset sub-pixels of the projected image according to the projected image includes: determining a plurality of display areas in the projected image and the projection image; According to the offset between the display area in the projected image and the display area in the projection image, the number of offset sub-pixels corresponding to each display area in the projected image is determined.

4. The method according to claim 3, characterized in that The step of adjusting the display position of the projected image on the display panel according to the number of the offset sub-pixels to obtain an initial corrected image includes: Determine the coordinates of a calibration point on the display panel of the geometric center of the display area in the projected image; The position of the calibration point coordinates in the display panel is adjusted according to the number of the offset sub-pixels to adjust the position of the projected image to obtain an initial corrected image.

5. The method according to claim 4, characterized in that Before adjusting the display position of the projected image on the display panel according to the number of the offset sub-pixels to obtain an initial corrected image, the method further includes: Determining the positional relationship between the display areas; Determine an upper limit value of the number of movable sub-pixels in each of the display areas according to the positional relationship; In a case where the number of the offset sub-pixels is less than the upper limit, the display position of the projected image on the display panel is adjusted according to the number of the offset sub-pixels to obtain the initial corrected image.

6. The method according to claim 5, characterized in that The method further comprises: In a case where the number of the offset sub-pixels is greater than the upper limit, the display position of the projected image on the display panel is adjusted according to the upper limit to obtain the initial corrected image.

7. The method according to any one of claims 1 to 4, characterized in that: The step of determining the number of offset sub-pixels of the projection image according to the projected image comprises: Acquire a first image feature matrix in the projection image and a second image feature matrix of the projected image; Obtaining a distortion correction matrix according to the second image feature matrix and the first image feature matrix; The number of offset sub-pixels is determined according to the distortion correction matrix.

8. The method according to any one of claims 1 to 4, characterized in that: The step of rearranging the pixel units in the initial corrected image by sub-pixels to obtain a target corrected image includes: Determining a pixel order in a pixel unit in the initial corrected image according to a position of the initial corrected image in the display panel; Based on the pixel sequence and the pixel information of the projected image, sub-pixels occupied by the initial corrected image in the display panel are assigned values ​​to obtain the target corrected image.

9. A device for correcting distortion of a projected image, characterized in that: include: An offset determination module, used to determine the number of offset sub-pixels of the projected image according to the projected image; A position adjustment module, used for adjusting the display position of the projected image on the display panel according to the number of the offset sub-pixels to obtain an initial corrected image; The pixel rearrangement module is used to rearrange the pixel units in the initial corrected image in sub-pixel order according to the pixel information of the projected image to obtain a target corrected image, so that the display color of the target corrected image is the same as that of the projected image.

10. A head-up display device, characterized in that: The head-up display device comprises: a processor and a memory; the processor is used to execute instructions stored in the memory to implement the distortion correction method of the projection image as described in any one of claims 1 to 8.

11. A computer storage medium, characterized in that: The storage medium stores at least one instruction, and the at least one instruction is used to be executed by a processor to implement the method for correcting distortion of a projection image as described in any one of claims 1 to 8.

Images