A method, device, and computer storage medium for correcting distortion of a projected image

Abstract

Embodiments of the present disclosure disclose a method, apparatus, and computer storage medium for correcting distortion of a projected image, which are used to solve the technical problem of low distortion correction accuracy in the prior art. The method for correcting distortion of a projected image may include: determining the number of offset sub-pixels of the projected image according to the image to be projected; adjusting the display position of the image to be projected on the display panel according to the number of offset sub-pixels to obtain an initial corrected image; reordering the sub-pixels of the pixel units in the initial corrected image according to the pixel information of the image to be projected to obtain a target corrected image, so that the display color of the target corrected image is the same as that of the image to be projected. It can improve the distortion correction accuracy of the projected image.

Description

Background Art

[0002] With the development of technology, the display effect of head-up display (HUD) devices has attracted increasing attention. In an HUD system, light is emitted from an image source on a display panel, magnified by an HUD lens, and projected to the viewing position of the human eye. However, due to reasons such as aberration and processing and assembly errors, the image seen by the human eye has certain distortions, including skewing and distortion of the image. In order to make the image seen by the human eye free of skewing and distortion, a distortion correction method is needed to process the image source. Existing distortion correction methods mainly preprocess the image source to compensate for image distortion caused by reasons such as aberration and processing and assembly errors.

[0003] Although existing distortion correction methods can reduce image distortion to a certain extent, due to the low resolution of HUDs, an offset of half a pixel may cause significant distortion, resulting in a large rotation amount of the image and affecting the display effect. In addition, when existing distortion correction methods process HUD images, they often perform distortion correction on the entire image, ignoring the improvement of the local display effect. Summary of the Invention

[0004] In view of this, embodiments of the present disclosure are expected to provide a method, apparatus, and computer storage medium for correcting the distortion of a projected image; capable of solving the technical problem of insufficient accuracy of existing distortion correction methods.

[0005] The technical solution of the embodiments of the present disclosure is implemented as follows:

[0006] In a first aspect, embodiments of the present disclosure provide a method for correcting the distortion of a projected image, including:

[0007] Determining the number of offset sub-pixels of the projected image according to the projected image;

[0008] Adjusting the display position of the projected image on the display panel according to the number of offset sub-pixels to obtain an initial corrected image;

[0009] Rearranging the sub-pixel order of the pixel units in the initial corrected image according to the pixel information of the projected image to obtain a target corrected image, so that the display color of the target corrected image is the same as that of the projected image.

[0010] In a second aspect, embodiments of the present disclosure provide a device for correcting the distortion of a projected image, including:

[0011] An offset determination module, configured to determine the number of offset sub-pixels of the projected image according to the projected image;

[0012] A position adjustment module, configured to adjust the display position of the projected image on the display panel according to the number of offset sub-pixels, so as to obtain an initial corrected image;

[0013] A pixel rearrangement module, configured to rearrange the sub-pixel order of pixel units in the initial corrected image according to the pixel information of the projected image to obtain a target corrected image, so that the display color of the target corrected image is the same as that of the projected image.

[0014] In a third aspect, an embodiment of the present disclosure provides a head-up display device, including: a processor and a memory; the processor is configured to execute instructions stored in the memory to implement the distortion correction method of the projected image according to the first aspect.

[0015] In a fourth aspect, an embodiment of the present disclosure provides a computer storage medium, where the storage medium stores at least one instruction, and the at least one instruction is used to be executed by a processor to implement the distortion correction method of the projected image as described in the first aspect.

[0016] An embodiment of the present disclosure provides a distortion correction method, device and computer storage medium for a projected image; first, accurately determine the number of offset sub-pixels of the projected image, and then fine-tune the display position of the image on the display panel according to these offsets to generate an initial corrected image. Further, this method uses the pixel information of the projected image to rearrange the order of pixel units in the initial corrected image at the sub-pixel level to generate a target corrected image. This process ensures that while performing sub-pixel level correction, the display color of the target corrected image remains unchanged, thereby significantly improving the accuracy of image distortion correction and ensuring the optimization of image quality and the true reproduction of colors. Description of the Drawings

[0017] Figure 1 It is an optical path schematic diagram of a HUD provided by an embodiment of the present disclosure.

[0018] Figure 2 It is a schematic diagram of pixel arrangement of a HUD display panel provided by an embodiment of the present disclosure.

[0019] Figure 3 It is a flowchart of a distortion correction method for a projected image provided by an embodiment of the present disclosure.

[0020] Figure 4 It is a schematic diagram of pixel rearrangement provided by an embodiment of the present disclosure.

[0021] Figure 5 It is a schematic diagram of a display element provided by an embodiment of the present disclosure.

[0022] Figure 6A schematic diagram of correcting an image according to mass points provided by an embodiment of the present disclosure.

[0023] Figure 7 Another schematic diagram of pixel arrangement of a HUD display panel provided by an embodiment of the present disclosure.

[0024] Figure 8 Another schematic diagram of pixel rearrangement provided by an embodiment of the present disclosure.

[0025] Figure 9 A schematic diagram of the structure of a projection image distortion correction device provided by an embodiment of the present disclosure.

[0026] Figure 10 A schematic diagram of the structure of a head-up display device provided by an embodiment of the present disclosure.

[0027] Through the above-mentioned drawings, specific embodiments of the present disclosure have been shown, and there will be more detailed descriptions hereinafter. These drawings and textual descriptions are not intended to limit the scope of the concept of the present disclosure in any way, but to illustrate the concept of the present disclosure to those skilled in the art by referring to specific embodiments. Detailed implementation manners

[0028] Now, example embodiments will be described more fully with reference to the accompanying drawings. However, the example embodiments can be implemented in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that the present disclosure will be more complete and comprehensive, and the concept of the example embodiments will be fully conveyed to those skilled in the art. The features, structures, or characteristics described can be combined in any suitable manner in one or more embodiments.

[0029] In addition, the drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repeated descriptions will be omitted. Some of the block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0030] A head-up display device (HUD) is an innovative display technology that projects key driving information directly into the driver's line of sight, thereby improving driving safety and convenience. The original design intention of the HUD system is to reduce the driver's eye movement during driving and ensure that they can continuously focus on the road conditions. This technology was initially applied in the military aviation field and then gradually introduced into the automotive industry, becoming an important tool to enhance the driving experience.

[0031] Refer toFigure 1 The HUD system mainly consists of an image source 1, an imaging magnifying lens 21, a windshield 22, a human eye 3, and a windshield 4. The image source 1 is responsible for generating projection images of key data such as vehicle speed and navigation information. The image source 1 includes a display panel, and the projection image is displayed on the display panel. The projection image is magnified and adjusted by the imaging magnifying lens 21 and then projected onto the windshield 22 along the projection path. The driver views this information through the human eye 3 without having to look down at the dashboard, thus reducing the risk of distraction.

[0032] Although HUD technology provides significant convenience, in practical applications, due to factors such as the optical characteristics of the imaging magnifying lens 21, machining and assembly errors, and the curvature of the windshield, the image projected onto the human eye may be distorted. These distortions may include image deformation, tilting, or twisting, affecting the accurate transmission of information and even potentially posing a threat to driving safety. Existing distortion correction methods mainly preprocess the image source to compensate for image distortion caused by aberration, machining and assembly errors, etc. For example, the shape parameters of the image source can be adjusted to compensate for image distortion. Additionally, the HUD lens can be optimized in design to reduce image distortion caused by aberration.

[0033] Refer to Figure 2 As shown, the pixel arrangement of the display panel of the HUD is arranged in the sub-pixel order of RGB. One pixel unit includes three sub-pixels arranged in sequence in one direction, and the pixel unit is arranged in an array. Existing image distortion correction methods can only move the projected image in units of one pixel when correcting the projected image.

[0034] However, due to the low resolution of the HUD, an offset of half a pixel may cause significant distortion, resulting in a large rotation amount of the image and affecting the display effect. In addition, existing distortion correction methods often perform distortion correction on the entire image when processing HUD images, ignoring the improvement of local display effects.

[0035] To solve the distortion problem in the HUD, this solution proposes an innovative distortion correction method. Figure 3 The flowchart of the distortion correction method for the projected image is shown, which can be applied to the above HUD. Among them, the distortion correction method for the projected image may include steps S310 to S330.

[0036] In step S310, the number of offset sub-pixels of the projected image is determined according to the projected image.

[0037] In some exemplary embodiments of the present disclosure, the projected image may be an image displayed on a display panel, which is the image source of the projected image. The projected image is an RGB image and can display, for example, navigation information, vehicle speed information, vehicle status, etc. The projected image is the image displayed after the projected image passes through a projection component.

[0038] In the present exemplary embodiment, the projected image and the projected image can be compared to determine the correction parameters for correcting the projected image. The correction parameters are used to make the projected image the same as the projected image before correction. Then, the number of offset sub-pixels can be determined according to the correction parameters.

[0039] Optionally, after calculating the number of offset sub-pixels, the corresponding offset direction can also be determined. The offset direction can be determined based on the comparison between the projected image and the projected image. The specific determination method can refer to related technologies and will not be elaborated here.

[0040] Step S320: Adjust the display position of the projected image on the display panel according to the number of offset sub-pixels to obtain an initial corrected image.

[0041] In an exemplary embodiment of the present disclosure, after obtaining the above-mentioned number of offset sub-pixels, the display position of the projected image on the display panel can be adjusted, that is, the position of the area to be corrected in the projected image is adjusted according to the number of offset sub-pixels. Specifically, the display position of the projected image is moved by the number of offset sub-pixels along the moving direction to obtain the above-mentioned initial corrected image.

[0042] In step S330, according to the pixel information of the projected image, the sub-pixel order of the pixel units in the initial corrected image is rearranged to obtain a target corrected image.

[0043] In an exemplary embodiment of the present disclosure, after obtaining the initial corrected image, the pixel information of the projected image can be obtained first. The pixel information includes the pixel values in each display element of the projected image. Then, the sub-pixel order of the pixel units in the initial corrected image can be rearranged according to the pixel values to obtain a corrected image, so that the display colors of the display units in the target corrected image are the same as those in the projected image.

[0044] Specifically, after adjusting the display position of the above initial corrected image, since the adjustment is based on sub-pixels, the sub-pixel arrangement of the pixel units in the initial corrected image cannot completely coincide with the sub-pixel arrangement of the pixel units of the display panel. Therefore, the sub-pixel order in the pixel units of the above initial corrected image can be adjusted to adapt to the sub-pixel order of the pixel units in the display panel, and then each sub-pixel in the display panel is assigned a value according to the position of the above initial corrected image in the display panel to obtain a target corrected image.

[0045] For example, referring to Figure 4 , assume that the number of offset sub-pixels is 1. At this time, before the position adjustment, the first pixel unit P1 in the projected image coincides with the pixel unit P2 on the display panel, and the corresponding arrangement order is RGB. After translating the above projected image to the right by one sub-pixel, an initial corrected image is obtained. At this time, the sub-pixels corresponding to the first pixel unit P3 of the initial corrected image are the sub-pixel arrangement GBR on the display panel. Therefore, it is necessary to rearrange the order of the sub-pixels in the first pixel unit P3 of the above initial corrected image to ensure that the displayed color remains unchanged to obtain the above target corrected image. The pixel unit corresponding to P1 in the target corrected image is P4. Specifically, if the pixel value of P1 is (0, 125, 256), then the pixel value of P4 is (125, 256, 0).

[0046] It should be noted that Figure 4 the smaller RGB in the characters is the sub-pixel order of the image, and the larger characters represent the sub-pixel order of the display panel.

[0047] In the method for correcting the distortion of the projected image according to the embodiments of the present disclosure, first, the number of offset sub-pixels of the projected image is accurately determined, and then the display position of the image on the display panel is finely adjusted according to these offsets to generate an initial corrected image. Further, this method uses the pixel information of the projected image to rearrange the order of the pixel units in the initial corrected image at the sub-pixel level to generate a target corrected image. This process ensures that while performing sub-pixel level correction, the displayed color of the target corrected image remains unchanged, thereby significantly improving the accuracy of image distortion correction and ensuring the optimization of image quality and the true reproduction of colors.

[0048] In some exemplary embodiments of the present disclosure, a first image feature matrix of a projection image may be obtained first. The first image feature matrix can represent the position information and pixel information of each display element in the projection image. The pixel information may include the pixel values of each pixel point. Then, a second image feature matrix of the projected image may be obtained. Then, a distortion correction matrix may be determined based on the first image feature matrix and the second image feature matrix. The distortion correction matrix includes the number of pixel units that each display element in the projected image needs to be moved. Then, the offset sub-pixel number may be calculated according to the distortion correction matrix.

[0049] It should be noted that the number of pixel units that need to be moved may include decimals. Therefore, directly adjusting according to pixel units will result in a deviation of up to half a pixel. Therefore, in the present disclosure, the offset sub-pixel number is calculated according to the distortion correction matrix. Correcting distortion based on sub-pixels can improve the accuracy of image distortion correction. For example, in Figure 2 the shown display panel, if the number of pixel units that need to be moved is 2.6, the offset sub-pixel number may be defined as 8. It is possible to judge the multiple of the number of pixel units that need to be moved and 1 / 3, and then use the integer after rounding as the offset sub-pixel number. Compared with moving three pixel units in the prior art, the moving number in the present disclosure is closer to the calculated value, which can improve the accuracy of image distortion correction.

[0050] Optionally, referring to Figure 5 , it is also possible to first determine a plurality of display regions in the projected image and the projection image. Each display region may include a plurality of display elements. The display region includes a background and a foreground. The display elements are located in the foreground region. The division between the background and the foreground may be determined based on the gray value. The specific division method will not be elaborated here.

[0051] The display elements have different forms in different scenarios. For example, in the HUD scenario, the display elements may be information for assisting the driver in driving, such as a vehicle speed icon, a navigation icon, an entertainment information icon, etc., which will not be elaborated here.

[0052] The offset sub-pixel number corresponding to each display region in the projected image may be determined according to the offset amount between the display region in the projected image and the display region in the projection image. The specific determination method has been described in detail above, so it will not be elaborated here. By dividing the display region to achieve local area correction of the image, the accuracy of distortion correction can be improved.

[0053] After determining the above offset sub-pixels, position adjustment can be performed for each display area. Specifically, the coordinates of the mass point of the above display area can be determined first. The mass point can be the coordinates of the geometric center of the above display area, or the average value of the coordinates of all pixel points in the display area can be used as the coordinates of the mass point. Then, the coordinates of the mass point are corrected by moving according to the above offset sub-pixels to adjust the display position of the display area on the display panel.

[0054] Before performing position adjustment on the above display area with an offset, it is also necessary to determine the pixel distance between the above multiple display areas to determine the upper limit value of the movable sub-pixels of each display area. The upper limit value is to prevent the image from being distorted due to the coincidence of two display areas after moving the display area. If the above upper limit value is less than the number of offset sub-pixels, the upper limit value is used as the number of offset sub-pixels to correct the projected image.

[0055] After performing position adjustment on each of the above display areas that need to be adjusted, an initial corrected image is obtained. After determining the initial corrected image, the number of sub-pixels in the pixel unit layout of the above display panel in the position adjustment direction can be judged. When the number of the above offset sub-pixels is an integer multiple of the number of layout sub-pixels, the above initial corrected image can be directly used as the target corrected image.

[0056] When the number of offset sub-pixels is an integer multiple of the number of layout pixels, the movement process can be equivalent to moving in units of pixel units, and it will not affect the display color of the initial corrected image.

[0057] When the number of the above offset sub-pixels is not an integer multiple of the number of layout pixels, it is necessary to re-arrange the sub-pixels of the pixel units in the above initial corrected image according to the pixel information in the projected image to obtain the target corrected image.

[0058] For example, taking HUD as an example, during the display process of HUD, the intervals between display elements are relatively large, and there will be multiple blank pixels for correcting the display elements. The pixel units and sub-pixel arrangement of the display panel of HUD are as Figure 2 shown.

[0059] Refer to Figure 6, the number of offset sub-pixels corresponding to the display area in the projected image is one-third of a pixel. During the movement, the coordinates of the centroid of the above display area can be determined first, and then the centroid coordinates are moved one-third of a pixel in the first direction (to the right in the figure) to obtain the initial corrected image. The sub-pixels in the pixel unit of the display area in the projected image are arranged as RGB, which is the same as the sub-pixel arrangement of the pixel unit in the display panel. After the movement, the sub-pixel order of the pixel unit in the display panel covered by the pixel unit in the initial corrected image is GBR. Therefore, it is necessary to rearrange the sub-pixel order in the pixel unit of the initial corrected image to obtain the target corrected image.

[0060] For example, that is, the sub-pixel order in the pixel unit of the initial corrected image is arranged as GBR. After rearrangement, the pixel unit on the above display panel is reassigned to display the target corrected image. Specifically, if the pixel value of a pixel unit in the initial pixel unit is (0, 125, 256), the pixel value in the target corrected image corresponding to the pixel unit in the initial corrected image is (125, 256, 0). It should be noted that Figure 6 The smaller RGB in the characters represents the sub-pixel order of the image, and the larger characters represent the sub-pixel order of the display panel.

[0061] In some examples, referring to Figure 7 , when there are four sub-pixels in the pixel unit of the display panel, namely RGBW, and they are arranged in a square, the number of offset sub-pixels can include the number of offset sub-pixels in the first direction and the number of offset sub-pixels in the second direction. Position correction is performed separately in the first direction and the second direction, and then, based on the sub-pixel information of the display panel occupied by the initial corrected image after position correction, the sub-pixel order in the pixel unit of the initial corrected image is rearranged to obtain the above target corrected image.

[0062] For example, referring to Figure 8 , assuming that the projected image is first moved one sub-pixel to the right and then one sub-pixel up to obtain the initial corrected image, the sub-pixels in the pixel unit of the projected image are arranged as , after the movement, the sub-pixels in the pixel unit of the display panel covered by the pixel unit in the initial corrected image are arranged as , based on this, it is necessary to set the sub-pixel arrangement in the pixel unit of the initial corrected image to to obtain the target corrected image. It should be noted that Figure 7 and Figure 8 The smaller-sized RGBW in the characters represents the sub-pixel arrangement order of the image, and the larger-sized RGBW characters represent the sub-pixel arrangement order of the display panel.

[0063] It should be noted that the sub-pixel arrangement in the pixel unit of the display panel may also include other methods, and corresponding rearrangement methods can also be adjusted adaptively, which will not be elaborated in this embodiment.

[0064] The embodiments of the present disclosure provide a method for correcting distortion of a projected image. This method accurately determines the number of offset sub-pixels of the projected image, and fine-tunes the display position of the image on the display panel according to these offsets to generate an initial corrected image. This step ensures the accuracy of the correction process, thereby significantly improving the accuracy of image distortion correction. Further, the method uses the pixel information of the projected image to perform sub-pixel level sequential rearrangement on the pixel units in the initial corrected image to generate a target corrected image. This process ensures that while performing sub-pixel level correction, the display color of the target corrected image remains unchanged, optimizes the image quality, and ensures the true reproduction of colors. Pay attention to the improvement of the local display effect. By determining multiple display areas and performing corrections separately, the overall display effect is improved.

[0065] Further, referring to Figure 9 As shown, in the embodiment of this example, a device 900 for correcting distortion of a projected image is also provided, including an offset determination module 910, a position adjustment module 920, and a pixel rearrangement module 930. Among them:

[0066] The offset determination module 910 can be used to determine the number of offset sub-pixels of the projected image according to the projected image. The position adjustment module 920 is used to adjust the display position of the projected image on the display panel according to the number of offset sub-pixels to obtain an initial corrected image. The pixel rearrangement module 930 is used to perform sub-pixel sequential rearrangement on the pixel units in the initial corrected image according to the pixel information of the projected image to obtain a target corrected image, so that the display color of the target corrected image is the same as that of the projected image.

[0067] In an example embodiment, the offset determination module 910 may be configured to obtain a first image feature matrix in the projected image and a second image feature matrix of the projected image; obtain a distortion correction matrix according to the second image feature matrix and the first image feature matrix; and determine the number of offset sub-pixels according to the distortion correction matrix.

[0068] In an example embodiment, the offset determination module 910 may be configured to determine multiple display areas in the projected image and the projected image; and determine the number of offset sub-pixels corresponding to each display area in the projected image according to the offset amount between the display area in the projected image and the display area in the projected image.

[0069] In an exemplary embodiment, the position adjustment module 920 may be configured to determine the coordinates of the calibration point on the display panel for the geometric center of the display area in the projected image; adjust the position of the calibration point coordinates in the display panel according to the number of offset sub-pixels to perform position adjustment on the projected image to obtain an initial corrected image.

[0070] In an exemplary embodiment, the position adjustment module 920 may be configured to determine the positional relationship between the respective display areas; determine the upper limit value of the number of movable sub-pixels of each display area according to the positional relationship; and adjust the display position of the projected image on the display panel according to the number of offset sub-pixels when the number of offset sub-pixels is less than the upper limit value to obtain an initial corrected image.

[0071] In an exemplary embodiment, the position adjustment module 920 may be configured to adjust the display position of the projected image on the display panel according to the maximum number of movable sub-pixels when the number of offset sub-pixels is greater than the upper limit value to obtain an initial corrected image.

[0072] In an exemplary embodiment, the pixel rearrangement module 930 may be configured to determine the number of layout sub-pixels of the pixel units of the display panel in the position adjustment direction; and when the number of offset sub-pixels is not an integer multiple of the number of layout sub-pixels, reorder the sub-pixels of the pixel units in the initial corrected image according to the pixel information of the projected image to obtain a target corrected image.

[0073] In an exemplary embodiment, the pixel rearrangement module 930 may be configured to determine the pixel order in the pixel units of the initial corrected image according to the position of the initial corrected image in the display panel; and assign values to the sub-pixels occupied by the initial corrected image in the display panel based on the pixel order and the pixel information of the projected image to obtain a target corrected image.

[0074] It should be understood that the above device embodiments are illustrative, and the devices of the present disclosure can also be implemented in other ways. For example, the division of units / modules in the above embodiments is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units, modules or components can be combined, or can be integrated into another system, or some features can be ignored or not executed.

[0075] In addition, unless otherwise specified, in each embodiment of the present disclosure, each functional unit / module can be integrated in one unit / module, or each unit / module can exist physically alone, or two or more units / modules can be integrated together. The above integrated unit / module can be implemented in the form of hardware or in the form of a software program module.

[0076] When the integrated unit / module is implemented in the form of hardware, the hardware can be a digital circuit, an analog circuit, etc. The physical implementation of the hardware structure includes, but is not limited to, transistors, memristors, etc. Unless otherwise specified, the processor can be any suitable hardware processor, such as a CPU, GPU, FPGA, DSP, and ASIC, etc. Unless otherwise specified, the storage unit can be any suitable magnetic storage medium or magneto-optical storage medium, such as resistive random access memory (RRAM), dynamic random access memory (DRAM), static random access memory (SRAM), enhanced dynamic random access memory (EDRAM), high-bandwidth memory (HBM), hybrid memory cube (HMC), etc.

[0077] When the integrated unit / module is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present disclosure, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a memory and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods of the various embodiments of the present disclosure. The aforementioned memory includes: various media that can store program codes, such as USB flash drives, read-only memories (ROM), random access memories (RAM), mobile hard disks, magnetic disks, or optical discs.

[0078] The exemplary embodiment of the present disclosure further provides a head-up display device for executing the above-mentioned distortion correction method of the projected image, as Figure 10 shown. The head-up display device 1000 can include: at least one processor 1010, a memory 1020, and a communication interface 1030.

[0079] The memory 1020 is used to store programs. Specifically, the program can include program codes, and the program codes include computer operation instructions.

[0080] The memory 1020 may include high-speed RAM memory and may also include non-volatile memory, such as at least one disk memory.

[0081] The processor 1010 is configured to execute computer-executable instructions stored in the memory 1020 to implement the distortion correction method of the projected image described in the foregoing method embodiments. Among them, the processor 1010 may be a central processing unit (CPU for short), or an application specific integrated circuit (ASIC for short), or one or more integrated circuits configured to implement the embodiments of the present disclosure.

[0082] The head-up display device 1000 may further include a communication interface 1030, through which it can communicate with external devices. In a specific implementation, if the communication interface 1030, the memory 1020, and the processor 1010 are implemented independently, the communication interface 1030, the memory 1020, and the processor 1010 can be interconnected through a bus and communicate with each other. The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc., but it does not mean that there is only one bus or one type of bus.

[0083] Optionally, in a specific implementation, if the communication interface 1030, the memory 1020, and the processor 1010 are integrated on a chip, the communication interface 1030, the memory 1020, and the processor 1010 can communicate through an internal interface.

[0084] Those skilled in the art can understand that various aspects of the present disclosure can be implemented as a system, a method, or a program product. Therefore, various aspects of the present disclosure can be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or an implementation combining hardware and software aspects, which can be collectively referred to as "circuits", "modules", or "systems" here.

[0085] Exemplary embodiments of the present disclosure also provide a computer-readable storage medium, on which a program product is stored that can implement the methods described above in this specification. In some possible embodiments, various aspects of the present disclosure can also be implemented in the form of a program product, which includes program code. When the program product runs on a terminal device, the program code is used to cause the terminal device to execute the steps according to various exemplary embodiments of the present disclosure described in the "Exemplary Methods" section above in this specification.

[0086] It should be noted that the computer-readable medium shown in the present disclosure can be a computer-readable signal medium or a computer-readable storage medium or any combination of the two. A computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of a computer-readable storage medium can include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0087] In the present disclosure, a computer-readable storage medium can be any tangible medium that contains or stores a program, which can be used by or in conjunction with an instruction execution system, apparatus, or device. And in the present disclosure, a computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on a computer-readable medium can be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical fiber, RF, etc., or any suitable combination of the above.

[0088] In addition, program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and also including conventional procedural programming languages such as the "C" language or similar programming languages. The program code may execute entirely on the user's computing device, partially on the user's device, execute as a stand-alone software package, execute partially on the user's computing device and partially on a remote computing device, or execute entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user's computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0089] In the above embodiments, the descriptions of the various embodiments have their respective emphases. For parts not detailed in a certain embodiment, reference may be made to the relevant descriptions of other embodiments. The technical features of the above embodiments may be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as falling within the scope described in this specification.

[0090] Those skilled in the art will readily conceive of other embodiments of the present disclosure after considering the specification and practicing the invention herein. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include known common knowledge or conventional technical means in the technical field not claimed in the present disclosure.

[0091] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.

Claims

1. A method for correcting distortion of a projected image, characterized in that, Including: Determine the number of offset sub-pixels of the projected image according to the projected image; Adjust the display position of the projected image on the display panel according to the number of offset sub-pixels to obtain an initial corrected image; According to the pixel information of the projected image, rearrange the sub-pixel order of the pixel units in the initial corrected image to obtain a target corrected image, so that the display color of the target corrected image is the same as that of the projected image.

2. The method according to claim 1, wherein The step of rearranging the sub-pixel order of the pixel units in the initial corrected image according to the pixel information of the projected image to obtain a target corrected image includes: Determine the number of layout sub-pixels of the pixel units of the display panel in the position adjustment direction; In the case where the number of offset sub-pixels is not an integer multiple of the number of layout sub-pixels, rearrange the sub-pixel order of the pixel units in the initial corrected image according to the pixel information of the projected image to obtain a target corrected image.

3. The method according to claim 1, characterized in that, Determining the number of offset sub-pixels of the projected image according to the projected image includes: Determine a plurality of display areas in the projected image and the projected image; According to the offset amount between the display area in the projected image and the display area in the projected image, determine the number of offset sub-pixels corresponding to each display area in the projected image.

4. The method according to claim 3, wherein The step of adjusting the display position of the projected image on the display panel according to the number of offset sub-pixels to obtain an initial corrected image includes: Determine the calibration point coordinates of the geometric center of the display area in the projected image on the display panel; Adjust the position of the calibration point coordinates in the display panel according to the number of offset sub-pixels to adjust the position of the projected image to obtain an initial corrected image.

5. The method according to claim 4, wherein Before adjusting the display position of the projected image on the display panel according to the number of offset sub-pixels to obtain an initial corrected image, the method further includes: Determine the positional relationship between each display area; Determine the upper limit value of the number of movable sub-pixels of each display area according to the positional relationship; In the case where the number of offset sub-pixels is less than the upper limit value, adjust the display position of the projected image on the display panel according to the number of offset sub-pixels to obtain the initial corrected image.

6. The method according to claim 5, wherein The method further includes: In the case where the number of offset sub-pixels is greater than the upper limit value, adjust the display position of the projected image on the display panel according to the upper limit value to obtain the initial corrected image.

7. The method according to any one of claims 1 to 4, characterized in that, Determining the number of offset sub-pixels of the projected image according to the projected image includes: Obtain a first image feature matrix in the projected image and a second image feature matrix of the projected image; Obtain a distortion correction matrix according to the second image feature matrix and the first image feature matrix; Determine the number of offset sub-pixels according to the distortion correction matrix.

8. The method according to any one of claims 1 to 4, characterized in that, The step of rearranging the sub-pixel order of the pixel units in the initial corrected image to obtain a target corrected image includes: Determine the pixel order in the pixel units of the initial corrected image according to the position of the initial corrected image in the display panel; Based on the pixel order and the pixel information of the projected image, assign sub-pixels occupied by the initial corrected image in the display panel to obtain the target corrected image.

9. A distortion correction device for a projected image, characterized in that, Including: An offset determination module for determining the number of offset sub-pixels of the projected image according to the projected image; A position adjustment module for adjusting the display position of the projected image on the display panel according to the number of offset sub-pixels to obtain an initial corrected image; A pixel rearrangement module for rearranging the sub-pixel order of pixel units in the initial corrected image according to the pixel information of the projected image to obtain a target corrected image, so that the display color of the target corrected image is the same as that of the projected image.

10. A head-up display device, characterized in that, The head-up display device includes: a processor and a memory; the processor is configured to execute instructions stored in the memory to implement the distortion correction method of the projected image according to any one of claims 1 to 8.

11. A computer storage medium, characterized in that, The storage medium stores at least one instruction, and the at least one instruction is used to be executed by a processor to implement the distortion correction method of the projected image according to any one of claims 1 to 8.

Images