Image distortion correction method and device, storage medium and electronic equipment

Abstract

The invention relates to an image distortion correction method and device, a storage medium and electronic equipment, and relates to the technical field of vehicle-mounted panoramic head-up display, and the method comprises the steps: obtaining an original video frame image, and carrying out the image mode conversion and image segmentation processing of the original video frame image, and obtaining a standard video frame image; obtaining distortion correction parameters, and determining a to-be-corrected image area from the standard video frame image according to position parameters in the distortion correction parameters; and performing distortion correction on the original pixels in the to-be-corrected image area based on weight parameters in the distortion correction parameters to obtain corrected pixels, and obtaining a to-be-displayed video frame image according to the corrected pixels. According to the invention, the image in the panoramic head-up display scene is corrected.

Description

Technical Field

[0001] This disclosure relates to the field of in-vehicle panoramic head-up display technology, and more specifically, to an image distortion correction method, an image distortion correction device, a computer-readable storage medium, and an electronic device. Background Technology

[0002] Existing methods cannot correct images in panoramic head-up display scenarios, resulting in low accuracy of the displayed images.

[0003] It should be noted that the information in the background section above is only used to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0004] The purpose of this disclosure is to provide an image distortion correction method, an image distortion correction device, a computer-readable storage medium, and an electronic device, thereby overcoming, to at least a certain extent, the problem of being unable to correct images in panoramic head-up display scenarios due to limitations and defects in related technologies.

[0005] According to one aspect of this disclosure, a method for image distortion correction is provided, comprising:

[0006] The original video frame images are acquired, and image mode conversion and image segmentation are performed on the original video frame images to obtain standard video frame images;

[0007] Obtain distortion correction parameters, and determine the image region to be corrected from the standard video frame image based on the position parameters in the distortion correction parameters;

[0008] The original pixels in the image region to be corrected are corrected based on the weight parameters in the distortion correction parameters to obtain the corrected pixels, and the video frame image to be displayed is obtained based on the corrected pixels.

[0009] In one exemplary embodiment of this disclosure, image mode conversion and image segmentation are performed on the original video frame image to obtain a standard video frame image, including:

[0010] The original video frame image is converted from a first image display mode to a second image display mode to obtain the image conversion result;

[0011] The image conversion result is subjected to image segmentation processing to obtain the standard video frame image.

[0012] In one exemplary embodiment of this disclosure, the first image display mode includes a standard display mode, and the second image display mode includes a non-standard display mode;

[0013] The second image display mode is consistent with the display mode of the panoramic head-up display terminal.

[0014] In one exemplary embodiment of this disclosure, converting the original video frame image from a first image display mode to a second image display mode to obtain an image conversion result includes:

[0015] Based on the first image display mode and the second image display mode, determine the horizontal pixel stretching coefficient and the vertical pixel compression coefficient;

[0016] Extract the first original horizontal pixel and the first original vertical pixel from the original video frame image, and perform pixel stretching processing on the first horizontal pixel according to the horizontal pixel stretching coefficient to obtain the first stretched horizontal pixel;

[0017] The first original vertical pixel is subjected to pixel compression processing according to the vertical pixel compression coefficient to obtain the first compressed vertical pixel, and the image conversion result is obtained according to the first stretched horizontal pixel and the first compressed vertical pixel.

[0018] In one exemplary embodiment of this disclosure, image segmentation processing is performed on the image conversion result to obtain the standard video frame image, including:

[0019] Extract the second horizontal image pixels and the second vertical image pixels from the image conversion result, and segment the second horizontal image pixels based on the preset image segmentation rules to obtain the first horizontal pixel segmentation result and the second horizontal pixel segmentation result;

[0020] A first image segmentation result is obtained based on the first horizontal pixel segmentation result and the second vertical image pixels, and a second image segmentation result is obtained based on the second horizontal pixel segmentation result and the second vertical image pixels;

[0021] The first image segmentation result and the second image segmentation result are combined to obtain the standard video frame image.

[0022] In one exemplary embodiment of this disclosure, obtaining distortion correction parameters and determining the image region to be corrected from the standard video frame image based on the position parameters in the distortion correction parameters includes:

[0023] The overall video timing parameters of the standard video frame image are determined based on the overall video display timing of the standard video frame image during the display process.

[0024] Sub-video timing parameters are determined from the overall video timing parameters, and sub-distortion correction regions corresponding to the sub-video timing parameters are determined based on the sub-video timing parameters.

[0025] Obtain the distortion correction parameters in the sub-distortion correction region, and extract the position parameters from the distortion correction parameters;

[0026] Based on the location parameters, the image region to be corrected corresponding to the sub-distortion correction region is determined from the standard video frame image.

[0027] In one exemplary embodiment of this disclosure, the overall video timing parameters include multiple parameters such as line valid, field valid, line front shoulder, field front shoulder, line sync pulse, field sync pulse, line back shoulder, field back shoulder, total line length, and total field length.

[0028] The overall video display timing sequence includes a first sub-video display timing sequence, a second sub-video display timing sequence, a third sub-video display timing sequence, and a fourth sub-video display timing sequence;

[0029] The sub-video timing parameters include the first sub-video timing parameters corresponding to the first sub-video display timing, the second sub-video timing parameters corresponding to the second sub-video display timing, the third sub-video timing parameters corresponding to the third sub-video display timing, and the fourth sub-video timing parameters corresponding to the fourth sub-video display timing.

[0030] In one exemplary embodiment of this disclosure, determining the image region to be corrected corresponding to the sub-distortion correction region from the standard video frame image based on the position parameters includes:

[0031] Extract the maximum and minimum horizontal coordinate values ​​from the position parameters, and determine the starting and ending horizontal pixel coordinates from the standard video frame image based on the maximum and minimum horizontal coordinate values.

[0032] Based on the vertical coordinate values ​​in the position parameters, determine the starting vertical pixel coordinates and the ending vertical pixel coordinates from the standard video frame image;

[0033] Based on the starting horizontal pixel coordinates, the starting vertical pixel coordinates, the ending horizontal pixel coordinates, and the ending vertical pixel coordinates, the image region to be corrected corresponding to the sub-distortion correction region is determined.

[0034] In one exemplary embodiment of this disclosure, distortion correction is performed on the original pixels in the image region to be corrected based on the weight parameters in the distortion correction parameters to obtain corrected pixels, including:

[0035] Based on the first parameter coordinate of the first correction parameter in the distortion correction parameters in the sub-distortion correction region, extract the first original pixel point corresponding to the first parameter coordinate from the image region to be corrected.

[0036] Determine the second, third, and fourth correction parameters adjacent to the first correction parameter, and determine the second, third, and fourth original pixels adjacent to the first original pixel.

[0037] Based on the first correction parameter, the second correction parameter, the third correction parameter, and the fourth correction parameter, respectively, distortion correction is performed on the first original pixel, the second original pixel, the third original pixel, and the fourth original pixel to obtain the corrected first pixel, the second pixel, the third pixel, and the fourth pixel.

[0038] By iterating through all the distortion correction parameters and all the original pixels in the original pixels, the above correction steps are repeated to obtain the corrected pixels.

[0039] In one exemplary embodiment of this disclosure, distortion correction is performed on the first original pixel based on the first correction parameter to obtain the corrected first pixel, including:

[0040] The first correction parameter is used to perform a product operation on the original pixel values ​​in the first original pixel to obtain the corrected first pixel; wherein the original pixel values ​​include R channel pixel values, G channel pixel values ​​and B channel pixel values.

[0041] In one exemplary embodiment of this disclosure, obtaining a video frame image to be displayed based on the corrected pixels includes:

[0042] The pixel values ​​of the corrected pixels are subjected to mean filtering to obtain the filtered pixels, and the video frame image to be displayed is generated based on the filtered pixels.

[0043] In one exemplary embodiment of this disclosure, the image distortion correction method further includes:

[0044] Based on the overall video display timing of the standard video frame image during the display process, the storage timing of the video frame image to be displayed is determined, and the video frame image to be displayed is written into direct access memory based on the storage timing, so as to push the video frame to be displayed to the panoramic head-up display terminal through the direct access memory based on the storage timing.

[0045] According to one aspect of this disclosure, an image distortion correction apparatus is provided, comprising:

[0046] The image mode conversion module is used to acquire the original video frame image and perform image mode conversion and image segmentation processing on the original video frame image to obtain the standard video frame image.

[0047] The image region to be corrected module is used to obtain distortion correction parameters and determine the image region to be corrected from the standard video frame image based on the position parameters in the distortion correction parameters.

[0048] The image distortion correction module is used to perform distortion correction on the original pixels in the image region to be corrected based on the weight parameters in the distortion correction parameters, to obtain the corrected pixels, and to obtain the video frame image to be displayed based on the corrected pixels.

[0049] According to one aspect of this disclosure, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the image distortion correction method described in any of the preceding claims.

[0050] According to one aspect of this disclosure, an electronic device is provided, comprising:

[0051] Processor; and

[0052] Memory for storing the executable instructions of the processor;

[0053] The processor is configured to execute the image distortion correction method described above by executing the executable instructions.

[0054] This disclosure provides an image distortion correction method. It involves acquiring an original video frame image, performing image mode conversion and image segmentation on the original video frame image to obtain a standard video frame image; then acquiring distortion correction parameters, and determining the image region to be corrected from the standard video frame image based on the position parameters in the distortion correction parameters; finally, performing distortion correction on the original pixels in the image region to be corrected based on the weight parameters in the distortion correction parameters to obtain corrected pixels, and obtaining the video frame image to be displayed based on the corrected pixels. This method achieves the correction of video frame images in panoramic head-up display scenarios, solving the problem in the prior art where the accuracy of the displayed image is low due to image correction in panoramic head-up display scenarios. It improves the accuracy of the video frame image to be displayed during the display process, thereby enhancing the user's viewing experience.

[0055] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0056] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure. It is obvious that the drawings described below are merely some embodiments of this disclosure, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort.

[0057] Figure 1 The flowchart illustrates an image distortion correction method according to an exemplary embodiment of the present disclosure.

[0058] Figure 2 This illustration schematically depicts an in-vehicle display terminal with a panoramic head-up display mode according to an example embodiment of the present disclosure.

[0059] Figure 3 The diagram schematically illustrates an example structure of a programmable array logic FPGA according to an exemplary embodiment of the present disclosure.

[0060] Figure 4 The illustration shows an example scenario of storing a pre-correction image and a post-correction image according to an exemplary embodiment of the present disclosure.

[0061] Figure 5 The illustration shows an example scenario of image segmentation of an image conversion result according to an exemplary embodiment of the present disclosure.

[0062] Figure 6 The illustration schematically shows a specific comparison example of an image region to be corrected and a sub-distortion correction region according to an exemplary embodiment of the present disclosure.

[0063] Figure 7 The illustration shows a specific scenario example diagram of an image region to be corrected and a cache region according to an exemplary embodiment of the present disclosure.

[0064] Figure 8 An example diagram schematically illustrates a specific arrangement of the original pixels before correction according to an exemplary embodiment of this disclosure.

[0065] Figure 9 The illustration shows a scenario example of a pixel distortion correction process according to an exemplary embodiment of the present disclosure.

[0066] Figure 10 The illustration shows a specific arrangement of pixels before filtering according to an example embodiment of the present disclosure.

[0067] Figure 11 The illustration shows a scenario example diagram illustrating a pixel filtering process according to an exemplary embodiment of the present disclosure.

[0068] Figure 12The illustration shows a scenario example of regional processing in a distortion correction and filtering process according to an exemplary embodiment of the present disclosure.

[0069] Figure 13 A block diagram schematically illustrates an image distortion correction apparatus according to an exemplary embodiment of the present disclosure.

[0070] Figure 14 An electronic device for implementing an image distortion correction method according to an example embodiment of the present disclosure is illustrated schematically. Detailed Implementation

[0071] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided to make this disclosure more comprehensive and complete, and to fully convey the concept of the example embodiments to those skilled in the art. The described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a full understanding of embodiments of this disclosure. However, those skilled in the art will recognize that the technical solutions of this disclosure can be practiced with one or more of the specific details omitted, or other methods, components, apparatus, steps, etc., can be employed. In other instances, well-known technical solutions are not shown or described in detail to avoid obscuring various aspects of this disclosure.

[0072] Furthermore, the accompanying drawings are merely illustrative of this disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and therefore repeated descriptions of them will be omitted. Some block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0073] This exemplary embodiment first provides an image distortion correction method. This method can be run on a display terminal, which may include, for example, an in-vehicle display terminal with a panoramic head-up display mode, or a panoramic head-up display terminal in other scenarios. Of course, those skilled in the art can also run the method disclosed herein on other platforms as needed, and this exemplary embodiment does not impose any special limitations on this. Specifically, refer to... Figure 1 As shown, the distortion correction method for this image may include the following steps:

[0074] Step S110. Obtain the original video frame image, and perform image mode conversion and image segmentation processing on the original video frame image to obtain a standard video frame image;

[0075] Step S120. Obtain distortion correction parameters, and determine the image region to be corrected from the standard video frame image based on the position parameters in the distortion correction parameters;

[0076] Step S130. Based on the weight parameters in the distortion correction parameters, perform distortion correction on the original pixels in the image region to be corrected to obtain the corrected pixels, and obtain the video frame image to be displayed based on the corrected pixels.

[0077] In the above-mentioned image distortion correction method, the original video frame image is acquired, and image mode conversion and image segmentation are performed on the original video frame image to obtain a standard video frame image. Then, distortion correction parameters are obtained, and the image region to be corrected is determined from the standard video frame image based on the position parameters in the distortion correction parameters. Finally, distortion correction is performed on the original pixels in the image region to be corrected based on the weight parameters in the distortion correction parameters to obtain the corrected pixels. The video frame image to be displayed is obtained based on the corrected pixels. This method realizes the correction of video frame images in panoramic head-up display scenarios, solves the problem in the prior art that the accuracy of the displayed image is low due to the correction of images in panoramic head-up display scenarios, improves the accuracy of the video frame image to be displayed in the display process, and thus enhances the user's viewing experience.

[0078] The image distortion correction method described in the exemplary embodiments of this disclosure will be explained and illustrated in detail below with reference to the accompanying drawings.

[0079] First, the technical implementation principle of the exemplary embodiments of this disclosure will be explained and described. Specifically, the image distortion correction method described in the exemplary embodiments of this disclosure can be used to correct adaptive large-angle distortion video frame images in PHUD (Panoramic Head-Up Display) scenarios in real time. Specifically, in practical applications, the image of the in-vehicle LCD screen in a global head-up display scenario is projected onto the windshield of the vehicle and reflected into the human eye, thereby forming a virtual image for the user to view; in this process, due to the curvature of the windshield, the video frame image will produce a fan-shaped distortion. The in-vehicle LCD screen is a continuous screen, resulting in a huge distortion of the video frame image, causing the distortion correction processor to need to cache too many video images in real time, thereby significantly increasing the processor cost; under this premise, the exemplary embodiments of this disclosure propose an image distortion correction method, which can be based on FPGA (Field Programmable Gate Array). The real-time distortion correction system (FPGA) performs time-division and region-division processing on distorted images, increases memory scheduling (effectively utilizes memory bandwidth), and reduces cache resource consumption, thereby reducing the demand on FPGA cache resources. This allows for real-time image distortion correction while ensuring system latency. In practical applications, the FPGA can handle real-time non-standard resolution and large-angle distortion. By performing time-division and region-division distortion correction on the entire image, memory bandwidth is reused, reducing the huge cache problem caused by large distortion correction, and thus reducing the cache resource requirements of the processor.

[0080] Secondly, the in-vehicle display terminal with panoramic head-up display mode involved in the exemplary embodiments of this disclosure will be explained and described. Specifically, refer to... Figure 2 As shown, the vehicle-mounted display terminal with panoramic head-up display mode may include a data acquisition chip SOC (System on Chip) 210, a programmable array logic FPGA 220, and a panoramic vehicle-mounted display screen 230; the data acquisition chip, programmable array logic, and panoramic vehicle-mounted display screen can be connected via a serial data interface; in practical applications, the data acquisition chip SOC is responsible for acquiring the images for the vehicle display; the FPGA is responsible for non-standard resolution processing and real-time correction of large-angle distortion; and the panoramic vehicle-mounted screen is responsible for projecting the HUD images.

[0081] In one example embodiment, reference is made to Figure 3 As shown, a programmable array logic FPGA may include the following modules:

[0082] HDMI_RX: HDMI (High Definition Multimedia Interface) receiver module, responsible for receiving raw video frame images sent by the SoC;

[0083] WDMA1, WDMA2, and WDMA3: Write DMA (Direct Memory Access) control module, through which data is written to memory;

[0084] RDMA1, RDMA2, and RDMA3: Read DMA control module, through which data is read from memory;

[0085] SPI_RD: The read control module of SPI_FLASH (FLASH storage distortion correction table); where SPI stands for Serial Periheral Interface, which is used to characterize the serial peripheral device interface;

[0086] D-Cache: Data caching module used to store distortion-corrected video data;

[0087] P-Cache: Parameter caching module, used to store parameter data required for distortion correction;

[0088] CORRECT: Distortion correction module, main distortion correction module;

[0089] FILTER: A filtering module used for data smoothing;

[0090] EDP_TX1 and EDP_TX2: EDP (Embedded Display Port) transmission modules;

[0091] AXI_INCONNECT: Bus arbitration module used to handle WDMA and RDMA usage of the AXI (Advanced deXtensible Interface) bus.

[0092] In one example embodiment, reference is made to... Figure 4 As shown, WDMA1 described above is used to store the original video frame image (i.e., the image before correction), and the display mode of the original video frame image when it first enters the memory is 8960*1092; WDMA3 described above is used to store the image after correction, and the display mode of the image after correction when it enters the memory for the second time is also 8960*1092; WDMA2 described above is used to store the distortion correction parameters read from FLASH.

[0093] In one example embodiment, the RDMA1 described above is used to read the uncorrected image from WDMA1 and store it in the D-Cache; the RDMA2 described above is used to read the distortion correction parameters from WDMA2 and store them in the P-Cache; the RDMA3 described above may include RDMA3 / 1 and RDMA3 / 2; wherein, RDMA3 / 1 and RDMA3 / 2 are used to read the corrected image from WDMA3 and push it to EDP_TX1 and EDP_TX2, and push the corrected image to the PHUD for display via EDP_TX1 and EDP_TX2.

[0094] The following will combine Figures 2-4 right Figure 1 The distortion correction method for the image shown will be further explained and illustrated. Specifically:

[0095] In step S110, the original video frame image is acquired, and the original video frame image is subjected to image mode conversion and image segmentation processing to obtain a standard video frame image.

[0096] In this example embodiment, firstly, original video frame images are acquired; specifically, original video frame images can be extracted from the received original video; that is, when a video needs to be displayed, the video can be segmented into frames according to its frame rate to obtain multiple original video frame images; secondly, image mode conversion and image segmentation are performed on the original video frame images to obtain standard video frame images; wherein, in the process of generating standard video frame images, two different operations need to be performed: one is the image mode conversion operation; the other is the image segmentation operation on the converted image; at the same time, the reason for performing image mode conversion is to adapt to the display mode of the panoramic vehicle screen; the reason for performing image segmentation is because regional display is required.

[0097] In one example embodiment, the image mode conversion operation can be implemented as follows: converting the original video frame image from a first image display mode to a second image display mode to obtain an image conversion result; wherein, the first image display mode includes a standard display mode, and the second image display mode includes a non-standard display mode; the second image display mode is consistent with the display mode of the panoramic head-up display terminal. Further, the image segmentation operation can be implemented as follows: performing image segmentation processing on the image conversion result to obtain the standard video frame image; meanwhile, the standard display mode described herein may include, for example, an 8K (7680*4320) display mode, or a 4K (4096*2160) display mode, or a 2K (2048*1080) display mode, etc., and this example does not impose any special limitations on this; the non-standard display mode described herein may include an 8960*1092 display mode, or other display modes may be set according to the actual situation of the panoramic head-up display terminal, and this example does not impose any special limitations on this.

[0098] In one example embodiment, converting the original video frame image from a first image display mode to a second image display mode to obtain an image conversion result can be achieved as follows: First, determine the horizontal pixel stretching coefficient and the vertical pixel compression coefficient based on the first image display mode and the second image display mode; second, extract the first original horizontal pixel and the first original vertical pixel from the original video frame image, and perform pixel stretching processing on the first horizontal pixel according to the horizontal pixel stretching coefficient to obtain a first stretched horizontal pixel; then, perform pixel compression processing on the first original vertical pixel according to the vertical pixel compression coefficient to obtain a first compressed vertical pixel, and obtain the image conversion result based on the first stretched horizontal pixel and the first compressed vertical pixel. Specifically, in practical applications, the screen resolution of the vehicle display module (i.e., the panoramic vehicle screen) is a non-standard resolution of 9K1K (i.e., 8960*1092), while the original video frame image resolution is a standard resolution of 8K4K (i.e., 7680*4320). Therefore, in order to display it on the panoramic vehicle screen, the display mode needs to be converted first. In the specific conversion process, the horizontal pixels can be stretched and the vertical pixels can be compressed to obtain the image conversion result that conforms to the display mode of the panoramic vehicle screen.

[0099] In one example embodiment, image segmentation processing is performed on the image conversion result to obtain the standard video frame image. This can be achieved as follows: First, the second horizontal image pixels and the second vertical image pixels in the image conversion result are extracted, and the second horizontal image pixels are segmented based on a preset image segmentation rule to obtain a first horizontal pixel segmentation result and a second horizontal pixel segmentation result; second, a first image segmentation result is obtained based on the first horizontal pixel segmentation result and the second vertical image pixels, and a second image segmentation result is obtained based on the second horizontal pixel segmentation result and the second vertical image pixels; then, the first image segmentation result and the second image segmentation result are combined to obtain the standard video frame image. Specifically, refer to... Figure 5 As shown, the second horizontal pixel in the image conversion result can be divided into two parts; the first part has a length of 5972 and the second part has a length of 2988, with a ratio of approximately 2:1. That is, in specific segmentation, the segmentation can be performed at two-thirds of the second horizontal pixel to obtain the first horizontal pixel segmentation result and the second horizontal pixel segmentation result. The reason for choosing this segmentation method is that the panoramic vehicle screen can be roughly divided into three display areas (left display area, middle display area, and right display area) during the display process, and the specific display order is from left to right. Therefore, the right third of the image can be segmented.

[0100] In step S120, distortion correction parameters are obtained, and the image region to be corrected is determined from the standard video frame image based on the position parameters in the distortion correction parameters.

[0101] Specifically, the process of determining the image region to be corrected can be implemented as follows: First, based on the overall video display timing of the standard video frame image during the display process, determine the overall video timing parameters of the standard video frame image; second, determine sub-video timing parameters from the overall video timing parameters, and based on the sub-video timing parameters, determine the sub-distortion correction region corresponding to the sub-video timing parameters; then, obtain the distortion correction parameters in the sub-distortion correction region, and extract the position parameters from the distortion correction parameters; finally, based on the position parameters, determine the image region to be corrected corresponding to the sub-distortion correction region from the standard video frame image; wherein, The overall video timing parameters recorded here include horizontal active, vertical active, horizontal front shoulder, vertical front shoulder, horizontal sync pulse, vertical sync pulse, horizontal back shoulder, vertical back shoulder, total horizontal length, and total vertical length, etc.; the overall video display timing recorded here includes the first sub-video display timing, the second sub-video display timing, the third sub-video display timing, and the fourth sub-video display timing; the sub-video timing parameters recorded here include the first sub-video timing parameters corresponding to the first sub-video display timing, the second sub-video timing parameters corresponding to the second sub-video display timing, the third sub-video timing parameters corresponding to the third sub-video display timing, and the fourth sub-video timing parameters corresponding to the fourth sub-video display timing.

[0102] In one example embodiment, determining the image region to be corrected corresponding to the sub-distortion correction region from the standard video frame image based on the position parameters can be achieved as follows: extracting the maximum and minimum horizontal coordinate values ​​from the position parameters, and determining the starting and ending horizontal pixel coordinates from the standard video frame image based on the maximum and minimum horizontal coordinate values; determining the starting and ending vertical pixel coordinates from the standard video frame image based on the vertical coordinate values ​​in the position parameters; and determining the image region to be corrected corresponding to the sub-distortion correction region based on the starting horizontal and vertical pixel coordinates, the ending horizontal and vertical pixel coordinates.

[0103] The following will combine Figure 6 as well as Figure 7 The specific process of determining the image region to be corrected will be further explained and illustrated. Specifically, in practical applications, the process of determining the image region to be corrected consists of two parts: reading the distortion correction parameters and determining the image region to be corrected based on the read distortion correction parameters. Specifically:

[0104] First, the process of reading distortion correction parameters is as follows: In practical applications, distortion correction parameters can be pre-stored in, for example... Figure 3The external FLASH (i.e., SPI_FLASH) shown is used for distortion correction parameters. The resolution of the distortion correction parameter table stored in the external FLASH is consistent with the image resolution of the standard video frame. The overall size of the distortion correction table is 8960x1092x56. The 56-bit organization is P[X,Y,W1,W2,W3,W4], where X is represented by 13 bits, Y by 11 bits, and W1, W2, W3, and W4 are each represented by 8 bits, so 13 + 11 + 8 * 4 = 56. When the vehicle display terminal with panoramic head-up display mode is powered on, the distortion correction parameters are written to memory once by the SPI_RD module and the WDAM-2 module according to a specific video timing sequence (i.e., the overall video display timing sequence), and only once. The specific overall video timing parameters can be as follows:

[0105] HAC:8960, VAC:1092, HFP:200, VFP:60, HSW:40, VSW:20, HBP:80, VBP:20, HTT:9280, VTT:1192; where HAC stands for Horizontal Active (horizontal active, i.e., horizontally active pixels); VAC stands for Vertical Active (vertical active, i.e., vertically active pixels); HFP stands for Horizontal Front Porch (horizontal front shoulder); VFP stands for Vertical Front Porch (vertical front shoulder); HSW stands for Horizontal Sync Width (horizontal sync pulse); VSW stands for Vertical Sync Width (vertical sync pulse); HBP stands for Horizontal Back Porch (horizontal back shoulder); VBP stands for Vertical Back Porch (vertical back shoulder); HTT stands for Horizontal Total (horizontal total length); VTT stands for Vertical Total (vertical total length).

[0106] In practical applications, distortion correction parameters can be read sequentially from memory in regions using RDMA-2. Each frame of image is read from memory once, and the distortion correction parameters are cached in the P-Cache, with at least one line of parameters cached, awaiting use by the distortion correction module. Simultaneously, the distortion correction parameters are read from memory in regions according to a fixed video timing sequence using RDMA-2. The specific timing parameters are as follows:

[0107] HAC:2240, VAC:4368, HFP:50, VFP:240, HSW:10, VSW:80, HBP:20, VBP:80, HTT:2320, VTT:4768.

[0108] Secondly, the specific implementation process for determining the image region to be corrected based on the read distortion correction parameters is as follows: Specifically, firstly, the distortion correction region is denoted as P, and the data region (i.e., the image region to be corrected) is denoted as D; taking the distortion correction 4-region division as an example, the size of the distortion correction region is 2240*1192, and its coordinates are denoted as P(x,y)=[m,n,w1,w2,w3,w4]; the data region range is denoted as D(j,k)=[r,g,b]; based on the distortion correction region (i.e., the sub-distortion correction region), the video data region range (i.e., the image region to be corrected) is determined; The specific process for determining the video data region range is as follows:

[0109] First, traverse the distortion correction region (i.e., the sub-distortion correction region), where the maximum value of parameter m is denoted as m_max and the minimum value as m_min. Then, the horizontal range of the video data area (i.e., the image area to be corrected) is: j = [1, m_max - m_min]; the vertical range of the video data area (the image area to be corrected) is: k = [1, 1092]. For a detailed comparison example between the image area to be corrected (regional video data) and the sub-distortion correction region (regional distortion parameters), please refer to... Figure 6 As shown.

[0110] Secondly, the D-Cache buffer area range is determined: the size of the D-Cache buffer area is denoted as [h, v]; where the range of h is consistent with the horizontal range of the video data, i.e., h = j = [1, m_max - m_min]; the range of v is determined as follows: traverse the distortion correction area, calculate ny for each coordinate data, where the maximum value is denoted as (ny)_max; then the range of v is as follows: [1, (ny)_max]; finally, the video area is read from memory in time-division and region-division using RDMA-1 and cached in the D-Cache, waiting for the distortion correction module to call it; for specific scene example diagrams of the image area to be corrected and the buffer area, please refer to Figure 7 As shown.

[0111] In step S130, distortion correction is performed on the original pixels in the image region to be corrected based on the weight parameters in the distortion correction parameters to obtain the corrected pixels, and the video frame image to be displayed is obtained based on the corrected pixels.

[0112] In this example embodiment, firstly, distortion correction is performed on the original pixels in the image region to be corrected based on the weight parameters in the distortion correction parameters to obtain the corrected pixels. Specifically, the image distortion correction process can be implemented as follows: Firstly, based on the first parameter coordinates of the first correction parameter in the distortion correction parameters within the sub-distortion correction region, the first original pixel point corresponding to the first parameter coordinates is extracted from the image region to be corrected. Secondly, the second, third, and fourth correction parameters adjacent to the first correction parameter are determined, and the pixel point corresponding to the first original pixel is determined. The second, third, and fourth original pixels adjacent to the original pixel are identified. Then, distortion correction is performed on the first, second, third, and fourth original pixels based on the first, second, third, and fourth correction parameters, respectively, to obtain the corrected first, second, third, and fourth pixels. Finally, the above correction steps are repeated by traversing all correction parameters in the distortion correction parameters and all original pixels in the original pixels to obtain the corrected pixels.

[0113] In one exemplary embodiment, the distortion correction of the first original pixel point based on the first correction parameter is performed to obtain the corrected first pixel point. This can be achieved by performing a product operation on the original pixel values ​​in the first original pixel point using the first correction parameter to obtain the corrected first pixel point; wherein the original pixel values ​​include R channel pixel values, G channel pixel values ​​and B channel pixel values.

[0114] The following will combine Figure 8 as well as Figure 9 The specific distortion correction process will be further explained and described. Specifically, during distortion correction, the CORRECT module sequentially reads parameters P[X,Y,W1,W2,W3,W4] from the P-Cache and four pixels from the D-Cache, with addresses D0[X,Y] / D1[X+1,Y] / D2[X,Y+1] / D3[X+1,Y+1]. Using these four pixels and their corresponding weights, the corrected pixels are obtained. Then, other pixels are read sequentially and the corresponding correction process is executed until all pixels in the image region to be corrected are corrected. The specific arrangement of the original pixels before correction can be found in [reference needed]. Figure 8 As shown, the specific correction process can be found in the reference. Figure 9 As shown; further, the pixel calculation formula after distortion correction is as follows: Formula (1):

[0115] C = D0 × W0 + D1 × W1 + D2 × W2 + D3 × W3; Formula (1)

[0116] Where D: [R / G / B]; that is, D is the R channel pixel value, G channel pixel value and B channel pixel value of each original pixel.

[0117] Secondly, the video frame image to be displayed is obtained based on the corrected pixels. Specifically, this can be achieved as follows: mean filtering is performed on the pixel values ​​of the corrected pixels to obtain filtered pixels, and the video frame image to be displayed is generated based on these filtered pixels. That is, in practical applications, filtering is required after distortion correction. Filtering is applied to the distorted pixels to eliminate jagged edges and make the displayed image smoother. In practical applications, four-point mean filtering can be used. The specific arrangement of pixels before filtering can be referenced in [reference needed]. Figure 10 As shown in the diagram, a scenario example of the specific filtering process can be found in the following diagram. Figure 11 As shown; further, the specific filtering calculation formula can be shown in the following formula (2):

[0118]

[0119] Where C:[R / G / B]; that is, C is the R channel pixel value, G channel pixel value and B channel pixel value of the pixel after distortion correction.

[0120] It's also worth noting that a region-based processing approach can be used in the distortion correction and filtering process. That is, the distortion correction parameters can be vertically divided into regions, and the video data regions are determined based on these regions. Once both the distortion parameters and video data are prepared, distortion correction and filtering operations are performed, processing one region at a time before moving on to the next. The filtered image is then written to memory using WDMA-3 according to a specific video timing sequence. An example diagram illustrating the region-based processing in the distortion correction and filtering process can be found in [reference needed]. Figure 12 As shown; furthermore, the specific timing parameters used in the region-based processing during distortion correction and filtering can be as follows:

[0121] HAC:2240, VAC:4368, HFP:50, VFP:240, HSW:10, VSW:80, HBP:20, VBP:80, HTT:2320, VTT:4768.

[0122] In one example embodiment of this disclosure, after obtaining the video frame image to be displayed, it is also necessary to display the video frame image. The specific display process can be implemented as follows: Based on the overall video display timing of the standard video frame image during the display process, the storage timing of the video frame image to be displayed is determined, and based on the storage timing, the video frame image to be displayed is written into direct access memory (DRAM), so that the video frame to be displayed is pushed to the panoramic head-up display terminal through the DRAM based on the storage timing. That is, in practical applications, video images can be read simultaneously from memory using RDMA-3 / 1 and RDMA-3 / 2 according to specific timing signals, and then the video data can be sent to the vehicle display screen through two EDP_TX interfaces. The specific timing parameters of the video frame image to be displayed during the display process are as follows:

[0123] HAC:4480, VAC:1092, HFP:100, VFP:60, HSW:20, VSW:20, HBP:40, VBP:20, HTT:4640, VTT:1192.

[0124] Thus, the image distortion correction method described in the exemplary embodiments of this disclosure has been fully implemented. Based on the foregoing description, it can be understood that the image distortion correction method described in the exemplary embodiments of this disclosure can address application scenarios involving large distortions caused by full-screen HUD displays. Furthermore, in practical applications, FPGA can handle real-time non-standard resolution and large-angle distortions. Moreover, by performing time-division and region-division distortion correction on the entire image, memory bandwidth is reused, reducing the huge cache problem caused by large distortion correction, thereby reducing the cache resource requirements of the processor.

[0125] The following are embodiments of the apparatus disclosed herein, which can be used to execute embodiments of the method disclosed herein. For details not disclosed in the apparatus embodiments of this disclosure, please refer to the embodiments of the method disclosed herein.

[0126] This disclosure also provides an image distortion correction apparatus in exemplary embodiments. Specifically, refer to... Figure 13 As shown, the image distortion correction device may include an image mode conversion module 1310, a region determination module 1320, and an image distortion correction module 1330. Wherein:

[0127] The image mode conversion module 1310 can be used to acquire the original video frame image, and perform image mode conversion and image segmentation processing on the original video frame image to obtain the standard video frame image.

[0128] The image region to be corrected module 1320 can be used to obtain distortion correction parameters and determine the image region to be corrected from the standard video frame image based on the position parameters in the distortion correction parameters.

[0129] The image distortion correction module 1330 can be used to perform distortion correction on the original pixels in the image region to be corrected based on the weight parameters in the distortion correction parameters, to obtain the corrected pixels, and to obtain the video frame image to be displayed based on the corrected pixels.

[0130] In one exemplary embodiment of this disclosure, performing image mode conversion and image segmentation processing on the original video frame image to obtain a standard video frame image includes: converting the original video frame image from a first image display mode to a second image display mode to obtain an image conversion result; and performing image segmentation processing on the image conversion result to obtain the standard video frame image.

[0131] In one exemplary embodiment of this disclosure, the first image display mode includes a 7680*4320 display mode, and the second image display mode includes an 8960*1092 display mode; the second image display mode is consistent with the display mode of the panoramic head-up display terminal.

[0132] In one exemplary embodiment of this disclosure, converting the original video frame image from a first image display mode to a second image display mode to obtain an image conversion result includes: determining a horizontal pixel stretching coefficient and a vertical pixel compression coefficient based on the first image display mode and the second image display mode; extracting a first original horizontal pixel and a first original vertical pixel from the original video frame image, and performing pixel stretching processing on the first horizontal pixel according to the horizontal pixel stretching coefficient to obtain a first stretched horizontal pixel; performing pixel compression processing on the first original vertical pixel according to the vertical pixel compression coefficient to obtain a first compressed vertical pixel, and obtaining the image conversion result based on the first stretched horizontal pixel and the first compressed vertical pixel.

[0133] In one exemplary embodiment of this disclosure, image segmentation processing is performed on the image conversion result to obtain the standard video frame image, including: extracting a second horizontal image pixel and a second vertical image pixel from the image conversion result, and segmenting the second horizontal image pixel based on a preset image segmentation rule to obtain a first horizontal pixel segmentation result and a second horizontal pixel segmentation result; obtaining a first image segmentation result based on the first horizontal pixel segmentation result and the second vertical image pixel, and obtaining a second image segmentation result based on the second horizontal pixel segmentation result and the second vertical image pixel; and merging the first image segmentation result and the second image segmentation result to obtain the standard video frame image.

[0134] In one exemplary embodiment of this disclosure, obtaining distortion correction parameters and determining the image region to be corrected from the standard video frame image based on the position parameters in the distortion correction parameters includes: determining overall video timing parameters of the standard video frame image based on the overall video display timing of the standard video frame image during the display process; determining sub-video timing parameters from the overall video timing parameters, and determining a sub-distortion correction region corresponding to the sub-video timing parameters based on the sub-video timing parameters; obtaining distortion correction parameters in the sub-distortion correction region and extracting the position parameters from the distortion correction parameters; and determining the image region to be corrected corresponding to the sub-distortion correction region from the standard video frame image based on the position parameters.

[0135] In one exemplary embodiment of this disclosure, the overall video timing parameters include multiple parameters selected from line valid, field valid, line front shoulder, field front shoulder, line sync pulse, field sync pulse, line back shoulder, field back shoulder, total line length, and total field length; the overall video display timing includes a first sub-video display timing, a second sub-video display timing, a third sub-video display timing, and a fourth sub-video display timing; the sub-video timing parameters include a first sub-video timing parameter corresponding to the first sub-video display timing, a second sub-video timing parameter corresponding to the second sub-video display timing, a third sub-video timing parameter corresponding to the third sub-video display timing, and a fourth sub-video timing parameter corresponding to the fourth sub-video display timing.

[0136] In one exemplary embodiment of this disclosure, determining the image region to be corrected corresponding to the sub-distortion correction region from the standard video frame image based on the position parameters includes: extracting the maximum and minimum horizontal coordinate values ​​from the position parameters, and determining the starting and ending horizontal pixel coordinates from the standard video frame image based on the maximum and minimum horizontal coordinate values; determining the starting and ending vertical pixel coordinates from the standard video frame image based on the vertical coordinate values ​​in the position parameters; and determining the image region to be corrected corresponding to the sub-distortion correction region based on the starting horizontal and vertical pixel coordinates, the ending horizontal and vertical pixel coordinates.

[0137] In an exemplary embodiment of this disclosure, distortion correction is performed on the original pixels in the image region to be corrected based on the weight parameters in the distortion correction parameters to obtain corrected pixels. This includes: extracting a first original pixel point corresponding to the first parameter coordinate in the sub-distortion correction region based on the first parameter coordinate of the first correction parameter in the distortion correction parameters; determining a second, third, and fourth correction parameter adjacent to the first correction parameter, and determining a second, third, and fourth original pixel point adjacent to the first original pixel point; performing distortion correction on the first, second, third, and fourth original pixel points based on the first, second, third, and fourth correction parameters respectively to obtain corrected first, second, third, and fourth pixel points; and repeating the above correction steps by traversing all correction parameters in the distortion correction parameters and all original pixel points in the original pixels to obtain corrected pixels.

[0138] In one exemplary embodiment of this disclosure, distortion correction is performed on a first original pixel based on a first correction parameter to obtain a corrected first pixel. This includes: performing a product operation on the original pixel values ​​in the first original pixel using the first correction parameter to obtain the corrected first pixel; wherein the original pixel values ​​include R channel pixel values, G channel pixel values, and B channel pixel values.

[0139] In one exemplary embodiment of this disclosure, obtaining a video frame image to be displayed based on the corrected pixels includes: performing a mean filtering operation on the pixel values ​​of the corrected pixels to obtain filtered pixels, and generating a video frame image to be displayed based on the filtered pixels.

[0140] In one exemplary embodiment of this disclosure, the image distortion correction device further includes:

[0141] The video frame image push module can be used to determine the storage timing of the video frame image to be displayed based on the overall video display timing of the standard video frame image during the display process, and write the video frame image to be displayed into direct access memory based on the storage timing, so as to push the video frame to be displayed to the panoramic head-up display terminal through the direct access memory based on the storage timing.

[0142] The specific details of each module in the above-mentioned device have been described in detail in the corresponding virtual object motion control method, so they will not be repeated here.

[0143] It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to embodiments of this disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0144] Furthermore, although the steps of the method in this disclosure are described in a specific order in the accompanying drawings, this does not require or imply that the steps must be performed in that specific order, or that all the steps shown must be performed to achieve the desired result. Additional or alternative steps may be omitted, multiple steps may be combined into one step, and / or a step may be broken down into multiple steps.

[0145] In an exemplary embodiment of this disclosure, an electronic device capable of implementing the above-described method is also provided.

[0146] Those skilled in the art will understand that various aspects of this disclosure can be implemented as a system, method, or program product. Therefore, various aspects of this disclosure can be specifically implemented in the following forms: a completely hardware implementation, a completely software implementation (including firmware, microcode, etc.), or a combination of hardware and software aspects, collectively referred to herein as a "circuit," "module," or "system."

[0147] The following reference Figure 14 To describe an electronic device 1400 according to such an embodiment of the present disclosure. Figure 14 The electronic device 1400 shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments disclosed herein.

[0148] like Figure 14 As shown, the electronic device 1400 is manifested in the form of a general-purpose computing device. The components of the electronic device 1400 may include, but are not limited to: at least one processing unit 1410, at least one storage unit 1420, a bus 1430 connecting different system components (including storage unit 1420 and processing unit 1410), and a display unit 1440.

[0149] The storage unit stores program code that can be executed by the processing unit 1410, causing the processing unit 1410 to perform the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of this disclosure. For example, the processing unit 1410 can perform actions such as... Figure 1Step S110: Acquire the original video frame image, and perform image mode conversion and image segmentation processing on the original video frame image to obtain a standard video frame image; Step S120: Acquire distortion correction parameters, and determine the image region to be corrected from the standard video frame image according to the position parameters in the distortion correction parameters; Step S130: Perform distortion correction on the original pixels in the image region to be corrected based on the weight parameters in the distortion correction parameters to obtain corrected pixels, and obtain the video frame image to be displayed based on the corrected pixels.

[0150] Storage unit 1420 may include readable media in the form of volatile storage units, such as random access memory (RAM) 14201 and / or cache memory 14202, and may further include read-only memory (ROM) 14203.

[0151] Storage unit 1420 may also include a program / utility 14204 having a set (at least one) of program modules 14205, such program modules 14205 including but not limited to: operating system, one or more application programs, other program modules and program data, each or some combination of these examples may include an implementation of a network environment.

[0152] Bus 1430 can represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of the various bus structures.

[0153] Electronic device 1400 can also communicate with one or more external devices 1500 (e.g., keyboard, pointing device, Bluetooth device, etc.), and with one or more devices that enable a user to interact with electronic device 1400, and / or with any device that enables electronic device 1400 to communicate with one or more other computing devices (e.g., router, modem, etc.). This communication can be performed via input / output (I / O) interface 1450. Furthermore, electronic device 1400 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 1460. As shown, network adapter 1460 communicates with other modules of electronic device 1400 via bus 1430. It should be understood that, although not shown in the figures, other hardware and / or software modules can be used in conjunction with electronic device 1400, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0154] From the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, terminal device, or network device, etc.) to execute the methods according to the embodiments of this disclosure.

[0155] In exemplary embodiments of this disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the methods described above is stored. In some possible implementations, various aspects of this disclosure may also be implemented as a program product including program code that, when the program product is run on a terminal device, causes the terminal device to perform the steps of the various exemplary embodiments of this disclosure described in the "Exemplary Methods" section above.

[0156] The program product for implementing the above-described method according to embodiments of the present disclosure may employ a portable compact disc read-only memory (CD-ROM) and include program code, and may run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto. In this document, the readable storage medium may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, apparatus, or device.

[0157] The program product may employ any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0158] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium, capable of sending, propagating, or transmitting programs for use by or in conjunction with an instruction execution system, apparatus, or device.

[0159] The program code contained on the readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.

[0160] Program code for performing the operations of this disclosure can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java and C++, and conventional procedural programming languages ​​such as C or similar languages. The program code can execute entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0161] Furthermore, the above figures are merely illustrative of the processes included in the method according to exemplary embodiments of this disclosure and are not intended to be limiting. It is readily understood that the processes shown in the above figures do not indicate or limit the temporal order of these processes. Additionally, it is readily understood that these processes may be executed synchronously or asynchronously, for example, in multiple modules.

[0162] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention described herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not invented by this disclosure. The specification and embodiments are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the claims.

Claims

1. A method for image distortion correction, characterized in that, include: The original video frame images are acquired, and image mode conversion and image segmentation are performed on the original video frame images to obtain standard video frame images; Obtain distortion correction parameters, and determine the image region to be corrected from the standard video frame image based on the position parameters in the distortion correction parameters; The original pixels in the image region to be corrected are corrected based on the weight parameters in the distortion correction parameters to obtain the corrected pixels, and the video frame image to be displayed is obtained based on the corrected pixels.

2. The image distortion correction method according to claim 1, characterized in that, The original video frame images are subjected to image mode conversion and image segmentation processing to obtain standard video frame images, including: The original video frame image is converted from a first image display mode to a second image display mode to obtain the image conversion result; The image conversion result is subjected to image segmentation processing to obtain the standard video frame image.

3. The image distortion correction method according to claim 2, characterized in that, The first image display mode is a standard display mode, and the second image display mode includes non-standard display modes; The second image display mode is consistent with the display mode of the panoramic head-up display terminal.

4. The image distortion correction method according to claim 3, characterized in that, The original video frame image is converted from a first image display mode to a second image display mode to obtain the image conversion result, including: Based on the first image display mode and the second image display mode, determine the horizontal pixel stretching coefficient and the vertical pixel compression coefficient; Extract the first original horizontal pixel and the first original vertical pixel from the original video frame image, and perform pixel stretching processing on the first horizontal pixel according to the horizontal pixel stretching coefficient to obtain the first stretched horizontal pixel; The first original vertical pixel is subjected to pixel compression processing according to the vertical pixel compression coefficient to obtain the first compressed vertical pixel, and the image conversion result is obtained according to the first stretched horizontal pixel and the first compressed vertical pixel.

5. The image distortion correction method according to claim 2, characterized in that, The image conversion result is subjected to image segmentation processing to obtain the standard video frame image, including: Extract the second horizontal image pixels and the second vertical image pixels from the image conversion result, and segment the second horizontal image pixels based on the preset image segmentation rules to obtain the first horizontal pixel segmentation result and the second horizontal pixel segmentation result; A first image segmentation result is obtained based on the first horizontal pixel segmentation result and the second vertical image pixels, and a second image segmentation result is obtained based on the second horizontal pixel segmentation result and the second vertical image pixels; The first image segmentation result and the second image segmentation result are combined to obtain the standard video frame image.

6. The image distortion correction method according to claim 1, characterized in that, Obtain distortion correction parameters, and determine the image region to be corrected from the standard video frame image based on the position parameters in the distortion correction parameters, including: The overall video timing parameters of the standard video frame image are determined based on the overall video display timing of the standard video frame image during the display process. Sub-video timing parameters are determined from the overall video timing parameters, and sub-distortion correction regions corresponding to the sub-video timing parameters are determined based on the sub-video timing parameters. Obtain the distortion correction parameters in the sub-distortion correction region, and extract the position parameters from the distortion correction parameters; Based on the location parameters, the image region to be corrected corresponding to the sub-distortion correction region is determined from the standard video frame image.

7. The image distortion correction method according to claim 6, characterized in that, The overall video timing parameters include multiple parameters such as line valid, field valid, line front shoulder, field front shoulder, line sync pulse, field sync pulse, line back shoulder, field back shoulder, total line length, and total field length. The overall video display timing sequence includes a first sub-video display timing sequence, a second sub-video display timing sequence, a third sub-video display timing sequence, and a fourth sub-video display timing sequence; The sub-video timing parameters include the first sub-video timing parameters corresponding to the first sub-video display timing, the second sub-video timing parameters corresponding to the second sub-video display timing, the third sub-video timing parameters corresponding to the third sub-video display timing, and the fourth sub-video timing parameters corresponding to the fourth sub-video display timing.

8. The image distortion correction method according to claim 6, characterized in that, Determining the image region to be corrected from the standard video frame image based on the position parameters, corresponding to the sub-distortion correction region, including: Extract the maximum and minimum horizontal coordinate values ​​from the position parameters, and determine the starting and ending horizontal pixel coordinates from the standard video frame image based on the maximum and minimum horizontal coordinate values. Based on the vertical coordinate values ​​in the position parameters, determine the starting vertical pixel coordinates and the ending vertical pixel coordinates from the standard video frame image; Based on the starting horizontal pixel coordinates, the starting vertical pixel coordinates, the ending horizontal pixel coordinates, and the ending vertical pixel coordinates, the image region to be corrected corresponding to the sub-distortion correction region is determined.

9. The image distortion correction method according to claim 1, characterized in that, Based on the weight parameters in the distortion correction parameters, distortion correction is performed on the original pixels in the image region to be corrected, resulting in corrected pixels, including: Based on the first parameter coordinate of the first correction parameter in the distortion correction parameters in the sub-distortion correction region, extract the first original pixel point corresponding to the first parameter coordinate from the image region to be corrected. Determine the second, third, and fourth correction parameters adjacent to the first correction parameter, and determine the second, third, and fourth original pixels adjacent to the first original pixel. Based on the first correction parameter, the second correction parameter, the third correction parameter, and the fourth correction parameter, respectively, distortion correction is performed on the first original pixel, the second original pixel, the third original pixel, and the fourth original pixel to obtain the corrected first pixel, the second pixel, the third pixel, and the fourth pixel. By iterating through all the distortion correction parameters and all the original pixels in the original pixels, the above correction steps are repeated to obtain the corrected pixels.

10. The image distortion correction method according to claim 9, characterized in that, Based on the first correction parameter, distortion correction is performed on the first original pixel to obtain the corrected first pixel, including: The first correction parameter is used to perform a product operation on the original pixel values ​​in the first original pixel to obtain the corrected first pixel; wherein the original pixel values ​​include R channel pixel values, G channel pixel values ​​and B channel pixel values.

11. The image distortion correction method according to claim 1, characterized in that, The video frame image to be displayed is obtained based on the corrected pixels, including: The pixel values ​​of the corrected pixels are subjected to mean filtering to obtain the filtered pixels, and the video frame image to be displayed is generated based on the filtered pixels.

12. The image distortion correction method according to claim 1, characterized in that, The image distortion correction method also includes: Based on the overall video display timing of the standard video frame image during the display process, the storage timing of the video frame image to be displayed is determined, and the video frame image to be displayed is written into direct access memory based on the storage timing, so as to push the video frame to be displayed to the panoramic head-up display terminal through the direct access memory based on the storage timing.

13. An image distortion correction device, characterized in that, include: The image mode conversion module is used to acquire the original video frame image and perform image mode conversion and image segmentation processing on the original video frame image to obtain the standard video frame image. The image region to be corrected module is used to obtain distortion correction parameters and determine the image region to be corrected from the standard video frame image based on the position parameters in the distortion correction parameters. The image distortion correction module is used to perform distortion correction on the original pixels in the image region to be corrected based on the weight parameters in the distortion correction parameters, to obtain the corrected pixels, and to obtain the video frame image to be displayed based on the corrected pixels.

14. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the image distortion correction method according to any one of claims 1-12.

15. An electronic device, characterized in that, include: processor; as well as Memory for storing the executable instructions of the processor; The processor is configured to execute the image distortion correction method according to any one of claims 1-12 by executing the executable instructions.

Images