FPGA-Based Image Correction Method, Device, Equipment and Medium

Abstract

The present invention relates to the field of image processing technology, and provides an FPGA-based image correction method, device, equipment, and medium. The method can utilize modules of the FPGA to identify the color and grayscale attributes of a video in units of pixels, thereby solving the problem of inaccurate region recognition or limited region size, satisfying image display applications in any scenario, separating color pixels into brightness and color difference, and making the transition between color and grayscale uniform according to a mapping relationship. The method uses color difference to perform brightness compensation on a GAMMA curve, so that the grayscale brightness of the GAMMA curve of the color portion remains basically consistent with that of a DICOM curve, reducing the brightness gradient between different image grayscales, solving the problems of noise, color blocks, and color spots in the transition region during image display, retaining the GAMMA curve characteristics of the color portion, and correcting the monochrome grayscale pixels using the DICOM curve, thereby realizing adaptive correction of color and grayscale video images based on the FPGA.

Description

Technical Field

[0001] The present invention relates to the field of image processing technology, and in particular to an image correction method, device, equipment and medium based on FPGA. Background Art

[0002] With the continuous advancement of digital imaging and display technologies, existing display products have evolved into products that integrate high resolution, wide color gamut, and high frame rates. Displays are also moving towards intelligence and multifunctionality. However, in areas such as medical displays, medical images include both diagnostic grayscale images and surgical color images. To meet their display characteristics, grayscale and color images often require different correction methods. For example, grayscale images must conform to the DICOM (Digital Imaging and Communications in Medicine) correction curve, while color images must conform to the Gamma correction curve.

[0003] In view of the above situation, in order to meet the correction requirements of different display images, hospitals may need to equip both a grayscale display and a color display, which not only increases the complexity of equipment and cable connections, but also affects the aesthetics. In addition, since the LCD (Liquid Crystal Display) display panels currently used in the market have high resolution and large display size, more and more medical display manufacturers are working on displaying color and grayscale images on a single high-resolution display. Display scaler chips can generally perform different correction methods for different input signals, such as Figure 1 As shown, DICOM curve correction is performed for grayscale image inputs such as CT (Computed Tomography) and MRI (Magnetic Resonance Imaging), and GAMMA2.2 curve correction is performed for endoscopic surgical system imaging input. However, the above method can only meet display requirements by manually selecting different inputs to use different correction curves.

[0004] Some medical display manufacturers are researching intelligent color grayscale adaptive correction methods. For example, they first determine the color grayscale properties of the image. If the judgment result is a grayscale pixel, they use the DICOM curve correction. If the judgment result is a color pixel, they use the GAMMA2.2 curve correction. This method is relatively easy to implement and can be used in scenarios where grayscale and color images are in separate areas. However, for images with random distribution of grayscale and color pixels, there will be display anomalies. Since the brightness gradient of the DICOM curve and the GAMMA2.2 curve at the same grayscale is too large, it will cause noise, color blocks, or color spots to appear in adjacent pixels of the color grayscale. Figure 2 As shown, a small square represents a pixel, grayscale points are represented by Y, and color points are represented by C. When the RGB components of the grayscale point are close to the RGB components of the color point (the components are close but belong to color pixels and grayscale pixels respectively), noise problems will occur due to the use of different correction curves.

[0005] In addition, it is also possible to automatically identify the grayscale areas and color areas in the image first, and then apply DICOM curve correction and GAMMA2.2 curve correction to different areas respectively. Since this method cannot predict the data of the displayed image itself, there are problems such as inaccurate area judgment or limited area size. The application scenario is also relatively simple and can only be applied to regular grayscale areas and color areas. Moreover, since the brightness gradient of the DICOM curve and the GAMMA2.2 curve is too large, display anomalies will appear at the area transition. When a single image is displayed full screen, there will also be problems such as color blocks and plaques. Figure 3 As shown, for different grayscale and color areas, displaying the same image in full screen will produce noise or patch problems where the grayscale area is adjacent to the color area. Summary of the Invention

[0006] In view of the above, it is necessary to provide an FPGA-based image correction method, device, equipment and medium that can simultaneously display grayscale and color images on a single display while retaining the display characteristics of each image.

[0007] An FPGA-based image correction method, the FPGA-based image correction method comprising:

[0008] Applied to an FPGA-based image correction system, the FPGA-based image correction system includes a color grayscale pixel recognition module, a brightness and color difference separation module, a GAMMA mapping processing module, a GAMMA color difference compensation module, a DICOM mapping processing module, a timing alignment module and a DICOM curve correction module. The FPGA-based image correction method includes:

[0009] When receiving a video to be processed, the color and grayscale pixel recognition module identifies the pixel type of the video to be processed;

[0010] When the pixel type is a grayscale pixel, after the timing alignment module performs delay processing, the DICOM curve correction module corrects the video to be processed to obtain a video to be output and outputs the video to be output;

[0011] When the pixel type is a color pixel, the brightness and color difference separation module separates the video to be processed to obtain the initial brightness and initial color difference of the video to be processed; the GAMMA mapping processing module performs mapping processing based on a pre-configured mapping relationship and the initial brightness to obtain the first RGB of the video to be processed under the GAMMA curve; the GAMMA color difference compensation module compensates the first RGB based on the initial color difference to obtain the second RGB; the DICOM mapping processing module performs mapping processing based on the mapping relationship and the second RGB to obtain the third RGB of the video to be processed under the DICOM curve; the DICOM curve correction module performs correction based on the third RGB to obtain the video to be output and output the video to be output.

[0012] According to a preferred embodiment of the present invention, the color grayscale pixel recognition module recognizes the pixel type of the video to be processed, including:

[0013] Obtain the R value, G value, and B value of each pixel in the video to be processed;

[0014] Get the pre-configured component difference threshold;

[0015] Calculate the component difference between the R value and the G value, the component difference between the G value and the B value, and the component difference between the R value and the B value of each pixel to obtain the component difference corresponding to each pixel;

[0016] When the component difference of each pixel in the to-be-processed video is less than or equal to the component difference threshold, determining that the to-be-processed video is the grayscale pixel; or

[0017] When the component difference of each pixel in the to-be-processed video is not less than or equal to the component difference threshold, it is determined that the to-be-processed video is the color pixel.

[0018] According to a preferred embodiment of the present invention, the color grayscale pixel recognition module recognizes the pixel type of the video to be processed, including:

[0019] Convert the video to be processed from RGB color space to YCbCr color space;

[0020] When each pixel in the video to be processed satisfies Cb=Cr=0, determining that the video to be processed is the grayscale pixel; or

[0021] When each pixel in the to-be-processed video does not satisfy Cb=Cr=0, it is determined that the to-be-processed video is the color pixel.

[0022] According to a preferred embodiment of the present invention, the mapping relationship is:

[0023] Wherein, D(x) represents the correction function corresponding to the DICOM curve; G(x) represents the correction function corresponding to the GAMMA curve; represents the mapping factor, The value range is [0.9, 1.1], n and m are positive integers; b represents the mapping brightness offset;

[0024] The GAMMA mapping processing module performs mapping processing based on a pre-configured mapping relationship and the initial brightness to obtain a first RGB of the video to be processed under the GAMMA curve, including:

[0025] Determine the RGB value corresponding to the initial brightness under the DICOM curve;

[0026] The RGB value corresponding to the initial brightness under the DICOM curve is input into the mapping relationship for mapping processing to obtain the first RGB of the video to be processed under the GAMMA curve.

[0027] According to a preferred embodiment of the present invention, the GAMMA color difference compensation module compensates the first RGB based on the initial color difference to obtain the second RGB, including:

[0028] The first RGB is compensated based on the initial color difference using the following formula:

[0029]

[0030] in, represents the RGB matrix corresponding to the second RGB, Represents the RGB matrix corresponding to the initial color difference; represents the RGB matrix corresponding to the first RGB, represents the color difference compensation coefficient matrix, k1, k2, and k3 represent the color difference compensation coefficients respectively, and the value range of k1, k2, and k3 is [0, 2].

[0031] According to a preferred embodiment of the present invention, the DICOM curve correction module performs correction based on the third RGB to obtain the video to be output, including:

[0032] Get the LUT display lookup table;

[0033] The third RGB is corrected based on the LUT display lookup table to obtain the video to be output.

[0034] According to a preferred embodiment of the present invention, outputting the video to be output includes:

[0035] The video to be output is sent to a display device connected to the FPGA-based image correction system.

[0036] An FPGA-based image correction device operates on an FPGA-based image correction system. The FPGA-based image correction system includes a color grayscale pixel recognition module, a brightness and color difference separation module, a gamma mapping processing module, a gamma color difference compensation module, a DICOM mapping processing module, a timing alignment module, and a DICOM curve correction module. The FPGA-based image correction device includes:

[0037] The color and grayscale pixel recognition module is used to identify the pixel type of the video to be processed when receiving the video to be processed;

[0038] The DICOM curve correction module is configured to, when the pixel type is a grayscale pixel, correct the video to be processed after the timing alignment module performs delay processing to obtain a video to be output and output the video to be output;

[0039] The brightness and color difference separation module is used to separate the video to be processed when the pixel type is a color pixel, so as to obtain the initial brightness and initial color difference of the video to be processed;

[0040] The GAMMA mapping processing module is used to perform mapping processing based on a pre-configured mapping relationship and the initial brightness to obtain a first RGB of the video to be processed under a GAMMA curve;

[0041] The GAMMA color difference compensation module is used to compensate the first RGB based on the initial color difference to obtain a second RGB;

[0042] The DICOM mapping processing module is used to perform mapping processing based on the mapping relationship and the second RGB to obtain a third RGB of the video to be processed under the DICOM curve;

[0043] The DICOM curve correction module is further configured to perform correction based on the third RGB to obtain the video to be output and output the video to be output.

[0044] A computer device, comprising:

[0045] a memory storing at least one instruction; and

[0046] A processor executes instructions stored in the memory to implement the FPGA-based image correction method.

[0047] A computer-readable storage medium stores at least one instruction, and the at least one instruction is executed by a processor in a computer device to implement the FPGA-based image correction method.

[0048] It can be seen from the above technical solutions that the present invention can utilize the functional modules of FPGA to identify the color and grayscale attributes of the video in units of pixels, thereby solving the problem of inaccurate regional identification or limited regional size during regional identification, and can meet the display application of images in any scene. The color pixels are further separated into brightness and color difference parts, and according to the established mapping relationship between the DICOM curve and the GAMMA curve, the transition between the color and grayscale parts is made uniform, and the color difference is further used to perform brightness compensation on the GAMMA curve, so that the grayscale brightness of the GAMMA curve of the color part remains basically consistent with the DICOM curve, reducing the brightness gradient between different image grayscales, thereby solving the problems of noise, color blocks, color spots, etc. in the transition area when the image is displayed. At the same time, the color part retains the characteristics of the GAMMA curve, and the monochrome grayscale pixels are corrected using the DICOM curve, thereby realizing adaptive correction of the color grayscale video image based on FPGA. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 It is a schematic diagram of different corrections of different inputs by the Scaler chip of the present invention.

[0050] Figure 2 It is a schematic diagram of the present invention for identifying color pixels and grayscale pixels.

[0051] Figure 3 It is a schematic diagram of color grayscale correction based on region recognition of the present invention.

[0052] Figure 4 This is a schematic diagram of an application environment of the FPGA-based image correction method of the present invention.

[0053] Figure 5 It is a flow chart of a preferred embodiment of the image correction method based on FPGA of the present invention.

[0054] Figure 6 This is a functional module diagram of a preferred embodiment of the FPGA-based image correction device of the present invention.

[0055] Figure 7It is a structural diagram of a computer device according to a preferred embodiment of the present invention for implementing an image correction method based on FPGA. DETAILED DESCRIPTION

[0056] In order to make the objectives, technical solutions and advantages of the present invention more clear, the present invention is described in detail below with reference to the accompanying drawings and specific embodiments.

[0057] like Figure 4 FIG2 is a schematic diagram of an application environment for the FPGA-based image correction method of the present invention. When a video to be processed is input into the FPGA-based image correction system, it is sequentially processed by the color grayscale pixel recognition module, brightness and color difference separation module, gamma mapping module, gamma color difference compensation module, DICOM (Digital Imaging and Communications in Medicine) mapping module, timing alignment module, and DICOM curve correction module within the FPGA-based image correction system. The correction results are ultimately output to a display device for display.

[0058] like Figure 5 FIG. 1 is a flow chart of a preferred embodiment of the image correction method based on FPGA of the present invention. According to different requirements, the order of the steps in the flow chart can be changed, and some steps can be omitted.

[0059] The FPGA-based image correction method is applied to one or more computer devices, which are devices that can automatically perform numerical calculations and / or information processing according to pre-set or stored instructions. Their hardware includes but is not limited to microprocessors, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), digital signal processors (DSPs), embedded devices, etc.

[0060] The computer device may be any electronic product that can interact with a user, such as a personal computer, a tablet computer, a smart phone, a personal digital assistant (PDA), a game console, an interactive network television (IPTV), a smart wearable device, etc.

[0061] The computer device may also include a network device and / or a user device, wherein the network device includes, but is not limited to, a single network server, a server group consisting of multiple network servers, or a cloud based on cloud computing consisting of a large number of hosts or network servers.

[0062] The server can be an independent server or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms.

[0063] Among them, Artificial Intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results.

[0064] Fundamental AI technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing, operating / interaction systems, and mechatronics. AI software technologies primarily encompass computer vision, robotics, biometrics, speech processing, natural language processing, and machine learning / deep learning.

[0065] The network where the computer device is located includes but is not limited to the Internet, wide area network, metropolitan area network, local area network, virtual private network (VPN), etc.

[0066] This embodiment is applied to an image correction system based on an FPGA (Field Programmable Gate Array). The FPGA-based image correction system includes a color grayscale pixel recognition module, a brightness and color difference separation module, a gamma mapping processing module, a gamma color difference compensation module, a DICOM (Digital Imaging and Communications in Medicine) mapping processing module, a timing alignment module, and a DICOM curve correction module. The FPGA-based image correction method includes:

[0067] S10: When a video to be processed is received, the color and grayscale pixel recognition module recognizes the pixel type of the video to be processed.

[0068] The video to be processed may be a grayscale image such as CT (Computed Tomography) or MRI (Magnetic Resonance Imaging), or may be a color image of an endoscopic surgical system.

[0069] The video to be processed can also be processed first by a scaler image processing module. The scaler image processing module primarily implements multi-channel video input, multi-window layout processing, menu control, and other functions. For example, a video processed by the scaler image processing module can be input into the FPGA-based image correction system, where it performs adaptive color grayscale correction and split-screen gamma correction. Finally, the correction results are output to a display device to complete the display of the video image.

[0070] Among them, FPGA is a hardware programmable logic device. The image processing it implements is a pure hardware processing method. Its programmability provides powerful scalability. Using the FPGA architecture, it can provide more differentiated image processing functions.

[0071] In this embodiment, the color grayscale pixel recognition module recognizes the pixel type of the video to be processed including:

[0072] Obtain the R (Red) value, G (Green) value, and B (Blue) value of each pixel in the video to be processed;

[0073] Get the pre-configured component difference threshold;

[0074] Calculate the component difference between the R value and the G value, the component difference between the G value and the B value, and the component difference between the R value and the B value of each pixel to obtain the component difference corresponding to each pixel;

[0075] When the component difference of each pixel in the to-be-processed video is less than or equal to the component difference threshold, determining that the to-be-processed video is the grayscale pixel; or

[0076] When the component difference of each pixel in the to-be-processed video is not less than or equal to the component difference threshold, it is determined that the to-be-processed video is the color pixel.

[0077] In this embodiment, the color grayscale pixel recognition module recognizes the pixel type of the video to be processed including:

[0078] Convert the video to be processed from RGB color space to YCbCr color space;

[0079] When each pixel in the video to be processed satisfies Cb=Cr=0, determining that the video to be processed is the grayscale pixel; or

[0080] When each pixel in the to-be-processed video does not satisfy Cb=Cr=0, it is determined that the to-be-processed video is the color pixel.

[0081] This embodiment uses a pix-by-pix color grayscale recognition method to complete color grayscale pixel recognition in units of pixels, solving the problem of inaccurate region recognition or limited region size during region recognition, and can meet the display application of any scene image.

[0082] S11, when the pixel type is a grayscale pixel, after the timing alignment module performs delay processing, the DICOM curve correction module corrects the video to be processed to obtain a video to be output and outputs the video to be output.

[0083] For example, if the pixel processed by the color-grayscale pixel recognition module is a grayscale pixel, the timing alignment module processes the pipeline delay, the delay amount is synchronized with the pipeline delay of the color pixel processing, and is output to the post-processing module.

[0084] S12, when the pixel type is a color pixel, the brightness and color difference separation module separates the video to be processed to obtain the initial brightness and initial color difference of the video to be processed; the GAMMA mapping processing module performs mapping processing based on a pre-configured mapping relationship and the initial brightness to obtain the first RGB of the video to be processed under the GAMMA curve; the GAMMA color difference compensation module compensates the first RGB based on the initial color difference to obtain the second RGB; the DICOM mapping processing module performs mapping processing based on the mapping relationship and the second RGB to obtain the third RGB of the video to be processed under the DICOM curve; the DICOM curve correction module performs correction based on the third RGB to obtain the video to be output and output the video to be output.

[0085] In this embodiment, if it is a color pixel, the brightness and color difference separation module separates the color pixel into brightness and color difference parts, where brightness is represented by L and color difference is represented by Rca, Gca, and Bca respectively, and outputs them to the post-processing module.

[0086] In this embodiment, the mapping relationship is:

[0087] Wherein, D(x) represents the correction function corresponding to the DICOM curve; G(x) represents the correction function corresponding to the GAMMA curve; represents the mapping factor, The value range is [0.9, 1.1], n and m are positive integers; b represents the mapping brightness offset.

[0088] in, A value that is too large or too small will cause noise and color block problems to appear to varying degrees.

[0089] Here, b is used as the mapping brightness offset. When the offset is increased, the brightness mapping relationship between the two curves can be corrected. The range of b can be positive or negative.

[0090] When using different DICOM curves and GAMMA curves, the above parameters can be used to fine-tune the effect.

[0091] The GAMMA curve may include, but is not limited to: GAMMA1.8, GAMMA2.0, GAMMA2.2, GAMMA2.4, GAMMA2.6, etc.;

[0092] The DICOM curves may include, but are not limited to: DICOM300, DICOM400, DICOM500, DICOM600, DICOM700, etc.

[0093] By establishing a mapping relationship between the DICOM curve and the GAMMA curve, the brightness gradient between color pixels and grayscale pixels is reduced, making the color-grayscale transition smoother and eliminating problems such as noise and color blocks.

[0094] In this embodiment, the GAMMA mapping processing module performs mapping processing based on a preconfigured mapping relationship and the initial brightness to obtain the first RGB of the video to be processed under the GAMMA curve, including:

[0095] Determine the RGB value corresponding to the initial brightness under the DICOM curve;

[0096] The RGB value corresponding to the initial brightness under the DICOM curve is input into the mapping relationship for mapping processing to obtain the first RGB of the video to be processed under the GAMMA curve.

[0097] In this embodiment, the GAMMA color difference compensation module compensates the first RGB based on the initial color difference to obtain the second RGB, including:

[0098] The first RGB is compensated based on the initial color difference using the following formula:

[0099]

[0100] in, represents the RGB matrix corresponding to the second RGB, Represents the RGB matrix corresponding to the initial color difference; represents the RGB matrix corresponding to the first RGB, represents the color difference compensation coefficient matrix, k1, k2, and k3 represent the color difference compensation coefficients respectively, and the value range of k1, k2, and k3 is [0, 2].

[0101] Among them, k1, k2, and k3 serve as the color difference compensation coefficients, and can take different values for different RGB color difference signals. k1, k2, and k3 are used to adjust the chromaticity effect of color pixels to meet the requirements of different users for chromaticity characteristics.

[0102] The chromaticity characteristics of the color pixel GAMMA can be retained through color difference compensation.

[0103] In this embodiment, the manner in which the DICOM mapping processing module performs mapping processing based on the mapping relationship and the second RGB is equivalent to the inverse process of the mapping processing performed by the GAMMA mapping processing module based on the pre-configured mapping relationship and the initial brightness, which is not described here.

[0104] In this embodiment, the DICOM curve correction module performs correction based on the third RGB to obtain the video to be output, including:

[0105] Get LUT (Look-Up-Table) to display the lookup table;

[0106] The third RGB is corrected based on the LUT display lookup table to obtain the video to be output.

[0107] In this embodiment, outputting the video to be output includes:

[0108] The video to be output is sent to a display device connected to the FPGA-based image correction system.

[0109] For example, the display device can be a medical display, a general display, or various display terminals within the color display field. When a display requires separate GAMMA and DICOM adaptive correction processing for color and grayscale pixels within the same displayed image, this cannot be accomplished within a single scaler chip. The hardware programmable nature of the FPGA is the only way to achieve these differentiated, unique functions. Therefore, the FPGA-based image correction method of this embodiment can be used to accurately display both grayscale and color images on a single display while preserving the display characteristics of each image.

[0110] Specifically, through FPGA-based color grayscale adaptive correction processing, an adaptive hybrid gamma display method is implemented using FPGA hardware, which can automatically identify color pixels and monochrome grayscale pixels in the displayed image. Monochrome pixels are corrected using the DICOM curve; color pixels undergo brightness and color difference separation, gamma mapping, gamma color difference compensation, DICOM mapping, and finally DICOM curve correction. This effectively solves the problem of excessive brightness gradients between the DICOM curve and the gamma curve at the same grayscale, ensuring uniform display of the transition portion of the color grayscale image while retaining the gamma curve characteristics of the color portion.

[0111] It can be seen from the above technical solutions that the present invention can utilize the functional modules of FPGA to identify the color and grayscale attributes of the video in units of pixels, thereby solving the problem of inaccurate regional identification or limited regional size during regional identification, and can meet the display application of images in any scene. The color pixels are further separated into brightness and color difference parts, and according to the established mapping relationship between the DICOM curve and the GAMMA curve, the transition between the color and grayscale parts is made uniform, and the color difference is further used to perform brightness compensation on the GAMMA curve, so that the grayscale brightness of the GAMMA curve of the color part remains basically consistent with the DICOM curve, reducing the brightness gradient between different image grayscales, thereby solving the problems of noise, color blocks, color spots, etc. in the transition area when the image is displayed. At the same time, the color part retains the characteristics of the GAMMA curve, and the monochrome grayscale pixels are corrected using the DICOM curve, thereby realizing adaptive correction of the color grayscale video image based on FPGA.

[0112] like Figure 6 FIG2 shows a functional block diagram of a preferred embodiment of an FPGA-based image correction device according to the present invention. The FPGA-based image correction device 11 includes a color grayscale pixel recognition module 110, a brightness and color difference separation module 111, a gamma mapping processing module 112, a gamma color difference compensation module 113, a DICOM mapping processing module 114, a timing alignment module 115, and a DICOM curve correction module 116. The modules / units referred to herein are a series of computer program segments that can be executed by a processor and perform fixed functions, and are stored in a memory. The functions of each module / unit in this embodiment will be described in detail in subsequent embodiments.

[0113] This embodiment is applied to an image correction system based on an FPGA (Field Programmable Gate Array). The FPGA-based image correction system includes the color grayscale pixel recognition module 110, the brightness and color difference separation module 111, the gamma mapping processing module 112, the gamma color difference compensation module 113, the DICOM (Digital Imaging and Communications in Medicine) mapping processing module 114, the timing alignment module 115, and the DICOM curve correction module 116, including:

[0114] The color and grayscale pixel identification module 110 is configured to identify the pixel type of a video to be processed when receiving the video to be processed.

[0115] The video to be processed may be a grayscale image such as CT (Computed Tomography) or MRI (Magnetic Resonance Imaging), or may be a color image of an endoscopic surgical system.

[0116] The video to be processed can also be processed first by a scaler image processing module. The scaler image processing module primarily implements multi-channel video input, multi-window layout processing, menu control, and other functions. For example, a video processed by the scaler image processing module can be input into the FPGA-based image correction system, where it performs adaptive color grayscale correction and split-screen gamma correction. Finally, the correction results are output to a display device to complete the display of the video image.

[0117] Among them, FPGA is a hardware programmable logic device. The image processing it implements is a pure hardware processing method. Its programmability provides powerful scalability. Using the FPGA architecture, it can provide more differentiated image processing functions.

[0118] In this embodiment, the color and grayscale pixel recognition module 110 recognizes the pixel type of the video to be processed including:

[0119] Obtain the R (Red) value, G (Green) value, and B (Blue) value of each pixel in the video to be processed;

[0120] Get the pre-configured component difference threshold;

[0121] Calculate the component difference between the R value and the G value, the component difference between the G value and the B value, and the component difference between the R value and the B value of each pixel to obtain the component difference corresponding to each pixel;

[0122] When the component difference of each pixel in the to-be-processed video is less than or equal to the component difference threshold, determining that the to-be-processed video is the grayscale pixel; or

[0123] When the component difference of each pixel in the to-be-processed video is not less than or equal to the component difference threshold, it is determined that the to-be-processed video is the color pixel.

[0124] In this embodiment, the color and grayscale pixel recognition module 110 recognizes the pixel type of the video to be processed including:

[0125] Convert the video to be processed from RGB color space to YCbCr color space;

[0126] When each pixel in the video to be processed satisfies Cb=Cr=0, determining that the video to be processed is the grayscale pixel; or

[0127] When each pixel in the to-be-processed video does not satisfy Cb=Cr=0, it is determined that the to-be-processed video is the color pixel.

[0128] This embodiment uses a pix-by-pix color grayscale recognition method to complete color grayscale pixel recognition in units of pixels, solving the problem of inaccurate region recognition or limited region size during region recognition, and can meet the display application of any scene image.

[0129] The DICOM curve correction module 116 is used to correct the video to be processed when the pixel type is a grayscale pixel, obtain a video to be output, and output the video to be output after the timing alignment module 115 performs delay processing.

[0130] For example, if the pixel processed by the color-grayscale pixel recognition module is a grayscale pixel, the timing alignment module processes the pipeline delay, the delay amount is synchronized with the pipeline delay of the color pixel processing, and is output to the post-processing module.

[0131] The brightness and color difference separation module 111 is used to separate the video to be processed when the pixel type is a color pixel, and obtain the initial brightness and initial color difference of the video to be processed.

[0132] The GAMMA mapping processing module 112 is configured to perform mapping processing based on a pre-configured mapping relationship and the initial brightness to obtain a first RGB of the video to be processed under a GAMMA curve.

[0133] In this embodiment, if it is a color pixel, the brightness and color difference separation module separates the color pixel into brightness and color difference parts, where brightness is represented by L and color difference is represented by Rca, Gca, and Bca respectively, and outputs them to the post-processing module.

[0134] In this embodiment, the mapping relationship is:

[0135] Wherein, D(x) represents the correction function corresponding to the DICOM curve; G(x) represents the correction function corresponding to the GAMMA curve; represents the mapping factor, The value range is [0.9, 1.1], n and m are positive integers; b represents the mapping brightness offset.

[0136] in, A value that is too large or too small will cause noise and color block problems to appear to varying degrees.

[0137] Here, b is used as the mapping brightness offset. When the offset is increased, the brightness mapping relationship between the two curves can be corrected. The range of b can be positive or negative.

[0138] When using different DICOM curves and GAMMA curves, the above parameters can be used to fine-tune the effect.

[0139] The GAMMA curve may include, but is not limited to: GAMMA1.8, GAMMA2.0, GAMMA2.2, GAMMA2.4, GAMMA2.6, etc.;

[0140] The DICOM curves may include, but are not limited to: DICOM300, DICOM400, DICOM500, DICOM600, DICOM700, etc.

[0141] By establishing a mapping relationship between the DICOM curve and the GAMMA curve, the brightness gradient between color pixels and grayscale pixels is reduced, making the color-grayscale transition smoother and eliminating problems such as noise and color blocks.

[0142] In this embodiment, the GAMMA mapping processing module performs mapping processing based on a preconfigured mapping relationship and the initial brightness to obtain the first RGB of the video to be processed under the GAMMA curve, including:

[0143] Determine the RGB value corresponding to the initial brightness under the DICOM curve;

[0144] The RGB value corresponding to the initial brightness under the DICOM curve is input into the mapping relationship for mapping processing to obtain the first RGB of the video to be processed under the GAMMA curve.

[0145] The GAMMA color difference compensation module 113 is configured to compensate the first RGB based on the initial color difference to obtain a second RGB.

[0146] In this embodiment, the GAMMA color difference compensation module compensates the first RGB based on the initial color difference to obtain the second RGB, including:

[0147] The first RGB is compensated based on the initial color difference using the following formula:

[0148]

[0149] in, represents the RGB matrix corresponding to the second RGB, Represents the RGB matrix corresponding to the initial color difference; represents the RGB matrix corresponding to the first RGB, represents the color difference compensation coefficient matrix, k1, k2, and k3 represent the color difference compensation coefficients respectively, and the value range of k1, k2, and k3 is [0, 2].

[0150] Among them, k1, k2, and k3 serve as the color difference compensation coefficients, and can take different values for different RGB color difference signals. k1, k2, and k3 are used to adjust the chromaticity effect of color pixels to meet the requirements of different users for chromaticity characteristics.

[0151] The chromaticity characteristics of the color pixel GAMMA can be retained through color difference compensation.

[0152] The DICOM mapping processing module 114 is configured to perform mapping processing based on the mapping relationship and the second RGB to obtain a third RGB of the video to be processed under a DICOM curve.

[0153] In this embodiment, the manner in which the DICOM mapping processing module performs mapping processing based on the mapping relationship and the second RGB is equivalent to the inverse process of the mapping processing performed by the GAMMA mapping processing module based on the pre-configured mapping relationship and the initial brightness, which is not described here.

[0154] The DICOM curve correction module 116 is further configured to perform correction based on the third RGB to obtain the video to be output and output the video to be output.

[0155] In this embodiment, the DICOM curve correction module performs correction based on the third RGB to obtain the video to be output, including:

[0156] Get LUT (Look-Up-Table) to display the lookup table;

[0157] The third RGB is corrected based on the LUT display lookup table to obtain the video to be output.

[0158] In this embodiment, outputting the video to be output includes:

[0159] The video to be output is sent to a display device connected to the FPGA-based image correction system.

[0160] For example, the display device can be a medical display, a general display, or various display terminals within the color display field. When a display requires separate GAMMA and DICOM adaptive correction processing for color and grayscale pixels within the same displayed image, this cannot be accomplished within a single scaler chip. The hardware programmable nature of the FPGA is the only way to achieve these differentiated, unique functions. Therefore, the FPGA-based image correction method of this embodiment can be used to accurately display both grayscale and color images on a single display while preserving the display characteristics of each image.

[0161] Specifically, through FPGA-based color grayscale adaptive correction processing, an adaptive hybrid gamma display method is implemented using FPGA hardware, which can automatically identify color pixels and monochrome grayscale pixels in the displayed image. Monochrome pixels are corrected using the DICOM curve; color pixels undergo brightness and color difference separation, gamma mapping, gamma color difference compensation, DICOM mapping, and finally DICOM curve correction. This effectively solves the problem of excessive brightness gradients between the DICOM curve and the gamma curve at the same grayscale, ensuring uniform display of the transition portion of the color grayscale image while retaining the gamma curve characteristics of the color portion.

[0162] It can be seen from the above technical solutions that the present invention can utilize the functional modules of FPGA to identify the color and grayscale attributes of the video in units of pixels, thereby solving the problem of inaccurate regional identification or limited regional size during regional identification, and can meet the display application of images in any scene. The color pixels are further separated into brightness and color difference parts, and according to the established mapping relationship between the DICOM curve and the GAMMA curve, the transition between the color and grayscale parts is made uniform, and the color difference is further used to perform brightness compensation on the GAMMA curve, so that the grayscale brightness of the GAMMA curve of the color part remains basically consistent with the DICOM curve, reducing the brightness gradient between different image grayscales, thereby solving the problems of noise, color blocks, color spots, etc. in the transition area when the image is displayed. At the same time, the color part retains the characteristics of the GAMMA curve, and the monochrome grayscale pixels are corrected using the DICOM curve, thereby realizing adaptive correction of the color grayscale video image based on FPGA.

[0163] like Figure 7 FIG. 1 is a schematic diagram of the structure of a computer device for implementing a preferred embodiment of the FPGA-based image correction method of the present invention.

[0164] The computer device 1 may include a memory 12 , a processor 13 , and a bus, and may further include a computer program stored in the memory 12 and executable on the processor 13 , such as an FPGA-based image correction program.

[0165] Those skilled in the art will understand that the schematic diagram is merely an example of the computer device 1 and does not constitute a limitation on the computer device 1. The computer device 1 may have either a bus structure or a star structure. The computer device 1 may also include more or less other hardware or software than shown in the figure, or a different arrangement of components. For example, the computer device 1 may also include input and output devices, network access devices, etc.

[0166] It should be noted that the computer device 1 is only an example. Other existing or future electronic products that are suitable for the present invention should also be included in the scope of protection of the present invention and included here by reference.

[0167] The memory 12 includes at least one type of readable storage medium, including a flash memory, a mobile hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory), a magnetic memory, a magnetic disk, an optical disk, etc. In some embodiments, the memory 12 may be an internal storage unit of the computer device 1, such as a mobile hard disk of the computer device 1. In other embodiments, the memory 12 may also be an external storage device of the computer device 1, such as a plug-in mobile hard disk, a smart memory card (SMC), a secure digital (SD) card, a flash memory card, etc. equipped on the computer device 1. Furthermore, the memory 12 may include both an internal storage unit of the computer device 1 and an external storage device. The memory 12 can be used not only to store application software and various types of data installed in the computer device 1, such as the code of an FPGA-based image correction program, but also to temporarily store data that has been output or is about to be output.

[0168] In some embodiments, the processor 13 may be comprised of an integrated circuit, such as a single packaged integrated circuit or a combination of multiple packaged integrated circuits with the same or different functions, including one or more central processing units (CPUs), microprocessors, digital processing chips, graphics processors, and various control chips. The processor 13 is the control core (Control Unit) of the computer device 1, connecting the various components of the entire computer device 1 using various interfaces and circuits. It executes programs or modules stored in the memory 12 (e.g., an FPGA-based image correction program) and accesses data stored in the memory 12 to perform various functions and process data.

[0169] The processor 13 executes the operating system of the computer device 1 and various installed applications. The processor 13 executes the applications to implement the steps in the above-mentioned embodiments of the image correction method based on FPGA, for example Figure 5 Steps shown.

[0170] Exemplarily, the computer program may be divided into one or more modules / units, which are stored in the memory 12 and executed by the processor 13 to implement the present invention. The one or more modules / units may be a series of computer-readable instruction segments capable of performing specific functions, and the instruction segments are used to describe the execution process of the computer program in the computer device 1. For example, the computer program may be divided into a color grayscale pixel recognition module 110, a brightness and color difference separation module 111, a gamma mapping processing module 112, a gamma color difference compensation module 113, a DICOM mapping processing module 114, a timing alignment module 115, and a DICOM curve correction module 116.

[0171] The integrated unit implemented as a software functional module can be stored in a computer-readable storage medium. The software functional module stored in the storage medium includes instructions for causing a computer device (which can be a personal computer, computer equipment, or network equipment, etc.) or a processor to execute portions of the FPGA-based image correction method described in various embodiments of the present invention.

[0172] If the modules / units integrated in the computer device 1 are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the present invention can also implement all or part of the processes in the above-mentioned method embodiments by instructing relevant hardware devices through a computer program. The computer program can be stored in a computer-readable storage medium. When executed by a processor, the computer program can implement the steps of each of the above-mentioned method embodiments.

[0173] The computer program includes computer program code, which may be in source code form, object code form, executable file, or some intermediate form. The computer-readable medium may include any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a mobile hard drive, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM), a random access memory, etc.

[0174] Furthermore, the computer-readable storage medium may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function, etc.; the data storage area may store data created according to the use of the blockchain node, etc.

[0175] Blockchain, as used in this article, refers to a novel application model for computer technologies such as distributed data storage, peer-to-peer transmission, consensus mechanisms, and encryption algorithms. Blockchain is essentially a decentralized database, a series of data blocks generated using cryptographic methods. Each block contains information about a batch of online transactions, used to verify the validity of this information (to prevent counterfeiting) and generate the next block. Blockchain can include the underlying blockchain platform, the platform product service layer, and the application service layer.

[0176] The bus can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 7 The figure shows that only one straight line is used, but it does not mean that there is only one bus or one type of bus. The bus is configured to realize the connection and communication between the memory 12 and at least one processor 13.

[0177] Although not shown, the computer device 1 may also include a power supply (such as a battery) to power various components. Preferably, the power supply can be logically connected to the at least one processor 13 via a power management device, thereby implementing functions such as charging management, discharging management, and power consumption management through the power management device. The power supply may also include one or more DC or AC power supplies, a recharging device, a power failure detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components. The computer device 1 may also include various sensors, Bluetooth modules, Wi-Fi modules, etc., which will not be detailed here.

[0178] Furthermore, the computer device 1 may also include a network interface. Optionally, the network interface may include a wired interface and / or a wireless interface (such as a WI-FI interface, a Bluetooth interface, etc.), which is usually used to establish a communication connection between the computer device 1 and other computer devices.

[0179] Optionally, the computer device 1 may further include a user interface, which may be a display or an input unit (such as a keyboard). Optionally, the user interface may also be a standard wired interface or a wireless interface. Optionally, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, or an OLED (Organic Light-Emitting Diode) touchscreen. The display may also be appropriately referred to as a display screen or a display unit, and is used to display information processed in the computer device 1 and to display a visual user interface.

[0180] It should be understood that the embodiment is for illustration only and the scope of the patent application is not limited to this structure.

[0181] Figure 7 Only the computer device 1 having components 12-13 is shown, and it can be understood by those skilled in the art that Figure 7 The structure shown does not constitute a limitation on the computer device 1 , and may include fewer or more components than shown in the figure, or combine certain components, or arrange the components differently.

[0182] Combine Figure 5 The memory 12 in the computer device 1 stores a plurality of instructions to implement an FPGA-based image correction method, and the processor 13 can execute the plurality of instructions to implement:

[0183] When receiving a video to be processed, the color and grayscale pixel recognition module identifies the pixel type of the video to be processed;

[0184] When the pixel type is a grayscale pixel, after the timing alignment module performs delay processing, the DICOM curve correction module corrects the video to be processed to obtain a video to be output and outputs the video to be output;

[0185] When the pixel type is a color pixel, the brightness and color difference separation module separates the video to be processed to obtain the initial brightness and initial color difference of the video to be processed; the GAMMA mapping processing module performs mapping processing based on a pre-configured mapping relationship and the initial brightness to obtain the first RGB of the video to be processed under the GAMMA curve; the GAMMA color difference compensation module compensates the first RGB based on the initial color difference to obtain the second RGB; the DICOM mapping processing module performs mapping processing based on the mapping relationship and the second RGB to obtain the third RGB of the video to be processed under the DICOM curve; the DICOM curve correction module performs correction based on the third RGB to obtain the video to be output and output the video to be output.

[0186] Specifically, the specific implementation method of the processor 13 for the above instructions can refer to Figure 5 The description of the relevant steps in the corresponding embodiments will not be repeated here.

[0187] It should be noted that the data involved in this case were all obtained legally.

[0188] In the several embodiments provided herein, it should be understood that the disclosed systems, devices, and methods may be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the module division is merely a logical functional division, and actual implementation may employ other division methods.

[0189] The present invention can be used in a wide variety of general or special computer system environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, and the like. The present invention can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present invention can also be practiced in distributed computing environments in which tasks are performed by remote processing devices connected via a communications network. In a distributed computing environment, program modules can be located in local and remote computer storage media, including storage devices.

[0190] The modules described as separate components may or may not be physically separate, and the components shown as modules may or may not be physical units, that is, they may be located in one place or distributed across multiple network elements. Some or all of the modules may be selected to achieve the purpose of the solution of this embodiment according to actual needs.

[0191] In addition, the functional modules in various embodiments of the present invention may be integrated into a single processing unit, each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or hardware plus software functional modules.

[0192] It will be apparent to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above, and that the present invention can be implemented in other specific forms without departing from the spirit or essential characteristics of the present invention.

[0193] Therefore, the embodiments should be considered in all respects as illustrative and non-restrictive, and the scope of the invention is defined by the appended claims rather than the foregoing description, and all changes that come within the meaning and range of equivalents of the claims are intended to be embraced therein. Any reference to a figure in a claim should not be construed as limiting the claim to which it relates.

[0194] Furthermore, it is clear that the word "comprising" does not exclude other units or steps, and the singular does not exclude the plural. Multiple units or devices described in the present invention may also be implemented by a single unit or device through software or hardware. Terms such as first and second are used to indicate names and do not imply any particular order.

[0195] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not limiting. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention.

Claims

1. An image correction method based on FPGA, characterized in that: Applied to an FPGA-based image correction system, the FPGA-based image correction system includes a color grayscale pixel recognition module, a brightness and color difference separation module, a GAMMA mapping processing module, a GAMMA color difference compensation module, a DICOM mapping processing module, a timing alignment module and a DICOM curve correction module. The FPGA-based image correction method includes: When receiving a video to be processed, the color and grayscale pixel recognition module identifies the pixel type of the video to be processed; When the pixel type is a grayscale pixel, after the timing alignment module performs delay processing, the DICOM curve correction module corrects the video to be processed to obtain a video to be output and outputs the video to be output; When the pixel type is a color pixel, the brightness and color difference separation module separates the video to be processed to obtain the initial brightness and initial color difference of the video to be processed; the GAMMA mapping processing module performs mapping processing based on a pre-configured mapping relationship and the initial brightness to obtain the first RGB of the video to be processed under the GAMMA curve; the GAMMA color difference compensation module compensates the first RGB based on the initial color difference to obtain the second RGB; the DICOM mapping processing module performs mapping processing based on the mapping relationship and the second RGB to obtain the third RGB of the video to be processed under the DICOM curve; the DICOM curve correction module performs correction based on the third RGB to obtain the video to be output and output the video to be output.

2. The FPGA-based image correction method according to claim 1, wherein: The color grayscale pixel recognition module recognizes the pixel type of the video to be processed, including: Obtain the R value, G value, and B value of each pixel in the video to be processed; Get the pre-configured component difference threshold; Calculate the component difference between the R value and the G value, the component difference between the G value and the B value, and the component difference between the R value and the B value of each pixel to obtain the component difference corresponding to each pixel; When the component difference of each pixel in the to-be-processed video is less than or equal to the component difference threshold, determining that the to-be-processed video is the grayscale pixel; or When the component difference of each pixel in the to-be-processed video is not less than or equal to the component difference threshold, it is determined that the to-be-processed video is the color pixel.

3. The FPGA-based image correction method according to claim 1, wherein: The color grayscale pixel recognition module recognizes the pixel type of the video to be processed, including: Convert the video to be processed from RGB color space to YCbCr color space; When each pixel in the video to be processed satisfies Cb=Cr=0, determining that the video to be processed is the grayscale pixel; or When each pixel in the to-be-processed video does not satisfy Cb=Cr=0, it is determined that the to-be-processed video is the color pixel.

4. The FPGA-based image correction method according to claim 1, wherein: The mapping relationship is: Wherein, D(x) represents the correction function corresponding to the DICOM curve; G(x) represents the correction function corresponding to the GAMMA curve; represents the mapping factor, The value range is [0.9, 1.1], n and m are positive integers; b represents the mapping brightness offset; The GAMMA mapping processing module performs mapping processing based on a pre-configured mapping relationship and the initial brightness to obtain a first RGB of the video to be processed under the GAMMA curve, including: Determine the RGB value corresponding to the initial brightness under the DICOM curve; The RGB value corresponding to the initial brightness under the DICOM curve is input into the mapping relationship for mapping processing to obtain the first RGB of the video to be processed under the GAMMA curve.

5. The FPGA-based image correction method according to claim 1, wherein: The GAMMA color difference compensation module compensates the first RGB based on the initial color difference to obtain the second RGB, including: The first RGB is compensated based on the initial color difference using the following formula: in, represents the RGB matrix corresponding to the second RGB, Represents the RGB matrix corresponding to the initial color difference; represents the RGB matrix corresponding to the first RGB, represents the color difference compensation coefficient matrix, k1, k2, and k3 represent the color difference compensation coefficients respectively, and the value range of k1, k2, and k3 is [0, 2].

6. The FPGA-based image correction method according to claim 1, wherein: The DICOM curve correction module performs correction based on the third RGB to obtain the video to be output, including: Get the LUT display lookup table; The third RGB is corrected based on the LUT display lookup table to obtain the video to be output.

7. The FPGA-based image correction method according to claim 1, wherein: Outputting the video to be output includes: The video to be output is sent to a display device connected to the FPGA-based image correction system.

8. An image correction device based on FPGA, characterized in that: The image correction system based on FPGA includes a color grayscale pixel recognition module, a brightness and color difference separation module, a gamma mapping processing module, a gamma color difference compensation module, a DICOM mapping processing module, a timing alignment module and a DICOM curve correction module. The image correction device based on FPGA includes: The color and grayscale pixel recognition module is used to identify the pixel type of the video to be processed when receiving the video to be processed; The DICOM curve correction module is configured to, when the pixel type is a grayscale pixel, correct the video to be processed after the timing alignment module performs delay processing to obtain a video to be output and output the video to be output; The brightness and color difference separation module is used to separate the video to be processed when the pixel type is a color pixel, so as to obtain the initial brightness and initial color difference of the video to be processed; The GAMMA mapping processing module is used to perform mapping processing based on a pre-configured mapping relationship and the initial brightness to obtain a first RGB of the video to be processed under a GAMMA curve; The GAMMA color difference compensation module is used to compensate the first RGB based on the initial color difference to obtain a second RGB; The DICOM mapping processing module is used to perform mapping processing based on the mapping relationship and the second RGB to obtain a third RGB of the video to be processed under the DICOM curve; The DICOM curve correction module is further configured to perform correction based on the third RGB to obtain the video to be output and output the video to be output.

9. A computer device, characterized in that: The computer device comprises: a memory storing at least one instruction; and A processor executes instructions stored in the memory to implement the FPGA-based image correction method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores at least one instruction, and the at least one instruction is executed by a processor in a computer device to implement the FPGA-based image correction method according to any one of claims 1 to 7.

Images