Image processing method and display device

Abstract

This invention proposes an image processing method and a display device using this method. The method includes: converting an original image to a first color space to generate a reference image corresponding to the first color space; detecting image regions with high-frequency signals in the reference image to generate a detection result; performing an operation on the detection result according to a preset gain value to generate a first operation result; evaluating the detection result and the first operation result, and selecting a reference gain value; performing an operation on the detection result according to the reference gain value to generate a second operation result; selecting at least one of the brightness values ​​of a first pixel in a first fused image and a second pixel in a second fused image according to the first operation result and the second operation result to generate the brightness values ​​of pixels in a third fused image; and converting the third fused image to a second color space to generate an output image corresponding to the second color space. The display device of this invention makes the displayed image clearer and suppresses the white-edge effect.

Description

Technical Field

[0001] This invention relates to an image processing technology, and more particularly to an image processing method and a display device using the image processing method. Background Technology

[0002] Currently, there are many image processing techniques that can improve the sharpness of projector images, such as using high-pass filters (or sharpening filters) to increase image sharpness. While these filters can make images sharper, they also produce the side effect of ringing effect.

[0003] Please refer to Figure 1 The image shows the visual effect of the display's high-pass filter processing. Figure 1 In the image, image 110 is the result of processing image 100 using a high-pass filter.

[0004] The difference between image 100 and image 110 shows that after high-pass filter processing, the edge parts (such as the hair decorations in the dashed box) become whiter, resulting in a white edge effect at the edges, making the overall image look too sharp and unnatural, affecting the image quality and the viewer's viewing experience.

[0005] Therefore, for those skilled in the art, designing a technical solution that can both make images clearer after passing through a high-pass filter and simultaneously suppress white-edge effects is an important issue.

[0006] The "Background Art" paragraph is only used to help understand the content of this invention. Therefore, the content disclosed in the "Background Art" paragraph may include known technologies that are not known to those skilled in the art. The content disclosed in the "Background Art" paragraph does not mean that the content or the problems to be solved by one or more embodiments of this invention were known or understood by those skilled in the art prior to this application. Summary of the Invention

[0007] Other objects and advantages of the present invention can be further understood from the technical features of the invention. At least one of the technical problems to be solved by the present invention is how to design a method that makes images clearer after passing through a high-pass filter and suppresses white fringing.

[0008] To achieve one or more of the above objectives or other objectives, an image processing method according to one embodiment of the present invention includes: performing a first color space conversion on an original image using an image preprocessing circuit to generate a reference image corresponding to the first color space; detecting image regions with high-frequency signals in the reference image using an edge filter to generate a detection result; performing an operation on the detection result according to a preset gain value using a first fusion circuit to generate a first operation result; evaluating the detection result and the first operation result using a gain selection circuit to select a reference gain value; performing an operation on the detection result according to the reference gain value using a second fusion circuit to generate a second operation result; selecting at least one of the brightness values ​​of a first pixel in the first fused image and the brightness values ​​of a second pixel in the second fused image using a multiplexer according to the first operation result and the second operation result to generate the brightness values ​​of pixels in a third fused image; and performing a second color space conversion on the third fused image using an image postprocessing circuit to generate an output image corresponding to the second color space.

[0009] Furthermore, a display device according to one embodiment of the present invention includes an image processing apparatus and an imaging apparatus. The image processing apparatus includes an image preprocessing circuit, an edge filter, a first fusion circuit, a gain selection circuit, a second fusion circuit, a multiplexer, and an image post-processing circuit. The image preprocessing circuit is configured to perform a first color space conversion on the original image to generate a reference image corresponding to the first color space. The edge filter is electrically connected to the image preprocessing circuit and configured to detect image regions with high-frequency signals in the reference image to generate a detection result. The first fusion circuit is electrically connected to the edge filter and configured to perform calculations on the detection result with a preset gain value to generate a first calculation result. The gain selection circuit is electrically connected to the edge filter and configured to evaluate the detection result and the first calculation result to select a reference gain value. The second fusion circuit is electrically connected to the gain selection circuit and configured to perform calculations on the detection result according to the reference gain value to generate a second calculation result. A multiplexer, electrically connected to the first and second fusion circuits, is configured to select at least one of the brightness values ​​of a first pixel in the first fused image and a second pixel in the second fused image, based on a first calculation result and a second calculation result, to generate the brightness values ​​of pixels in the third fused image. An image post-processing circuit, electrically connected to the multiplexer, is configured to perform a second color space conversion on the third fused image to generate an output image corresponding to the second color space. An imaging device, electrically connected to the image processing device, is used to receive and display the output image. Attached Figure Description

[0010] Figure 1 This is a visual effect diagram of an image processed using a high-pass filter.

[0011] Figure 2 This is a schematic diagram of a display device illustrated according to one embodiment of the present invention.

[0012] Figure 3 It is based on Figure 2 A schematic diagram of an image processing device.

[0013] Figure 4 This is a flowchart illustrating an image processing method according to one embodiment of the present invention.

[0014] Figure 5 This is a schematic diagram illustrating the generation of a third fused image according to one embodiment of the present invention.

[0015] Figure 6 This is an image processing effect diagram illustrated according to one embodiment of the present invention.

[0016] Figure 7 This is an image processing effect diagram illustrated according to one embodiment of the present invention.

[0017] Explanation of reference numerals in the attached figures:

[0018] 200: Display device

[0019] 202: Image Processing Device

[0020] 204: Imaging device

[0021] 310: Image preprocessing circuit

[0022] 320: Edge Filter

[0023] 330: First Fusion Circuit

[0024] 340: Gain Selection Circuit

[0025] 350: Second fusion circuit

[0026] 360: Multiplexer

[0027] 370: Image post-processing circuit

[0028] 510: Diagonal area

[0029] 520: Dot matrix area

[0030] 610, 620, 630, 710, 720, 730: Images

[0031] C1: First operation result

[0032] C2: Second operation result

[0033] F1, F2, L: Brightness values

[0034] G0: Preset gain value

[0035] G1: Reference gain value

[0036] I1: Original Image

[0037] I2: Reference Image

[0038] I3: Output Image

[0039] M1: First Fusion Image

[0040] M2: Second Fusion Image

[0041] M3: Third Fusion Image

[0042] R1: Detection Results

[0043] S410, S420, S430, S440, S450, S460, S470, S480: Steps. Detailed Implementation

[0044] The foregoing description and other technical contents, features, and effects of this invention will be clearly presented in the following detailed description of a preferred embodiment with reference to the accompanying drawings. The directional terms mentioned in the following embodiments, such as up, down, left, right, front, or back, are merely for reference to the directions in the accompanying drawings. Therefore, the directional terms used are for illustrative purposes and not for limiting the invention.

[0045] Please refer to Figure 2 This is a schematic diagram of a display device according to one embodiment of the present invention. In different embodiments, the display device 200 may be, for example, a projector, a monitor, or other electronic device that provides display functionality, but is not limited thereto. The display device 200 is communicatively connected to an image source via wired or wireless signal transmission, and the image source provides the original image I1 to the display device 200. The image source may be, for example, an electronic device such as a computer, laptop, smartphone, or tablet.

[0046] exist Figure 2In this embodiment, the display device 200 includes an image processing device 202 and an imaging device 204. In one example, the image processing device 202 includes at least one image processor and can be used to implement image processing methods. The image processor may be, for example, a microprogrammed control unit (MCU), a central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or a programmable logic device (PLD). The combination of a Field Programmable Gate Array (FPGA) chip and circuit or the above-mentioned device is possible, but not limited to this.

[0047] Furthermore, the imaging device 204 is electrically connected to the image processing device 202. The imaging device 204 receives and displays the output image I3 provided by the image processing device 202, allowing a viewer to view the output image I3. The imaging device 204 may be, for example, an optical engine, a display panel, and / or other optical devices with imaging capabilities, but is not limited thereto. Those skilled in the art will know that an optical engine includes at least a light valve and a projection lens. The display panel may be, for example, a liquid crystal display panel (LCD panel) or a light-emitting diode panel (LED panel), but is not limited thereto. In addition, an electrical connection represents the relationship of electrical signal transmission between the two devices.

[0048] Please refer to Figure 3 It is based on Figure 2 A schematic diagram of an image processing device. Figure 3 In the image processing device 202, there are at least an image preprocessing circuit 310, an edge filter 320, a first fusion circuit 330, a gain selection circuit 340, a second fusion circuit 350, a multiplexer 360, and an image postprocessing circuit 370.

[0049] like Figure 3As shown, edge filter 320 is electrically connected to image preprocessing circuit 310; first fusion circuit 330 is electrically connected to edge filter 320; gain selection circuit 340 is electrically connected to edge filter 320; second fusion circuit 350 is electrically connected to gain selection circuit 340; multiplexer 360 is electrically connected to first fusion circuit 330 and second fusion circuit 350; image postprocessing circuit 370 is electrically connected to multiplexer 360 and imaging device 204.

[0050] In the embodiments of the present invention, the image processing device 202 and the imaging device 204 of the display device 200 can be used to implement the image processing method proposed in the embodiments of the present invention, and the details are described below.

[0051] Please refer to Figure 4 This is a flowchart illustrating an image processing method according to one embodiment of the present invention. The method of this embodiment can be derived from... Figure 2 The image processing device 202 performs the following, which is paired with Figure 2 , Figure 3 Component description shown Figure 4 Details of each step.

[0052] In step S410, the image preprocessing circuit 310 performs a first color space conversion on the original image I1 to generate a reference image I2 corresponding to the first color space.

[0053] In one embodiment, the image preprocessing circuit 310 may perform image preprocessing on the original image I1, wherein the image preprocessing includes at least one of scaling, flipping, and conversion of the first color space, but is not limited thereto.

[0054] In one embodiment, the first color space is, for example, YUV, HSL, HSV, YCrCb or other color spaces, but is not limited to these.

[0055] For ease of understanding, YUV is used as an example of the first color space below, but it is only used as an example and is not intended to limit the possible implementation of the present invention.

[0056] In one embodiment, the original image I1 is, for example, an RGB image (color image). Step S410 can be understood as the image preprocessing circuit 310 converting the RGB image into a YUV image, but it is not limited to this. More specifically, those skilled in the art will know that the image preprocessing circuit 310 converts the R, G, B values ​​of each pixel corresponding to the RGB image into the Y, U, V values ​​of each pixel corresponding to the YUV image. The Y value is obtained, and the Y value represents the brightness value of the pixel in the original image I1.

[0057] In step S420, the edge filter 320 detects image regions with high-frequency signals in the reference image I2 and generates a detection result R1 based on the image regions with high-frequency signals.

[0058] Generally speaking, high-frequency signals in an image refer to rapidly changing signals received by pixels, mainly including edges, textures, details, and any noise that may be present. These signals manifest as abrupt changes in brightness or color in the image, such as the outlines of objects, fine texture patterns, or random noise in the background. In frequency domain analysis, high-frequency signals correspond to high-frequency components, reflecting the richness of image detail.

[0059] In one embodiment, the edge filter 320 includes at least one of a high-pass filter, a mean filter, a median filter, a Gaussian filter, a Laplace filter, and a Sobel filter.

[0060] In one embodiment, the image region with high-frequency signals is, for example, an image region in reference image I2 where the change in brightness value (e.g., contrast) is greater than a preset value. The preset value can be set by the designer. Increasing the contrast of some reference pixels in reference image I2 can improve the sharpness of some regions of reference image I2. Edge filter 320 is used to detect the brightness value (Y value) corresponding to each reference pixel in reference image I2, obtain the position of the reference pixel corresponding to the image region with high-frequency signals, and generate a detection result R1. Detection result R1 is the position (coordinate) information of the reference pixels with high-frequency signals in reference image I2. Reference image I2 has W x H reference pixels. W is the number of pixels in reference image I2 in the horizontal direction, and H is the number of pixels in reference image I2 in the vertical direction.

[0061] In step S430, in one embodiment, the first fusion circuit 330 receives the detection result R1 and the reference image I2 provided by the edge filter 320. The first fusion circuit 330 performs an operation on the detection result R1 according to a preset gain value G0 to generate a first operation result C1.

[0062] In one embodiment, the first fusion circuit 330 amplifies the brightness value of the reference pixel with high-frequency signal in the detection result R1 by a factor of a preset gain value G0 to generate a first fused image M1. Then, the first fusion circuit 330 generates a first calculation result C1 based on the first fused image M1. Taking one pixel (the first pixel) of the first fused image M1 as an example, the coordinates of the first pixel of the first fused image M1 are (2,2), and the brightness value of the first pixel is F1. The coordinates of the reference pixel with high-frequency signal in the reference image I2 in the detection result R1 are (2,2), and the brightness value of the reference pixel is L, where F1 = K1 * L, where K1 is the preset gain value G0, and the coordinates of the first pixel of the first fused image M1 correspond to the coordinates of the reference pixel with high-frequency signal in the reference image I2. This invention forms the first fused image M1 by adjusting the brightness values ​​of some reference pixels (reference pixels with high-frequency signals) in the reference image I2. The first fusion circuit 330 generates the first calculation result C1 based on the first fused image M1. The first calculation result C1 includes the brightness value of each pixel (at least one first pixel) of the first fused image M1.

[0063] The first fusion circuit 330 provides the first calculation result C1 to the gain selection circuit 340 and the multiplexer 360. The first fusion circuit 330 provides the first fused image M1 to the multiplexer 360.

[0064] In one embodiment, the display device 200 may provide a user-configurable preset gain value G0 through a built-in and / or external user interface. Furthermore, the preset gain value G0 may also be a preset value pre-set in the first fusion circuit 330, but is not limited to this.

[0065] In step S440, the gain selection circuit 340 evaluates the detection result R1 and the first calculation result C1 to select the reference gain value G1.

[0066] In an embodiment of the present invention, the gain selection circuit 340 receives the reference image I2 and detection result R1 provided by the edge filter 320, and the first calculation result C1 provided by the first fusion circuit 330. The gain selection circuit 340 can provide a reference gain value G1. In one embodiment, the gain selection circuit 340 can determine whether the brightness value of at least one of the first pixels (hereinafter referred to as the first specific pixel P1) in the first fused image M1 of the first calculation result C1 is greater than a first threshold.

[0067] In one embodiment, in response to determining that the brightness value of the first specific pixel P1 is greater than a first threshold, the gain selection circuit 340 selects a first gain value as a reference gain value G1 corresponding to the first specific pixel P1. Conversely, in response to determining that the brightness value of the first specific pixel P1 is not greater than the first threshold, the gain selection circuit 340 selects a second gain value as a reference gain value G1 corresponding to the first specific pixel P1, wherein the second gain value is greater than the first gain value. In one embodiment, the second gain value is a preset gain value G0.

[0068] In other words, for each first pixel of the first fused image M1 in the first calculation result C1, the gain selection circuit 340 can select the first gain value as the corresponding reference gain value G1 when it determines that the brightness value is greater than the first threshold, and select the second gain value as the corresponding reference gain value G1 when it determines that the brightness value is not greater than the first threshold.

[0069] In one embodiment, both the first gain value and the second gain value are constant values.

[0070] In other embodiments, the gain selection circuit 340 can select values ​​suitable as the first gain value and the second gain value from a gain range. Furthermore, in one embodiment, the upper limit of the gain range is, for example, a preset gain value G0.

[0071] In one embodiment, both the first gain value and the second gain value are constant values.

[0072] In one embodiment, if the brightness value of a first specific pixel P1 is greater than a first threshold, the first gain value may be negatively correlated with a first difference value between the brightness value of the first specific pixel P1 and the first threshold. That is, when the brightness value of the first specific pixel P1 is greater than the first threshold, the smaller the brightness value of the first specific pixel P1, the larger the first gain value; the larger the brightness value of the first specific pixel P1, the smaller the first gain value.

[0073] Furthermore, when the brightness value of the first specific pixel P1 is greater than the first threshold, this indicates that a white border may appear at the reference pixel position of the first specific pixel P1 in the detection result R1. Therefore, the gain selection circuit 340 selects a smaller value from the gain range as the first gain value to reduce the white border.

[0074] Furthermore, when the brightness value of the first specific pixel P1 is not greater than the first threshold, the second gain value can be positively correlated with the second difference value between the brightness value of the first specific pixel P1 and the first threshold. That is, when the brightness value of the first specific pixel P1 is not greater than the first threshold, the smaller the brightness value of the first specific pixel P1, the smaller the second gain value; the larger the brightness value of the first specific pixel P1, the larger the second gain value.

[0075] Furthermore, when the brightness value of the first specific pixel P1 is not greater than the first threshold, this means that the position of the first specific pixel P1 in the detection result R1 should not have a white edge. Therefore, the gain selection circuit 340 selects a larger value from the gain range as the second gain value to increase the corresponding sharpness.

[0076] In one embodiment, the lower limit of the gain range can be set as a fixed value by the designer as needed.

[0077] In another embodiment, the lower limit of the gain range can be determined by specific means. For example, the designer can gradually increase the gain value and use this gain value to amplify the brightness values ​​of each reference pixel in the detection result R1 to generate a test result image. When the designer observes white edges appearing in the test result image, the designer can gradually decrease the gain value and continue to observe the corresponding test result image. When the white edges in the test result image disappear, the gain value used at this point can be determined as the lower limit of the gain range, but it is not limited to this.

[0078] In step S450, the second fusion circuit 350 performs calculations on the detection result R1 according to the reference gain value G1 to generate the second calculation result C2.

[0079] In one embodiment, the second fusion circuit 350 receives a reference gain value G1, a detection result R1, and a reference image I2 provided by the gain selection circuit 340. Based on the reference gain value G1, the second fusion circuit 350 amplifies the brightness value of the reference pixel with a high-frequency signal in the detection result R1 to generate a second fused image M2. Subsequently, the second fusion circuit 350 can generate a second calculation result C2 based on the second fused image M2.

[0080] Taking one pixel (the second pixel) of the second fused image M2 as an example, the coordinates of the second pixel of the second fused image M2 are (2,2), and the brightness value of the second pixel is F2. The coordinates of the reference pixel with high-frequency signal in the reference image I2 in the detection result R1 are (2,2), and the brightness value of the reference pixel is L, where F2 = K2 * L, and K2 is the reference gain value G1. The coordinates of the second pixel of the second fused image M2 correspond to the coordinates of the reference pixel with high-frequency signal in the reference image I2. This invention forms the second fused image M2 by adjusting the brightness values ​​of some reference pixels (reference pixels with high-frequency signals) in the reference image I2. The second fusion circuit 350 generates a second calculation result C2 based on the second fused image M2. The second calculation result C2 includes the brightness values ​​of each pixel (at least one second pixel) of the second fused image M2.

[0081] In step S460, the multiplexer 360 selects at least one of the brightness values ​​of a portion of pixels (first pixels) in the first fused image M1 and the brightness values ​​of a portion of pixels (second pixels) in the second fused image M2, based on the first calculation result C1 and the second calculation result C2, to generate the brightness values ​​of pixels (third pixels) in the third fused image M3.

[0082] In an embodiment of the present invention, the multiplexer 360 receives a first fused image M1 and a first calculation result C1 provided by the first fusion circuit 330, and a second fused image M2 and a second calculation result C2 provided by the second fusion circuit 350.

[0083] In one embodiment, taking a single pixel as an example, the multiplexer 360 can determine whether the brightness value of the first pixel of the first fused image M1 is higher than a preset threshold (e.g., 0xF0 (hexadecimal) or 11110000 (binary)).

[0084] In response to the determination that the brightness value of the first pixel is higher than a preset threshold, the multiplexer 360 can select the brightness value of the second pixel of the second fused image M2 as the brightness value of the third pixel of the third fused image M3. The position (coordinates) of the second pixel is equal to the position (coordinates) of the third pixel.

[0085] On the other hand, in response to the determination that the brightness value of the first pixel is not higher than a preset threshold, the multiplexer 360 can select the brightness value of the first pixel of the first fused image M1 as the brightness value of the third pixel of the third fused image M3. The position (coordinates) of the first pixel is equal to the position (coordinates) of the third pixel.

[0086] In one embodiment, the multiplexer 360 can select the brightness values ​​of all pixels (first pixels) in the first fused image M1 based on the first calculation result C1 and the second calculation result C2, so as to generate the brightness values ​​of all pixels (third pixels) in the third fused image M3.

[0087] In one embodiment, the multiplexer 360 can select the brightness values ​​of all pixels (second pixels) in the second fused image M2 based on the first calculation result C1 and the second calculation result C2 to generate the brightness values ​​of all pixels (third pixels) in the third fused image M3.

[0088] Please refer to Figure 5 This is a schematic diagram illustrating the generation of a third fused image M3 according to one embodiment of the present invention. Figure 5In the first fused image M1, if the brightness value of the first pixel in the diagonal region 510 is not higher than a preset threshold, then the first pixel in this diagonal region 510 can form the third pixel in the third fused image M3 corresponding to the diagonal region 510, and the brightness value of the third pixel is equal to the brightness value of the first pixel in the diagonal region 510.

[0089] Additionally, for the first pixel not located within the diagonal region 510 (whose brightness values ​​are all higher than a preset threshold), the multiplexer 360 can find the position of the second pixel (e.g., the second pixel within the dot matrix region 520) corresponding to the position of the first pixel not located within the diagonal region 510 in the second fused image M2, and form the second pixel within the dot matrix region 520 into the third pixel within the third fused image M3 corresponding to the dot matrix region 520, with the brightness value of the third pixel being equal to the brightness value of the second pixel within the dot matrix region 520.

[0090] In step S470, the image post-processing circuit 370 performs a second color space conversion on the third fused image M3 to generate an output image I3 corresponding to the second color space.

[0091] In one embodiment, the image post-processing circuit 370 receives a third fused image M3 provided by the multiplexer 360. The image post-processing circuit 370 can perform image post-processing on the third fused image M3, wherein the image post-processing includes at least one of the second color space conversion, brightness adjustment, and color quantization.

[0092] In one embodiment, the second color space is, for example, the color space corresponding to the original image I1, such as the RGB color space, but is not limited to this. In this case, the output image I3 is, for example, another RGB image obtained by converting the YUV image corresponding to the third fused image M3, but is not limited to this.

[0093] In step S480, the imaging device 204 receives the output image I3 provided by the image processing device 202 and displays the output image I3. In embodiments where the imaging device 204 is an optical engine, the imaging device 204 may, for example, project the output image I3 onto a projection plane (e.g., a screen and / or a wall), but is not limited to this.

[0094] Please refer to Figure 6 This is an image processing effect diagram illustrated according to one embodiment of the present invention.

[0095] In this embodiment, images 610, 620, and 630 are individually, for example, output images I3 projected onto a projection plane. Figure 6In this context, image 610 is, for example, the original image, image 620 is, for example, the result image obtained by processing image 610 in a conventional manner (e.g., using a high-pass filter), and image 630 is, for example, the output image obtained by processing image 610 in the manner proposed in the embodiments of the present invention.

[0096] Depend on Figure 6 It can be seen that image 610 has relatively blurry edges without high-pass filter processing. However, after image 610 is processed by high-pass filter to obtain image 620, although the edges are clearer, the white edge effect is also more serious.

[0097] In contrast, after image 610 is processed by the method of the present invention to obtain image 630, not only is the clarity improved, but the white edge effect is also suppressed.

[0098] Please refer to Figure 7 This is an image processing effect diagram illustrated according to one embodiment of the present invention.

[0099] In this embodiment, images 710, 720, and 730 are individually, for example, output images I3 projected onto a projection plane. Figure 7 In this context, image 710 is, for example, the original image under consideration, image 720 is, for example, the result image obtained by processing image 710 in a conventional manner (e.g., using a high-pass filter), and image 730 is, for example, the output image obtained by processing image 710 in the manner proposed in the embodiments of the present invention.

[0100] Depend on Figure 7 As can be seen, in image 710 without high-pass filtering, the particles of sand and gravel on the ground are rather blurry. However, after image 710 is processed through a high-pass filter to obtain image 720, although the particles of sand and gravel on the ground are clearer, the white edge effect is also more severe.

[0101] In contrast, after image 710 was processed using the methods described in this case to obtain image 730, not only was the clarity improved, but the white border effect was also suppressed.

[0102] In summary, the image processing method and display device of the embodiments of the present invention have at least one of the following advantages: since the embodiments of the present invention can select the gain value of amplifying pixel brightness value in a more flexible manner, the white border effect can be reduced on the output image while maintaining the clarity of the output image.

[0103] The above description is merely a preferred embodiment of the present invention and should not be construed as limiting the scope of the embodiments of the present invention. Any simple equivalent changes and modifications made in accordance with the claims and description of the invention are still within the scope of this patent. Furthermore, no embodiment or claim of the present invention needs to achieve all the objectives, advantages, or features of the present invention. In addition, the abstract and title (invention title) are only used to assist in patent document retrieval and are not intended to limit the scope of the invention. Furthermore, the terms "first," "second," etc., mentioned in this specification or claims are only used to name elements or distinguish different embodiments or scopes, and are not used to limit the upper or lower limit of the number of elements.

Claims

1. An image processing method, characterized in that, The image processing method includes: The image preprocessing circuit performs a first color space conversion on the original image to generate a reference image corresponding to the first color space. By using an edge filter, image regions with high-frequency signals in the reference image are detected to generate detection results; The detection result is processed by the first fusion circuit according to a preset gain value to generate a first calculation result; The detection result and the first calculation result are evaluated by a gain selection circuit to select a reference gain value; The detection result is processed based on the reference gain value using the second fusion circuit to generate a second calculation result; Using a multiplexer, based on the first and second calculation results, at least one of the brightness values ​​of a first pixel in the first fused image and a second pixel in the second fused image is selected to generate the brightness values ​​of pixels in the third fused image; and The third fused image is converted to a second color space by means of an image post-processing circuit to produce an output image corresponding to the second color space.

2. The image processing method according to claim 1, characterized in that, The edge filter includes at least one of a high-pass filter, a mean filter, a median filter, a Gaussian filter, a Laplace filter, and a Sobel filter.

3. The image processing method according to claim 1, characterized in that, The image region with high-frequency signals is the image region in the reference image where the change in brightness value is greater than a preset value.

4. The image processing method according to claim 1, characterized in that, The image processing method further includes: using the edge filter to detect the brightness value of each reference pixel in the reference image to obtain the position of the reference pixel corresponding to the image region with high-frequency signal, so as to generate the detection result.

5. The image processing method according to claim 4, characterized in that, The image processing method further includes: using the first fusion circuit, amplifying the brightness value of the reference pixel having the high-frequency signal in the detection result by a preset gain value to generate the first fused image; and using the first fusion circuit, generating the first calculation result based on the first fused image.

6. The image processing method according to claim 5, characterized in that, The image processing method further includes: using the gain selection circuit to determine whether the brightness value of at least one of the first pixels in the first fused image of the first calculation result is greater than a first threshold.

7. The image processing method according to claim 6, characterized in that, The image processing method further includes: in response to determining that the brightness value of a first specific pixel is greater than a first threshold, the gain selection circuit selects a first gain value as the reference gain value corresponding to the first specific pixel, wherein the first specific pixel is at least one of the first pixels.

8. The image processing method according to claim 7, characterized in that, The image processing method further includes: in response to determining that the brightness value of the first specific pixel is not greater than the first threshold, the gain selection circuit selects a second gain value as the reference gain value corresponding to the first specific pixel, wherein the second gain value is greater than the first gain value.

9. The image processing method according to claim 8, characterized in that, The image processing method further includes: using the second fusion circuit, amplifying the brightness value of the reference pixel having the high-frequency signal in the detection result by a magnification factor according to the reference gain value to generate the second fused image; and using the second fusion circuit, generating the second calculation result based on the second fused image.

10. The image processing method according to claim 9, characterized in that, The image processing method further includes: using the multiplexer to determine whether the brightness value of the first pixel of the first fused image is higher than a preset threshold.

11. The image processing method according to claim 10, characterized in that, The image processing method further includes: using the multiplexer, in response to determining that the brightness value of the first pixel is higher than the preset threshold, the multiplexer selects the brightness value of the second pixel of the second fused image as the brightness value of the third pixel of the third fused image.

12. The image processing method according to claim 11, characterized in that, The image processing method further includes: using the multiplexer, in response to determining that the brightness value of the first pixel is not higher than the preset threshold, the multiplexer selects the brightness value of the first pixel of the first fused image as the brightness value of the third pixel of the third fused image.

13. A display device, characterized in that, The display device includes an image processing device and an imaging device, wherein: The image processing device includes an image preprocessing circuit, an edge filter, a first fusion circuit, a gain selection circuit, a second fusion circuit, a multiplexer, and an image postprocessing circuit, wherein: The image preprocessing circuit is configured to perform a first color space conversion on the original image to generate a reference image corresponding to the first color space. The edge filter is electrically connected to the image preprocessing circuit and configured to detect image regions with high-frequency signals in the reference image to generate detection results. The first fusion circuit is electrically connected to the edge filter and is configured to perform calculations on the detection result with a preset gain value to generate a first calculation result; The gain selection circuit is electrically connected to the edge filter and configured to evaluate the detection result and the first calculation result to select a reference gain value; The second fusion circuit is electrically connected to the gain selection circuit and configured to perform calculations on the detection result based on the reference gain value to generate a second calculation result; The multiplexer is electrically connected to the first fusion circuit and the second fusion circuit, and is configured to select at least one of the brightness values ​​of a first pixel in the first fused image and a second pixel in the second fused image, based on the first calculation result and the second calculation result, to generate the brightness values ​​of the pixels in the third fused image; and The image post-processing circuit is electrically connected to the multiplexer and configured to perform a second color space conversion on the third fused image to produce an output image corresponding to the second color space; and The imaging device is electrically connected to the image processing device and is used to receive and display the output image.

14. The display device according to claim 13, characterized in that, The edge filter includes at least one of a high-pass filter, a mean filter, a median filter, a Gaussian filter, a Laplace filter, and a Sobel filter.

15. The display device according to claim 13, characterized in that, The image region with high-frequency signals is the image region in the reference image where the change in brightness value is greater than a preset value.

16. The display device according to claim 13, characterized in that, The edge filter is used to detect the brightness value of each reference pixel in the reference image to obtain the position of the reference pixel corresponding to the image region with high-frequency signal, so as to generate the detection result.

17. The display device according to claim 16, characterized in that, The first fusion circuit is used to amplify the brightness value of the reference pixel with the high-frequency signal in the detection result by a predetermined gain value to generate the first fused image. The first fusion circuit is used to generate the first calculation result based on the first fused image.

18. The display device according to claim 17, characterized in that, The gain selection circuit is used to determine whether the brightness value of at least one of the first pixels in the first fused image of the first calculation result is greater than a first threshold.

19. The display device according to claim 18, characterized in that, The gain selection circuit is used to react to the determination that the brightness value of a first specific pixel is greater than a first threshold, and the gain selection circuit is used to select a first gain value as the reference gain value corresponding to the first specific pixel, wherein the first specific pixel is at least one of the first pixels.

20. The display device according to claim 19, characterized in that, The gain selection circuit is used to react to the determination that the brightness value of the first specific pixel is not greater than the first threshold, and the gain selection circuit is used to select a second gain value as the reference gain value corresponding to the first specific pixel, wherein the second gain value is greater than the first gain value.

21. The display device according to claim 20, characterized in that, The second fusion circuit is used to amplify the brightness value of the reference pixel having the high-frequency signal in the detection result by a certain factor according to the reference gain value, so as to generate the second fused image; The second fusion circuit is used to generate the second calculation result based on the second fused image.

22. The display device according to claim 21, characterized in that, The multiplexer is used to determine whether the brightness value of the first pixel in the first fused image is higher than a preset threshold.

23. The display device according to claim 22, characterized in that, The multiplexer is used to respond to the determination that the brightness value of the first pixel is higher than the preset threshold, and the multiplexer is used to select the brightness value of the second pixel of the second fused image as the brightness value of the third pixel of the third fused image.

24. The display device according to claim 23, characterized in that, The multiplexer is used to respond to the determination that the brightness value of the first pixel is not higher than the preset threshold, and the multiplexer is used to select the brightness value of the first pixel of the first fused image as the brightness value of the third pixel of the third fused image.

Images