A picture display method and apparatus thereof

Abstract

The application provides a picture display method and device. The method comprises the following steps: obtaining a histogram of picture frame i according to brightness information of pixels in the picture frame i at T+1, obtaining a brightness cumulative value of the picture frame i based on the histogram at T+2, and outputting target RGB of pixels in picture frame i+2 based on the brightness cumulative value and the brightness information of pixels in the picture frame i+2 at T+3; obtaining a histogram of picture frame i+1 based on the brightness information of pixels in the picture frame i+1 at T+2, obtaining a brightness cumulative value of the picture frame i+1 based on the histogram at T+3, and outputting target RGB of pixels in picture frame i+3 based on the brightness cumulative value and the brightness information of pixels in the picture frame i+3 at T+4; obtaining a histogram of picture frame i+2 at T+3, obtaining a brightness cumulative value of the picture frame i+2 based on the histogram at T+4, and outputting target RGB of pixels in picture frame i+4 based on the brightness cumulative value and the brightness information of pixels in the picture frame i+4 at T+5.

Description

Technical Field

[0001] This application relates to the field of image processing technology, and in particular to a screen display method and apparatus. Background Technology

[0002] With the development of display technology, many display devices have emerged. Contrast ratio is one of the factors affecting the picture quality of a monitor. Low contrast ratio often leads to poor image display, and improving the contrast ratio to enhance image quality has become a hot research topic. Summary of the Invention

[0003] This application provides a screen display method and apparatus.

[0004] The first aspect of this application provides a screen display method, including:

[0005] At time T+1, the histogram of frame i is obtained based on the brightness information of the pixels in frame i. At time T+2, the cumulative brightness value of frame i is obtained based on the histogram of frame i. At time T+3, the target RGB of the pixels in frame i+2 is output based on the cumulative brightness value of frame i and the brightness information of the pixels in frame i+2. Here, i and T are natural numbers that satisfy a set rule starting from 1.

[0006] At time T+2, based on the brightness information of the pixels in frame i+1, the histogram of frame i+1 is obtained. At time T+3, based on the histogram of frame i+1, the cumulative brightness value of frame i+1 is obtained. At time T+4, based on the cumulative brightness value of frame i+1 and the brightness information of the pixels in frame i+3, the target RGB of the pixels in frame i+3 is output.

[0007] At time T+3, based on the brightness information of the pixels in frame i+2, the histogram of frame i+2 is obtained. At time T+4, based on the histogram of frame i+2, the cumulative brightness value of frame i+2 is obtained. At time T+5, based on the cumulative brightness value of frame i+2 and the brightness information of the pixels in frame i+4, the target RGB of the pixels in frame i+4 is output.

[0008] A second aspect of this application provides a screen display device, comprising:

[0009] The first processing module is used to obtain the histogram of the frame i at time T+1 based on the brightness information of the pixels in the frame i, and to obtain the cumulative brightness value of the frame i based on the histogram of the frame i at time T+2, and to output the target RGB of the pixels in the frame i+2 based on the cumulative brightness value of the frame i and the brightness information of the pixels in the frame i+2 at time T+3, wherein i and T are natural numbers that satisfy a set rule starting from 1;

[0010] The second processing module is used to obtain the histogram of the frame i+1 based on the brightness information of the pixels in the frame i+1 at time T+2, obtain the cumulative brightness value of the frame i+1 based on the histogram of the frame i+1 at time T+3, and output the target RGB of the pixels in the frame i+3 based on the cumulative brightness value of the frame i+1 and the brightness information of the pixels in the frame i+3 at time T+4.

[0011] The third processing module is used to obtain the histogram of the frame i+2 based on the brightness information of the pixels in the frame i+2 at time T+3, obtain the cumulative brightness value of the frame i+2 based on the histogram of the frame i+2 at time T+4, and output the target RGB of the pixels in the frame i+4 based on the cumulative brightness value of the frame i+2 and the brightness information of the pixels in the frame i+4 at time T+5.

[0012] A third aspect of this application provides an electronic device, including: a screen display device as described in a second aspect of this application.

[0013] A fourth aspect of this application provides an electronic device, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement the method proposed in the first aspect of this application.

[0014] A fifth aspect of this application provides a non-transitory computer-readable storage medium that, when instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to perform the method proposed in the first aspect of this application.

[0015] A sixth aspect of this application provides a computer program product including a computer program that, when executed by a processor in a communication device, implements the method proposed in the first aspect of this application.

[0016] The technical solution provided by the embodiments of this application brings at least the following beneficial effects: based on the cumulative brightness value of the current frame, the brightness information of pixels in a frame one frame apart can be remapped to obtain the target RGB of pixels in a frame one frame apart. In the process of determining the target RGB, since the cumulative brightness value of the current frame is referenced, the real-time brightness information of pixels in a frame one frame apart is adjusted, which can enhance the local contrast of the image and make the display effect of continuous image data more consistent.

[0017] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0018] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, wherein:

[0019] Figure 1 A flowchart illustrating a screen display method provided in an embodiment of this application;

[0020] Figure 2 A flowchart illustrating another screen display method provided in an embodiment of this application;

[0021] Figure 3 This is a schematic diagram illustrating the positional relationship between pixels and adjacent pixels provided in an embodiment of this application;

[0022] Figure 4 This is a schematic diagram illustrating the calculation of the neighborhood mean provided in an embodiment of this application.

[0023] Figure 5 A flowchart illustrating another screen display method provided in an embodiment of this application;

[0024] Figure 6 A flowchart illustrating another screen display method provided in an embodiment of this application;

[0025] Figure 7 A flowchart illustrating another screen display method provided in an embodiment of this application;

[0026] Figure 8 A flowchart illustrating another screen display method provided in an embodiment of this application;

[0027] Figure 9 This is a schematic diagram of the structure of the screen display device provided in the embodiments of this application;

[0028] Figure 10 This is a schematic diagram of the structure of the screen display device provided in the embodiments of this application;

[0029] Figure 11 This is a schematic diagram of the screen display method provided in an embodiment of this application;

[0030] Figure 12 This is a schematic diagram of the structure of an electronic device according to an embodiment of this application;

[0031] Figure 13 This is a schematic diagram of the structure of another electronic device provided according to an embodiment of this application;

[0032] Figure 14 This is a schematic diagram of another display chip provided according to an embodiment of this application. Detailed Implementation

[0033] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with those of this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of the embodiments of this application as detailed in the appended claims.

[0034] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to limit the embodiments of this application. The singular forms “a” and “the” as used in the embodiments of this application and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any or all possible combinations of one or more of the associated listed items.

[0035] It should be understood that although the terms first, second, third, etc., may be used to describe various information in the embodiments of this application, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other. For example, without departing from the scope of the embodiments of this application, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the words "if" and "suppose" as used herein can be interpreted as "when," "when," or "in response to a determination."

[0036] Embodiments of this application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application.

[0037] It should be noted that the screen display method provided in any embodiment of this application can be executed alone, or can be executed together with possible implementation methods in other embodiments, or can be executed together with any technical solution in related technologies.

[0038] The screen display method and apparatus of this application are described below with reference to the accompanying drawings.

[0039] Figure 1 This is a flowchart illustrating a screen display method provided in an embodiment of this application. Figure 1 As shown, the method includes, but is not limited to, the following steps:

[0040] S101: At time T+1, obtain the histogram of frame i based on the brightness information of the pixels in frame i, and at time T+2, obtain the cumulative brightness value of frame i based on the histogram of frame i. At time T+3, output the target RGB of the pixels in frame i+2 based on the cumulative brightness value of frame i and the brightness information of the pixels in frame i+2.

[0041] Where i and T are natural numbers starting from 1 that satisfy a set pattern.

[0042] The screen display method provided in this application is typically used on display devices, such as mobile phone screens, computer monitors, televisions, smart screens, and other devices.

[0043] It should be noted that the screen display method provided in this application embodiment may include multiple processing stages, each processing stage corresponding to a different processing device or module, and each processing device or module processes different screen frames at different times to achieve continuous processing of continuously input screen frames.

[0044] In order to ensure that the display device can output images in real time, the embodiments of this application require continuous processing of continuously input image frames. In some implementations, the values ​​of i and T can be 1, 4, 7, 10, 13, ... (3n-2), where n is a natural number greater than or equal to 1.

[0045] It is understandable that the brightness information of a pixel in frame i can be obtained at time T. This brightness information can include the pixel's brightness component and its average brightness. The brightness component of the pixel can characterize its actual brightness. In some implementations, neighboring pixels surrounding the pixel can be identified, and further, the average brightness of the pixel can be determined based on its brightness component and the brightness components of its neighboring pixels.

[0046] After obtaining the brightness information of the pixels in frame i at time T, the frequency of occurrence of the brightness information of the pixels in frame i can be statistically analyzed at time T+1 to obtain the histogram of frame i.

[0047] After obtaining the histogram of frame i at time T+1, the histogram of frame i is adjusted at time T+2, and the cumulative brightness value of frame i is obtained based on the adjusted histogram.

[0048] It is understood that in the embodiments of this application, the brightness information of the pixels in frame i+1 can be obtained at time T+1, and the brightness information of the pixels in frame i+2 can be obtained at time T+2.

[0049] In this embodiment, after obtaining the cumulative luminance value of frame i at time T+2, the luminance information of pixels in frame i+2 can be fused based on the cumulative luminance value of frame i at time T+3, and the target RGB of the pixels in frame i+2 can be output at that time. In some implementations, the luminance information of pixels in frame i+2 is fused based on the cumulative luminance value of frame i at time T+3 to obtain the target luminance component of the pixels in frame i+2. Further, the blue color difference component and red color difference component of the pixel are obtained. Based on the target luminance component, blue color difference component, and red color difference component of the pixel, the target RGB of the pixel is finally obtained. It can be understood that the luminance information of each pixel in frame i+2 is fused one by one based on the cumulative luminance value of frame i at time T+3, and the target RGB of each pixel in frame i+2 can be obtained one by one and displayed on the display device.

[0050] S102, at time T+2, based on the brightness information of the pixels in frame i+1, obtain the histogram of frame i+1, at time T+3, based on the histogram of frame i+1, obtain the cumulative brightness value of frame i+1, and at time T+4, based on the cumulative brightness value of frame i+1 and the brightness information of the pixels in frame i+3, output the target RGB of the pixels in frame i+3.

[0051] After acquiring the brightness information of pixels in frame i at time T, the brightness information of pixels in frame i+1 can be acquired again at time T+1. After acquiring the brightness information of pixels in frame i+1 at time T+1, the frequency of occurrence of the brightness information of pixels in frame i+1 can be statistically analyzed at time T+2 to obtain the histogram of frame i+1.

[0052] After obtaining the histogram of frame i+1 at time T+2, the histogram of frame i+1 is adjusted at time T+3, and the cumulative brightness value of frame i+1 is obtained based on the adjusted histogram.

[0053] It is understood that in the embodiments of this application, the brightness information of the pixels in frame i+1 can be obtained at time T+1, the brightness information of the pixels in frame i+2 can be obtained at time T+2, and the brightness information of the pixels in frame i+3 can be obtained at time T+3.

[0054] In this embodiment, after obtaining the cumulative luminance value of frame i+1 at time T+3, the luminance information of pixels in frame i+3 can be fused based on the cumulative luminance value of frame i+1 at time T+4, and the target RGB of the pixels in frame i+3 can be output at that time. In some implementations, the luminance information of pixels in frame i+3 is fused based on the cumulative luminance value of frame i+1 at time T+4 to obtain the target luminance component of the pixels in frame i+3. Further, the blue color difference component and red color difference component of the pixel are obtained. Based on the target luminance component, blue color difference component, and red color difference component of the pixel, the target RGB of the pixel is finally obtained.

[0055] S103: At time T+3, based on the brightness information of the pixels in frame i+2, obtain the histogram of frame i+2; at time T+4, based on the histogram of frame i+2, obtain the cumulative brightness value of frame i+2; and at time T+5, based on the cumulative brightness value of frame i+2 and the brightness information of the pixels in frame i+4, output the target RGB of the pixels in frame i+2.

[0056] After acquiring the brightness information of pixels in frame i+2 at time T+2, the brightness information of pixels in frame i+2 can be acquired again at time T+3. After acquiring the brightness information of pixels in frame i+1 at time T+3, the frequency of occurrence of the brightness information of pixels in frame i+2 can be statistically analyzed at time T+4 to obtain the histogram of frame i+2.

[0057] After obtaining the histogram of frame i+1 at time T+3, the histogram of frame i+2 is adjusted at time T+4, and the cumulative brightness value of frame i+2 is obtained based on the adjusted histogram.

[0058] It is understood that in the embodiments of this application, the brightness information of the pixels in frame i+1 can be obtained at time T+1, the brightness information of the pixels in frame i+2 can be obtained at time T+2, the brightness information of the pixels in frame i+3 can be obtained at time T+3, and the brightness information of the pixels in frame i+4 can be obtained at time T+4.

[0059] In this embodiment, after obtaining the cumulative luminance value of frame i+2 at time T+4, the luminance information of pixels in frame i+4 can be fused based on the cumulative luminance value of frame i+2 at time T+5, and the target RGB of the pixels in frame i+4 can be output at that time. In some implementations, the luminance information of pixels in frame i+4 is fused based on the cumulative luminance value of frame i+2 at time T+5 to obtain the target luminance component of the pixels in frame i+4. Further, the blue color difference component and red color difference component of the pixel are obtained. Based on the target luminance component, blue color difference component, and red color difference component of the pixel, the target RGB of the pixel is finally obtained.

[0060] It should be noted that, in the histogram statistics process for any frame in each embodiment of this application, it is necessary to count the luminance components of all pixels in any frame. After completing the statistics for all pixels, the histogram of any frame is obtained. Moreover, in the histogram statistics process for any frame, it is necessary to cache the previously counted luminance components to avoid losing the statistical results of the previous luminance components. Then, based on the luminance components of the current pixel, the count of occurrences of the same luminance component in the cache can be updated to obtain the final histogram.

[0061] For example, when i=1 and T=1, the brightness information of pixels in frame 1 can be acquired at time T=1, and the frequency of occurrence of the brightness information of pixels in frame 1 can be statistically analyzed at time T=2 to obtain the histogram of frame 1. At time T=3, the histogram of frame 1 is adjusted, and the cumulative brightness value of frame 1 is obtained based on the adjusted histogram. At time T=4, the brightness information of pixels in frame 3 is fused based on the cumulative brightness value of frame 1, and the target RGB of the pixels in frame 3 is output at this time.

[0062] In this embodiment, at time T=2, frame 2 is input, and the brightness information of the pixels in frame 2 is obtained. At time T=3, the frequency of occurrence of the brightness information of the pixels in frame 2 is statistically analyzed to obtain the histogram of frame 2. At time T=4, the histogram of frame 2 is adjusted, and the cumulative brightness value of frame 2 is obtained based on the adjusted histogram. At time T=5, based on the cumulative brightness value of frame 2, the brightness information of the pixels in frame 4 is fused, and the target RGB of the pixels in frame 4 is output at this time.

[0063] In this embodiment, at time T=3, frame 3 is input, and the brightness information of the pixels in frame 3 is obtained. At time T=4, the frequency of occurrence of the brightness information of the pixels in frame 3 is statistically analyzed to obtain the histogram of frame 3. At time T=5, the histogram of frame 3 is adjusted, and the cumulative brightness value of frame 3 is obtained based on the adjusted histogram. At time T=6, based on the cumulative brightness value of frame 3, the brightness information of the pixels in frame 5 is fused, and the target RGB of the pixels in frame 5 is output at this time.

[0064] The screen display method provided in this application includes three processing paths, each of which processes the input screen frame according to the same processing flow. Moreover, there is a certain temporal offset between the same processing models of the three processing paths. This not only avoids confusion and overlap of screen data, but also ensures continuous display of the screen on the display device through the temporal interleaving strategy of the three processing paths.

[0065] Understandably, to prevent pixel confusion and overwriting, each frame needs to be kept in an enabled state during processing. That is, upon receiving the first pixel in the frame, a frame enable signal is generated based on the pixel's frame identifier. This enable signal indicates that the frame is ready for processing. In this embodiment, each processing module can perform processing operations on the pixels within the frame under the control of the frame enable signal. Once the processing flow for all pixels in the frame is complete, the frame enable signal can be terminated.

[0066] In this embodiment of the application, there are three processing paths. The first processing path takes into account the first frame, the fourth frame, the seventh frame... the 3n-2th frame... and can be used with Y. 1_en This indicates that the input frame of the first processing path is in an enabled state;

[0067] The second processing path takes in the second frame, the fifth frame, the eighth frame... the (3n-1)th frame... and can be processed using Y. 2_en This indicates that the input frame of the second processing path is in an enabled state;

[0068] The third processing path inputs the third frame, the sixth frame, the ninth frame... the 3nth frame..., which can be used with Y... 3_en This indicates that the input frame of the third processing path is enabled.

[0069] The screen display method provided in this application can perform histogram adjustment on screen frames and, based on the cumulative brightness value obtained from the adjusted histogram, perform brightness remapping on the brightness information of pixels in screen frames separated by one frame, obtaining new brightness components of pixels in screen frames separated by one frame. In the process of determining the new brightness components of pixels, the results of histogram adjustment of previous screen frames are referenced, which can be used to enhance screen contrast. Furthermore, the neighborhood mean value of pixels in screen frames separated by one frame is also referenced, which helps to make the display effect of consecutive screen frames more consistent. Further, in this application embodiment, each processing path processes the input screen frames according to the same processing flow, and there is a certain temporal offset between the same processing models of each processing path. This not only avoids confusion and overlap of screen data, but also ensures continuous display of the screen on the display device through the temporal interleaving strategy of each processing path.

[0070] Based on the above embodiments, Figure 2 This is a flowchart illustrating another screen display method provided in an embodiment of this application. Figure 2 As shown, this method explains the process of acquiring the brightness information of pixels in any frame:

[0071] S201, for any pixel P in any frame xy Perform a conversion from the RGB domain to the YCbCr domain to obtain pixel P. xy YCbCr information.

[0072] S202, based on pixel P xy YC b C r Information, to obtain pixel P xy The brightness component.

[0073] Among them, pixel P xy This represents the pixel in the x-th row and y-th column, where x is an integer greater than or equal to 2 and y is an integer greater than or equal to 1.

[0074] In some implementations, pixel P in any frame is obtained. xy RGB information, and from the RGB domain to the YC domain b C r The first color gamut mapping matrix during domain transformation. Further, the first color gamut mapping matrix and pixel P... xy Perform matrix operations on the RGB information to obtain pixel P. xy YC b C r Information, in which pixel P xy YC b C r The information may include pixel P xyThe brightness component, blue color difference component, and red color difference component.

[0075] For example, the first color gamut mapping matrix is ​​set as follows:

[0076]

[0077] In any frame, pixel P is acquired. xy After obtaining the RGB information, the color gamut can be converted using the following formula:

[0078]

[0079] Where Y represents the luminance component, C b The component representing the blue color difference, C r This represents the component of red color difference.

[0080] To reduce computational complexity and cost, floating-point multiplication can be converted into shift and addition operations using bitwise operations. Optionally, for pixel P... xy After performing color gamut conversion on the RGB information, it can be targeted at YC. b C r Any one of the luminance component, blue color difference component, and red color difference component in the information is shifted by the matrix operation result of any one component to obtain the shift operation result of any one component. Furthermore, the shift operation result is truncated to a set number of bits from the high bit to the low bit to obtain the target operation result of any one component.

[0081] For example, after color gamut conversion using the above formula, the luminance component of any pixel in an 8-bit input frame can be expressed as: 1024*Y = 306R + 601G + 116B. Furthermore, the matrix operation result can be shifted to obtain the final target result.

[0082] 1024*Y=306R+601G+116B=(R<<8+R<<4+R<<1)+(G<<9+G<<6+G<<4+G<<3+G)+(B<<6+B<<5+B<<4+B<<2);

[0083] After completing the above shift operation, the result of the above calculation can be shifted 10 bits from left to right (from high bit to low bit) to obtain the target calculation result of the pixel's luminance component Y. Similarly, for the blue color difference component C... b and red color difference component C r The same steps as those used for the luminance component Y are applied.

[0084] S203, Obtain pixel P xyThe adjacent pixels, and based on pixel P xy The luminance component of the pixel and the luminance component of each adjacent pixel are used to obtain P. xy The average luminance component.

[0085] In some implementations, pixel P can be determined using a translation matrix of size M*M. xy The size of the neighborhood will determine the pixel P within that neighborhood. xy The neighboring pixels of the matrix, where M is an integer greater than or equal to 1. For example, pixel P can be obtained using a 3x3 movement matrix. xy The 8 adjacent pixels of pixel P xy Pixel P is located at the center of the neighborhood enclosed by 8 adjacent pixels. xy The positional relationship between it and its adjacent pixels can be shown in Figure 3.

[0086] In some implementations, during the process of acquiring the brightness information of pixels in the (x+1)th row one by one, if the current pixel in the (x+1)th row is pixel P... xy The last adjacent pixel is obtained from the first buffer queue, and the sum of the pixels in row x-1 and belonging to pixel P is obtained. xy The brightness information of adjacent pixels is obtained, and the pixel P in the x-th row is retrieved from the second buffer queue. xy The brightness information of adjacent pixels. Further, for pixel P... xy The luminance component of pixel P is averaged with the luminance components of each adjacent pixel to obtain pixel P. xy The average brightness. It is understandable that, as shown in Figure 3, pixel P... xy The last adjacent pixel is the pixel in the bottom right corner of the image.

[0087] In obtaining pixel P xy In the process of averaging the luminance components, the luminance components of each adjacent pixel are needed, which means the luminance components of the pixel P in the (x-1)th row are needed. xy The luminance components of adjacent pixels, the pixel P in the x-th row xy The luminance components of the adjacent pixels, and the pixel P in the (x+1)th row. xy The brightness information of adjacent pixels. In this embodiment of the application, during the acquisition of the brightness information of the pixel in the (x+1)th row, it is necessary to calculate the brightness information of pixel P. xy The average brightness component, i.e., pixel P xy The average luminance component relative to pixel P xy The luminance component has a time delay, in order to achieve pixel P xyTo obtain the average luminance component, optionally, two buffer queues need to be set in advance, including a first buffer queue and a second buffer queue. The first buffer queue and the second buffer queue can be used to buffer the luminance information of the pixels in the (x-1)th row and the luminance information of the pixels in the xth row, respectively.

[0088] In the process of obtaining the brightness information of the pixel in the (x+1)th row, since the first cache queue and the second cache queue store the brightness information of the pixel in the (x-1)th row and the xth row respectively, the brightness information of the pixel in the (x+1)th row can be cached through the cache in the memory pool, waiting for one of the cache queues to be released.

[0089] When the average luminance component of the last pixel in row x is obtained, the luminance information of the pixels in row x-1 in the first cache queue is cleared, and the luminance information of the pixels in row x+1 cached in memory is cached in the first cache queue. Optionally, the luminance information of the pixels in row x cached in the second cache queue can be cached in the first cache queue, and the luminance information of the pixels in row x+1 cached in memory can be cached in the first cache queue.

[0090] like Figure 4 As shown, two First-In-First-Out (FIFO) buffer queues, FIFO1 and FIFO2, are set up, each connected to the averaging unit. FIFO1 can buffer the brightness information of the pixels in the x-th row, and FIFO2 can buffer the brightness information of the pixels in the (x-1)-th row. When the pixel P in the (x+1)-th row and (y+1)-th column is obtained... x+1,y+1 (pixel P) xy After performing luminance component analysis on the last adjacent pixel, the mean value calculation unit can read from the buffer queues FIFO1 and FIFO2. From FIFO1, the pixel P in the xth row can be read. xy The brightness information of adjacent pixels can be read from FIFO2, specifically pixel P in the (x-1)th row. xy The brightness information of adjacent pixels is obtained, and the pixel P in the (x+1)th row is read from memory. xy The brightness information of the adjacent pixels, and pixel P xy The brightness information is used to determine the pixel P. xy Average brightness information.

[0091] It should be noted that there may be cases where adjacent pixels are missing for pixels on edge rows and edge columns. In this embodiment, for pixels P on edge rows and edge columns... xy Determine pixel P xyThe existing and missing neighboring pixels are identified, and the brightness information of the existing neighboring pixels is obtained. Brightness information is then padded for the missing neighboring pixels. Further, based on pixel P... xy The luminance component of the pixel and the luminance component of each adjacent pixel are used to obtain P. xy The average luminance component.

[0092] Optionally, the brightness information of missing adjacent pixels can be completed based on a set value, or the brightness information of missing adjacent pixels can be completed based on the brightness information of existing adjacent pixels. For example, the average value of the brightness information of existing adjacent pixels can be obtained, and the brightness information of missing adjacent pixels can be completed based on the average value; or, for another example, the brightness information of existing adjacent pixels can be weighted, and the brightness information of missing adjacent pixels can be completed based on the weighted brightness information.

[0093] It is understandable that edge rows include the first and last rows of the image frame, and edge columns include the first and last columns of the image frame.

[0094] The screen display method provided in this application embodiment can perform color gamut conversion on the RGB information of pixels in the current screen frame to output the YC of the pixels. b C r Information is obtained to acquire the luminance component and average luminance component of the pixel, providing data for subsequent processing stages.

[0095] Contrast ratio is one of the factors affecting the image quality of a display. Global contrast enhancement can improve the quality of images with low contrast, but it can also lead to poor local image quality. To address this issue, after obtaining the luminance components of pixels in a frame, the frame can be segmented, and the display method provided in this application can be executed on a block-by-block basis to enhance local contrast and improve image quality.

[0096] It is understood that the processing time of a frame block and the frame to which it belongs is the same in subsequent processing stages. That is, the processing time of the frame block of frame i in subsequent processing stages is the same as the processing time of frame i in subsequent processing stages in the above embodiment; the processing time of the frame block of frame i+1 in subsequent processing stages is the same as the processing time of frame i+1 in subsequent processing stages in the above embodiment; and the processing time of the frame block of frame i+1 in subsequent processing stages is the same as the processing time of frame i+1 in subsequent processing stages in the above embodiment.

[0097] For ease of explanation, the specific processing procedure for any given frame may include, but is not limited to, the following steps: Figure 5 As shown.

[0098] S501, after obtaining the brightness information of the pixels in the frame, segments the frame.

[0099] After obtaining the brightness information of the pixels in the image frame, in order to further enhance the contrast of the image detail area and avoid excessive amplification of noise in the background and flat areas, the image frame can be segmented. For example, the image frame can be divided into matrix image blocks of the same size that do not overlap.

[0100] S502: For any pixel in different pixel blocks, obtain the histogram of the pixel block based on the brightness information of the pixels in the pixel block.

[0101] S503, based on the histogram of the picture block, obtains the cumulative brightness value of the picture block.

[0102] S504, based on the cumulative brightness value of the picture block and the brightness information of the pixels in the same picture block in the fused picture frame, outputs the target RGB of the pixels in the picture block, wherein there is a one-frame interval between the fused picture frame and the picture frame to which the picture block belongs.

[0103] It should be noted that the processing time of a frame block and the frame to which it belongs is the same in subsequent processing stages. For example, if any frame is frame i, the brightness information of the pixels in frame i is acquired at time T. Frame i is segmented at time T+1, and the histogram of each frame block is acquired at time T+1. At time T+2, based on the histogram of each frame block, the cumulative brightness value of each frame block is obtained. In this embodiment, the fused frame of frame i is frame i+2. Further, based on the cumulative brightness value of the frame blocks in frame i and the brightness information of the pixels in the same frame block in frame i+2, the target RGB of the pixels in the frame blocks of frame i+2 is output. It should be noted that each frame can be divided into N frame blocks. Then, the cumulative brightness value of the nth frame block in frame i is used to fuse the brightness information of the pixels in the nth frame block in frame i+2 to obtain the target RGB of the pixels in the first frame block of frame i+2.

[0104] Any frame is designated as frame i+1. At time T+1, the luminance information of the pixels in frame i+1 is acquired. At time T+2, frame i+1 is segmented, and the histogram of each frame block is acquired at time T+2. At time T+3, based on the histogram of each frame block, the cumulative luminance value of each frame block is obtained. In this embodiment, the fused frame i+1 is frame i+3. Further, based on the cumulative luminance value of the frame blocks in frame i+1 and the luminance information of pixels in the same frame blocks in frame i+3, the target RGB of the pixels in the frame blocks of frame i+3 is output.

[0105] Any frame is frame i+2. At time T+2, the brightness information of the pixels in frame i+1 is acquired. At time T+3, frame i+2 is segmented, and at time T+4, the histogram of each frame block is acquired. At time T+5, based on the histogram of each frame block, the cumulative brightness value of each frame block is obtained. In this embodiment, the fused frame of frame i+1 is frame i+4. Further, based on the cumulative brightness value of the frame blocks in frame i+2 and the brightness information of the pixels in the same frame blocks in frame i+4, the target RGB of the pixels in the frame blocks of frame i+4 is output.

[0106] After dividing the image frame into blocks, the image block to which the pixel belongs can be determined based on the coordinates of the currently input pixel, and a first enable signal for that image block can be generated. In this embodiment, the first enable signal can be used to indicate that the image block is in a state where related processing operations can be performed. Optionally, row counters and column counters are used to count the rows and columns of the image frame. The results of the two counters can determine the coordinates of the pixel in the entire image frame. Based on the input block size parameter, the image block to which the pixel coordinates belong is determined, and the first enable signal for that image block is output, so that subsequent processing modules can perform related processing operations based on the first enable signal of each image block.

[0107] Understandably, while processing a frame block, it's also necessary to keep the frame to which that frame block belongs in an enabled state. That is, upon receiving the first pixel in the frame, a second enable signal for the frame is generated based on the pixel's frame identifier. This second enable signal indicates that the frame is in a state where relevant processing operations can be performed. With the frame in an enabled state, relevant processing operations can be performed on the image block in that enabled state.

[0108] In this embodiment of the application, after obtaining the luminance component of the pixel in the image frame, the image frame can be segmented. The image frame can be segmented into images, and subsequent processing operations can be performed on images as units. Image segmentation can enhance local contrast, such as enhancing the contrast of image detail areas, while avoiding the problem of excessive amplification of noise in the background and flat areas, thus better improving image quality.

[0109] Based on the above embodiments, Figure 6 This is a flowchart illustrating another screen display method provided in an embodiment of this application. Figure 6 The process of obtaining the histogram of any frame data to be processed in a frame or frame block is explained as shown:

[0110] S601, selects the first memory and the second memory.

[0111] To address the issue of inaccurate calculations when reading and writing the same luminance component, two memories can be used, such as a first memory and a second memory, to perform ping-pong operations on odd / even column pixels during the statistical process. In the process of histogram statistics based on luminance components, it is necessary to distinguish between 256 luminance components and continuously write and read data. Therefore, the entire histogram statistical process requires a memory capable of simultaneous read and write operations. Optionally, the first memory can be Random Access Memory (RAM).

[0112] Optionally, using an odd-even counter to select the first and second memories can achieve the purpose of ping-pong statistics for odd-numbered and even-numbered pixel columns, allowing time to rewrite the newly counted structure.

[0113] S602, the brightness components of odd-numbered columns of pixels in the image data to be processed are counted through the first memory, and the brightness components of even-numbered columns of pixels in the image data to be processed are counted through the second memory.

[0114] In some implementations, a read address is determined for each luminance component in the image data to be processed. The storage space indicated by this read address is used to store the occurrence count of the corresponding luminance component. The pixels in the image data to be processed are traversed. When counting the luminance components of the current traversed pixel, the accumulated occurrence count of the luminance component is obtained based on the read address corresponding to the current traversed pixel's luminance component. The accumulated occurrence count is updated and stored again in the storage space corresponding to the read address, until all pixels in the image data to be processed have been traversed.

[0115] In other words, when traversing the entire image data to be processed, YC b C r The Y component is used as the horizontal axis of the luminance distribution map, and the number of occurrences of the luminance component is used as the vertical axis. The occurrence count of each luminance component is initialized to 0, and a read address is allocated to each luminance component. The storage space indicated by the read address can store the count of occurrences of that luminance component.

[0116] Starting from the first pixel, the process iterates through the luminance component of the current pixel. Based on the read address corresponding to the luminance component, the current cumulative occurrence count is read from the storage location, and the read cumulative occurrence count is incremented by 1. The data is then rewritten into RAM according to the read address corresponding to the luminance component. Through the above process, the frequency of occurrence of each luminance component can be counted, and finally, a histogram of the image data to be processed can be obtained.

[0117] S603, add the statistical results of the odd-numbered columns of pixels together to obtain the histogram of the image data to be processed.

[0118] It should be noted that, in the histogram statistics process for any frame in each embodiment of this application, it is necessary to count the luminance components of all pixels in any frame. After completing the statistics for all pixels, the histogram of any frame is obtained. Moreover, in the histogram statistics process for any frame, it is necessary to cache the previously counted luminance components to avoid losing the statistical results of the previous luminance components. Then, based on the luminance components of the current pixel, the count of occurrences of the same luminance component in the cache can be updated to obtain the final histogram.

[0119] It is understandable that after obtaining the cumulative brightness value of the image data to be processed based on the histogram of the image data to be processed, the first memory and the second memory can be cleared to be used for histogram statistics of the next image data to be processed; or, when the next image data to be processed arrives, it is necessary to clear the histogram of the currently processed image data.

[0120] In this embodiment of the application, after obtaining the luminance component of the pixel in the image frame, histogram statistics can be performed based on the luminance component. During the histogram statistics process, ping-pong operation can be performed on the odd-numbered and even-numbered pixel columns through the first memory and the second memory. This not only solves the problem of inaccurate calculation when reading and writing the same luminance component, but also allows time for the rewriting of the statistical results.

[0121] Based on the above embodiments, Figure 7 This is a flowchart illustrating another screen display method provided in an embodiment of this application. Figure 7 The process of determining the cumulative brightness value of any image data to be processed in a frame or block is explained as shown below:

[0122] S701, based on the luminance components of the pixels in the image data to be processed, obtain the total average luminance and maximum luminance component of the image data to be processed.

[0123] The average luminance components of all pixels in the image data to be processed are averaged to obtain the total average luminance value of the image data. The total average luminance value can be determined using the following formula:

[0124] α = ∑Y / A; where α represents the average total brightness, Y represents the brightness component of a pixel, and A represents the total number of pixels in the image data to be processed.

[0125] Furthermore, the luminance components of all pixels in the image data to be processed are sorted or compared to determine the maximum luminance component of the image data to be processed.

[0126] S702, based on the total average brightness and the maximum brightness component, obtain the adjustment threshold of the histogram.

[0127] After obtaining the mean total brightness and the maximum brightness component, the adjustment threshold of the histogram is obtained according to the set mapping rules based on the mean total brightness and the maximum brightness component. The adjustment threshold of the histogram can be determined using the following formula:

[0128] δ=g(α,L max ); where α represents the mean total brightness, δ represents the adjustment threshold of the histogram, and L max This represents the maximum luminance component of the image data to be processed, and g() represents the relationship between δ and L. max Mapping rules between them.

[0129] For example, the ratio of the total average brightness to the maximum brightness component can be obtained, and this ratio can be used to determine the adjustment threshold of the histogram.

[0130] S703, adjust the histogram of the image data to be processed based on the adjustment threshold to obtain the adjusted histogram of the image data to be processed.

[0131] After obtaining the adjustment threshold of the histogram, the histogram of the image data to be processed is adjusted to obtain the adjusted histogram of the image data to be processed. Optionally, the histogram of the image data to be processed is adjusted to obtain the adjusted histogram.

[0132] For example, the adjusted histogram can be determined using the following formula:

[0133] N' l =h(N) l ,δ); where l∈[0,L max ], N i N' represents the number of occurrences of the luminance component l in the histogram. i This indicates the number of times the luminance component l appears in the adjusted histogram.

[0134] S704 performs an accumulation operation on the adjusted histogram to obtain the cumulative brightness value of the image data to be processed.

[0135] After obtaining the adjusted histogram, an accumulation operation can be performed on the adjusted histogram to obtain the cumulative brightness value of the image data to be processed. The cumulative brightness value can be determined using the following formula:

[0136] Where, l∈[0,L] max ], i.e. S l =S l-1 +N' l Among them, S l S represents the sum of the luminance components l.l This represents the sum of the luminance values ​​of the luminance component l-1.

[0137] In this embodiment of the application, after obtaining the adjusted histogram of the image frame, a brightness summation operation can be performed on the adjusted histogram to obtain a brightness summation value. This brightness summation value provides data for subsequent processing stages, so as to enhance the contrast of the image frame and improve image quality.

[0138] Based on the above embodiments, Figure 8 This is a flowchart illustrating another screen display method provided in an embodiment of this application. Figure 8 The following explains the process of outputting the target RGB values ​​of pixels in any frame or block of image data:

[0139] S801, determine the fused image data corresponding to the image data to be processed, wherein the image frame to which the fused image data belongs is separated from the image frame to which the image data to be processed belongs by one frame.

[0140] It is understandable that if the image data to be processed is a single image frame i, the fused image data is image frame i+2; if the image data to be processed is a block of image data in image frame i, the fused image data is the same block of image data in image frame i+2.

[0141] If the image data to be processed is a single image frame i+1, the merged image data is image frame i+3; if the image data to be processed is a block of image data in image frame i+1, the merged image data is the same block of image data in image frame i+3.

[0142] If the image data to be processed is a single image frame i+2, the merged image data is image frame i+4; if the image data to be processed is a block of image data in image frame i+2, the merged image data is the same block of image data in image frame i+4.

[0143] S802, based on the luminance components of pixels in the fused image data and the cumulative luminance value of the image data to be processed, determine the target luminance components of pixels in the image data to be processed.

[0144] In some implementations, the luminance information of each pixel in the frame to which the image data to be processed belongs is obtained, and the maximum luminance component of the frame is determined based on the luminance information of each pixel in the frame. Histogram adjustments are performed on the frame to which the image data to be processed belongs, either globally or locally. After accumulating the luminance value of the image data to be processed, the luminance components of pixels in the continuously input fused image data can be fused one by one based on the accumulated luminance value to output the target luminance component of the pixels in the image data to be processed.

[0145] Optionally, the reading address corresponding to the luminance component of the pixel in the currently input fused image data can be determined, and the stored target luminance sum value can be read from the storage space indicated by the reading address. Further, the luminance component mapping parameters of the pixel in the image data to be processed can be obtained based on the target luminance sum value, the maximum luminance component, and the total number of pixels included in the image data to be processed.

[0146] For example, the luminance component mapping parameter H of the j-th pixel can be determined using the following formula. j :

[0147] H j =L max *S j / A; where H j L represents the luminance component mapping parameter of the j-th pixel. max S represents the maximum luminance component of the frame to which the image data to be processed belongs, A represents the total number of pixels included in the image data to be processed, and S represents the maximum luminance component of the frame to which the image data to be processed belongs. j This represents the cumulative target luminance value corresponding to the luminance component of the j-th pixel.

[0148] Furthermore, after obtaining the luminance component mapping parameters of the pixels, the average luminance component of the frame to which the fused image data belongs is determined. Based on the luminance component mapping parameters of the pixels, the average luminance component of the frame to which the fused image data belongs can be luminance mapped to obtain the target luminance component of the pixels in the image data to be processed.

[0149] For example, the target luminance component Y of the j-th pixel can be determined using the following formula. j ':

[0150] in, Y represents the average luminance component of the frame to which the merged image data belongs. j ' represents the target luminance component of the j-th pixel.

[0151] S803 outputs the target RGB information of the pixels in the image data to be processed based on the target luminance component, blue color difference component and red color difference component of the pixels in the image data to be processed.

[0152] In some implementations, the pixels in the image data to be processed are converted from RGB to YC domain. b C r Domain transformation allows us to obtain the blue and red color difference components of a pixel. We can obtain the RGB information of pixels in the image data to be processed and the first color gamut mapping matrix. Matrix operations are then performed on the first color gamut mapping matrix and the RGB information of the pixel to obtain the pixel's YC value. b C rInformation, including YC b C r The information includes the luminance component, blue chromatic aberration component, and red chromatic aberration component of the pixel. It can be understood that the YC of this pixel... b C r The information can be obtained during the color gamut conversion process in extracting brightness information. The brightness component, blue color difference component, and red color difference component of the pixel can be obtained directly from the cache.

[0153] Furthermore, based on the target luminance component, blue color difference component, and red color difference component of the pixels in the image data to be processed, the target YC of the pixels in the image data to be processed is obtained. b C r information.

[0154] When acquiring the target luminance component of a pixel in the image data to be processed, it can be obtained from the pixel's YC... b C r The blue and red color difference components are obtained from the information. Further, the target luminance component, blue color difference component, and red color difference component of the pixel are combined to obtain the target YC of the pixel. b C r information.

[0155] In acquiring the target YC of the pixels b C r After receiving the information, the target YC of the pixels in the image data to be processed can be determined. b C r Information, conducting YC b C r The reverse conversion from the RGB domain is performed to obtain the target RGB information of the pixels in the image data to be processed and output it. After obtaining the target YC of the pixels in the image data to be processed... b C r Information, in order to be displayed on a display device, can be targeted at the pixel YC. b C r Information, conducting YC b C r The reverse conversion from the YC domain to the RGB domain yields the target RGB information of the pixels in the image data to be processed, which is then output. In some implementations, the YC domain can be obtained... b C r The second color gamut mapping matrix, which performs an inverse transformation from the RGB domain to the RGB domain, is used to determine the second color gamut mapping matrix and the target YC of the pixel. b C r The information is used to perform matrix operations to obtain the target RGB information of the pixel.

[0156] The screen display method provided in this application embodiment can perform brightness remapping on the brightness information of pixels in a screen frame one frame apart based on the cumulative brightness value of the current screen frame, so as to obtain the target brightness component of the pixels in the current screen frame. In the process of determining the target brightness component, the cumulative brightness value can be referenced to enhance the local contrast of the screen, and the real-time brightness information of pixels in a screen frame one frame apart is also referenced, which is beneficial to improve the display effect of the current screen frame and make the display effect of subsequent screen data more consistent.

[0157] Figure 9 This is a schematic diagram of a screen display device according to an embodiment of this application. Figure 9 As shown, the screen display device 900 includes: a first processing module 910, a second processing module 920 and a third processing module 930;

[0158] The first processing module 910 is used to obtain the histogram of frame i at time T+1 based on the brightness information of the pixels in frame i, and to obtain the cumulative brightness value of frame i based on the histogram of frame i at time T+2, and to output the target RGB of the pixels in frame i+2 based on the cumulative brightness value of frame i and the brightness information of the pixels in frame i+2 at time T+3, where i and T are natural numbers that satisfy a set rule starting from 1.

[0159] The second processing module 920 is used to obtain the histogram of frame i+1 based on the brightness information of the pixels in frame i+1 at time T+2, obtain the cumulative brightness value of frame i+1 based on the histogram of frame i+1 at time T+3, and output the target RGB of the pixels in frame i+3 based on the cumulative brightness value of frame i+1 and the brightness information of the pixels in frame i+3 at time T+4.

[0160] The third processing module 930 is used to obtain the histogram of frame i+2 based on the brightness information of the pixels in frame i+2 at time T+3, obtain the cumulative brightness value of frame i+2 based on the histogram of frame i+2 at time T+4, and output the target RGB of the pixels in frame i+4 based on the cumulative brightness value of frame i+2 and the brightness information of the pixels in frame i+4 at time T+5.

[0161] In some possible implementations, the display device also includes a brightness extraction module 940.

[0162] The brightness extraction module 940 is used to acquire the brightness information of the pixels in frame i at time T; acquire the brightness information of the pixels in frame i+1 at time T+1; and acquire the brightness information of the pixels in frame i+2 at time T+2; wherein the brightness information includes brightness components and average brightness components.

[0163] The screen display method provided in this application embodiment can perform brightness remapping on the brightness information of pixels in screen frames one frame apart based on the cumulative brightness value of the current screen frame, so as to obtain the target brightness component of the pixels in the current screen frame. In the process of determining the target brightness component, the cumulative brightness value can enhance the local contrast of the screen, and the neighborhood average value of the pixels in screen frames one frame apart is also referenced, which helps to make the display effect of consecutive screen frames more consistent.

[0164] Figure 10 This is another structural schematic diagram of the screen display device according to an embodiment of this application. Figure 10 As shown, the screen display device 1000 includes: a first processing module 110, a second processing module 120, a third processing module 130, and a brightness extraction module 140;

[0165] The first processing module 110 is used to obtain the histogram of frame i at time T+1 based on the brightness information of the pixels in frame i, and to obtain the cumulative brightness value of frame i based on the histogram of frame i at time T+2, and to output the target RGB of the pixels in frame i+2 based on the cumulative brightness value of frame i and the brightness information of the pixels in frame i+2 at time T+3, where i and T are natural numbers that satisfy a set rule starting from 1.

[0166] The second processing module 120 is used to obtain the histogram of frame i+1 based on the brightness information of the pixels in frame i+1 at time T+2, obtain the cumulative brightness value of frame i+1 based on the histogram of frame i+1 at time T+3, and output the target RGB of the pixels in frame i+3 based on the cumulative brightness value of frame i+1 and the brightness information of the pixels in frame i+3 at time T+4.

[0167] The third processing module 130 is used to obtain the histogram of frame i+2 based on the brightness information of the pixels in frame i+2 at time T+3, obtain the cumulative brightness value of frame i+2 based on the histogram of frame i+2 at time T+4, and output the target RGB of the pixels in frame i+4 based on the cumulative brightness value of frame i+2 and the brightness information of the pixels in frame i+4 at time T+5.

[0168] In some possible implementations, the display device also includes a brightness extraction module 140.

[0169] The brightness extraction module 140 is used to acquire the brightness information of the pixels in frame i at time T; acquire the brightness information of the pixels in frame i+1 at time T+1; and acquire the brightness information of the pixels in frame i+2 at time T+2; wherein the brightness information includes a brightness component and an average brightness component.

[0170] In some possible implementations, the display device also includes a brightness extraction module 140.

[0171] The brightness extraction module 140 is used to acquire the brightness information of the pixels in frame i at time T; acquire the brightness information of the pixels in frame i+1 at time T+1; and acquire the brightness information of the pixels in frame i+2 at time T+2; wherein the brightness information includes a brightness component and an average brightness component.

[0172] In some possible implementations, the luminance extraction module 140 includes a color gamut conversion unit 141 and a neighborhood mean calculation unit 142.

[0173] Among them, the color gamut conversion unit 141 is used to convert pixel P in any frame of the image. xy Perform a conversion from the RGB domain to the YCbCr domain to obtain pixel P. xy YCbCr information, and based on pixel P xy The YCbCr information is used to obtain pixel P. xy The luminance component; where pixel P xy This represents the pixel in the x-th row and y-th column, where x is an integer greater than or equal to 2 and y is an integer greater than or equal to 1;

[0174] Neighborhood mean calculation unit 142 is used to obtain pixel P xy The adjacent pixels, and based on pixel P xy The luminance component of the pixel and the luminance component of each adjacent pixel are used to obtain P. xy The average luminance component.

[0175] In some possible implementations, the neighborhood mean calculation unit 142 is also used for:

[0176] During the process of acquiring the brightness information of each pixel in the (x+1)th row, if the current pixel in the (x+1)th row is pixel P xy The last adjacent pixel is obtained from the first buffer queue, and the sum of the pixels in row x-1 and belonging to pixel P is obtained. xy The brightness information of adjacent pixels is obtained, and the pixel P in the x-th row is retrieved from the second buffer queue. xy Brightness information of adjacent pixels;

[0177] For pixel P xy The luminance component of pixel P is averaged with the luminance components of each adjacent pixel to obtain pixel P. xy The average luminance component.

[0178] In some possible implementations, the neighborhood mean calculation unit 142 is also used for:

[0179] Cache the brightness information of the pixels in the (x+1)th row;

[0180] When the average luminance component of the last pixel in row x is obtained, the luminance information of the pixel in row x-1 in the first cache queue is cleared, and the luminance information of the pixel in row x+1 is cached in the first cache queue; or, the luminance information of the pixel in row x in the second cache queue is cached in the first cache queue, and the luminance information of the pixel in row x+1 is cached in the first cache queue.

[0181] In some possible implementations, the neighborhood mean calculation unit 142 is also used for:

[0182] For pixels P on edge rows and edge columns xy Determine P xy Existing adjacent pixels and missing adjacent pixels;

[0183] Obtain the brightness information of existing adjacent pixels and fill in the brightness information of missing adjacent pixels;

[0184] Based on pixel P xy The luminance component of the pixel and the luminance component of each adjacent pixel are used to obtain P. xy The average luminance component.

[0185] In some possible implementations, each of the first processing module 110, the second processing module 120, and the third processing module 130 is further configured to:

[0186] After obtaining the brightness information of the pixels in the frame, the frame is segmented.

[0187] For any pixel in different pixel blocks, the histogram of the pixel block is obtained based on the brightness information of the pixels in the pixel block. Based on the histogram of the pixel block, the cumulative brightness value of the pixel block is obtained. Based on the cumulative brightness value of the pixel block, the brightness information of the pixels in the same pixel block in the same frame is fused and the target RGB of the pixels in the pixel block is output.

[0188] In this process, the processing time of the image block and the image frame to which the image block belongs is the same in different subsequent processing stages, and there is a one-frame interval between the merged image frame and the image frame to which the image block belongs.

[0189] In some possible implementations, each of the first processing module 110, the second processing module 120, and the third processing module 130 includes: a histogram statistics unit, a histogram processing unit, and a brightness mapping unit;

[0190] The histogram statistics unit is used to obtain a histogram of the image data to be processed based on the brightness information of the pixels in the image data to be processed; wherein the image data to be processed is an image frame or an image block in an image frame;

[0191] The histogram processing unit is used to obtain the cumulative brightness value of the image data to be processed based on the histogram of the image data to be processed.

[0192] A luminance mapping unit is used to fuse the luminance information of pixels in the fused image frame based on the cumulative luminance value of the image data to be processed, so as to output the target RGB of the pixels in the image data to be processed. The fused image frame is separated from the image frame to which the image data to be processed belongs by one frame.

[0193] In some possible implementations, the histogram statistics unit is also used for:

[0194] Select the first memory and the second memory;

[0195] The brightness components of odd-numbered columns of pixels in the image data to be processed are counted using the first memory, and the brightness components of even-numbered columns of pixels in the image data to be processed are counted using the second memory.

[0196] The histogram of the image data to be processed is obtained by adding the statistical results of the odd-numbered columns of pixels together.

[0197] In some possible implementations, the histogram statistics unit is also used for:

[0198] After obtaining the cumulative brightness value of the image data to be processed based on the histogram of the image data to be processed, the first memory and the second memory are cleared.

[0199] In some possible implementations, the histogram statistics unit is also used for:

[0200] Determine the reading address corresponding to each luminance component in the image data to be processed, and the storage space indicated by the reading address is used to store the occurrence count of the corresponding luminance component;

[0201] The pixels in the image data to be processed are traversed. When the luminance component of the current pixel is counted, the cumulative occurrence count of the luminance component is obtained based on the read address of the current pixel luminance component. The cumulative occurrence count is updated and stored in the storage space corresponding to the read address until all pixels in the image to be processed have been traversed.

[0202] In some possible implementations, the histogram processing unit is also used for:

[0203] Based on the luminance components of the pixels in the image data to be processed, the average total luminance and the maximum luminance component of the image data to be processed are obtained.

[0204] The adjustment threshold of the histogram is obtained based on the total average brightness and the maximum brightness component.

[0205] The histogram of the image data to be processed is adjusted based on the adjustment threshold to obtain the adjusted histogram of the image data to be processed.

[0206] The adjusted histogram of the image data to be processed is summed to obtain the cumulative brightness value of the image data to be processed.

[0207] In some possible implementations, the luminance mapping unit is also used for:

[0208] Determine the fused image data corresponding to the image data to be processed, wherein the image frame to which the fused image data belongs is separated from the image frame to which the image data to be processed belongs by one frame;

[0209] Based on the luminance components of the pixels in the fused image data and the cumulative luminance value of the image data to be processed, the target luminance components of the pixels in the image data to be processed are determined.

[0210] In some possible implementations, the luminance mapping unit is also used for:

[0211] The luminance mapping unit is also used for:

[0212] Based on the brightness information of the pixels in the frame to which the image data to be processed belongs, the maximum brightness component of the frame to which the image data to be processed belongs is determined.

[0213] Determine the read address corresponding to the luminance component of the current pixel in the fused image data, and obtain the target luminance sum value stored in the storage space indicated by the read address;

[0214] Based on the target cumulative brightness value, the maximum brightness component, and the total number of pixels included in the image data to be processed, the brightness component mapping parameters of the pixels in the image data to be processed are obtained.

[0215] The target luminance component is obtained based on the luminance component mapping parameters and the average luminance component of the frame to which the fused image data belongs.

[0216] like Figure 10As shown, the first processing module 110 includes a histogram statistics unit 111, a histogram processing unit 112, and a brightness mapping unit 113; the second processing module 120 includes a histogram statistics unit 121, a histogram processing unit 122, and a brightness mapping unit 123; and the third processing module 130 includes a histogram statistics unit 131, a histogram processing unit 132, and a brightness mapping unit 133.

[0217] In some possible implementations, the screen display device in this application embodiment further includes an output control module 160.

[0218] The output control module 160 is used to obtain the target RGB information of the pixels in the image data to be processed based on the target brightness component and the blue and red color difference components of the pixels in the image data to be processed, and then output it.

[0219] In some possible implementations, the output control module 160 includes:

[0220] Output control unit 161 is used to output the target brightness component of the pixel in the image data to be processed;

[0221] Color gamut inverse conversion unit 162 is used to obtain the target YC of the pixels in the image data to be processed based on the target luminance component, blue color difference component, and red color difference component of the pixels in the image data to be processed. b C r Information; for the target YC of pixels in the image data to be processed. b C r Information, conducting YC b C r The reverse conversion from the RGB domain is performed to obtain the target RGB information of the pixels in the image data to be processed and output it.

[0222] In some possible implementations, the color gamut conversion unit 141 is also used for:

[0223] Obtain the RGB information and first color gamut mapping matrix of the pixel;

[0224] Perform matrix operations on the first color gamut mapping matrix and the RGB information of the pixel to obtain the YC of the pixel. b C r Information, including YC b C r The information includes the pixel's luminance component, blue color difference component, and red color difference component.

[0225] In some possible implementations, the color gamut conversion unit 141 is also used to: perform a shift operation on the matrix operation result of any one of the luminance component, blue color difference component and red color difference component to obtain the shift operation result of any one of the components.

[0226] The result of the shift operation is truncated to a set number of bits from the least significant bit to the most significant bit to obtain the target result of any component.

[0227] In some possible implementations, the screen display device further includes: an input control module 150,

[0228] In some possible implementations, the input control module 150 is used to determine the image block to which the pixel belongs based on the pixel's coordinates, so as to generate a first enable signal for the image block, which indicates that the image block is in a state where relevant processing operations can be performed.

[0229] In some possible implementations, the input control module 150 is also configured to, upon receiving a pixel in any frame, generate a second enable signal for any frame based on the frame identifier of the pixel, the second enable signal being used to indicate that any frame is in a state where related processing operations can be performed.

[0230] The image display method provided in this application embodiment can perform luminance remapping on the luminance information of pixels in an image frame one frame apart based on the cumulative luminance value of the current image frame, to obtain the target luminance component of the pixels in the current image frame. In determining the target luminance component, referencing the cumulative luminance value enhances the local contrast of the image, and also considers the real-time luminance information of pixels in an image frame one frame apart, which helps to improve the consistency between the display effect of the current image frame and the display effect of subsequent image data. Furthermore, after obtaining the luminance component of the pixels in the image frame, the image frame can be segmented. This segmentation allows for subsequent processing operations on image blocks as units. Image segmentation can enhance local contrast, such as enhancing the contrast of detailed areas of the image, while avoiding the problem of excessive amplification of noise in the background and flat areas, thus better improving image quality.

[0231] Figure 11 This is a schematic diagram of a process displayed on a screen according to an exemplary embodiment. For example... Figure 11 As shown, the display device includes: a color gamut conversion unit, a mean calculation unit, an input control unit, and three processing branches. Each processing branch includes a histogram statistics unit, a mapping function calculation unit (such as the histogram processing unit in the above embodiment), a brightness mapping unit, an output control unit, and a color gamut inverse conversion unit.

[0232] In this embodiment, the input terminal of the color gamut conversion unit receives the input image frame, and the output terminal of the color gamut conversion unit is connected to the input terminal of the mean calculation unit to perform neighborhood mean calculation on the pixels in the image frame.

[0233] The output of the mean calculation unit is connected to the input of the input control unit, and the output of the input control unit is connected to each of the three processing branches. The input control unit generates an enable signal for the current frame after the mean of all pixels in the frame has been calculated, allowing it to continue inputting into the corresponding processing branch for subsequent operations.

[0234] In this system, the input of the histogram statistics unit in the three processing branches is connected to the output of the input control unit. The output of the histogram statistics unit is connected to the input of the mapping function calculation unit. The input of the mapping function calculation unit is connected to the outputs of both the mapping function calculation unit and the input control unit. After the input control unit calculates the neighborhood mean of pixels in the fused frame (i.e., a frame separated from the previous frame), it generates an enable signal for that fused frame. This allows pixels in the fused frame to be input to the luminance mapping unit. The luminance mapping unit then uses the cumulative luminance value of the previous frame to perform luminance mapping with the currently input pixel in the fused frame, obtaining the target luminance component after fusion of the same pixel in the previous frame.

[0235] Furthermore, the output of the luminance mapping unit is connected to the input of the output control unit, the input of the output control unit is connected to the input of the input control unit, and the output of the output control unit is connected to the color gamut inverse mapping unit. The input control unit can input an enable signal corresponding to each frame in the three branches to the output control unit, where the input time of the enable signal is different for different frames. Under the control of the enable signal, the output control unit can input the target luminance component of the pixels in the enabled frame into the color gamut inverse conversion unit for color gamut inverse conversion to obtain the target RGB of the pixels in the frame.

[0236] like Figure 11 As shown, each processing branch includes two RAMs: one RAM for histogram statistics and the other RAM for mapping function calculation.

[0237] For example, the RGB values ​​of a pixel in frame 1 are input into the color gamut conversion unit at time T to obtain the YC values ​​of the pixel in frame 1. b C r Information, including YC b C rThe Y component in the information is input to the neighborhood mean calculation unit, which outputs the pixel's luminance component and average luminance component, and then inputs these components to the control unit. After the neighborhood calculation of all pixels in frame 1 is completed, the input control unit can generate the effective enable signal Y1_en for frame 1 and the effective enable signal Zone_con for the frame block containing the pixel. At time T+1, the input control unit can perform statistics on the histogram statistics unit 1 in processing branch 1 and cache the histogram in RAM. 1-1 In the middle. At time T+2, the input mapping function calculation unit 1 is used to obtain the cumulative brightness value of frame 1, and the cumulative brightness value is cached in RAM. 1-2 In the middle. At time T+3, the input control unit can input the brightness information of the pixels of frame 3 and the enable signal (Y3_en) of frame 3 to the brightness mapping unit 1, so that the brightness mapping unit 1 can be based on RAM. 1-2 The cumulative brightness value of frame 1 in the image is used to perform brightness mapping on the brightness information of pixels in frame 3, so as to obtain Y1' of the same pixel in frame 3, that is, the target brightness component of the pixel.

[0238] It is understandable that after the brightness mapping is completed at time T+3, the RAM can be accessed. 1-1 The histogram of frame 1 in the buffer is cleared and used for the histogram buffer of frame 4.

[0239] At time T+3, the output control unit can receive the enable signals of frame 1 and frame 3 output by the input control unit. Under the control of the enable signals, Y1' is input to the color gamut inverse conversion unit at this time. The color gamut inverse conversion unit can obtain the C of the pixel from the color gamut conversion unit. b And Cr, the three components are combined to obtain the YC of the pixel. b C r 'i.e., the target YC of the pixel' b C r Information, and the YC of the pixel b C r Perform a reverse conversion to obtain the R'G'B' of the pixels in frame 3.

[0240] The RGB values ​​of the pixels in frame 2 are input into the color gamut conversion unit at time T+1 to obtain the YC values ​​of the pixels in frame 2. b C rThe information processing unit outputs the luminance component and average luminance component of each pixel from the neighborhood mean calculation unit, and inputs these components into the control unit. After completing the neighborhood calculation for all pixels in frame 2, the input control unit can generate the effective enable signal Y2_en for frame 2, and the effective enable signal Zone_con for the frame block containing that pixel. At time T+2, the input control unit can perform statistics on the histogram statistics unit 2 in processing branch 2 and cache the histogram in RAM. 2-1 In the middle. At time T+3, the mapping function calculation unit 2 is input to obtain the cumulative brightness value of frame 2, and the cumulative brightness value is cached in RAM. 2-2 At time T+4, the input control unit can input the brightness information of the pixels of frame 4 and the enable signal (Y4_en) of frame 4 into the brightness mapping unit 2, enabling the brightness mapping unit 2 to perform operations based on RAM. 2-2 The cumulative luminance value of frame 2 in the image is used to perform luminance mapping on the luminance information of pixels in frame 4, resulting in Y2' of the same pixel in frame 4, which is the target luminance component of that pixel. It can be understood that after the luminance mapping is completed at time T+4, the RAM can be accessed. 2-1 The histogram in the buffer is cleared to zero, and used for the histogram buffer of frame 5.

[0241] At time T+4, the output control unit can receive the enable signals of frame 2 and frame 4 output by the input control unit. Under the control of the enable signals, Y2' is input to the color gamut inverse conversion unit at this time. The color gamut inverse conversion unit can obtain the C of the pixel from the color gamut conversion unit. b And Cr, the three components are combined to obtain the YC of the pixel. b C r 'i.e., the target YC of the pixel' b C r Information, and the YC of the pixel b C r Perform a reverse conversion to obtain the R'G'B' of the pixels in frame 4.

[0242] The RGB values ​​of the pixels in frame 3 are input into the color gamut conversion unit at time T+2 to obtain the YC values ​​of the pixels in frame 3. b C r The information processing unit outputs the luminance component and average luminance component of the pixel from the neighborhood mean calculation unit, and inputs these components into the control unit. After the neighborhood calculation of all pixels in frame 3 is completed, the input control unit can generate the effective enable signal Y3_en for frame 3 and the effective enable signal Zone_con for the frame block to which the pixel belongs. The input control unit can perform statistics on the histogram statistics unit 3 in processing branch 3 at time T+3 and cache the histogram in RAM.3-1 In the middle. At time T+4, the mapping function calculation unit 3 is input to obtain the cumulative brightness value of frame 3, and the cumulative brightness value is cached in RAM. 3-2 In the middle. At time T+5, the input control unit can input the brightness information of the pixels of frame 5 and the enable signal (Y5_en) of frame 5 to the brightness mapping unit 3, so that the brightness mapping unit 3 can be based on RAM. 3-2 The cumulative luminance value of frame 3 in the image is used to perform luminance mapping on the luminance information of pixels in frame 5, resulting in Y3' of the same pixel in frame 5, which is the target luminance component of that pixel. It can be understood that after the luminance mapping is completed at time T+5, the RAM can be accessed. 3-1 The histogram in the buffer is cleared to zero, and used for the histogram buffer of frame 6.

[0243] At time T+5, the output control unit can receive the enable signals of frame 3 and frame 5 output by the input control unit. Under the control of the enable signals, Y3' is input to the color gamut inverse conversion unit at this time. The color gamut inverse conversion unit can obtain the C of the pixel from the color gamut conversion unit. b And Cr, the three components are combined to obtain the YC of the pixel. b C r 'i.e., the target YC of the pixel' b C r Information, and the YC of the pixel b C r Perform a reverse conversion to obtain the R'G'B' of the pixels in frame 5 of the image.

[0244] At time T+3, frame 4 is input and processed by three units in processing branch 1 at times T+4, T+5 and T+6 respectively. Based on the cumulative brightness value of frame 4, the brightness information of the pixels in frame 6 is fused to output the R'G'B' of the pixels in frame 6.

[0245] At time T+4, frame 5 is input and processed by three units in processing branch 2 at times T+5, T+6 and T+7 respectively. Based on frame 5, frame 7 is fused to output the R'G'B' of the pixels in frame 7.

[0246] At time T+5, frame 6 is input. Frame 6 is input to processing branch 3. The three units in processing branch 3 process frame 6 at times T+6, T+7 and T+8 respectively. Based on the cumulative brightness value of frame 6, the brightness information of the pixels in frame 8 is fused to output the R'G'B' of the pixels in frame 8.

[0247] At time T+6, frame 7 is input and processed by three units in processing branch 1. At times T+7, T+8 and T+9, frame 9 is processed and the brightness information of the pixels in frame 9 is fused based on the cumulative brightness value of frame 7 to output the R'G'B' of the pixels in frame 9.

[0248] Similarly, the input frame for processing branch 1 can include 1, 4, 7, 10, ..., 3n-2; the input frame for processing branch 2 can include 2, 5, 8, 11, ..., 3n-1; and the input frame for processing branch 3 can include 3, 6, 9, 12, ..., 3n.

[0249] It is understandable that, such as Figure 11 As shown, the enable signal input from the input control unit to the output control unit can be labeled as Y. i _en, Y i+1 _en, Y i+2 It should be noted that when the input control unit inputs the enable signal for each frame to the output control unit, it also inputs the control signal (Contrastenhancement start, ce-st) for the brightness mapping unit to the output control unit. This ce-st enables the brightness mapping unit to enter the working state.

[0250] For example, frame 1 can be set to acquire brightness information at T=0. Furthermore, at time T=1, the histogram statistics unit 1 of processing branch 1 is input. The states of the two RAMs in the three processing branches from time T=1 to time T=9 are shown in Table 1 below:

[0251]

[0252] It should be noted that, as Figure 11 As shown, when inputting a frame into the display device, a vertical synchronization signal (Vs) and a data enable signal (de) are also input simultaneously. The Vs signal can be used as a frame reset signal. A high level on the de signal indicates that the input frame data is valid.

[0253] Figure 12 This is a block diagram of an electronic device according to an exemplary embodiment. For example... Figure 12As shown, the display device 1200 includes a screen display device 1200. A display device, also called a monitor, or more commonly, a display screen, screen, etc., is a device capable of outputting images or tactile information (e.g., a Braille display designed for the blind). Display devices may include plasma display panels (PDP), liquid crystal displays (LCD), thin-film transistor displays (TFT) within liquid crystal displays, organic light-emitting diode displays (OLED), surface-conduction electron-emitter displays (SED), laser video displays, carbon nanotube displays, quantum dot displays, interferometric modulator displays (IMOD), etc. The embodiments in this application are not specifically limited.

[0254] According to an embodiment of this application, a display device is also provided, including: a processor; and a memory for storing processor-executable instructions, wherein the processor is configured to execute the instructions to implement the screen display method described above.

[0255] To implement the above embodiments, this application also proposes a storage medium.

[0256] When the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is able to perform the screen display method described above.

[0257] To implement the above embodiments, this application also provides a computer program product.

[0258] When the computer program product is executed by the processor of the electronic device, it enables the electronic device to perform the screen display method described above.

[0259] Figure 13 This is a block diagram of an electronic device according to an exemplary embodiment. Figure 13 The electronic device shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of this application.

[0260] like Figure 13As shown, the electronic device 1300 includes a processor 1301, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1302 or a program loaded from memory 1306 into a random access memory (RAM) 1303. The RAM 1303 also stores various programs and data required for the operation of the electronic device 1300. The processor 1301, ROM 1302, and RAM 1303 are interconnected via a bus 1304. An input / output (I / O) interface 1305 is also connected to the bus 1304.

[0261] The following components are connected to I / O interface 1305: memory 1306 including hard disks, etc.; and communication section 1307 including network interface cards such as LAN (Local Area Network) cards, modems, etc., which performs communication processing via a network such as the Internet; and driver 1308 is also connected to I / O interface 1305 as needed.

[0262] Specifically, according to embodiments of this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this application include a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via the communication section 1307. When the computer program is executed by the processor 1301, it performs the functions defined in the methods of this application.

[0263] In an exemplary embodiment, a storage medium including instructions is also provided, such as a memory including instructions, which can be executed by the processor 1301 of the electronic device 1300 to perform the above-described method. Optionally, the storage medium may be a non-transitory computer-readable storage medium, such as a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device.

[0264] In this application, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this application, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which can transmit, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wireless, wireline, optical fiber, RF, etc., or any suitable combination thereof.

[0265] In this application, the electronic device 1300 also includes a display 1309 for displaying image frames. The display 1309 can be a PDP, LCD, TFT, OLED, etc. This application does not impose specific limitations on the embodiments.

[0266] Figure 14 This is a structural block diagram of a display chip according to an exemplary embodiment. Figure 14 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments of this application. Figure 14 As shown, the electronic device 1400 includes a processor 1401 and a memory 1402. The memory 1402 is used to store program code, and the processor 1401 is connected to the memory 1402 and is used to read program code from the memory 1402 to implement the screen display method in the above embodiment.

[0267] Alternatively, the number of processors 1401 can be one or more.

[0268] Optionally, the electronic device may also include an interface 1403, and there may be multiple interfaces 1403. The interface 1403 can be connected to an application and can receive data from external devices such as sensors.

[0269] Other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the following claims.

[0270] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

Claims

1. A method for displaying a screen, characterized in that, include: Based on the frame rate at time T+1 i The brightness information of the middle pixels is used to obtain the image frame. i The histogram, and at time T+2 based on the frame. i The histogram is used to obtain the frame of the video. i The cumulative brightness value, and the brightness value based on the frame at time T+3. i brightness summation value and frame rate i The brightness information of the +2 pixels is used to output the image frame. i The target RGB of +2 pixels, wherein i T is a natural number starting from 1 that satisfies a predetermined pattern; Based on the aforementioned frame at time T+2 i The brightness information of the +1 pixel is used to obtain the image frame. i +1 histogram, and based on the frame at time T+3. i The histogram of +1 is used to obtain the frame of the image. i The cumulative brightness value of +1, and the brightness value based on the frame at time T+4. i +1 brightness cumulative value and frame rate i The brightness information of the +3 pixels is used to output the image frame. i The target RGB of +3 pixels; Based on the aforementioned frame at time T+3 i The brightness information of the +2 pixels is used to obtain the image frame. i +2 histogram, and based on the frame at time T+4. i The histogram of +2 is used to obtain the frame. i The cumulative brightness value of +2, and the brightness value based on the frame at time T+5. i +2 brightness cumulative value and frame rate i The brightness information of the +4 pixels is used to output the image frame. i +4 pixels' target RGB; The process of determining the cumulative brightness value of any image data to be processed within an image frame or image block includes: Based on the luminance components of the pixels in the image data to be processed, the average total luminance and the maximum luminance component of the image data to be processed are obtained. The adjustment threshold of the histogram is obtained based on the total average brightness and the maximum brightness component. The histogram of the image data to be processed is adjusted based on the adjustment threshold to obtain the adjusted histogram of the image data to be processed. The adjusted histogram of the image data to be processed is summed to obtain the cumulative brightness value of the image data to be processed. The process of outputting the target RGB values ​​of pixels in the fused image data corresponding to any image data to be processed in a frame or image block includes: Determine the fused image data corresponding to the image data to be processed, wherein the image frame to which the fused image data belongs is separated from the image frame to which the image data to be processed belongs by one frame; Based on the luminance components of the pixels in the fused image data and the cumulative luminance value of the image data to be processed, the target luminance components of the pixels in the fused image data are determined. Based on the target luminance component, the blue color difference component and the red color difference component of the pixels in the fused image data, the target RGB information of the pixels in the fused image data is obtained and output.

2. The method according to claim 1, characterized in that, The method further includes: At time T, the image frame is acquired. i Brightness information of the middle pixels; At time T+1, the image frame is acquired. i The brightness information of the pixel in +1; At time T+2, the image frame is acquired. i +2 pixels' brightness information; The brightness information includes a brightness component and an average brightness component.

3. The method according to claim 2, characterized in that, The process of acquiring the brightness information of pixels in any frame includes: For any pixel P in the aforementioned frame xy A conversion from the RGB domain to the YCbCr domain is performed to obtain the pixel P. xy YCbCr information, wherein the pixel P xy Indicates the first x Line number y The pixels of the column, wherein the x It is an integer greater than or equal to 2. y It is an integer greater than or equal to 1; Based on the pixel P xy The YCbCr information is used to obtain the pixel P. xy The brightness component; Obtain the pixel P xy The adjacent pixels, and based on the pixel P xy The luminance component of the pixel and the luminance component of each adjacent pixel are used to obtain the P. xy The average luminance component.

4. The method according to claim 3, characterized in that, Based on the pixel P xy The luminance component of the pixel and the luminance component of each adjacent pixel are used to obtain the pixel P. xy The average luminance component includes: In obtaining the first one one by one x During the process of obtaining the brightness information of the pixel in row +1, if the first... x The current pixel in row +1 is the pixel P. xy The last adjacent pixel is retrieved from the first buffer queue. x -1 row and belonging to pixel P xy The brightness information of adjacent pixels is obtained from the second cache queue. x The row belongs to the pixel P xy Brightness information of adjacent pixels; For the pixel P xy The luminance component of pixel P is averaged with the luminance components of each adjacent pixel to obtain the pixel P. xy The average luminance component.

5. The method according to claim 4, characterized in that, The method further includes: For the first x The brightness information of the pixels in row +1 is cached; After obtaining the first x When considering the average luminance component of the last pixel in the row, the first buffer queue contains the... x Clear the brightness information of the pixels in row -1, and remove the first... x The brightness information of the pixel in row +1 is cached in the first cache queue; or, the brightness information of the pixel in row +1 is cached in the second cache queue. x The brightness information of the pixels in the row is cached in the first cache queue, and the brightness information of the first pixel is cached in the second cache queue. x The brightness information of the pixel in row +1 is cached in the first cache queue.

6. The method according to any one of claims 3-5, characterized in that, Based on the pixel P xy The luminance component of the pixel and the luminance components of the adjacent pixels are used to obtain the pixel P. xy The average luminance component includes: For pixels P on edge rows and edge columns xy Determine the P xy Existing adjacent pixels and missing adjacent pixels; Obtain the brightness information of the existing adjacent pixels, and fill in the brightness information of the missing adjacent pixels; Based on the pixel P xy The luminance component of the pixel and the luminance component of each adjacent pixel are used to obtain the P. xy The average luminance component.

7. The method according to claim 1, characterized in that, The method further includes: After obtaining the brightness information of pixels in any frame, the frame is segmented. For any frame block in different frame blocks, based on the brightness information of the pixels in the frame block, the histogram of the frame block is obtained, and based on the histogram of the frame block, the cumulative brightness value of the frame block is obtained. Based on the cumulative brightness value of the frame block and the brightness information of the pixels in the same frame block in the fused frame, the target RGB of the pixels in the same frame block in the fused frame is output. The processing time of the image block and the image frame to which the image block belongs is the same in each processing stage of subsequent histogram acquisition, brightness summation calculation and target RGB output, and the fused image frame is separated from the image frame to which the image block belongs by one frame.

8. The method according to claim 1 or 7, characterized in that, The process of obtaining the histogram for any frame data to be processed within a frame or frame block includes: Select the first memory and the second memory; The brightness components of odd-numbered columns of pixels in the image data to be processed are counted using the first memory, and the brightness components of even-numbered columns of pixels in the image data to be processed are counted using the second memory. The histogram of the image data to be processed is obtained by adding the statistical results of the odd-numbered columns of pixels together.

9. The method according to claim 8, characterized in that, The method further includes: After obtaining the cumulative brightness value of the image data to be processed based on the histogram of the image data to be processed, the first memory and the second memory are cleared.

10. The method according to claim 8, characterized in that, The method further includes: Determine the reading address corresponding to each luminance component in the image data to be processed, and the storage space indicated by the reading address is used to store the occurrence count of the corresponding luminance component; The pixels in the image data to be processed are traversed. When the luminance component of the current pixel is counted, the cumulative occurrence count of the luminance component is obtained based on the read address of the current pixel luminance component. The cumulative occurrence count is updated and stored in the storage space corresponding to the read address until all pixels in the image to be processed have been traversed.

11. The method according to claim 1, characterized in that, The step of obtaining and outputting the target RGB information of the pixels in the fused image data based on the target luminance component, the blue color difference component and the red color difference component of the pixels in the fused image data includes: Based on the target luminance component, blue color difference component, and red color difference component of the pixels in the fused image data, the target YC of the pixels in the fused image data is obtained. b C r information; For the target YC of the pixels in the fused image data b C r Information, conducting YC b C r The reverse conversion from the RGB domain to the RGB domain is performed to obtain the target RGB information of the pixels in the fused image data and output it.

12. The method according to claim 1, characterized in that, The step of determining the target luminance component of a pixel in the fused image data based on the luminance component of the pixel in the fused image data and the cumulative luminance value of the image data to be processed includes: Based on the brightness information of the pixels in the frame to which the fused image data belongs, the maximum brightness component of the frame to which the fused image data belongs is determined; Determine the read address corresponding to the luminance component of the current pixel in the fused image data, and obtain the target luminance sum value stored in the storage space indicated by the read address; Based on the target cumulative brightness value, the maximum brightness component, and the total number of pixels included in the fused image data, the brightness component mapping parameters of the pixels in the fused image data are obtained; The target luminance component is obtained based on the luminance component mapping parameters and the average luminance component of the frame to which the fused image data belongs.

13. The method according to claim 1, characterized in that, If the image data to be processed is an image block, the fused image data is the same image block in the image frame to which the fused image data belongs.

14. The method according to claim 3, characterized in that, The method further includes: Obtain the pixel P xy RGB information and the first color gamut mapping matrix; For the first color gamut mapping matrix and the pixel P xy The RGB information is used to perform matrix operations to obtain the pixel P. xy YC b C r Information, wherein the YC b C r The information includes the pixel P xy The brightness component, blue color difference component, and red color difference component.

15. The method according to claim 14, characterized in that, The first color gamut mapping matrix and the pixel P xy The RGB information is used to perform matrix operations to obtain the pixel P. xy YC b C r Information, including: For any one of the luminance component, blue color difference component, and red color difference component, perform a shift operation on the matrix operation result of the any one component to obtain the shift operation result of the any one component; The shift operation result is truncated by a set number of bits from the least significant bit to the most significant bit to obtain the target operation result of any component.

16. The method according to claim 7, characterized in that, The method further includes: Based on the coordinates of the pixel, the image block to which the pixel belongs is determined, and a first enable signal for the image block is generated. The first enable signal is used to indicate that the image block is in a state where relevant processing operations can be performed.

17. The method according to claim 1 or 7, characterized in that, The method further includes: When a pixel in any frame is received, a second enable signal for the frame is generated based on the frame identifier of the pixel. The second enable signal is used to indicate that the frame is in a state where related processing operations can be performed.

18. A screen display device, characterized in that, include: The first processing module is used to process the frame rate at time T+1. i The brightness information of the middle pixels is used to obtain the image frame. i The histogram, and at time T+2 based on the frame. i The histogram is used to obtain the frame of the video. i The cumulative brightness value, and the brightness value based on the frame at time T+3. i brightness summation value and frame rate i The brightness information of the +2 pixels is used to output the image frame. i The target RGB of +2 pixels, wherein i T is a natural number starting from 1 that satisfies a predetermined pattern; The second processing module is used to process the image frame at time T+2. i The brightness information of the +1 pixel is used to obtain the image frame. i +1 histogram, and based on the frame at time T+3. i The histogram of +1 is used to obtain the frame. i The cumulative brightness value of +1, and the brightness value based on the frame at time T+4. i +1 brightness cumulative value and frame rate i The brightness information of the +3 pixels is used to output the image frame. i +3 pixels' target RGB; The third processing module is used to process the image frame at time T+3. i The brightness information of the +2 pixels is used to obtain the image frame. i +2 histogram, and based on the frame at time T+4. i The histogram of +2 is used to obtain the frame. i The cumulative brightness value of +2, and the brightness value based on the frame at time T+5. i +2 brightness cumulative value and frame rate i The brightness information of the +4 pixels is used to output the image frame. i +4 pixels' target RGB; The process of determining the cumulative brightness value of any image data to be processed within an image frame or image block includes: Based on the luminance components of the pixels in the image data to be processed, the average total luminance and the maximum luminance component of the image data to be processed are obtained. The adjustment threshold of the histogram is obtained based on the total average brightness and the maximum brightness component. The histogram of the image data to be processed is adjusted based on the adjustment threshold to obtain the adjusted histogram of the image data to be processed. The adjusted histogram of the image data to be processed is summed to obtain the cumulative brightness value of the image data to be processed. The process of outputting the target RGB values ​​of pixels in the fused image data corresponding to any image data to be processed in a frame or image block includes: Determine the fused image data corresponding to the image data to be processed, wherein the image frame to which the fused image data belongs is separated from the image frame to which the image data to be processed belongs by one frame; Based on the luminance components of the pixels in the fused image data and the cumulative luminance value of the image data to be processed, the target luminance components of the pixels in the fused image data are determined. Based on the target luminance component, the blue color difference component and the red color difference component of the pixels in the fused image data, the target RGB information of the pixels in the fused image data is obtained and output.

19. The apparatus according to claim 18, characterized in that, The device further includes: The brightness extraction module is used to acquire the image frame at time T. i Brightness information of the middle pixels; at time T+1, acquire the frame. i +1 brightness information of pixels; at time T+2, acquire the image frame. i The brightness information of the +2 pixels; wherein the brightness information includes a brightness component and an average brightness component.

20. The apparatus according to claim 19, characterized in that... The brightness extraction module includes: The color gamut conversion unit is used to convert pixel P in any of the frame images. xy A conversion from the RGB domain to the YCbCr domain is performed to obtain the pixel P. xy YCbCr information, and based on the pixel P xy The YCbCr information is used to obtain the pixel P. xy The brightness component; wherein, the pixel P xy Indicates the first x Line number y The pixels of the column, wherein, x It is an integer greater than or equal to 2. y It is an integer greater than or equal to 1; The neighborhood mean calculation unit is used to obtain the pixel P. xy The adjacent pixels, and based on the pixel P xy The luminance component of the pixel and the luminance component of each adjacent pixel are used to obtain the P. xy The average luminance component.

21. The apparatus according to claim 18, characterized in that, Any processing module is also used for: After obtaining the brightness information of the pixels in the image frame, the image frame is segmented. For any frame block in different frame blocks, based on the brightness information of the pixels in the frame block, the histogram of the frame block is obtained, and based on the histogram of the frame block, the cumulative brightness value of the frame block is obtained. Based on the cumulative brightness value of the frame block and the brightness information of the pixels in the same frame block in the fused frame, the target RGB of the pixels in the same frame block in the fused frame is output. The processing time of the image block and the image frame to which the image block belongs is the same in each processing stage of subsequent histogram acquisition, brightness summation calculation and target RGB output, and the fused image frame is separated from the image frame to which the image block belongs by one frame.

22. The apparatus according to claim 18 or 21, characterized in that, Any processing module includes: The histogram statistics unit is used to obtain a histogram of the image data to be processed based on the brightness information of the pixels in the image data to be processed; wherein the image data to be processed is an image frame or an image block in an image frame; The histogram processing unit is used to obtain the cumulative brightness value of the image data to be processed based on the histogram of the image data to be processed. A luminance mapping unit is used to fuse the luminance information of pixels in a fused image frame based on the cumulative luminance value of the image data to be processed, so as to output the target RGB of the pixels in the fused image frame. The fused image frame is separated from the image frame to which the image data to be processed belongs by one frame.

23. The apparatus according to claim 22, characterized in that, The device further includes: The output control module is used to obtain the target RGB information of the pixels in the fused image data based on the target brightness component and the blue and red color difference components of the pixels in the fused image data, and then output it.

24. The apparatus according to claim 23, characterized in that, The output control module includes: Output control unit, used to output the target brightness component of the pixels in the fused image data; The color gamut inverse conversion unit is used to obtain the target YC of the pixels in the fused image data based on the target luminance component, blue color difference component, and red color difference component of the pixels in the fused image data. b C r Information; for the target YC of pixels in the fused image data b C r Information, conducting YC b C r The reverse conversion from the RGB domain to the RGB domain is performed to obtain the target RGB information of the pixels in the fused image data and output it.

25. The apparatus according to claim 22, characterized in that, The device further includes: An input control module is used to determine the image block to which the pixel belongs based on the pixel's coordinates, so as to generate a first enable signal for the image block, the first enable signal being used to indicate that the image block is in a state where related processing operations can be performed.

26. The apparatus according to claim 25, characterized in that, The input control module is also used for: When a pixel in any frame is received, a second enable signal for the frame is generated based on the frame identifier of the pixel. The second enable signal is used to indicate that the frame is in a state where related processing operations can be performed.

27. A display device, characterized in that, include: The apparatus as described in any one of claims 18 to 26.

28. An electronic device, characterized in that, include: processor; Memory used to store the processor's executable instructions; The processor is configured to execute the instructions to implement the method as described in any one of claims 1 to 17.

29. A non-transitory computer-readable storage medium, characterized in that, When the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is able to perform the method as described in any one of claims 1 to 17.

30. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method of any one of claims 1 to 17.

Images