Pixel processing method and device, equipment and storage medium

Abstract

The invention provides a pixel processing method and device, equipment and a storage medium. The pixel processing method comprises the steps of obtaining an RGB pixel image stored by a system; performing screening processing on each piece of pixel data in the RGB pixel image to obtain an initialized pixel data array; performing rendering processing on each sub-pixel in the initialized pixel data array to obtain a rendered sub-pixel data array; and performing pixel rearrangement on the rendering sub-pixel data array according to a preset target rule to obtain a target pixel data array. According to the method, RGB pixel images in a system are screened to remove some sub-pixel data, then the remaining sub-pixel data are rendered to achieve the purpose of making up for lost colors, then sub-pixels are rearranged, finally, the arrangement of the pixel images is matched with a hardware structure, and on the basis of new pixel data and an original multiplexer structure, the color loss of the system is reduced. Therefore, the technical effects of reducing the number of scanning lines and reducing power consumption are achieved from the software perspective.

Description

Technical Field

[0001] This application relates to the field of image processing technology, specifically to a pixel processing method, apparatus, device, and storage medium. Background Technology

[0002] Organic light-emitting diodes (OLEDs) have excellent properties such as low power consumption, high color saturation, wide viewing angle, thinness, and flexibility, and are therefore widely used in terminal devices.

[0003] With increasing demands for environmental protection and energy efficiency, the arrangement and density of pixels on a display screen directly impact its power consumption. Current methods to reduce power consumption include lowering brightness, reducing resolution, or using energy-saving modes. However, these methods inevitably degrade the display's performance. Therefore, further reducing power consumption is a pressing issue that needs to be addressed. Summary of the Invention

[0004] To address the aforementioned technical problem of reducing the power consumption of a display screen, this invention provides a pixel processing method, apparatus, device, and storage medium.

[0005] In a first aspect, embodiments of this application provide a pixel processing method, comprising: acquiring an RGB pixel image stored in the system; filtering each pixel data in the RGB pixel image to obtain an initial pixel data array; rendering each sub-pixel in the initial pixel data array to obtain a rendered sub-pixel data array; and rearranging the rendered sub-pixel data array according to a preset target rule to obtain a target pixel data array.

[0006] In conjunction with the first aspect, the step of filtering each pixel data in the RGB pixel image to obtain an initial pixel data array includes: deleting B sub-pixel data from the i-th column of the pixel data in the odd-numbered rows of the RGB pixel image and R sub-pixel data from the (i+1)-th column of the pixel data to obtain RGBG combined sub-pixel data; deleting R sub-pixel data from the i-th column of the pixel data in the even-numbered rows of the RGB pixel image and B sub-pixel data from the (i+1)-th column of the pixel data to obtain BGRG combined sub-pixel data, where i is a positive integer; and obtaining an initial pixel data array based on the RGBG combined sub-pixel data and the BGRG combined sub-pixel data.

[0007] In conjunction with the first aspect, the step of rendering each sub-pixel in the initial pixel data array to obtain a rendered sub-pixel data array includes: performing luminance conversion on the grayscale values ​​corresponding to the initial pixel data array to obtain a luminance pixel data array; performing rendering processing on each sub-pixel in the luminance pixel data array based on a pixel color borrowing algorithm to obtain a color-colored sub-pixel data array; performing grayscale conversion on the luminance values ​​corresponding to the color-colored sub-pixel data array, and using the converted sub-pixel data array as the rendered sub-pixel data array.

[0008] In conjunction with the first aspect, the rendering process of each sub-pixel in the luminance pixel data array based on the pixel color borrowing algorithm to obtain a colored sub-pixel data array includes: marking the R sub-pixel data and B sub-pixel data in the luminance pixel data array to obtain the corresponding RB sub-pixel data array; keeping the luminance value of the G sub-pixel data in the luminance pixel data array unchanged to obtain the G local address sub-pixel; performing color borrowing processing on the RB sub-pixel data array using the pixel color borrowing algorithm to obtain the colored RB sub-pixel; obtaining the colored sub-pixel data array based on the colored RB sub-pixel and the G local address sub-pixel; preferably, the step of performing color borrowing processing on the RB sub-pixel data array using the pixel color borrowing algorithm to obtain the colored RB sub-pixel includes: performing color borrowing processing on the sub-pixel of the i-th row and first column of the RB sub-pixel data array, and dividing the sub-pixel of the i-th row and first column, the sub-pixel of the i-th row and second column, the sub-pixel of the i+1-th row and first column, and the sub-pixel of the i+1-th row and second column into a single image. The average sum of the grayscale values ​​corresponding to the pixels in the first row and first column is used to obtain the stained sub-pixel in the i-th row and first column, where i is a positive integer. Color borrowing is performed on the sub-pixel in the j-th column of the first row of the RB sub-pixel data array. The average sum of the grayscale values ​​corresponding to the sub-pixel in the j-th column of the first row, the (j+1)-th column of the first row, the j-th column of the second row, and the (j+1)-th column of the second row is used to obtain the stained sub-pixel in the j-th column of the first row, where j is a positive integer. Color borrowing is performed on the sub-pixel in the k-th column of the c-th row of the RB sub-pixel data array. The average sum of the grayscale values ​​corresponding to the sub-pixel in the k-th column of the c-th row, the (k-1)-th column of the c-1-th row, and the (k-1)-th column of the c-1-th row is used to obtain the stained sub-pixel in the k-th column of the c-th row, where c and k are positive integers greater than 1. The stained RB sub-pixel is obtained based on the stained sub-pixel in the first column of the i-th row, the stained sub-pixel in the j-th column of the first row, and the stained sub-pixel in the k-th column of the c-th row.

[0009] In conjunction with the first aspect, the step of rearranging the pixels of the rendered sub-pixel data array according to a pre-set target rule to obtain a target pixel data array includes: sequentially extracting odd-numbered columns of sub-pixels from all sub-pixels in the m-th row of the rendered sub-pixel data array, and combining the odd-numbered columns of sub-pixels in the m-th row into sub-pixels in the (2m-1)-th row; sequentially extracting even-numbered columns of sub-pixels from all sub-pixels in the m-th row of the rendered sub-pixel data array, and combining the even-numbered columns of sub-pixels in the m-th row into sub-pixels in the 2m-th row, where m is a positive integer; and recombining the sub-pixels in the (2m-1)-th row and the sub-pixels in the 2m-th row to obtain the target pixel data array.

[0010] In conjunction with the first aspect, the method further includes: packaging the target pixel data array to obtain a pixel data packet; and sending the pixel data packet to the display screen to perform display.

[0011] Secondly, embodiments of this application provide a pixel processing apparatus, comprising: an acquisition module for acquiring an RGB pixel image stored in the system; a filtering module for filtering each pixel data in the RGB pixel image to obtain an initial pixel data array; a rendering module for rendering each sub-pixel in the initial pixel data array to obtain a rendered sub-pixel data array; and a rearrangement module for rearranging the rendered sub-pixel data array according to a preset target rule to obtain a target pixel data array.

[0012] In conjunction with the second aspect, the pixel processing device further includes: a packaging module for packaging the target pixel data array to obtain a pixel data packet; and a display module for sending the pixel data packet to the display screen for display.

[0013] Thirdly, embodiments of this application provide a pixel processing device, including a processor and a memory, wherein the processor is configured to execute a pixel processing program stored in the memory to implement any of the pixel processing methods described in the first aspect.

[0014] Fourthly, embodiments of this application provide a storage medium storing one or more programs, which can be executed by one or more processors to implement any of the pixel processing methods described in the first aspect.

[0015] The pixel processing method, apparatus, device, and storage medium provided in this application involve acquiring an RGB pixel image stored in the system; filtering each pixel data in the RGB pixel image to obtain an initial pixel data array; rendering each sub-pixel in the initial pixel data array to obtain a rendered sub-pixel data array; and rearranging the rendered sub-pixel data array according to a pre-set target rule to obtain a target pixel data array. By filtering and removing some sub-pixel data from the RGB pixel image in the system, and then rendering the remaining sub-pixel data to compensate for lost colors, and then rearranging the sub-pixels, the pixel image arrangement is finally matched with the hardware structure. Based on the new pixel data and the original multiplexer structure, the technical effect of reducing the number of scan lines and reducing power consumption is achieved from a software perspective. Attached Figure Description

[0016] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. Furthermore, these drawings and textual descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concepts of this application to those skilled in the art through reference to specific embodiments.

[0017] Figure 1 A schematic diagram of a pixel array arrangement provided by existing technology.

[0018] Figure 2 This is a schematic flowchart of a pixel processing method provided in an embodiment of this application.

[0019] Figure 3 This is a schematic flowchart of a pixel processing method provided in another embodiment of this application.

[0020] Figure 4a This is a schematic diagram of the structure of a pixel data array provided in an embodiment of this application.

[0021] Figure 4b This is a schematic diagram of the structure of an initial pixel data array provided in an embodiment of this application.

[0022] Figure 5 This is a schematic diagram of the process for obtaining a rendering subpixel data array according to an embodiment of this application.

[0023] Figure 6a This is a schematic diagram of a pixel rearrangement structure provided in an embodiment of this application.

[0024] Figure 6b This is a schematic diagram of the circuit structure after pixel rearrangement provided in an embodiment of this application.

[0025] Figure 7This is a schematic flowchart of a pixel processing method provided in another embodiment of this application.

[0026] Figure 8a This is an illustration of the effect of color borrowing processing of the first row of pixels provided in an embodiment of this application.

[0027] Figure 8b This is an illustration of the effect of color borrowing processing of the first column of pixels provided in an embodiment of this application.

[0028] Figure 8c This is an illustration of the effect of intermediate pixel color borrowing processing provided in an embodiment of this application.

[0029] Figure 9a Timing diagrams provided for routine scans.

[0030] Figure 9b This is a timing diagram corresponding to a pixel processing method provided in an embodiment of this application.

[0031] Figure 10 This is a schematic diagram of the structure of a pixel processing apparatus provided in an embodiment of this application.

[0032] Figure 11 This is a schematic diagram of the structure of a pixel processing device provided in another embodiment of this application.

[0033] Figure 12 This is a schematic diagram of the structure of a pixel processing device provided in an embodiment of this application. Detailed Implementation

[0034] To make the objectives, technical solutions, and advantages of this invention application clearer, the technical solutions in the embodiments of this invention application will be clearly and completely described below in conjunction with the embodiments of this invention application. Obviously, the described embodiments are only some embodiments of this invention application, not all embodiments. Based on the embodiments of this invention application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this invention application. Unless otherwise specified, the following embodiments and features can be combined with each other.

[0035] Figure 1 This is a schematic diagram of a pixel array arrangement provided by existing technology. Figure 1 The provided illustration shows a column of RB sub-pixels adjacent to a column of G sub-pixels, and also next to a column of BR sub-pixels. On the other side, it is adjacent to another column of G sub-pixels, presenting an effect of odd-numbered pixel arrangements. By adding multiplexers MUX1 and MUX2, both connected to the same Source signal line, the number of hardware signal lines is reduced, thereby reducing power consumption.

[0036] but, Figure 1 The hardware architecture in this system cannot be supported by the software. Furthermore, the pixel grayscale values ​​are affected during display, reducing display quality while lowering power consumption.

[0037] To solve the problem that the software cannot achieve [the desired result] Figure 1 To address the limitations of the provided circuit structure in terms of control support and the inability to reduce circuit power consumption, this application offers a pixel processing method. First, the RBG pixel image provided by the system is re-filtered to obtain an initial pixel data array. Since G sub-pixels are crucial for screen display, they are retained during the filtering process, while one sub-pixel (e.g., R or B sub-pixel) is removed from each pixel. Since removing a sub-pixel affects the display and reduces brightness, the R or B sub-pixels in the filtered initial pixel data array are then rendered to mitigate the impact of the lost sub-pixel on the display effect, resulting in a rendered sub-pixel data array. Next, the rendered sub-pixel data array is reordered using a rearrangement method, ensuring that the software-ordered pixel data array matches the pixel array designed in the hardware structure. Subsequently, the software continues to receive signals from the multiplexer to perform line-by-line scanning control on the rearranged pixel data array. Simultaneously, the number of connected signal lines to the multiplexer is reduced to match the related connection structure of the multiplexer in the hardware structure, achieving a result based on… Figure 1 This is based on the goal of achieving pixel processing in software.

[0038] To facilitate understanding of the embodiments of this application, the following will provide further explanation and description with reference to the accompanying drawings and specific embodiments. These embodiments do not constitute a limitation on the embodiments of this application.

[0039] Figure 2 This is a schematic flowchart illustrating a pixel processing method provided in an embodiment of this application. According to... Figure 2 The provided illustrations show that the pixel processing methods specifically include: S201. Obtain the RGB pixel image stored in the system.

[0040] Taking a pixel containing three sub-pixels as an example, obtaining the RGB pixel image stored in the system is equivalent to obtaining the corresponding R sub-pixel data, G sub-pixel data, and B sub-pixel data in each pixel. The RGB pixel image corresponds to a pixel data array composed of R sub-pixel data, G sub-pixel data, and B sub-pixel data.

[0041] S202. Filter the data of each pixel in the RGB pixel image to obtain an initial pixel data array.

[0042] The filtering process mentioned here can be understood as the process of selecting some sub-pixels to form a new pixel data array while ensuring the display effect. For example, deleting sub-pixels at a specified position, or selecting specified pixels to reconstruct pixel units.

[0043] Furthermore, each pixel in the RGB pixel image is selected according to the set filtering method (the filtering method is not unique, as long as the initial pixel data array is obtained). This can be done by deleting specified R or B sub-pixels in each pixel to obtain a new pixel data array. The filtered pixel data array is used as the initial pixel data array, changing the original one pixel to contain 3 sub-pixels to one pixel containing 2 sub-pixels, thus not changing the number of columns in the original pixel data matrix. At this time, the matrix of the initial pixel data array still maintains the number of rows and columns before filtering.

[0044] S203. Render each sub-pixel in the initialized pixel data array to obtain the rendered sub-pixel data array.

[0045] The rendering process mentioned here can be understood as the process of adjusting the grayscale or brightness values ​​of sub-pixels to compensate for the poor display effect caused by missing sub-pixels.

[0046] Furthermore, by filtering the pixel data array, some sub-pixels are lost, which negatively impacts the display effect. To compensate for the poor display effect, it is necessary to render other sub-pixels near the lost sub-pixels by increasing their brightness or grayscale value.

[0047] S204. Rearrange the pixels of the rendered sub-pixel data array according to the preset target rules to obtain the target pixel data array.

[0048] The target rule mentioned here can be understood as a rearrangement algorithm or rearrangement method. The specific implementation method is not unique, as long as it can obtain the arrangement order corresponding to the hardware pixel array.

[0049] The target pixel data array mentioned here can be understood as a pixel data array that matches the hardware pixel array structure, thereby enabling software control of the pixel scanning order.

[0050] Furthermore, the rendered sub-pixel data array is rearranged according to the designed rearrangement algorithm or pattern to obtain the result. Figure 1 The rearrangement result of the hardware sub-pixel array is matched, and a new pixel data array is formed by rearranging it. Compared with the original pixel data array, the data line scanning order is changed, which can meet the following requirements: Figure 1 The scanning of the hardware sub-pixel array structure shown achieves the goal of reducing the number of signal lines without affecting the display effect.

[0051] This application provides a pixel processing method. It involves acquiring an RGB pixel image stored in the system, filtering each pixel data in the RGB pixel image to obtain an initial pixel data array, rendering each sub-pixel in the initial pixel data array to obtain a rendered sub-pixel data array, and rearranging the rendered sub-pixel data array according to a pre-set target rule to obtain a target pixel data array. With hardware support, by filtering and removing redundant sub-pixels from the sub-pixel data array, the internal arrangement is reduced, and rendering compensates for the poor display effect caused by missing sub-pixels. Simultaneously, by reordering the rendered sub-pixel data array, it achieves matching with the pixel array in the hardware structure, thereby enabling pixel scanning through software algorithms, which also reduces the number of scan lines and achieves the technical effect of reducing system power consumption.

[0052] Figure 3 This is a schematic flowchart of a pixel processing method provided in another embodiment of this application. Figure 3 This is based on the previous embodiment. Figure 3 The provided illustration shows that the pixel processing method specifically includes the following steps: S301. Obtain the RGB pixel image stored in the system.

[0053] Retrieve the RGB pixel images stored in the system, and obtain the corresponding R subpixel data, G subpixel data, and B subpixel data for each pixel.

[0054] In one possible sorting method Figure 4a The structure of the acquired RGB pixel image is shown. Each pixel contains three sub-pixels, arranged in RGB order in each row, and each column contains the same sub-pixel. The sorting results in a 4×4 pixel data array, requiring 12 scan lines (S1-S12) to connect. Sub-pixel R1-1 represents the red sub-pixel in the first row, and sub-pixel G2-1 represents the green sub-pixel in the second row.

[0055] S302. Delete the B sub-pixel data in the i-th column of the odd-numbered row of the RGB pixel image and the R sub-pixel data in the (i+1)-th column of the pixel data to obtain the RGBG combined sub-pixel data.

[0056] S303. Delete the R sub-pixel data in the i-th column of the even-numbered row of the RGB pixel image and the B sub-pixel data in the (i+1)-th column to obtain the BGRG combined sub-pixel data, where i is a positive integer.

[0057] S304. An initial pixel data array is obtained based on RGBG combined sub-pixel data and BGRG combined sub-pixel data.

[0058] Specifically, the filtering method is not unique. This application employs a method of deleting one sub-pixel data from each pixel data and then concatenating them to obtain an initial pixel data array. Similarly, it is also possible to directly select sub-pixels in odd-numbered rows according to the RGBG order, while selecting sub-pixels in even-numbered rows in a different arrangement order to form new pixels.

[0059] Optionally, for odd-numbered rows, subpixel data in BGRG order can be selected by deleting a subpixel or by direct selection, while for even-numbered rows, subpixel data in RGBG order can be selected by deleting a subpixel or by direct selection.

[0060] In one possible example scenario, Figure 4b It provides a way to... Figure 4a One method for obtaining an initialized pixel data array after filtering. Based on... Figure 4b The provided diagram shows how to delete one B sub-pixel from the first column of RGB pixels in the odd-numbered rows of a 4×4 pixel data array (i.e., R1-1, G1-1, B1-1; R2-1, G2-1, B2-1; R3-1, G3-1, B3-1; R4-1, G4-1, B4-1 in the diagram), and delete the R sub-pixels from the second column of RGB pixels (i.e., R1-2, G1-2, B1-2; R2-2, G2-2, B2-2; R3-2, G3-2, B3-2; R4-2, G4-2, B4-2 in the diagram). Following this pattern, RGBG pixel data is obtained, and each pixel is composed of two sub-pixels instead of three. For even-numbered rows, the order is set differently from that of odd-numbered rows. One R sub-pixel is deleted from the first column of RGB pixels, and one B sub-pixel is deleted from the second column of RGB pixels. This process is repeated to obtain BGRG pixel data, which is then concatenated to form an initial pixel data array, maintaining a 4×4 structure. Here, G1-2 represents the green sub-pixel in the first row, second column, and B3-4 represents the blue sub-pixel in the third row, fourth column. It can be seen that the sub-pixels, after being filtered, have their column numbers rearranged.

[0061] Optionally, the filtering method can be modified. Select BGRG sequential subpixels from odd-numbered rows and RGBG sequential subpixels from even-numbered rows to obtain the initial pixel data array. Ensure that the subpixel arrangement order is different for adjacent rows.

[0062] S305. Perform luminance conversion on the grayscale values ​​corresponding to the initialized pixel data array to obtain a luminance pixel data array.

[0063] The grayscale values ​​mentioned here can be understood as the pixel values ​​of RGB pixels. The brightness conversion mentioned here can be understood as the brightness conversion of the pixel values ​​of RGB pixels.

[0064] Specifically, the formula for converting grayscale values ​​to brightness values ​​is as follows: Equation 1: Formula 1 Where Gray is the grayscale value, LGray is the brightness value of Gray, and γ is the curve showing the relationship between the output image brightness and voltage, typically γ=2.2.

[0065] Furthermore, by performing brightness conversion on the grayscale values ​​corresponding to the sub-pixel data array, reference data is provided for the next rendering step.

[0066] S306. Render each sub-pixel in the luminance pixel data array based on the pixel color borrowing algorithm to obtain the color-colored sub-pixel data array.

[0067] By borrowing colors from the sub-pixels in the luminance pixel data array, the problem of poor display effect caused by missing sub-pixels is compensated. By borrowing colors from surrounding sub-pixels and adjusting the grayscale value of the sub-pixels, the color-colored sub-pixel data array is finally obtained by borrowing colors from each sub-pixel.

[0068] S307. Perform grayscale conversion on the brightness values ​​corresponding to the color-dyed sub-pixel data array, and use the converted sub-pixel data array as the rendering sub-pixel data array.

[0069] The brightness values ​​of the sub-pixel data array after color borrowing are converted to grayscale values ​​to obtain the corresponding grayscale data, thus completing the rendering process of the sub-pixel data array. The rendered sub-pixel data array can compensate for the display problems caused by missing sub-pixels.

[0070] Specifically, the formula for converting brightness values ​​to grayscale values ​​is as follows: Equation 2: Formula 2 Where Gray represents the converted grayscale value, and LGray represents the original brightness value.

[0071] In one possible example scenario, Figure 5 This is a schematic diagram illustrating the process of obtaining the rendered subpixel data array provided in this application. Figure 5The provided diagram illustrates that the pixel rendering process is generally divided into three parts. The first part involves converting the grayscale values ​​of the original image to brightness to obtain brightness pixel data. Then, color borrowing is performed on the rows and columns of the sub-pixel data array. Color borrowing is performed separately on the first row and the first column of sub-pixels. Color borrowing is performed on the sub-pixel data array in the middle position according to the relationship between odd and even rows. Finally, the brightness values ​​of the sub-pixel data array after color borrowing are converted to grayscale values, thus completing the rendering process of the sub-pixel data array.

[0072] S308. Extract the odd-numbered column sub-pixels from all sub-pixels in the m-th row of the rendered sub-pixel data array in sequence, and combine the odd-numbered column sub-pixels in the m-th row into the sub-pixels in the 2m-1-th row.

[0073] S309. Extract the even-numbered column sub-pixels from all sub-pixels in the m-th row of the rendering sub-pixel data array in sequence, and combine the even-numbered column sub-pixels in the m-th row into the 2m-th row of sub-pixels, where m is a positive integer.

[0074] S310. The target pixel data array is obtained by recombining the sub-pixels of the (2m-1)th row and the sub-pixels of the 2mth row.

[0075] Specifically, following the order of odd and even rows, the first step is to select RBRB subpixels in sequence to form the first row of data (assuming the subpixel arrangement order of odd rows is RGBG order), and then use the remaining G subpixels to form the second row, and so on, processing the subpixel data of odd rows. For the second row of data (assuming the subpixel arrangement order of even rows is BGRG order), the second step is to select BRBR subpixels in sequence to form the third row, and then use the remaining G subpixels to form the fourth row, and so on, processing the subpixel data of even rows. This results in the number of rows doubling, but the number of columns decreasing from 12 to 8, thus reducing the area occupied.

[0076] For example, Figure 6a This is a schematic diagram of the pixel rearrangement structure provided in an embodiment of this application. Figure 6b The circuit structure after pixel rearrangement, according to Figure 6a The provided diagram illustrates a rearrangement method for a 4×8 column pixel data array. For odd-numbered rows, RBRB subpixels are selected to form a new row, and the remaining G subpixels form another row. For even-numbered rows, BRBR subpixels are selected to form a new row, and the remaining G subpixels form another row. This results in a rearranged target pixel data array that matches the pixel array in the hardware structure. For example... Figure 6bThe provided connection structure, based on the rearranged target pixel data array, connects a multiplexer to one end of the obtained 8×4 column sub-pixel data array. Two multiplexers correspond to two rows of pixel data, and thus the scanning of pixels can be achieved using four data lines, achieving the technical effect of reducing power consumption through software control.

[0077] This application provides another pixel processing method, which obtains an initial pixel data array by filtering RGB pixel images, converts the grayscale values ​​of the initial pixel data array to brightness, and performs color borrowing processing on the converted pixel data array to compensate for the problem of poor display effect caused by missing sub-pixels. After converting to grayscale values, a rendering sub-pixel data array is obtained. The position of each sub-pixel in the rendering sub-pixel data array is rearranged to match the pixel array structure in the hardware structure, thereby obtaining the target pixel data array. The number of data lines is reduced by an externally connected multiplexer, thereby achieving the technical effect of reducing power consumption.

[0078] Figure 7 This is a schematic flowchart of a pixel processing method provided in another embodiment of this application. Figure 7 Is Figure 2 This description is based on the embodiments. Figure 7 The provided illustration shows that the pixel processing method specifically includes the following steps: S701, Obtain the RGB pixel image stored in the system.

[0079] The system retrieves the RGB pixel image stored in the system. Each pixel contains three sub-pixels. The system also obtains the corresponding R sub-pixel data, G sub-pixel data, and B sub-pixel data for each pixel, thereby obtaining the pixel data array corresponding to the RGB pixel image.

[0080] S702. Filter the data of each pixel in the RGB pixel image to obtain an initial pixel data array.

[0081] The methods and means of pixel selection are the same as in the previous embodiment, and will not be repeated here.

[0082] S703. Mark the R sub-pixel data and B sub-pixel data in the brightness pixel data array to obtain the corresponding RB sub-pixel data array.

[0083] S704. Keep the brightness value of the G sub-pixel data in the brightness pixel data array unchanged to obtain the G local address sub-pixel.

[0084] S705. Use the pixel color borrowing algorithm to perform color borrowing processing on the RB sub-pixel data array to obtain colored RB sub-pixels.

[0085] S706. Obtain the color-dyed sub-pixel data array based on the color-dyed RB sub-pixels and the G local address sub-pixels.

[0086] The local subpixel mentioned here can be understood as a subpixel that does not undergo color borrowing and retains its original brightness value.

[0087] Furthermore, the sub-pixel data array is rendered by first marking the positions within the array to determine the data size; the brightness value of the G sub-pixel data is not changed, i.e., no color borrowing is performed on the G sub-pixels. A color borrowing algorithm is then used to borrow color from the R and B sub-pixels in the array, and the borrowed data is used as the stained sub-pixels, thus obtaining the stained sub-pixel data array.

[0088] The algorithm for borrowing colors is as follows: Equation 3: Formula 3 Where Ri(i,j) represents the R sub-pixel in the i-th row and j-th column, and Ro represents the brightness value of the current R sub-pixel after color borrowing. Bi(i,j) represents the B sub-pixel in the i-th row and j-th column, and Bo represents the brightness value of the current B sub-pixel after color borrowing.

[0089] S707. Perform color borrowing processing on the sub-pixels in the first column of the i-th row of the RB sub-pixel data array. Calculate the average of the sums of the grayscale values ​​of the sub-pixels in the first column of the i-th row, the second column of the i-th row, the first column of the i+1-th row, and the second column of the i+1-th row to obtain the color-colored sub-pixels in the first column of the i-th row, where i is a positive integer.

[0090] The color borrowing process for the first column of sub-pixel data can be understood as the average of the sum of the brightness values ​​of the first column of the i-th row of the current color borrowing process, the second column of the same row in the lower right direction, the first column of the next row, and the second column of the next row, which is then used as the new brightness value of the first column of the i-th row, thus achieving the rendering purpose.

[0091] For example, Figure 8b This is an image showing the effect of color borrowing processing on the first column of pixels according to an embodiment of this application. Figure 8b The provided diagram clearly shows that for the first column of sub-pixel data, the brightness values ​​of the three adjacent sub-pixels to its lower right are summed and then averaged to obtain a new brightness value. The same method is used to perform color borrowing on the first column of sub-pixel data.

[0092] S708. Perform color borrowing processing on the sub-pixel in the first row and j-th column of the RB sub-pixel data array. Calculate the average of the sums of the grayscale values ​​of the sub-pixel in the first row and j-th column, the sub-pixel in the first row and j+1-th column, the sub-pixel in the second row and j+1-th column, and obtain the colored sub-pixel in the first row and j-th column, where j is a positive integer.

[0093] The color borrowing process for the first row of sub-pixel data can be understood as the average of the sum of the brightness values ​​of the first row and j-th column sub-pixel, the first and (j+1)-th column sub-pixels in the lower right direction, the second row and j-th column sub-pixels, and the second row and (j+1)-th column sub-pixels, which is then used as the new brightness value of the first row and j-th column sub-pixel to achieve the rendering purpose.

[0094] For example, Figure 8a This is an image showing the effect of color borrowing processing on the first row of pixels according to an embodiment of this application. Figure 8a The provided diagram clearly shows that for the first row of subpixel data, the brightness values ​​of the three adjacent subpixels to its lower right are summed and then averaged to obtain a new brightness value. The same method is used to perform color borrowing on the first row of subpixel data.

[0095] S709. Perform color borrowing processing on the sub-pixel in the c-th row and k-th column of the RB sub-pixel data array. Calculate the average of the sums of the grayscale values ​​of the sub-pixel in the c-th row and k-th column, the sub-pixel in the c-th row and k-1 column, and the sub-pixel in the c-1 row and k-1 column to obtain the colored sub-pixel in the c-th row and k-th column, where c and k are positive integers greater than 1.

[0096] The process of borrowing color from the middle sub-pixel data of the array can be understood as the average of the sum of the brightness values ​​of the sub-pixel in the i-th row and j-th column, the sub-pixel in the (i-1)-th column, the sub-pixel in the i-th row and (j-1)-th column, and the sub-pixel in the (i-1)-th row and (j-1)-th column in the upper left direction, which is then used as the new brightness value of the sub-pixel in the i-th row and j-th column to achieve the purpose of rendering.

[0097] For example, Figure 8c This is an image showing the effect of intermediate pixel color borrowing processing provided in an embodiment of this application. According to... Figure 8c The provided diagram clearly shows that the brightness values ​​of the three sub-pixels adjacent to the upper left of the middle pixel are summed and then averaged to obtain a new brightness value. The same method is used to perform color borrowing on the middle pixel data.

[0098] S710. Obtain the RB sub-pixel based on the i-th row and first column color sub-pixel, the j-th row and first column color sub-pixel, and the c-th row and k-th column color sub-pixel.

[0099] By processing the sub-pixel data in the first column, the first row, and the middle position separately, a rendered sub-pixel data array is obtained, providing reference data for the next step of pixel rearrangement.

[0100] S711. Extract the odd-numbered column sub-pixels from all sub-pixels in the m-th row of the rendered sub-pixel data array in sequence, and combine the odd-numbered column sub-pixels in the m-th row into the sub-pixels in the 2m-1-th row.

[0101] S712. Extract the even-numbered column sub-pixels from all sub-pixels in the m-th row of the rendering sub-pixel data array in sequence, and combine the even-numbered column sub-pixels in the m-th row into the 2m-th row of sub-pixels, where m is a positive integer.

[0102] S713. The target pixel data array is obtained by recombining the sub-pixels of the (2m-1)th row and the sub-pixels of the 2mth row.

[0103] The process of rearranging the obtained rendering subpixel data array is the same as the rearrangement process in the previous embodiment, and will not be repeated here.

[0104] Optionally, the processing order of rendering and pixel rearrangement in RGB pixel images is not limited. That is, the initial pixel data array after filtering can be rendered first and then rearranged, or the initial pixel data array after filtering can be rearranged first and then rendered. This has no effect on the target pixel data array.

[0105] S714. Pack the target pixel data array to obtain a pixel data packet.

[0106] S715: Send pixel data packets to the display screen and execute the display.

[0107] Specifically, after obtaining the target pixel data array, it is sent to the display screen in a packaged manner. Combined with the hardware pixel array structure, the image is displayed. Through filtering, rendering, and pixel rearrangement, the pixel data array is reduced in size compared to the original pixel data array. Furthermore, the number of connecting lines is reduced by using a connecting multiplexer, and power consumption is reduced through software matching with hardware.

[0108] In one possible example scenario, Figure 9a This is a scan timing diagram in the prior art. Figure 9b This is a timing diagram corresponding to a pixel processing method provided in an embodiment of this application. Figure 9a and Figure 9b This is a scanning timing diagram based on Figure 6. Compared to conventional scanning, which has a single-line refresh time of 8µs and outputs three sub-pixels (R / G / B) simultaneously, requiring a large number of connecting lines, this application reduces the single-line refresh time to 4µs. The multiplexer MUX is low to indicate selected output, and sub-pixels are output in a time-division manner. R1-1 and G1-1 are output in two separate lines, taking a total of 4+4=8µs, effectively outputting two lines of data instead of one, thus improving the refresh rate. Figure 9b Only the first RGB subpixel of each row is marked.

[0109] Figure 10 This is a schematic diagram of the structure of a pixel processing apparatus provided in an embodiment of this application. Figure 10The provided illustration shows that the structure of the pixel processing device specifically includes: The acquisition module 10 is used to acquire RGB pixel images stored in the system.

[0110] The filtering module 20 is used to filter the data of each pixel in the RGB pixel image to obtain an initialized pixel data array.

[0111] The rendering module 30 is used to render each sub-pixel in the initialized pixel data array to obtain the rendered sub-pixel data array.

[0112] The rearrangement module 40 is used to rearrange the rendered sub-pixel data array according to a pre-set target rule to obtain the target pixel data array.

[0113] The pixel processing device provided in this embodiment can be as follows: Figure 10 The pixel processing device shown can perform, for example Figures 2-9b All steps of the mid-pixel processing method, thereby achieving Figures 2-9b For details on the technical effects of the pixel processing method shown, please refer to [link / reference]. Figures 2-9b The relevant descriptions are presented concisely and will not be elaborated upon here.

[0114] This application also provides a pixel processing device. Figure 11 This is a schematic diagram of the structure of a pixel processing device provided in another embodiment of this application. Figure 11 This is based on an embodiment. Figure 11 The provided illustration shows that the structure of the pixel processing device specifically includes: Acquisition module 10, Filtering module 20, Rendering module 30, Rearrangement module 40.

[0115] according to Figure 11 The provided illustration shows that the pixel processing device specifically includes: Packaging module 50 is used to package the target pixel data array to obtain pixel data packets; Display module 60 is used to send the pixel data packet to the display screen and perform display.

[0116] The pixel processing device provided in this embodiment can be as follows: Figure 11 The pixel processing device shown can perform, for example Figures 2-9b All steps of the mid-pixel processing method, thereby achieving Figures 2-9b For details on the technical effects of the pixel processing method shown, please refer to [link / reference]. Figures 2-9b The relevant descriptions are presented concisely and will not be elaborated upon here.

[0117] Figure 12 This is a schematic diagram of the structure of a pixel processing device provided in an embodiment of this application. Figure 12 The pixel processing device 1200 shown includes at least one processor 1201, a memory 1202, at least one network interface 1204, and other user interfaces 1203. The various components in the pixel processing device 1200 are coupled together via a bus system 1205. It is understood that the bus system 1205 is used to implement communication between these components. In addition to a data bus, the bus system 1205 also includes a power bus, a control bus, and a status signal bus. However, for clarity, ... Figure 12 The general labeled all buses as Bus System 1205.

[0118] The user interface 1203 may include a display, keyboard, or clicking device (e.g., mouse, trackball, touchpad, or touchscreen).

[0119] It is understood that the memory 1202 in the embodiments of this application can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), Synchronous DRAM (SDRAM), Double Data Rate Synchronous DRAM (DDRSDRAM), Enhanced Synchronous DRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The memory 1202 described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0120] In some implementations, memory 1202 stores elements, executable units or data structures, or subsets thereof, or extended sets thereof: operating system 12021 and application program 12022.

[0121] The operating system 12021 includes various system programs, such as the framework layer, core library layer, and driver layer, used to implement various basic business functions and handle hardware-based tasks. The application program 12022 includes various applications, such as a media player and a browser, used to implement various application functions. The program implementing the method of this application embodiment can be included in the application program 12022.

[0122] In this embodiment, by calling the program or instructions stored in memory 1202, specifically the program or instructions stored in application program 12022, processor 1201 executes the method steps provided in each method embodiment, including, for example: The system retrieves the RGB pixel image stored in the system; filters and processes the data of each pixel in the RGB pixel image to obtain an initial pixel data array; renders each sub-pixel in the initial pixel data array to obtain a rendered sub-pixel data array; and rearranges the rendered sub-pixel data array according to a pre-set target rule to obtain the target pixel data array.

[0123] The methods disclosed in the embodiments of this application can be applied to or implemented by the processor 1201. The processor 1201 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the integrated logic circuit of the hardware or by instructions in the form of software in the processor 1201. The processor 1201 may be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly embodied in the execution of a hardware decoding processor, or can be executed by a combination of hardware and software units in the decoding processor. The software units may be located in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. The storage medium is located in memory 1202. Processor 1201 reads the information in memory 1202 and completes the steps of the above method in conjunction with its hardware.

[0124] It is understood that the embodiments described herein can be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described herein, or combinations thereof.

[0125] For software implementation, the techniques described herein can be implemented by units that perform the functions described herein. The software code can be stored in memory and executed by a processor. The memory can be implemented in the processor or external to the processor.

[0126] The pixel processing device provided in this embodiment can be as follows: Figure 12 The pixel processing device shown can perform, for example Figures 2-9b All steps of the mid-pixel processing method, thereby achieving Figures 2-9b For details on the technical effects of the pixel processing method shown, please refer to [link / reference]. Figures 2-9b For the sake of brevity, the relevant description will not be elaborated upon here.

[0127] This application also provides a storage medium (computer-readable storage medium). This storage medium stores one or more programs. The storage medium may include volatile memory, such as random access memory; it may also include non-volatile memory, such as read-only memory, flash memory, hard disk, or solid-state drive; and it may also include combinations of the above types of memory.

[0128] When one or more programs in the storage medium can be executed by one or more processors to implement the pixel processing method described above that is executed on the pixel processing device side.

[0129] The processor is used to execute a pixel processing program stored in memory to implement the following steps of a pixel processing method executed on the pixel processing device side: The system retrieves the RGB pixel image stored in the system; filters and processes the data of each pixel in the RGB pixel image to obtain an initial pixel data array; renders each sub-pixel in the initial pixel data array to obtain a rendered sub-pixel data array; and rearranges the rendered sub-pixel data array according to a pre-set target rule to obtain the target pixel data array.

[0130] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0131] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein can be implemented in hardware, a software module executed by a processor, or a combination of both. The software module can be located in random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

[0132] Furthermore, in this application, unless otherwise expressly specified and limited, the terms "connected," "linked," "stacked," etc., should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral part; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication of two elements or the interaction between two elements. Those skilled in the art can understand the specific meaning of the above terms in this application according to the specific circumstances.

[0133] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A pixel processing method, characterized in that, include: Retrieve the RGB pixel image stored in the system; The pixel data in the RGB pixel image is filtered to obtain an initial pixel data array; Rendering processing is performed on each sub-pixel in the initial pixel data array to obtain a rendered sub-pixel data array; The rendered sub-pixel data array is rearranged according to a pre-set target rule to obtain the target pixel data array.

2. The method according to claim 1, characterized in that, The step of filtering each pixel data in the RGB pixel image to obtain an initialized pixel data array includes: Delete the B sub-pixel data in the i-th column of the odd-numbered row of the RGB pixel image and the R sub-pixel data in the (i+1)-th column of the pixel data to obtain the RGBG combined sub-pixel data; Delete the R sub-pixel data in the i-th column of the even-numbered row of the RGB pixel image and the B sub-pixel data in the (i+1)-th column of the pixel data to obtain the RGBG combined sub-pixel data, where i is a positive integer; An initial pixel data array is obtained based on the RGBG combined sub-pixel data and the BGRG combined sub-pixel data.

3. The method according to claim 1, characterized in that, The step of rendering each sub-pixel in the initialized pixel data array to obtain a rendered sub-pixel data array includes: The grayscale values ​​corresponding to the initial pixel data array are converted to brightness to obtain a brightness pixel data array; The color-borrowing algorithm is used to render each sub-pixel in the brightness pixel data array to obtain the color-dyed sub-pixel data array. The brightness values ​​corresponding to the color-dyed sub-pixel data array are converted to grayscale, and the converted sub-pixel data array is used as the rendering sub-pixel data array.

4. The method according to claim 3, characterized in that, The pixel-based color borrowing algorithm is used to render each sub-pixel in the luminance pixel data array to obtain a color-colored sub-pixel data array, including: Mark the R sub-pixel data and B sub-pixel data in the brightness pixel data array to obtain the corresponding RB sub-pixel data array; By keeping the brightness value of the G sub-pixel data in the brightness pixel data array unchanged, the G local address sub-pixel is obtained; The RB sub-pixel data array is processed by using a pixel color borrowing algorithm to obtain colored RB sub-pixels; A color-stained sub-pixel data array is obtained based on the color-stained RB sub-pixels and the G local address sub-pixels; Preferably, the step of using a pixel color-borrowing algorithm to perform color-borrowing processing on the RB sub-pixel data array to obtain colored RB sub-pixels includes: The i-th row and first column sub-pixel of the RB sub-pixel data array is subjected to color borrowing processing. The average of the sums of the grayscale values ​​of the i-th row and first column sub-pixel, the i-th row and second column sub-pixel, the i+1-th row and first column sub-pixel and the i+1-th row and second column sub-pixel is calculated to obtain the i-th row and first column color-stained sub-pixel, where i is a positive integer. Color borrowing is performed on the sub-pixel in the first row and j-th column of the RB sub-pixel data array. The average of the grayscale values ​​corresponding to the sub-pixel in the first row and j-th column, the sub-pixel in the first row and j+1-th column, the sub-pixel in the second row and j-th column and the sub-pixel in the second row and j+1-th column is calculated to obtain the color-colored sub-pixel in the first row and j-th column, where j is a positive integer. Color borrowing is performed on the sub-pixel in the c-th row and k-th column of the RB sub-pixel data array. The average of the sums of the grayscale values ​​of the sub-pixel in the c-th row and k-th column, the sub-pixel in the c-th row and k-1 column, the sub-pixel in the (c-1)-th row and k-1-th column, and the sub-pixel in the (c-1)-th row and k-1 column is calculated to obtain the color-stained sub-pixel in the c-th row and k-th column, where c and k are positive integers greater than 1. The RB sub-pixel is obtained based on the i-th row and first column color sub-pixel, the j-th row and first column color sub-pixel, and the c-th row and k-th column color sub-pixel.

5. The method according to claim 1, characterized in that, The step of rearranging the rendered sub-pixel data array according to a pre-set target rule to obtain a target pixel data array includes: Extract the odd-numbered columns of sub-pixels from all sub-pixels in the m-th row of the rendered sub-pixel data array in sequence, and combine the odd-numbered columns of sub-pixels in the m-th row into sub-pixels in the 2m-1-th row; Extract the even-numbered column sub-pixels from all sub-pixels in the m-th row of the rendered sub-pixel data array in sequence, and combine the even-numbered column sub-pixels in the m-th row into the 2m-th row of sub-pixels, where m is a positive integer; The target pixel data array is obtained by recombining the sub-pixels of the 2m-1th row and the sub-pixels of the 2mth row.

6. The method according to claim 1, characterized in that, The method further includes: Pack the target pixel data array into pixel data packets; The pixel data packet is sent to the display screen for display.

7. A pixel processing apparatus, characterized in that, include: The acquisition module is used to acquire RGB pixel images stored in the system. The filtering module is used to filter the data of each pixel in the RGB pixel image to obtain an initialized pixel data array; The rendering module is used to render each sub-pixel in the initialized pixel data array to obtain a rendered sub-pixel data array. The rearrangement module is used to rearrange the rendered sub-pixel data array according to a pre-set target rule to obtain the target pixel data array.

8. The pixel processing apparatus according to claim 7, characterized in that, The pixel processing device further includes: The packaging module is used to package the target pixel data array to obtain pixel data packets; The display module is used to send the pixel data packets to the display screen and perform the display.

9. A pixel processing device, characterized in that, include: A processor and a memory, the processor being configured to execute a pixel processing program stored in the memory to implement the pixel processing method according to any one of claims 1 to 6.

10. A storage medium, characterized in that, The storage medium stores one or more programs, which can be executed by one or more processors to implement the pixel processing method according to any one of claims 1 to 6.

Images