Sub-pixel rendering method, device, display device, and storage medium

Abstract

Embodiments of the present application disclose a sub-pixel rendering method, apparatus, display device, and storage medium, wherein the method includes: obtaining an image to be rendered to be displayed on a first display panel; determining a first positional relationship of the first display panel relative to a second display panel connected in series with the first display panel; based on the first positional relationship, determining a set of pixel points in the image to be rendered that matches the pixel point to be rendered; and determining target sub-pixel data of the pixel point to be rendered based on the sub-pixel data of the pixel point to be rendered and the pixel point set.

Description

Technical Field

[0001] The present application relates to, but is not limited to, the field of display technology, and in particular to a sub-pixel rendering method, apparatus, display device, and storage medium. Background Art

[0002] Sub-pixel rendering in the display driver IC (DDI) of foldable phones needs to support cascade mode. In cascade mode, because the image at the intersection is continuous, a portion of the data on both sides of the intersection must be transferred to the display driver IC on the other side to obtain the input data required by the filter. However, transmitting this partial data is prone to delays and requires additional memory to store it, resulting in a waste of time and space costs. Summary of the Invention

[0003] In view of this, embodiments of the present application provide at least a sub-pixel rendering method, apparatus, display device, and storage medium.

[0004] The technical solution of the embodiment of the present application is implemented as follows:

[0005] In one aspect, an embodiment of the present application provides a sub-pixel rendering method, the method comprising:

[0006] Acquire an image to be rendered to be displayed on a first display panel;

[0007] determining a first positional relationship of the first display panel relative to a second display panel connected in series with the first display panel;

[0008] Based on the first positional relationship, determining a set of pixel points that matches the pixel point to be rendered in the image to be rendered;

[0009] Based on the sub-pixel data of the pixel to be rendered and the pixel set, target sub-pixel data of the pixel to be rendered is determined.

[0010] In another aspect, an embodiment of the present application provides a sub-pixel rendering device, the sub-pixel rendering device comprising:

[0011] A first acquisition module, configured to acquire an image to be rendered to be displayed on a first display panel;

[0012] a first determining module, configured to determine a first positional relationship of the first display panel relative to a second display panel connected in series with the first display panel;

[0013] A second determining module is configured to determine, in the image to be rendered, a set of pixels that matches the pixel to be rendered based on the first positional relationship;

[0014] The third determining module is configured to determine target sub-pixel data of the pixel to be rendered based on the sub-pixel data of the pixel to be rendered and the pixel set.

[0015] On the other hand, an embodiment of the present application provides a display device, comprising: a first display panel, a second display panel, and a display driver chip;

[0016] The first display panel and the second display panel are connected in series;

[0017] The display driver chip is used to implement the steps in the above method and drive the first display panel and the second display panel to display the image after sub-pixel rendering of the image to be rendered.

[0018] On the other hand, an embodiment of the present application provides a computer device, including a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, it implements some or all of the steps in the above method.

[0019] On the other hand, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which implements some or all of the steps in the above method when executed by a processor.

[0020] On the other hand, an embodiment of the present application provides a computer program, including computer-readable code. When the computer-readable code is executed in a computer device, a processor in the computer device executes some or all of the steps for implementing the above method.

[0021] On the other hand, an embodiment of the present application provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, implements some or all of the steps in the above method.

[0022] The present application provides a sub-pixel rendering method. For an image to be rendered that is to be displayed on a first display panel, first, a first positional relationship between the first display panel and a second display panel connected in series is determined. Second, based on the first positional relationship, a set of pixels matching the pixel to be rendered is determined in the image to be rendered. In this way, the set of pixels for sub-pixel rendering of the pixel to be rendered is set according to the positional relationship between the connected display panels, so that the set of pixels matches the first positional relationship. Third, the sub-pixel data of the pixel to be rendered and the sub-pixel data of the pixel set are combined to determine target sub-pixel data of the pixel to be rendered. In this way, the target sub-pixel data of the pixel to be rendered is obtained by fusing the sub-pixel data of the pixel to be rendered and the sub-pixel data of the pixel set in the same display panel, without transmitting pixel data from other display panels. In this way, since the sub-pixel data of the pixel to be rendered and the sub-pixel data of the pixel set are both sub-pixel data corresponding to the first display panel, it is not necessary to transmit pixel data from the second display panel in the process of obtaining the target sub-pixel data. In this way, for the serially connected display panels, there is no need to transmit image data from one display panel to another display panel during the sub-pixel rendering process of the image to be rendered, thereby saving data transmission time and data storage space.

[0023] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and are not intended to limit the technical solutions of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The drawings herein are incorporated into and constitute a part of the specification. These drawings illustrate embodiments consistent with the present application and, together with the specification, are used to illustrate the technical solutions of the present application.

[0025] Figure 1 A schematic diagram of an implementation framework of a display device in some embodiments;

[0026] Figure 2 A schematic diagram of the implementation flow of the sub-pixel rendering method provided in an embodiment of the present application;

[0027] Figure 3 Another implementation flow diagram of the sub-pixel rendering method provided in this embodiment of the application

[0028] Figure 4 A schematic diagram of another implementation flow of the sub-pixel rendering method provided in an embodiment of the present application;

[0029] Figure 5 A schematic diagram of the structure of a display device provided in an embodiment of the present application;

[0030] Figure 6A schematic diagram of the structure of a sub-pixel rendering device provided in an embodiment of the present application;

[0031] Figure 7 A hardware entity diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0032] In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions of this application are further elaborated in detail below with reference to the accompanying drawings and embodiments. The described embodiments should not be regarded as limiting this application. All other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0033] In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0034] The terms "first / second / third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It is understandable that "first / second / third" can be interchanged with a specific order or sequence where permitted so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0035] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which this application pertains. The terms used herein are for the purpose of describing this application only and are not intended to limit this application.

[0036] Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are first described. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations.

[0037] 1) Subpixel Rendering (SPR) is a process in which computer software decomposes a single pixel on the screen into component colors, which are combined at different intensities to create perceived colors. Since the displayed unit is smaller than the standard pixel used to fill the area, the result of sub-pixel rendered images is to make angles and curves appear smoother. In an embodiment of the present application, when rendering an image, more gradient levels can be obtained by manipulating the sub-pixels of larger pixels. Ultimately, the space that should normally be occupied by the entire pixel is partially filled with sub-pixels, presenting a smooth picture.

[0038] 2) The integrated circuit (IC) industry continues to drive the development of the smartphone industry. Touch and display driver integration (TDDI) offers a unified system architecture. The existing system architecture separates the display and touch chips, which can lead to some display noise. TDDI, however, achieves unified control and is more effective in noise management. TDDI uses a "time-sharing scan" approach, dividing the display frame time into two parts: one for touch scanning and the other for display scanning. These two parts prevent interference, fundamentally reducing the risk of signal interference.

[0039] In order to better understand the sub-pixel rendering method provided in the embodiments of the present application, the process of implementing sub-pixel rendering in some embodiments is described below.

[0040] In some embodiments, in cascade mode of dual-screen devices, subpixel rendering (SPR) typically uses a filter of 3×3 or larger size, such as Figure 1 As shown, Figure 1 The figure is a schematic diagram of the implementation framework of the display device in some embodiments, wherein the filter used in the left display screen 11 is a 3×3 filter 12; and the filter used in the right display screen 13 is a 3×3 filter 14. In Cascade mode, in order to obtain the 3×3 input data required by the filter, it is necessary to transfer a portion of the data on both sides of the junction of the left display screen 11 and the right display screen 13 to the display driver chip on the other side through the SPI protocol. For example, the data 15 in the left display screen 11 is transferred to the first column 16 of the right display screen 13; the data 17 of the right display screen 13 is transferred to the last column 18 of the left display screen; this portion of data needs to be transmitted using the Serial Peripheral Interface (SPI) protocol. In this way, during the data transmission process, due to the limitation of the SPI protocol transmission rate, a delay is generated and part of the memory in the display driver chip is occupied, resulting in a waste of time and space costs.

[0041] The embodiment of the present application provides a sub-pixel rendering method, by setting an evaluation position for sub-pixel rendering of a to-be-rendered image according to the relative position relationship of a plurality of display panels connected in series, and determining the target sub-pixel data of the evaluation position by the sub-pixel data of the evaluation position and the adjacent area in the same display panel, so that a natural and smooth picture can be presented at the junction of the two display panels without data transmission at the junction of the two display panels, thereby reducing the delay of data transmission and saving data storage space. The sub-pixel rendering method provided by the embodiment of the present application can be implemented by a display device, which can be a component of an electronic device, wherein the electronic device can be various types of terminals such as a laptop, a tablet computer, a desktop computer, a set-top box, a mobile device (for example, a mobile phone, a portable music player, a personal digital assistant, a dedicated messaging device, a portable gaming device), or can be implemented as a server. The server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms.

[0042] Below, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the drawings in the embodiments of the present application.

[0043] Figure 2 A schematic diagram of the implementation flow of the sub-pixel rendering method provided in the embodiment of the present application is shown in FIG. Figure 2 As shown, this can be achieved through the following steps S201 to S205.

[0044] Step S201: obtaining an image to be rendered to be displayed on a first display panel.

[0045] Here, the first display panel can be a display panel on a flexible screen, such as a display panel on a foldable screen mobile phone. The first display panel and other display panels on the flexible screen are used to present a complete frame of image.

[0046] In some embodiments, the image to be rendered may be image data input to the host end of the first display panel. The image data may be a frame or multiple frames of images, or a video, etc. The image to be rendered may be image data located on the first display panel within a complete frame of an image presented on the first display panel and the second display panel, or may be image data located in a boundary area of ​​the first display panel.

[0047] In some embodiments, the image to be rendered includes multiple pixels, each of which includes three sub-pixels: R, G, and B. The image to be rendered cannot be directly output to the first display panel. Instead, the image to be rendered needs to be sub-pixel rendered and then output to the first display panel to be displayed on the first display panel.

[0048] Step S202 : determining a first positional relationship of the first display panel relative to a second display panel connected in series with the first display panel.

[0049] Here, the second display panel is at least one display panel, and the first display panel and the second display panel are different display panels on the same flexible screen, for example, different display panels on a folding screen mobile phone. The different display panels are connected in series to present a complete and smooth picture.

[0050] In some embodiments, the first positional relationship of the first display panel relative to the second display panel includes: the first display panel is located to the left of the second display panel, for example, the first display panel and the second display panel are the right and left screens of a foldable screen mobile phone, respectively; or the first display panel is located to the right of the second display panel, etc. The relative positional relationship of the first display panel and the second display panel after being connected in series is different, and the boundary area between the first display panel and the second display panel is different. If the first display panel is located to the left of the second display panel, then the right edge of the second display panel and the left edge of the first display panel constitute the boundary area between the first display panel and the second display panel.

[0051] Step S203 : determining a set of pixel points that match the pixel points to be rendered in the image to be rendered based on the first positional relationship.

[0052] Here, based on the first positional relationship, a second positional relationship is determined between the pixels of the image to be rendered and the pixels to be rendered; and a plurality of pixels whose second positional relationship matches the first positional relationship are taken as the pixel set. The pixel to be rendered can be any pixel in the image to be rendered.

[0053] In some embodiments, the pixel point set may be a plurality of pixel points adjacent to the pixel point to be rendered. The pixel point to be rendered and the pixel point set form a pixel point matrix, in which the position of the pixel point to be rendered is used as the evaluation position, the pixel point to be rendered is set in a column in the matrix close to the boundary line of the two display panels, and the other pixel points in the matrix are used as the pixel point set. In the process of implementing sub-pixel rendering, each pixel point in the image to be rendered includes three sub-pixels and is converted into two sub-pixels; for a sub-pixel missing from the pixel point, the value of the missing sub-pixel is determined by fusing the sub-pixels in the adjacent area of ​​the pixel point, and the value of the missing sub-pixel is output from the position where the pixel point is located; the adjacent area is the area in the first display panel adjacent to the evaluation position. In this way, the pixel points in the adjacent area of ​​the pixel point are the pixel point set. For example, multiple pixel points in the adjacent columns and rows of the pixel point to be rendered.

[0054] Step S204 : determining target sub-pixel data of the pixel to be rendered based on the sub-pixel data of the pixel to be rendered and the pixel set.

[0055] Here, the sub-pixel data of the pixel to be rendered and the pixel set are the sub-pixel data corresponding to each pixel after the image to be rendered is converted from red, green, and blue (RGB) pixels to two sub-pixels. The target sub-pixel data of the pixel to be rendered includes the sub-pixel value after the sub-pixel conversion of the image to be rendered and the value of the missing sub-pixel. The value of the missing sub-pixel can be obtained by combining the sub-pixel data of the pixel to be rendered with the sub-pixel data of the pixel set.

[0056] In a specific example, the RGB pixels of the pixel to be rendered are converted into BG sub-pixels, and the missing sub-pixel for the pixel is the R sub-pixel; taking the pixel as the evaluation position, the pixel set is the pixel points in the area adjacent to the pixel in the first display panel, and by fusing the R sub-pixel values ​​of the pixel set, the value of the missing R sub-pixel of the pixel to be rendered is determined, and the target sub-pixel data to be rendered is obtained.

[0057] In an embodiment of the present application, for an image to be rendered on a first display panel, the sub-pixel data of the pixel to be rendered and the sub-pixel data of a set of pixels in the same display panel are merged to obtain target sub-pixel data of the pixel to be rendered, without the need to transmit pixel data from other display panels. In this way, since the sub-pixel data of the pixel to be rendered and the sub-pixel data of the set of pixels are both sub-pixel data corresponding to the first display panel, there is no need to transmit pixel data from the second display panel connected in series in the process of obtaining the target sub-pixel data. In this way, for display panels connected in series, there is no need to transmit image data from one display panel to another display panel during sub-pixel rendering of the image to be rendered, thereby saving data transmission time and data storage space.

[0058] In other embodiments, after step S204, for each pixel to be rendered in the image to be rendered, the target sub-pixel data of the pixel to be rendered is determined with each pixel to be rendered as the evaluation position. This allows the target sub-pixel data of the entire frame of the image to be rendered to be obtained, and the target sub-pixel data is then output to the first display panel, thereby presenting the sub-pixel rendered image on the first display panel. The two display panels on either side of the junction synchronously display the image data after sub-pixel rendering of the image to be rendered, so that the respective image data can be presented in the display area at the junction, thereby presenting a continuous image at the junction of the two display panels.

[0059] In some embodiments, according to the first position relationship between the two display panels connected in series, a pixel set for performing sub-pixel rendering on the pixel to be rendered is determined from the image to be rendered, that is, the above step S203 can be performed by Figure 3 The steps described achieve:

[0060] Step S301 : Taking the position of the pixel to be rendered as the evaluation position, a second positional relationship between the positions of other pixel points and the evaluation position is determined.

[0061] Here, the other pixels are pixels other than the pixel to be rendered in the image to be rendered. During sub-pixel rendering of the image to be rendered, the pixel to be rendered is used as the evaluation location to determine a second positional relationship between each other pixel in the image to be rendered and the pixel to be rendered. For example, the second positional relationship includes the other pixel being to the left, right, above, below, diagonally above right, diagonally above left, diagonally below right, and diagonally below left of the pixel to be rendered.

[0062] Step S302 : selecting a set of pixel points that matches the pixel point to be rendered from the other pixel points based on the first position relationship and the second position relationship.

[0063] Here, based on the second positional relationship between each pixel and the pixel to be rendered, and the first positional relationship between the first display panel and the second display panel, a pixel is selected from among the plurality of other pixels, whose positional relationship relative to the evaluation position matches the positional relationship between the first display panel and the second display panel. For example, if the first positional relationship is that the first display panel is connected in series to the left of the second display panel, then pixels are selected from among the other pixels that are located to the left of the pixel to be rendered and adjacent to the pixel to be rendered, as well as pixels that are in the same column as the pixel to be rendered and are relatively close to the pixel to be rendered, and these pixels are considered the pixel set.

[0064] In an embodiment of the present application, by analyzing the second positional relationship between other pixel points and the pixel points to be rendered, a set of pixel points whose second positional relationship matches the first positional relationship is selected from other pixel points; in this way, the position of the pixel point set in the image to be rendered matches the positional relationship of the first display panel connected in series with the second display panel, and each pixel point in the pixel point set comes from the image to be rendered corresponding to the first display panel, and there is no need to transmit pixel data from the second display panel.

[0065] In some embodiments, according to the second positional relationship between the positions of the other pixel points and the evaluation position and the first positional relationship, a set of pixel points that matches the pixel point to be rendered is selected from the other pixel points. That is, the above step S302 can be implemented by the following steps S321 to S323 (not shown):

[0066] Step S321 : Determine, among the other pixel points, at least one column of pixel points whose second positional relationship matches the first positional relationship and whose distance between the pixel point and the evaluation position is less than a preset distance threshold.

[0067] Here, the second positional relationship matches the first positional relationship in that the positional relationship of the first display panel relative to the second display panel matches the positional relationship of the other pixel points relative to the evaluation position. In some possible implementations, the positional relationship of the first display panel relative to the second display panel is the same as the positional relationship of the other pixel points relative to the evaluation position; that is, the positions of the other pixel points are on the same side of the evaluation position as the side of the second display panel to which the first display panel is connected in series. For example, if the first positional relationship is that the first display panel is connected in series to the left of the second display panel, then the second positional relationship is that the other pixel points are located to the left of the pixel to be rendered. Alternatively, if the first positional relationship is that the first display panel is connected in series to the right of the second display panel, then the second positional relationship is that the other pixel points are located to the right of the pixel to be rendered. In this way, the evaluation position is always close to the boundary line where the two display panels are connected in series, and the other pixel points are adjacent to the pixel to be rendered, and the positions of the other pixel points and the evaluation position belong to the same display panel. The distance between the positions of the other pixel points and the evaluation position is less than a predetermined distance threshold, which may be because the number of pixels between the positions of the other pixel points and the evaluation position is small. The preset distance threshold is set according to the number of pixels. For example, the preset distance threshold is set as the distance between the positions of two pixels.

[0068] In some possible implementations, taking the distance between two pixel locations as an example, the second positional relationship is the same as the first positional relationship and is a column of pixels adjacent to the evaluation location. For example, if the first positional relationship is that the first display panel is connected in series to the left of the second display panel, then among the other pixels to be displayed on the first display panel, at least one column of pixels located to the left of the evaluation location and adjacent to the evaluation location is determined. For example, among the other pixels, two columns of pixels located adjacent to the left of the evaluation location are determined.

[0069] Step S322 : determining, among the other pixel points, at least one row of pixel points whose positions are in the same column as the evaluation position and whose distance from the evaluation position is less than the preset distance threshold.

[0070] Here, among the other pixels, at least one row of pixels is selected that is located in the same column as the evaluation location and is relatively close to the evaluation location. The at least one row of pixels includes at least one row of pixels adjacent to the evaluation location. For example, among the other pixels, one or two rows of pixels are selected that are located below the evaluation location and adjacent to the evaluation location.

[0071] In a specific example, taking the preset distance threshold as the distance between the positions of two pixel points as an example, the at least one row of pixel points includes a row of pixel points adjacent to and below the evaluation position.

[0072] Step S323: Obtain the pixel point set based on the at least one column of pixel points and the at least one row of pixel points.

[0073] Here, if the first position relationship is that the first display panel is connected in series to the left side of the second display panel, at least one column of pixels includes at least one column of pixels to the left of the evaluation position, and at least one row of pixels includes at least one row of pixels below the evaluation position. In this way, the pixel set and the pixels to be rendered form a pixel matrix with 2 columns and multiple rows, and the position of the pixel to be rendered is the evaluation position, which is located in a column close to the intersection line in the pixel matrix. Since the evaluation position is the position of the center point in the 3×3 pixel matrix, when the 3×3 pixel matrix is ​​set at the intersection of the display panels, there is a blank column in the 3×3 pixel matrix. Based on this, a pixel matrix with 2 columns is used for sub-pixel rendering, and the evaluation position of the pixel matrix with 2 columns is set in a column close to the intersection, so there is no blank column in the pixel matrix with 2 columns. In this way, a pixel matrix with 2 columns is set in both the first display panel and the second display panel. Since there are no blank columns in the pixel matrix with 2 columns, there is no need to transmit data from each other to fill the blank columns at the junction between the first display panel and the second display panel, and smooth image data can still be presented at the junction of the first display panel and the second display panel. Taking a 2×2 pixel matrix as an example, in the 2×2 pixel matrix composed of a pixel set and pixels to be rendered, the pixels to be rendered are located in the upper right corner of the 2×2 pixel matrix, that is, the first row and second column. The pixels in the first row and first column, the pixels in the first column and second row, and the pixels in the second row and second column are used as the pixel set. In this way, the pixel sets all come from the image to be rendered corresponding to the first display panel, so that the first display panel has no blank columns at the junction, and thus there is no need to transmit data from the second display panel to fill the blank columns in the 3×3 pixel matrix. The first display panel can still present the rendered image data at the junction. Similarly, for the image to be rendered on the second display panel, in the 2×2 pixel matrix, the position of the pixel points in a column close to the intersection line is used as the evaluation position, and the other three pixel points in the 2×2 pixel matrix are used as the pixel point set of the evaluation position. Sub-pixel rendering is performed on the image data of the second display panel at the intersection. Because the pixel point sets all come from the image to be rendered corresponding to the same display panel, there is no need to transfer data from the first display panel to fill the blank pixel columns. The second display panel can still present the rendered image data at the intersection.

[0074] In an embodiment of the present application, at least one column of pixels whose second positional relationship is the same as the first positional relationship and adjacent to the evaluation position is selected from other pixels; and at least one row of pixels that is in the same column as the evaluation position and adjacent to the evaluation position is selected from other pixels, thereby forming a pixel set consisting of the at least one column of pixels and the at least one row of pixels. In this way, the pixels in the pixel set all come from the image to be rendered corresponding to the first display panel, eliminating the need to transmit pixel data from the second display panel, thereby enabling rapid sub-pixel rendering of the image to be rendered.

[0075] In some embodiments, the image to be displayed in the boundary area of ​​the first display panel is used as the image to be rendered, that is, the above step S201 can be implemented by the following steps S221 and S222 (not shown):

[0076] Step S221 : determining transition image data to be output to a boundary region where the first display panel and the second display panel are connected in series.

[0077] Here, the interface region between the first and second display panels is a display region including the interface line between the first and second display panels; for example, the interface region includes: a display region of two columns of pixels near an edge of the first display panel, and a display region of two columns of pixels near an edge of the second display panel. Image data presented in the interface region after sub-pixel rendering is used as transitional image data; thus, the transitional image data represents the image content of the interface region.

[0078] Step S222 : determining the image data to be displayed on the first display panel in the transition image data as the image to be rendered.

[0079] Here, in the transition image data, the image data to be displayed on the first display panel is used as the image to be rendered; thus, the image to be rendered is the image data of the first display panel located in the boundary area.

[0080] For example, the image to be rendered is data from a partial image region within the transitional image data. For example, if the transitional image data is an image of a building, the image to be rendered can be a representation of the building displayed on the first display panel, while another portion of the image within the transitional image data is displayed on the second display panel. The image frames output by the first and second display panels are continuous at the junction, thus presenting a complete frame of the image via the first and second display panels.

[0081] In the above steps S221 and S222, the image data to be displayed on the first display panel in the boundary area is used as the image to be rendered. In this way, the image to be rendered is the image at the edge of the first display panel. In this way, by using the image data to be displayed on the first display panel in the boundary area as the image to be rendered, any pixel to be rendered in the image to be rendered is rendered using a set of pixel points that matches the pixel to be rendered, so that a smooth picture can be presented in the boundary area between the two display panels.

[0082] In some embodiments, the sub-pixel data of the pixel to be rendered and the sub-pixel data of the pixel set are fused to determine the target sub-pixel data of the pixel to be rendered, that is, the above step S204 can be performed by Figure 4 The steps shown achieve:

[0083] Step S401 : performing sub-pixel processing on the image to be rendered to obtain sub-pixel data of the pixel to be rendered and the pixel set.

[0084] Here, in the sub-pixel rendering process, each pixel in the image to be rendered is converted from RGB pixel to RG or BG sub-pixel; thereby, the sub-pixel data of the pixel to be rendered and the sub-pixel data of each pixel in the pixel set can be obtained.

[0085] Step S402 : Fusing the sub-pixel data of the pixel to be rendered and the pixel set to obtain target sub-pixel data of the pixel to be rendered.

[0086] Here, the sub-pixel data of the pixel to be rendered and the pixel set are fused to determine the sub-pixel missing from the pixel to be rendered. The sub-pixel is combined with the sub-pixel data of the pixel to be rendered to obtain the target sub-pixel data of the pixel to be rendered.

[0087] In some possible implementations, the first positional relationship is that the first display panel is located to the left of the second display panel, and the pixel set is the pixel points in the 2×2 pixel matrix except the pixel point in the upper right corner, and the position of the pixel point in the upper right corner is used as the evaluation position. In the case where the sub-pixel data of the pixel point to be rendered is a BG sub-pixel, the sub-pixel missing from the pixel point to be rendered is an R sub-pixel. The pixel point to be rendered is used as the evaluation position, and the column where the evaluation position is located is used as a column in the 2×2 pixel matrix close to the intersection line. If the first display panel is located to the left of the second display panel, then the pixel point to be rendered can be any pixel point in the second column of the 2×2 pixel matrix, for example, the pixel point to be rendered is set to be located at the upper right corner of the 2×2 pixel matrix. If the first display panel is located to the right of the second display panel, then the pixel point to be rendered can be any pixel point in the first column of the 2×2 pixel matrix, for example, the pixel point to be rendered is set to be located at the upper left corner of the 2×2 pixel matrix. By analyzing the pixel value of the R sub-pixel for each pixel in the pixel set, the influence weight of each pixel in the pixel set on the missing R sub-pixel in the pixel to be rendered is determined. By multiplying this weight by the pixel value of the R sub-pixel for each pixel, the value of the missing R sub-pixel in the pixel to be rendered is determined. The missing sub-pixel of the pixel to be rendered and the sub-pixel data carried by the pixel to be rendered are used together as the target sub-pixel data.

[0088] In an embodiment of the present application, after determining a pixel set of the pixel to be rendered in the first display panel, the sub-pixel data of the pixel set is fused with the sub-pixel data of the pixel to be rendered to determine the sub-pixels missing from the pixel to be rendered; thereby, by combining the missing sub-pixels of the pixel to be rendered and the sub-pixel data of the pixel to be rendered, the target sub-pixel data of the pixel to be rendered is obtained.

[0089] In some embodiments, to improve the smoothness of the image data at the junction of two display panels connected in series, pixel compensation is performed on the image data displayed at the junction. That is, the above step S401 can be implemented by the following steps S411 and S412 (not shown):

[0090] Step S411 , performing sub-pixel conversion on the image to be rendered to obtain converted image data of the pixel point to be rendered and the pixel point set.

[0091] Here, performing pixel conversion on the image to be rendered in the first display panel may involve converting each pixel in the image to be rendered from RGB pixel data to RG or BG sub-pixel data, thereby obtaining sub-pixel data displayable on the display panel, i.e., converted image data. In each display panel, pixel conversion is performed on the image data to be displayed in the boundary region to obtain converted image data capable of rendering the image to be rendered.

[0092] Step S412 : Based on the converted image data corresponding to the second display panel, compensation processing is performed on the converted image data of the pixel to be rendered and the pixel set to obtain sub-pixel data of the pixel to be rendered and the pixel set.

[0093] Here, after obtaining the converted image data in each display panel, the converted image data in the two display panels are compensated by comparing the differences between the converted image data in the two display panels in series, so that there is no color difference between the images presented in the two display panels.

[0094] In some possible implementations, the hue, pixel value, etc. of the converted image data in the two display panels connected in series are adjusted by adjusting the difference between the converted image data in the two display panels connected in series so that the hue and pixel value of the converted image data in the two display panels connected in series are the same, thereby making the picture in the boundary area of ​​the series smoother.

[0095] In an embodiment of the present application, for image data presented in the corresponding boundary area of ​​the series, data compensation is performed on the converted image data in the two display panels connected in series by obtaining the difference between the converted image data after pixel conversion in the two display panels connected in series, thereby solving the problem of unnatural transition of image data at the boundary caused by different settings of filters in the two display panels, thereby making the image picture in the boundary area smoother and more fluent.

[0096] In some embodiments, by analyzing the differences between the display parameters of the converted image data in different serially connected display panels, pixel compensation is performed on the converted image data according to the differences. That is, the above-mentioned step S412 can be implemented by the following steps:

[0097] The first step is to determine the first display parameters of the converted image data of the pixel point to be rendered and the pixel point set, and the second display parameters of the converted image data corresponding to the second display panel.

[0098] Here, the first display parameter and the second display parameter include pixel values ​​and hues in the converted image data, etc., by respectively determining the pixel values ​​and hues of the converted image data corresponding to the second display panel and the pixel values ​​and hues of the converted image data corresponding to the first display panel.

[0099] In the second step, pixel compensation is performed on the converted image data of the pixel point to be rendered and the pixel point set based on the first display parameter and the second display parameter to obtain sub-pixel data of the pixel point to be rendered and the pixel point set.

[0100] Here, by comparing the first display parameter with the second display parameter, the difference between the first display parameter and the second display parameter is determined; based on the difference, pixel compensation is performed on the converted image data corresponding to the first display panel, and pixel compensation is performed on the converted image data corresponding to the second display panel, thereby obtaining image data presented on the first display panel and image data presented on the second display panel, respectively.

[0101] In some possible implementations, the difference between pixel values ​​in the first display parameter and pixel values ​​in the second display parameter, as well as the difference between hues in the first display parameter and hues in the second display parameter, is determined. Interpolation is performed on the converted image data based on the difference in pixel values ​​and hues, thereby smoothing the interpolated sub-image data. Alternatively, the mean of the first display parameter and the second display parameter is determined, and the converted image data is adjusted based on the mean to obtain sub-pixel data for the pixel or pixel set to be rendered.

[0102] In an embodiment of the present application, for the converted image data in any display panel, the difference between the first display parameter and the second display parameter of the converted image data is determined, and pixel compensation is performed on the converted image data in the display panel according to the difference, so that the display parameters of the converted image data in the display panel are the same as the display parameters corresponding to other display panels connected in series, thereby being able to present an image picture with a natural transition in the boundary area of ​​the series.

[0103] The following describes the application of the display method provided in the embodiment of the present application in actual scenarios, taking the Cascade mode of sub-pixel rendering without additional time and space costs as an example.

[0104] In some embodiments, two types of 2×2 filters with different evaluation positions are set in the driver chip of each display screen of the dual display screen to achieve sub-pixel rendering. Figure 5As shown, the driver IC for left display screen 51 uses filter 52 with its evaluation position located in the upper right corner, while the driver IC for right display screen 53 uses filter 54 with its evaluation position located in the upper left corner. This way, when the filters calculate boundary pixel data, they do not need to transmit data from either side of the boundary to the IC on the other side via the SPI protocol, thus saving data transmission time and memory.

[0105] In some embodiments, a filter with n rows and 2 columns can also be used in the driver IC, again without the need for SPI protocol transmission of additional data. For the left display, the filter evaluation position can be anywhere on the right side of the filter; for the right display, the filter evaluation position can be anywhere on the left side of the filter, thus eliminating the need for SPI protocol transmission of additional data.

[0106] Since the 2×2 filters in the driver ICs of the two displays are different, the pixel data at the junction of the two displays may have an unnatural transition phenomenon. Therefore, pixel compensation is performed at the junction through interpolation or mean compensation to prevent color difference in this area.

[0107] In an embodiment of the present application, for a dual-screen device, different filters are set in the driver ICs of the two display screens so that valid data exists in the last column and the first column of each display screen, thereby eliminating the need to transmit additional data through the SPI protocol, thereby optimizing time and memory resources.

[0108] Based on the foregoing embodiments, an embodiment of the present application provides a display device, which includes the various units included and the various modules included in each unit, and can be implemented by a processor in a computer device; of course, it can also be implemented by a specific logic circuit; in the implementation process, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA), etc.

[0109] Figure 6 A schematic diagram of the structure of a sub-pixel rendering device provided in an embodiment of the present application is shown in FIG. Figure 6 As shown, the sub-pixel rendering device 600 includes:

[0110] A first acquisition module 601 is used to acquire an image to be rendered to be displayed on a first display panel;

[0111] A first determining module 602 is configured to determine a first positional relationship of the first display panel relative to a second display panel connected in series with the first display panel;

[0112] A second determining module 603 is configured to determine, in the image to be rendered, a set of pixels that matches the pixel to be rendered based on the first positional relationship;

[0113] The third determining module 604 is configured to determine target sub-pixel data of the pixel to be rendered based on the sub-pixel data of the pixel to be rendered and the pixel set.

[0114] In some embodiments, the second determining module 603 includes:

[0115] a first determining submodule, configured to determine a second positional relationship between positions of other pixels and the evaluation position, using the position of the pixel to be rendered as the evaluation position; wherein the other pixels are pixels other than the pixel to be rendered in the image to be rendered;

[0116] A first selection submodule is configured to select a set of pixel points that matches the pixel point to be rendered from the other pixel points based on the first position relationship and the second position relationship.

[0117] In some embodiments, the first determining submodule includes:

[0118] A first determining unit is configured to determine, among the other pixel points, at least one column of pixel points whose second positional relationship matches the first positional relationship and whose position is at least one column of pixel points whose distance from the evaluation position is less than a preset distance threshold;

[0119] A second determining unit is configured to determine, among the other pixel points, at least one row of pixel points whose positions are in the same column as the evaluation position and whose distance from the evaluation position is less than the preset distance threshold;

[0120] The third determining unit is configured to obtain the pixel point set based on the at least one column of pixel points and the at least one row of pixel points.

[0121] In some embodiments, the first acquisition module 601 includes:

[0122] a second determining submodule, configured to determine, in a boundary region where the first display panel and the second display panel are connected in series, transition image data to be output to the boundary region;

[0123] The third determining submodule is configured to determine the image data to be displayed on the first display panel in the transition image data as the image to be rendered.

[0124] In some embodiments, the third determining module 604 includes:

[0125] A first processing submodule is configured to perform sub-pixel processing on the image to be rendered to obtain sub-pixel data of the pixel to be rendered and the pixel set;

[0126] The first fusion submodule is configured to fuse the sub-pixel data of the pixel to be rendered and the sub-pixel data of the pixel set to obtain target sub-pixel data of the pixel to be rendered.

[0127] In some embodiments, the first processing submodule includes:

[0128] A first conversion unit, configured to perform sub-pixel conversion on the image to be rendered to obtain converted image data of the pixel point to be rendered and the pixel point set;

[0129] The first compensation unit is used to perform compensation processing on the converted image data of the pixel to be rendered and the pixel set based on the converted image data corresponding to the second display panel, so as to obtain sub-pixel data of the pixel to be rendered and the pixel set.

[0130] In some embodiments, the first compensation unit includes:

[0131] a first determining subunit, configured to determine first display parameters of the converted image data of the pixel point to be rendered and the pixel point set, and second display parameters of the converted image data corresponding to the second display panel;

[0132] The first compensation subunit is used to perform pixel compensation on the converted image data of the pixel point to be rendered and the pixel point set based on the first display parameter and the second display parameter to obtain sub-pixel data of the pixel point to be rendered and the pixel point set.

[0133] The description of the above device embodiment is similar to the description of the above method embodiment and has similar beneficial effects as the method embodiment. In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to perform the methods described in the above method embodiments. For technical details not disclosed in the device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0134] It should be noted that, in the embodiment of the present application, if the above-mentioned backlight control method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application, or the part that contributes to the relevant technology, can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a magnetic disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific hardware, software or firmware, or any combination of hardware, software and firmware.

[0135] An embodiment of the present application provides a display device, comprising: a first display panel, a second display panel, and a display driver chip;

[0136] The first display panel and the second display panel are connected in series;

[0137] The display driver chip is used to implement the steps in the above method and drive the first display panel and the second display panel to display the image after sub-pixel rendering of the image to be rendered.

[0138] An embodiment of the present application provides a computer device, including a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, some or all of the steps in the above method are implemented.

[0139] The present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements some or all of the steps in the above method. The computer-readable storage medium may be transient or non-transient.

[0140] An embodiment of the present application provides a computer program, including computer-readable code. When the computer-readable code is run in a computer device, a processor in the computer device executes some or all of the steps for implementing the above method.

[0141] An embodiment of the present application provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, implements some or all of the steps in the above method. The computer program product can be implemented specifically by hardware, software, or a combination thereof. In some embodiments, the computer program product is embodied as a computer storage medium. In other embodiments, the computer program product is embodied as a software product, such as a software development kit (SDK), etc.

[0142] It should be noted that the descriptions of the various embodiments above tend to emphasize the differences between the various embodiments, and their similarities or similarities can be referenced to each other. The descriptions of the above device, storage medium, computer program, and computer program product embodiments are similar to the descriptions of the above method embodiments and have similar beneficial effects as the method embodiments. For technical details not disclosed in the embodiments of the device, storage medium, computer program, and computer program product of this application, please refer to the description of the method embodiments of this application for understanding.

[0143] It should be noted that Figure 7 A schematic diagram of a hardware entity of a computer device in an embodiment of the present application is shown in FIG. Figure 7 As shown, the hardware entity of the computer device 700 includes: a processor 701, a communication interface 702 and a memory 703, wherein:

[0144] Processor 701 generally controls the overall operation of computer device 700 .

[0145] The communication interface 702 enables the computer device to communicate with other terminals or servers through a network.

[0146] The memory 703 is configured to store instructions and applications executable by the processor 701. It can also cache data to be processed or processed by the processor 701 and various modules in the computer device 700 (for example, image data, audio data, voice communication data, and video communication data). This can be implemented using flash memory (FLASH) or random access memory (RAM). Data can be transmitted between the processor 701, the communication interface 702, and the memory 703 via a bus 704.

[0147] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned steps / processes does not mean the order of execution, and the execution order of each step / process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The above-mentioned serial numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments.

[0148] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0149] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0150] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed across multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the scheme of this embodiment.

[0151] In addition, all functional units in the embodiments of the present application can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the above-mentioned integrated units can be implemented in the form of hardware or in the form of hardware plus software functional units.

[0152] Those skilled in the art will understand that all or part of the steps of implementing the above-mentioned method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above-mentioned method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, and other media that can store program codes.

[0153] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the relevant technology, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0154] The above is only an implementation method of the present application, but the scope of protection of the present application is not limited thereto. Any technician familiar with this technical field can easily think of changes or replacements within the technical scope disclosed in this application, which should be covered by the scope of protection of the present application.

Claims

1. A sub-pixel rendering method, characterized in that: The method comprises: Acquire an image to be rendered to be displayed on a first display panel; determining a first positional relationship of the first display panel relative to a second display panel connected in series with the first display panel; Based on the first positional relationship, determining a set of pixel points that matches the pixel point to be rendered in the image to be rendered; Determining target sub-pixel data of the pixel to be rendered based on the sub-pixel data of the pixel to be rendered and the pixel set; The step of determining, in the image to be rendered, a set of pixel points that matches the pixel points to be rendered based on the first positional relationship includes: Taking the position of the pixel to be rendered as the evaluation position, determining a second positional relationship between the positions of other pixel points and the evaluation position; wherein the other pixel points are pixel points other than the pixel to be rendered in the image to be rendered; Determine, among the other pixel points, at least one column of pixel points whose second positional relationship matches the first positional relationship and whose position is at a distance from the evaluation position less than a preset distance threshold; Determine, among the other pixel points, at least one row of pixel points whose positions are in the same column as the evaluation position and whose distance from the evaluation position is less than the preset distance threshold; The pixel point set is obtained based on the at least one column of pixel points and the at least one row of pixel points.

2. The method according to claim 1, characterized in that The step of obtaining an image to be rendered and to be displayed on the first display panel includes: In a boundary region where the first display panel and the second display panel are connected in series, determining transition image data to be output to the boundary region; The image data to be displayed on the first display panel in the transition image data is determined as the image to be rendered.

3. The method according to claim 1, characterized in that The determining target sub-pixel data of the pixel to be rendered based on the sub-pixel data of the pixel to be rendered and the pixel set includes: Performing sub-pixel processing on the image to be rendered to obtain sub-pixel data of the pixel to be rendered and the pixel set; The sub-pixel data of the pixel point to be rendered and the sub-pixel data of the pixel point set are fused to obtain target sub-pixel data of the pixel point to be rendered.

4. The method according to claim 3, characterized in that The performing sub-pixel processing on the image to be rendered to obtain sub-pixel data of the pixel to be rendered and the pixel set includes: Performing sub-pixel conversion on the image to be rendered to obtain converted image data of the pixel point to be rendered and the pixel point set; Based on the converted image data corresponding to the second display panel, compensation processing is performed on the converted image data of the pixel to be rendered and the pixel set respectively to obtain sub-pixel data of the pixel to be rendered and the pixel set.

5. The method according to claim 4, characterized in that The method of performing compensation processing on the converted image data of the pixel to be rendered and the pixel set based on the converted image data corresponding to the second display panel to obtain sub-pixel data of the pixel to be rendered and the pixel set includes: Determining first display parameters of the converted image data of the pixel point to be rendered and the pixel point set, and second display parameters of the converted image data corresponding to the second display panel; Based on the first display parameter and the second display parameter, pixel compensation is performed on the converted image data of the pixel point to be rendered and the pixel point set to obtain sub-pixel data of the pixel point to be rendered and the pixel point set.

6. A sub-pixel rendering device, characterized in that: The sub-pixel rendering device includes: A first acquisition module, configured to acquire an image to be rendered to be displayed on a first display panel; a first determining module, configured to determine a first positional relationship of the first display panel relative to a second display panel connected in series with the first display panel; A second determining module is configured to determine, in the image to be rendered, a set of pixels that matches the pixel to be rendered based on the first positional relationship; a third determining module, configured to determine target sub-pixel data of the pixel to be rendered based on the sub-pixel data of the pixel to be rendered and the pixel set; The second determining module is specifically configured to: determine a second positional relationship between positions of other pixel points and the evaluation position, using the position of the pixel point to be rendered as the evaluation position; wherein the other pixel points are pixel points other than the pixel point to be rendered in the image to be rendered; Determine, among the other pixel points, at least one column of pixel points whose second positional relationship matches the first positional relationship and whose position is at a distance from the evaluation position less than a preset distance threshold; Determine, among the other pixel points, at least one row of pixel points whose positions are in the same column as the evaluation position and whose distance from the evaluation position is less than the preset distance threshold; The pixel point set is obtained based on the at least one column of pixel points and the at least one row of pixel points.

7. A display device, characterized in that: The display device includes: a first display panel, a second display panel and a display driver chip; The first display panel and the second display panel are connected in series; The display driver chip is used to implement the steps in the method according to any one of claims 1 to 5, and drive the first display panel and the second display panel to display an image after sub-pixel rendering of the image to be rendered.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.

Images