Display driving chip and display method of display screen

Abstract

The application provides a display driving chip and a display method of a display screen, comprising: a gray scale conversion unit, an image compressor, an inter-frame differentiator and a frame rate control unit; the gray scale conversion unit is used for converting video frames of an input video stream into gray scale images; the image compressor is used for compressing the gray scale images in a preset direction to obtain compressed images of each video frame; the inter-frame differentiator is used for performing difference calculation on continuous multiple compressed images to obtain a difference calculation result; the frame rate control unit is used for determining the activity of a functional area in the display screen according to touch information of the display screen, the difference calculation result and a preset threshold, and setting a corresponding refresh frame rate for the functional area according to the activity of the functional area; wherein the higher the activity of the functional area, the greater the refresh frame rate of the functional area. The application achieves the purpose of reducing the energy consumption of the display screen on the basis of guaranteeing the user experience of the display screen.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a display driver chip and a display method for a display screen. Background Technology

[0002] During the operation of display devices, the power consumption generated by the display screen accounts for a very high proportion. Therefore, controlling the power consumption of the display screen is an important means to reduce the energy consumption of display devices.

[0003] Currently, one approach to control power consumption of a display is to reduce its brightness. Another approach is to reduce the number of times the capacitors in the display are charged and discharged.

[0004] However, current solutions for reducing screen brightness will affect the overall performance of the screen, while solutions for reducing the number of times the capacitors in the screen are charged and discharged will reduce the screen refresh rate, which will also affect the overall performance of the screen. Summary of the Invention

[0005] This application provides a display driver chip and a display method for a display screen, in order to solve the problem that the energy consumption control scheme of the display screen in the prior art will affect the overall performance of the display screen.

[0006] In a first aspect, embodiments of this application provide a display driver chip, the display driver chip comprising:

[0007] Grayscale conversion unit, image compressor, inter-frame difference unit, and frame rate control unit;

[0008] The grayscale conversion unit is used to convert video frames of the input video stream into grayscale images;

[0009] The image compressor is used to compress the grayscale image in a preset direction to obtain a compressed image of each video frame;

[0010] The inter-frame differencer is used to perform differential calculations on multiple consecutive frames of the compressed image to obtain the differential calculation results;

[0011] The frame rate control unit is used to determine the activity level of the functional area in the display screen based on the touch information of the display screen, the differential calculation result and the preset threshold, and to set the corresponding refresh frame rate for the functional area based on the activity level of the functional area.

[0012] The higher the activity level of a functional area, the higher its refresh rate.

[0013] Secondly, embodiments of this application provide a method for displaying a screen, the method comprising:

[0014] Convert video frames from the input video stream to grayscale images;

[0015] The grayscale image is compressed in a preset direction to obtain a compressed image of each video frame;

[0016] Differential calculation is performed on multiple consecutive frames of the compressed image to obtain the differential calculation result;

[0017] Based on the touch information of the display screen, the differential calculation result, and the preset threshold, the activity level of the functional area in the display screen is determined, and a corresponding refresh rate is set for the functional area based on the activity level of the functional area.

[0018] The higher the activity level of a functional area, the higher its refresh rate.

[0019] This application embodiment considers the hardware resource cost of the display device. First, it reduces data resource consumption and computing costs through compression and grayscale conversion. Then, based on the user's usage of the display screen, it flexibly calculates the activity level of each functional area on the display screen. Different refresh rate frames are executed for functional areas with different activity levels, ensuring that the refresh rate of functional areas with higher activity levels is higher. In this way, executing a high refresh rate in functional areas with high activity levels does not affect the user's current usage experience for these areas. On the other hand, executing a low refresh rate in functional areas with low activity levels reduces the refresh rate of low-activity functional areas that are not of high user attention, thereby reducing the number of capacitor charging and discharging cycles in these lower-activity functional areas and achieving the goal of reducing the display screen's energy consumption.

[0020] The above description is only an overview of the technical solution of this application. In order to better understand the technical means of this application and to implement it in accordance with the contents of the specification, and to make the above and other objects, features and advantages of this application more obvious and understandable, the following are specific embodiments of this application. Attached Figure Description

[0021] Figure 1 This is a structural block diagram of a display driver chip provided in an embodiment of this application;

[0022] Figure 2 This is a schematic diagram of image compression provided in an embodiment of this application;

[0023] Figure 3 This is a display screen interface diagram provided in an embodiment of this application;

[0024] Figure 4 This is an operational logic diagram of an inter-frame differential provided in an embodiment of this application;

[0025] Figure 5This is a flowchart of a pixel row activity determination method provided in an embodiment of this application;

[0026] Figure 6 This is another display screen interface diagram provided in the embodiments of this application;

[0027] Figure 7 This is an execution flowchart of a frame rate divider provided in an embodiment of this application;

[0028] Figure 8 This is a flowchart illustrating the steps of a display method for a display screen according to an embodiment of this application;

[0029] Figure 9 This is a logic block diagram of a display device provided in an embodiment of this application;

[0030] Figure 10 This is a logic block diagram of another display device provided in the embodiments of this application. Detailed Implementation

[0031] Exemplary embodiments of the present application will now be described in more detail with reference to the accompanying drawings. While exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this application will be thorough and complete, and will fully convey the scope of the present application to those skilled in the art.

[0032] In the embodiments of this application, reference is made to Figure 1 The diagram illustrates a block diagram of a display driver chip, which includes: a grayscale conversion unit, an image compressor, an inter-frame difference unit, and a frame rate control unit.

[0033] The grayscale conversion unit is used to convert video frames from the input video stream into grayscale images;

[0034] The image compressor is used to compress grayscale images in a preset direction to obtain a compressed image for each video frame;

[0035] The inter-frame differencer is used to perform differential calculations on multiple consecutive compressed images to obtain the differential calculation results;

[0036] The frame rate control unit is used to determine the activity level of functional areas on the display screen based on the touch information of the display screen, the differential calculation results, and the preset threshold, and to set the corresponding refresh frame rate for the functional areas according to their activity level; the higher the activity level of the functional area, the higher the refresh frame rate.

[0037] In this embodiment, the grayscale conversion unit and the image compressor are designed to reduce the hardware resource costs of the display device by first reducing the data resource consumption and computing costs through grayscale conversion and image compression, so that the display screen energy consumption control scheme can be executed in a lightweight and efficient manner.

[0038] Specifically, the grayscale conversion unit is used to convert video frames of the input video stream into grayscale images. Storing video frames as grayscale images can save about two-thirds of the storage space, and grayscale images do not affect the accuracy of subsequent detection and calculation, still ensuring high precision.

[0039] Optionally, the grayscale conversion unit includes a shifter and an adder; the grayscale conversion unit performs grayscale conversion calculations on the video frames of the input video stream through the shifter and adder to obtain a grayscale image.

[0040] In this embodiment of the application, converting a color video frame into a grayscale image can be achieved based on conversion formula 1:

[0041] Conversion Formula 1: GRAY = (R × 19595 + G × 38469 + B × 7472) >> 16;

[0042] Where GRAY is the pixel value of the pixel in the converted grayscale image, R is the red channel pixel value of the pixel in the original video frame, G is the green channel pixel value of the pixel in the original video frame, B is the blue channel pixel value of the pixel in the original video frame, and >> is the right shift operation, which is equivalent to the division operation.

[0043] In the specific implementation of conversion formula 1, to avoid the additional overhead of multiplication operations, the grayscale conversion unit can use a shifter to replace multiplication operations. Combined with an adder to implement conversion formula 1, the grayscale conversion unit can then achieve grayscale conversion based on conversion formula 2 through the shifter and adder.

[0044] Gray=[(R<<14+R<<11+R<<10+R<<6+R<<3+R<<1+R)+(G<<15+G<<12+G<<10+G<<9+G<<6+G<<2+G)+(B<<12+B<<11+B<<10+B<<8+B<<5+B<<4)]>>16

[0045] Where GRAY represents the pixel value of the converted grayscale image, R represents the red channel pixel value of the original video frame, G represents the green channel pixel value of the original video frame, B represents the blue channel pixel value of the original video frame, >> represents the right shift operation (equivalent to division), and << represents the left shift operation (equivalent to multiplication).

[0046] As can be seen, the embodiments of this application achieve grayscale conversion through shifters and adders, which achieves the accuracy requirements of grayscale conversion while saving resource consumption.

[0047] Furthermore, the image compressor is used to compress the grayscale image in a preset direction to obtain a compressed image for each video frame. After image compression, the amount of image data can be further reduced, thereby reducing the occupation of hardware resources. Optionally, the preset direction used by the image compressor during compression includes: the horizontal direction and / or the vertical direction.

[0048] Specifically, the image compression in this application embodiment is performed in a preset direction, which includes the horizontal direction and / or the vertical direction. After compression, the size of the image in the preset direction becomes smaller, and the compression process does not change the grayscale value of the grayscale image, but only reduces the number of sample points in the pixel row or pixel column, so it will not affect the accuracy of the image content.

[0049] For example, refer to Figure 2 , where a is the compressed image obtained by compressing the original image by half its size in the horizontal direction, b is the compressed image obtained by compressing the original image by half its size in the vertical direction, and c is the compressed image obtained by compressing the original image by half its size in both the vertical and horizontal directions.

[0050] In this embodiment of the application, the inter-frame differencer is used to perform differential calculation on a series of compressed images to obtain differential calculation results. The differential calculation results participate in the subsequent detection and calculation process, which makes it easier to detect pixels that have changed in the functional areas of the display screen.

[0051] Furthermore, the frame rate control unit can determine the activity level of functional areas on the display screen based on touch information, differential calculation results, and preset thresholds. These functional areas can be pre-defined regions on the display screen or regions defined by the user's region-division operations. For example, refer to... Figure 3 The diagram shows a display interface comprising four different functional areas: a status bar area for displaying status information such as time, battery level, and signal strength; a content display area for playing multimedia content such as videos; an application information area for displaying application information, such as push notifications; and a comment area for displaying, editing, and publishing comments.

[0052] In addition, the frame rate control unit can determine the frequency of operations and screen changes in the functional area based on the touch information of the display screen and the differential calculation results. Then, it compares this information with relevant thresholds to determine the activity level of the functional area. Figure 3In the middle, the content display area is playing a video, and the screen changes frequently, so it is determined to be a high-activity area. In the comment area, users are entering comments through touch, which means that touch is frequent, so it is also determined to be a high-activity area. In contrast, the status bar area and the application information area have relatively fixed screens and less touch activity, so they are determined to be low-activity areas.

[0053] Subsequently, the frame rate control unit can set a corresponding refresh frame rate for each functional area based on its activity level. Functional areas with higher activity levels are set with higher refresh frame rates, while those with lower activity levels are set with lower refresh frame rates. This achieves the technical effect of dynamically adjusting the refresh rate across different areas of the display screen.

[0054] This application embodiment considers the hardware resource cost of the display device. First, it reduces data resource consumption and computing costs through compression and grayscale conversion. Then, based on the user's usage of the display screen, it flexibly calculates the activity level of each functional area on the display screen. Different refresh rate frames are executed for functional areas with different activity levels, ensuring that the refresh rate of functional areas with higher activity levels is higher. In this way, executing a high refresh rate in functional areas with high activity levels does not affect the user's current usage experience for these areas. On the other hand, executing a low refresh rate in functional areas with low activity levels reduces the refresh rate of low-activity functional areas that are not of high user attention, thereby reducing the number of capacitor charging and discharging cycles in these lower-activity functional areas and achieving the goal of reducing the display screen's energy consumption.

[0055] Optional, refer to Figure 1 The display driver chip also includes a memory, which includes multiple storage units. The multiple storage units are used to store multiple consecutive historical compressed images preceding the current frame compressed image. Preferably, each storage unit stores one historical compressed image, but each storage unit can also store multiple historical compressed images.

[0056] The inter-frame differencer is used to extract multiple frames of historical compressed images from multiple storage units, and calculate the first difference value between the current frame compressed image and the historical compressed images, as well as the second difference value between the historical compressed images, so as to obtain the difference calculation result including the first difference value and the second difference value.

[0057] In this embodiment, the memory can be a random access memory (RAM) including multiple memory cells. Each memory cell can be a static random-access memory (SRAM). Preferably, each memory cell can store one frame of historical compressed image, allowing the memory to store multiple consecutive frames of historical compressed images. Furthermore, the inter-frame differencer can retrieve the historical compressed images used for difference calculation from the memory and, in conjunction with the currently input compressed image, calculate a first difference value between the current frame compressed image and the historical compressed images, as well as a second difference value between the historical compressed images.

[0058] For example, in one implementation, the memory is assumed to include two SRAMs, which are used to store the two previous frames of historical compressed images of the current frame. The capacity of the SRAM is determined by the maximum resolution supported by the display screen. If the maximum resolution of the display screen is m×n, then the minimum capacity of a single SRAM is (m×n÷2)×8 bits.

[0059] Furthermore, referring to Figure 4 This diagram illustrates the operational logic of an inter-frame differential. Based on a memory design including two SRAMs, the inter-frame differential implements a dynamic pixel overlay algorithm. This algorithm calculates on three compressed images (two historical compressed images plus one current compressed image) to make it easier to detect pixels that have changed in the functional area. Specifically, the inter-frame differential can obtain two historical compressed images α and β from SRAM1 and SRAM2 through the memory controller. Differentiator 1 of the inter-frame differential takes the current compressed image δ and the historical compressed image α as input, and calculates the first difference value between the current compressed image and the historical compressed image. Differentiator 2 of the inter-frame differential takes the historical compressed image α and the historical compressed image β as input, and calculates the second difference value between the historical compressed images.

[0060] It should be noted that the embodiments of this application do not specifically limit the number of historical compressed images used when the inter-frame differential performs differential calculations, or the combination of images involved in the differential value calculation.

[0061] Optional, refer to Figure 1 The frame rate control unit includes: a line display mode determination subunit and a frame rate divider; the line display mode determination subunit is used to determine the activity level of pixel rows in the functional area based on the differential calculation result and the first threshold, and to determine the activity level of the functional area based on the activity level of the pixel rows included in the functional area; the frame rate divider is used to determine the refresh frame rate of the functional area based on the activity level of the functional area.

[0062] In this embodiment, the frame rate control unit includes a horizontal display mode determination subunit and a frame rate divider. The horizontal display mode determination subunit is used to determine the activity level of a functional area, and the frame rate divider is used to determine the refresh frame rate of the functional area based on its activity level. The display driver chip also includes a threshold control module, which provides two sets of parameters: threshold parameter group 1 (including a first threshold, a second threshold, etc.) and threshold parameter group 2 (including X, Y, I, J, P, etc.). Threshold parameter group 1 is used by the horizontal display mode determination subunit to determine the activity level of the functional area through threshold judgment, and threshold parameter group 2 is used by the frame rate divider to determine the refresh frame rate of the functional area through threshold judgment. Specifically, the parameters in threshold parameter group 1 and threshold parameter group 2 can be set by the user according to actual needs, so that the activity level division effect and refresh frame rate setting effect of the functional area can meet the actual user requirements.

[0063] In addition, in the process of determining the activity level of the functional area, the row display mode judgment subunit first judges the activity level of each pixel row in the functional area based on the differential calculation results and relevant thresholds, and then determines the activity level of the functional area based on the activity level of each pixel row in the functional area and relevant thresholds.

[0064] Optionally, the difference calculation result includes a first difference value between the current frame compressed image and the historical compressed images, and a second difference value between the historical compressed images; the line display mode determination subunit is specifically used to: select the larger value between the first difference value and the second difference value as the effective value of the current frame compressed image; compare the effective value of each current frame compressed image with a first threshold to obtain a comparison result; and determine the activity level of the pixel row in the functional area based on the comparison result and the second threshold.

[0065] Reference Figure 5 It shows the process by which the line display mode determination subunit determines the activity level of a pixel row. The line display mode determination subunit performs activity level classification and counting of pixels in each pixel row through the inter-frame difference method, and finally realizes the activity level classification of each pixel row.

[0066] First, the effective data Ddiff of each frame's compressed image can be determined based on the first difference value fα and the second difference value fβ corresponding to each frame. The selection strategy is to choose the larger of the first difference value fα and the second difference value fβ. If fα ≥ fβ, then Ddiff is selected. diff =fα; if fα < fβ, then D diff =fβ. This determines the effective data D of the compressed image in each frame. diff Then, the effective value D of the compressed image in each current frame is... diffThe results are compared with the first threshold θ_2 to obtain the comparison results. Based on the comparison results and the second threshold, the activity level of the pixel row in the functional area is determined.

[0067] Optionally, the second threshold includes a first value θ_3 and a second value θ_4; the line display mode judgment subunit is specifically used to: when a comparison result in which the effective value is greater than or equal to the first threshold is obtained, increment the high activity count value H by 1; when a comparison result in which the effective value is less than the first threshold is obtained, increment the medium activity count value M by 1.

[0068] If the result of M×ω1+H×ω2 is less than the first value, the activity level of the pixel row is determined to be low.

[0069] If the result of M×ω1+H×ω2 is greater than or equal to the first value, and the result of M×ω1+H×ω2 is less than the second value, then the activity level of the pixel row is determined to be medium activity.

[0070] If the result of M×ω1+H×ω2 is greater than or equal to the first value, and the result of M×ω1+H×ω2 is greater than or equal to the second value, the activity level of the pixel row is determined to be high activity.

[0071] In this embodiment of the application, activity level can include: low activity level, medium activity level, and high activity level; refer to Figure 5 Specifically, in compressing the effective value D of each current frame image... diff Each value is compared with the first threshold θ_2. After obtaining the comparison results, if the effective value D is... diff If the value is greater than or equal to the first threshold θ_2, then the pixel is considered to be a highly active pixel row, and the high-activity count value H can be incremented by 1; if the effective value D diff If the value is less than the first threshold θ_2, it is considered that the probability of the pixel row being active is relatively high. At this time, the active pixel count value M can be incremented by 1. As the comparison continues, the effective value D can be continuously used to identify the most active pixels. diff The comparison result with the first threshold θ_2 is used to update the values ​​of H and M until the row counting is completed. The obtained value of H reflects the weight of highly active pixels, and the obtained value of M reflects the weight of moderately active pixels. The values ​​of H and M, as well as the constant parameter ω, are then considered. 1、For ω2, a low activity determination can be performed: that is, when the result of M×ω1+H×ω2 is less than the first value θ_3, the activity of the pixel row is determined as low activity; additionally, when the result of M×ω1+H×ω2 is greater than or equal to the first value θ_3, a further new determination is performed, that is, the comparison result between the result of M×ω1+H×ω2 and the second value θ_4 is determined. If the result of M×ω1+H×ω2 is less than the second value θ_4, the activity of the pixel row is determined as medium activity; if the result of M×ω1+H×ω2 is greater than or equal to the second value θ_4, the activity of the pixel row is determined as high activity. Therefore, based on the above determination process, through the comparison between the difference result and the threshold, the change of pixel points in the pixel row is identified, and thus the purpose of determining the activity of the pixel row is achieved.

[0072] Optionally, the activity includes: low activity, medium activity and high activity; the row display mode determination sub-unit is specifically configured to: when the functional area includes at least X low-activity pixel rows and this lasts for at least Y consecutive frames, the functional area is determined as low activity; when the functional area includes I low-activity pixel rows and J medium-activity pixel rows, this lasts for at least P consecutive frames, and I×ω3+J×ω4<T, the functional area is determined as medium activity; when the functional area is neither low activity nor medium activity, or the functional area receives a touch operation, the functional area is determined as high activity.

[0073] In the embodiment of the present application, after the row display mode determination sub-unit completes Figure 5 the determination process and determines the activity of pixel rows in the functional area, the row display mode determination sub-unit can further determine the activity of the functional area according to the activity of pixel rows in the functional area. The process specifically includes:

[0074] Judgment condition for low-activity functional area: when the functional area includes at least X low-activity pixel rows and this lasts for at least Y consecutive frames, this indicates that a large number of low-activity pixel rows continuously and stably appear in the functional area, so the functional area is determined as low activity. In addition, the premise for satisfying this judgment condition for low-activity functional area is that there is no touch operation in the functional area.

[0075] Judgment condition for medium-activity functional area: when the functional area includes I low-activity pixel rows and J medium-activity pixel rows, this lasts for at least P consecutive frames, and I×ω3+J×ω4<T, the functional area is determined as medium activity. This indicates that moderate pixel changes continuously and stably occur in the functional area, so the functional area is determined as medium activity. In addition, the premise for satisfying this judgment condition for medium-activity functional area is that there is no touch operation in the functional area.

[0076] Criteria for determining high activity level of a functional area: When a functional area is neither low nor medium activity level, or when a functional area receives a touch operation, the functional area can be determined to be highly active.

[0077] Where X, Y, P, T, I, and J are preset thresholds, and ω3 and ω4 are constant parameters.

[0078] Specifically, the values ​​of X, Y, P, T, I, J, ω3, and ω4 can be set based on actual needs. In one scenario, the values ​​can be set based on the sensitivity of refresh rate adjustment. When a higher sensitivity to refresh rate adjustment is desired, the values ​​of X, Y, P, T, I, and J can be set smaller. This makes it easier to detect low- to medium-activity functional areas, thus triggering refresh rate adjustments more frequently. Conversely, the values ​​of X, Y, P, T, I, and J can be set larger. Additionally, ω3 is the weight for low-activity pixel rows, and ω4 is the weight for medium-activity pixel rows. To increase sensitivity for low-activity pixel rows, the value of ω3 can be set relatively large; similarly, to increase sensitivity for medium-activity pixel rows, the value of ω4 can be set relatively large.

[0079] It should be noted that, referring to Figure 1 The display device also includes a touch detection module, a reset module, and a status monitor. The touch detection module detects user touch operations on the display screen and converts these operations into touch signals, which are then sent to the reset module and the status monitor. The status monitor determines the user's activity level within a certain time range based on the touch signals. Upon receiving a touch signal, the reset module sends a reset signal to the frame rate control unit. The frame rate control unit then sets the functional area where the touch operation occurred to a high activity level, thereby setting a high refresh rate for that functional area to meet its performance requirements under frequent use. In short, the functional area where the touch action occurs is the area the user is currently focusing on and operating on. Setting a high activity level and a high refresh rate for this functional area aims to improve its display effect and touch response sensitivity.

[0080] Optional, refer to Figure 1The line display mode determination subunit is also used for: receiving the user status sent by the status monitor; for low-activity functional areas, if any of the following conditions are met: a touch operation occurs in the low-activity functional area, a row of pixels with medium or high activity appears in the low-activity functional area for K consecutive frames, or the user status is medium or high activity, the low-activity status of the functional area is cancelled and the activity level of the functional area is redefined; for medium-activity functional areas, if any of the following conditions are met: a touch operation occurs in the medium-activity functional area, the result of I×ω3+J×ω4 in the medium-activity functional area for K consecutive frames is greater than or equal to T, or the user status is high activity, the medium-activity status of the functional area is cancelled and the activity level of the functional area is redefined.

[0081] In the embodiments of this application, reference is made to Figure 1 The display device also includes a status monitor, which is used to determine the user status within a certain time range based on the touch signals received from the touch detection module. The user status is divided into low activity, medium activity and high activity.

[0082] In addition, this application also provides a strategy for updating the activity of functional areas:

[0083] Low-activity timeliness conditions for low-activity functional areas: If any of the following conditions are met: a touch operation occurs in the low-activity functional area, a row of pixels with medium or high activity appears in the low-activity functional area for K consecutive frames, or the user is in a medium or high activity state, it can be determined that the user is currently paying more attention to the functional area and has more active operation injection. At this time, the low-activity status of the functional area can be canceled and the activity status of the functional area can be re-determined.

[0084] The conditions for medium activity in a medium-activity functional area are as follows: if any of the following conditions are met, it can be determined that the user is currently paying more attention to the functional area and has a very active operation. At this time, the medium activity of the functional area can be canceled and the activity of the functional area can be redefined.

[0085] Specifically, the value of K can be set based on actual needs. In one case, the value of K can be set based on the activity reset sensitivity. If a higher sensitivity to activity reset is desired, the value of K can be set smaller, making it easier to trigger the activity reset; conversely, the value of K can be set larger.

[0086] This application embodiment continuously updates the activity level of functional areas by real-time monitoring, thereby matching the complex usage of the display screen (i.e., a functional area on the display screen is sometimes busy and sometimes almost inactive), forming an adaptive refresh rate adjustment scheme.

[0087] Optionally, the frame rate divider is specifically used for: receiving user status sent by the status monitor; when no touch operation occurs in the functional area and the user status is low activity, setting a first refresh frame rate for the low activity functional area, setting a second refresh frame rate for the medium activity functional area, and setting a third refresh frame rate for the high activity functional area; when a touch operation occurs in the functional area or the user status is medium / high activity, setting a third refresh frame rate for the functional area; wherein, the third refresh frame rate is greater than the second refresh frame rate, and the second refresh frame rate is greater than the first refresh frame rate.

[0088] In this embodiment, based on the low-activity, medium-activity, and high-activity division of functional areas, this embodiment can set a first refresh frame rate corresponding to low activity, a second refresh frame rate corresponding to medium activity, and a third refresh frame rate corresponding to high activity, wherein the third refresh frame rate is greater than the second refresh frame rate, and the second refresh frame rate is greater than the first refresh frame rate. When no touch operation occurs in the functional area and the user state is low activity, the first refresh frame rate is set for the low-activity functional area, the second refresh frame rate is set for the medium-activity functional area, and the third refresh frame rate is set for the high-activity functional area.

[0089] This allows for high refresh rates in highly active functional areas without affecting the user experience. Conversely, low refresh rates are applied to less active areas, reducing capacitor charging and discharging cycles and thus lowering energy consumption. Finally, moderate refresh rates are applied to moderately active areas, balancing energy efficiency with a good user experience.

[0090] For example, in one implementation, the first refresh rate corresponding to low activity can be 30 Hz, the second refresh rate corresponding to medium activity can be 60 Hz, and the third refresh rate corresponding to high activity can be 90 Hz, as shown in the reference. Figure 6 If area 1 of the display screen is determined to be low activity, area 2 is determined to be high activity, and area 3 is determined to be medium activity, then area 1 will implement a refresh rate of 30 Hz, area 2 will implement a refresh rate of 90 Hz, and area 3 will implement a refresh rate of 60 Hz.

[0091] Specifically, this application embodiment has two high-priority execution strategies. First, whenever a touch operation occurs in the functional area, the functional area is set to high activity for the duration of the touch operation, and a high refresh rate is executed in that functional area. Second, if the user is in a medium / high activity state, the functional area is set to high activity for the duration of the medium / high activity state, and a high refresh rate is executed in that functional area. This priority strategy ensures that the performance of the functional area is optimal when the user is using it or when the user is in an active state, thereby providing a better user experience.

[0092] Furthermore, in display devices that simultaneously support the first, second, and third refresh rate, a default refresh rate can be determined. The default screen refresh rate is generally the maximum third refresh rate, which is applicable to high-activity functional areas. During the period when the activity level of a functional area is high and no new activity level has been determined, the functional area executes the default refresh rate.

[0093] Reference Figure 7 The flowchart illustrates the execution process of the frame rate divider, including: first, determining if a pixel row is the first row of the first frame; if so, classifying the region and adding the pixel row to the region's statistical results; otherwise, directly classifying the region and adding the pixel row to the region's statistical results; then, determining if the region's statistical results meet the region's activity criteria; if so, classifying the region's activity and updating the screen refresh rate accordingly; if not, waiting for the next pixel row input. Additionally, the screen refresh rate update step also occurs when there is a user activity update or a reset caused by a touch operation.

[0094] In summary, this application embodiment considers the hardware resource cost of the display device. First, it reduces data resource consumption and computational cost through compression and grayscale conversion. Then, based on the user's usage of the display screen, it flexibly calculates the activity level of each functional area on the display screen. Different refresh rates are executed for functional areas with different activity levels, ensuring that the refresh rate is higher for functional areas with higher activity. In this way, executing a high refresh rate in a highly active functional area does not affect the user's current experience of using the highly active functional area. Executing a low refresh rate in a less active functional area reduces the refresh rate for less active functional areas that are not of high user attention, thereby reducing the number of capacitor charging and discharging cycles in less active functional areas and achieving the goal of reducing the display screen's energy consumption.

[0095] Reference Figure 8 It illustrates a flowchart of a display method for a screen, including:

[0096] Step 101: Convert the video frames of the input video stream into grayscale images.

[0097] Step 102: Compress the grayscale image in a preset direction to obtain a compressed image of each video frame.

[0098] Step 103: Perform differential calculation on multiple consecutive frames of the compressed image to obtain the differential calculation result.

[0099] Step 104: Determine the activity level of the functional area in the display screen based on the touch information of the display screen, the differential calculation result, and the preset threshold, and set the corresponding refresh rate for the functional area based on the activity level of the functional area.

[0100] The higher the activity level of a functional area, the higher its refresh rate.

[0101] In the embodiments of this application, the implementation process of steps 101-104 can be specifically referred to the description of the above embodiments, and will not be repeated here.

[0102] In summary, this application embodiment considers the hardware resource cost of the display device. First, it reduces data resource consumption and computational cost through compression and grayscale conversion. Then, based on the user's usage of the display screen, it flexibly calculates the activity level of each functional area on the display screen. Different refresh rates are executed for functional areas with different activity levels, ensuring that the refresh rate is higher for functional areas with higher activity. In this way, executing a high refresh rate in a highly active functional area does not affect the user's current experience of using the highly active functional area. Executing a low refresh rate in a less active functional area reduces the refresh rate for less active functional areas that are not of high user attention, thereby reducing the number of capacitor charging and discharging cycles in less active functional areas and achieving the goal of reducing the display screen's energy consumption.

[0103] Figure 9 This is a block diagram illustrating a display device 600 according to an exemplary embodiment. For example, the display device 600 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.

[0104] Reference Figure 9 The display device 600 may include one or more of the following components: a processing component 602, a memory 604, a power supply component 606, a multimedia component 608, an audio component 610, an input / output (I / O) interface 612, a sensor component 614, and a communication component 616.

[0105] Processing component 602 typically controls the overall operation of display device 600, such as operations associated with display, telephone calls, data communication, camera operation, and recording. Processing component 602 may include one or more processors 620 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 602 may include one or more modules to facilitate interaction between processing component 602 and other components. For example, processing component 602 may include a multimedia module to facilitate interaction between multimedia component 608 and processing component 602.

[0106] Memory 604 is used to store various types of data to support the operation of display device 600. Examples of this data include instructions for any application or method operating on display device 600, contact data, phonebook data, messages, pictures, multimedia, etc. Memory 604 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0107] Power supply component 606 provides power to various components of display device 600. Power supply component 606 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to display device 600.

[0108] Multimedia component 608 includes a screen that provides an output interface between the display device 600 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 608 includes a front-facing camera and / or a rear-facing camera. When the display device 600 is in an operating mode, such as a shooting mode or a multimedia mode, the front-facing camera and / or rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0109] Audio component 610 is used to output and / or input audio signals. For example, audio component 610 includes a microphone (MIC) used to receive external audio signals when display device 600 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 604 or transmitted via communication component 616. In some embodiments, audio component 610 also includes a speaker for outputting audio signals.

[0110] I / O interface 612 provides an interface between processing component 602 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0111] Sensor assembly 614 includes one or more sensors for providing state assessments of various aspects of display device 600. For example, sensor assembly 614 may detect the on / off state of display device 600, the relative positioning of components such as the display and keypad of display device 600, changes in the position of display device 600 or a component of display device 600, the presence or absence of user contact with display device 600, the orientation or acceleration / deceleration of display device 600, and temperature changes of display device 600. Sensor assembly 614 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 614 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 614 may also include an accelerometer, gyroscope, magnetometer, pressure sensor, or temperature sensor.

[0112] Communication component 616 facilitates wired or wireless communication between display device 600 and other devices. Display device 600 can access wireless networks based on communication standards, such as WiFi, carrier networks (such as 2G, 3G, 4G, or 5G), or combinations thereof. In one exemplary embodiment, communication component 616 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 616 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0113] In an exemplary embodiment, the display device 600 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to implement a logarithmic inverse operation method provided in the embodiments of this application.

[0114] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 604 including instructions, which can be executed by a processor 620 of a display device 600 to perform the above-described method. For example, the non-transitory storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0115] Figure 10 This is a block diagram illustrating a display device 700 according to an exemplary embodiment. For example, the display device 700 may be provided as a server. (Refer to...) Figure 10 The display device 700 includes a processing component 722, which further includes one or more processors, and memory resources represented by memory 732 for storing instructions executable by the processing component 722, such as application programs. The application programs stored in memory 732 may include one or more modules, each corresponding to a set of instructions. Furthermore, the processing component 722 is configured to execute instructions to perform a logarithmic inverse operation method provided in embodiments of this application.

[0116] The display device 700 may also include a power supply component 726 configured to perform power management of the display device 700, a wired or wireless network interface 750 configured to connect the display device 700 to a network, and an input / output (I / O) interface 758. The display device 700 can operate on an operating system stored in memory 732, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, or similar.

[0117] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the following claims.

[0118] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

Claims

1. A display driver chip, characterized in that, The display driver chip includes: Grayscale conversion unit, image compressor, inter-frame difference unit, and frame rate control unit; The grayscale conversion unit is used to convert video frames of the input video stream into grayscale images; The image compressor is used to compress the grayscale image in a preset direction to obtain a compressed image of each video frame; The inter-frame differencer is used to perform difference calculations on multiple consecutive frames of the compressed image to obtain the difference calculation results; The frame rate control unit is used to determine the activity level of each functional area in the display screen based on the touch information corresponding to each functional area of ​​the display screen, the differential calculation result, and the preset threshold, and to set the corresponding refresh frame rate for each functional area based on the activity level of each functional area. The higher the activity level of a functional area, the higher its refresh rate.

2. The display driver chip according to claim 1, characterized in that, The display driver chip further includes a memory, which includes multiple storage units; the multiple storage units are used to store multiple consecutive historical compressed images preceding the current frame compressed image; The inter-frame differencer is used to extract multiple frames of historical compressed images from multiple storage units, and calculate a first difference value between the current frame compressed image and the historical compressed image, and a second difference value between the historical compressed images, thereby obtaining a difference calculation result including the first difference value and the second difference value.

3. The display driver chip according to claim 1, characterized in that, The frame rate control unit includes: a line display mode determination subunit and a frame rate divider; The row display mode determination subunit is used to determine the activity level of the pixel row in the functional area based on the difference calculation result and the first threshold, and to determine the activity level of the functional area based on the activity level of the pixel row included in the functional area. The frame rate divider is used to determine the refresh frame rate of the functional area based on the activity level of the functional area.

4. The display driver chip according to claim 3, characterized in that, The difference calculation result includes a first difference value between the current frame compressed image and the historical compressed images, and a second difference value between the historical compressed images; The line display mode determination subunit is specifically used for: The larger value between the first difference value and the second difference value is selected as the effective value of the current frame compressed image; The effective value of each current frame compressed image is compared with the first threshold to obtain the comparison result; Based on the comparison results and the second threshold, the activity level of the pixel rows in the functional area is determined.

5. The display driver chip according to claim 4, characterized in that, The second threshold includes a first value and a second value; The line display mode determination subunit is specifically used for: When a comparison result is obtained in which the effective value is greater than or equal to the first threshold, the high activity count value H is incremented by 1; When a comparison result is obtained in which the effective value is less than the first threshold, the medium activity count value M is incremented by 1; If the result of M×ω1+H×ω2 is less than the first value, the activity level of the pixel row is determined to be low. If the result of M×ω1+H×ω2 is greater than or equal to the first value, and the result of M×ω1+H×ω2 is less than the second value, the activity level of the pixel row is determined to be medium activity. When the result of M×ω1+H×ω2 is greater than or equal to said first value and the result of M×ω1+H×ω2 is greater than or equal to said second value, determining that the activity of said pixel row is high activity; wherein ω1 and ω2 are constant parameters.

6. The display driver chip according to claim 3, characterized in that, Said activity includes: low activity, medium activity and high activity; Said row display mode judgment sub-unit is specifically configured to: When said functional area includes at least X low-activity pixel rows and the condition lasts for at least Y consecutive frames, said functional area is low-activity; When said functional area only includes I low-activity pixel rows and J medium-activity pixel rows, the condition lasts for at least P consecutive frames, and I×ω3+J×ω4<T, said functional area is medium-activity; When said functional area is neither low-activity nor medium-activity, or said functional area receives a touch operation, said functional area is high-activity; wherein ω3 is the weight of low-activity pixel rows, ω4 is the weight of medium-activity pixel rows, and T is a preset threshold.

7. The display driver chip according to claim 6, characterized in that, Said row display mode judgment sub-unit is further configured to: Receive the user status sent by the status monitor; For a low-activity functional area, when any one of the following conditions is satisfied: a touch operation occurs in said low-activity functional area, medium-activity or high-activity pixel rows appear in said low-activity functional area for K consecutive frames, and said user status is a medium-activity status or a high-activity status, cancel the low-activity status of said functional area and re-determine the activity of said functional area; For a medium-activity functional area, when any one of the following conditions is satisfied: a touch operation occurs in said medium-activity functional area, the result of I×ω3+J×ω4 in said medium-activity functional area is greater than or equal to T for K consecutive frames, and said user status is a high-activity status, cancel the medium-activity status of said functional area and re-determine the activity of said functional area.

8. The display driver chip according to claim 1, characterized in that, Said frame rate divider is specifically configured to: Receive the user status sent by the status monitor; When no touch operation occurs in said functional area and said user status is a low-activity status, set a first refresh frame rate for the low-activity functional area, set a second refresh frame rate for the medium-activity functional area, and set a third refresh frame rate for the high-activity functional area; When a touch operation occurs in said functional area or said user status is a medium / high activity status, set the third refresh frame rate for said functional area; Wherein, said third refresh frame rate is greater than said second refresh frame rate, and said second refresh frame rate is greater than said first refresh frame rate.

9. The display driver chip according to claim 1, characterized in that, Said gray-scale conversion unit includes: a shifter and an adder; Said gray-scale conversion unit performs gray-scale conversion calculation on the video frames of said input video stream through said shifter and said adder to obtain said gray-scale image; The preset directions adopted by said image compressor for compression include: horizontal direction and / or vertical direction.

10. A display method for a display screen, characterized in that, Said method comprises: Converting video frames of an input video stream into a gray-scale image; Compressing said gray-scale image in a preset direction to obtain a compressed image for each said video frame; Differential calculation is performed on multiple consecutive frames of the compressed image to obtain the differential calculation result; Based on the touch information corresponding to different functional areas of the display screen, the differential calculation results, and the preset threshold, the activity level of each functional area in the display screen is determined, and a corresponding refresh rate is set for each functional area based on the activity level of each functional area. The higher the activity level of a functional area, the higher its refresh rate.

Images