Refresh frequency determination method and apparatus, electronic device, readable storage medium, and program product
Patent Information
- Application Number
- CN202410613498.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-05-16
- Publication Date
- 2026-10-20
- Estimated Expiration
- 2044-05-16
AI Technical Summary
[0003]传统技术中,在显示屏的显示内容需要进行更新的情况下,显示驱动芯片控制显示屏以最高刷新频率进行更新,最高刷新频率为显示驱动芯片可以提供的最大刷新频率,例如,LTPO显示屏的最高刷新频率为120HZ(赫兹),如果在需要更高刷新频率的显示场景,仍然控制显示屏以最大刷新频率进行刷新,会导致显示屏显示画面的流畅性降低
[0019]上述刷新频率确定方法、装置、电子设备、计算机可读存储介质和计算机程序产品,获取第一图像数据和第二图像数据;第二图像数据为第一图像数据的前一帧图像数据;基于第一图像数据和第二图像数据,确定待更新图像区域;确定待更新图像区域的区域面积,以及第一图像数据对应的图像面积;在区域面积与图像面积之间的面积比例小于第一比例阈值的情况下,确定目标刷新频率;目标刷新频率大于显示屏的更新刷新频率,目标刷新频率用于指示显示屏中待更新图像区域所对应的目标区域,按照目标刷新频率进行刷新。通过第一图像数据和第二图像数据确定待更新图像区域,待更新图像区域表征第一图像数据与第二图像数据中图像数据差异较大的区域,如果显示屏中的显示画面直接从第二图像数据更新为第一图像数据,由于待更新图像区域在第一图像数据与第二图像数据中的图像数据差异较大,会导致显示屏显示画面的流畅性降低,在区域面积与图像面积之间的面积比例小于第一比例阈值的情况下,确定一个比更新刷新频率更高的目标刷新频率,控制显示屏中待更新图像区域所对应的目标区域,按照目标刷新频率进行刷新,由于目标区域按照更高刷新频率的目标刷新频率进行刷新,在一帧内目标区域的刷新次数增多,从而可以显示更多待更新图像区域对应的待更新图像数据,从而提高显示屏显示画面的流畅性。
Smart Images

Figure CN118351811B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of image display technology, and in particular to a refresh rate determination method, apparatus, electronic device, computer-readable storage medium, and computer program product. Background Technology
[0002] With the development of image display technology, more and more electronic devices are adopting LTPO (Low Temperature Polycrystalline Oxide) displays, which can achieve adaptive frequency conversion.
[0003] In traditional technology, when the content displayed on the screen needs to be updated, the display driver chip controls the screen to update at the highest refresh rate. The highest refresh rate is the maximum refresh rate that the display driver chip can provide. For example, the highest refresh rate of an LTPO display is 120 Hz. If the screen is still controlled to refresh at the maximum refresh rate in a display scenario that requires a higher refresh rate, the smoothness of the displayed image will be reduced. Summary of the Invention
[0004] This application provides a refresh rate determination method, apparatus, electronic device, and computer-readable storage medium, which can improve the smoothness of the screen display.
[0005] Firstly, this application provides a method for determining the refresh rate, including:
[0006] Acquire first image data and second image data; the second image data is the image data of the frame preceding the first image data.
[0007] Based on the first image data and the second image data, determine the image region to be updated;
[0008] Determine the area of the region to be updated and the area of the image corresponding to the first image data;
[0009] If the area ratio between the area of the region and the area of the image is less than a first ratio threshold, a target refresh rate is determined; the target refresh rate is greater than the refresh rate of the display screen, and the target refresh rate is used to indicate the target area corresponding to the image area to be updated in the display screen to be refreshed according to the target refresh rate.
[0010] Secondly, this application also provides a refresh frequency determining device, comprising:
[0011] The acquisition module is used to acquire first image data and second image data; the second image data is the image data of the frame preceding the first image data.
[0012] The region determination module is used to determine the image region to be updated based on the first image data and the second image data;
[0013] An area determination module is used to determine the area of the region to be updated in the image, and the area of the image corresponding to the first image data.
[0014] The frequency determination module is used to determine a target refresh frequency when the area ratio between the area of the region and the area of the image is less than a first ratio threshold; the target refresh frequency is greater than the update refresh frequency of the display screen, and the target refresh frequency is used to indicate that the target area corresponding to the image area to be updated in the display screen is refreshed according to the target refresh frequency.
[0015] Thirdly, this application also provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps of any of the methods described in the first aspect.
[0016] In one embodiment, the electronic device further includes a display driver chip and a display screen, wherein the display driver chip is used to control a target area in the display screen to refresh according to a target refresh rate.
[0017] Fourthly, this application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the method described in any one of the first aspects.
[0018] Fifthly, this application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the method described in any of the first aspects.
[0019] The aforementioned refresh rate determination method, apparatus, electronic device, computer-readable storage medium, and computer program product acquire first image data and second image data; the second image data is the image data of the previous frame of the first image data; based on the first image data and the second image data, determine the image region to be updated; determine the area of the image region to be updated and the image area corresponding to the first image data; if the area ratio between the area and the image area is less than a first ratio threshold, determine a target refresh rate; the target refresh rate is greater than the refresh rate of the display screen, and the target refresh rate is used to indicate the target area corresponding to the image region to be updated on the display screen, and refresh according to the target refresh rate. The image region to be updated is determined by using first image data and second image data. The image region to be updated represents the area where the image data in the first image data and the second image data differs significantly. If the display screen directly updates from the second image data to the first image data, the smoothness of the display screen will be reduced because the image data of the image region to be updated differs significantly between the first and second image data. When the area ratio between the region area and the image area is less than a first ratio threshold, a target refresh rate higher than the update refresh rate is determined. The target region corresponding to the image region to be updated on the display screen is then refreshed according to the target refresh rate. Since the target region is refreshed according to the target refresh rate, the number of times the target region is refreshed within one frame increases, thereby displaying more image data corresponding to the image region to be updated, thus improving the smoothness of the display screen. Attached Figure Description
[0020] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments of this application or related technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.
[0021] Figure 1 This is a flowchart illustrating a refresh rate determination method in one embodiment;
[0022] Figure 2 This is a flowchart illustrating the steps for determining the image region to be updated in one embodiment;
[0023] Figure 3 This is a flowchart illustrating the target refresh frequency determination step in one embodiment;
[0024] Figure 4 This is a flowchart illustrating the target region determination steps in one embodiment;
[0025] Figure 5 This is a schematic diagram of the timing framework in one embodiment;
[0026] Figure 6 This is a schematic diagram of the link timing between the processor and the display driver chip in one embodiment;
[0027] Figure 7 This is a schematic diagram of the target area in one embodiment;
[0028] Figure 8 This is a structural block diagram of a refresh frequency determination device in one embodiment;
[0029] Figure 9 This is a diagram of the internal structure of an electronic device in one embodiment. Detailed Implementation
[0030] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0031] In one embodiment, such as Figure 1 As shown, a refresh rate determination method is provided. Taking the application of this method to an electronic device as an example, the electronic device includes an AP (Application Processor), a DDIC (Display Driver IC), and a display panel. The AP is responsible for running applications and handling user interactions. The DDIC receives image data and control commands from the AP and converts them into signals that can drive the display panel. The DDIC is connected to the pixel units in the display panel through a source channel (data channel). During the update period of the display cycle, the DDIC adjusts the voltage output of the source channel to control the input voltage of the pixel units in the display panel, so that the display panel displays the image data, that is, the display panel displays the corresponding image.
[0032] Electronic devices can be, but are not limited to, various personal computers, laptops, smartphones, tablets, IoT devices, and portable wearable devices. IoT devices can include smart speakers, smart TVs, smart air conditioners, smart in-vehicle systems, smart cars, etc., while portable wearable devices can include smartwatches and smart bracelets, etc. It is understood that this method can also be applied to systems including electronic devices and servers, and implemented through the interaction between the electronic devices and the server. In this embodiment, the method includes steps 102 to 108, wherein:
[0033] Step 102: Obtain the first image data and the second image data; the second image data is the image data of the frame preceding the first image data.
[0034] Image data refers to a collection of data from multiple pixels, including but not limited to the position coordinates and pixel values of these pixels. The first image data refers to the image data of the current image to be displayed, and the second image data refers to the image data of the preceding adjacent image of the current image to be displayed.
[0035] For example, when the processor of an electronic device determines that the display type is the target type, it acquires first image data and the previous frame image data of the first image data, and determines the previous frame image data as the second image data.
[0036] Step 104: Determine the image region to be updated based on the first image data and the second image data.
[0037] The image region to be updated refers to a local image region in the first image corresponding to the first image data that needs to be updated and displayed on the screen. It can be understood as a region where the image content of the local image region in the first image corresponding to the first image data differs significantly from the image content of the local image region in the second image corresponding to the second image data. In other words, the image region to be updated represents the area where the image data in the first image data and the second image data differ significantly. The representation of the image region to be updated can be set according to the display characteristics of the screen. It can be represented by a set of pixel coordinates; it can be represented by a start row and an end row, for example, 2A and 2B, where 2A represents the start row and 2B represents the end row; or it can be represented by a start column and an end column.
[0038] For example, the processor of the electronic device determines a motion mask between first image data and second image data, wherein the mask value in the motion mask is a first identifier or a second identifier, the first identifier indicates that the pixel is a moving pixel, and the second identifier indicates that the pixel is a non-moving pixel. The pixel with the mask value of the first identifier is determined as the pixel to be updated, and the image region to be updated is determined based on multiple pixels to be updated.
[0039] In one embodiment, determining the image region to be updated based on multiple pixels to be updated includes: determining the region composed of the multiple pixels to be updated as the image region to be updated.
[0040] In one embodiment, determining the image region to be updated based on multiple pixels to be updated includes: determining the start row and end row corresponding to the multiple pixels to be updated, and determining the image region formed by the start row and the end row as the image region to be updated. Here, the start row refers to the first row in the first image data where the pixels to be updated appear, and the end row refers to the last row in the first image data where the pixels to be updated appear. For example, in a 256×256 image data, there are 256 rows, each containing 256 pixels. If there are no pixels to be updated in the first 9 rows, but there are pixels to be updated in the 10th row, then the 10th row is the start row. If there are no pixels to be updated after the 158th row, but there are pixels to be updated in the 158th row, then the 158th row is the end row. The rectangular area formed by rows 10 to 158 is the image region to be updated.
[0041] In one embodiment, determining the image region to be updated based on multiple pixels to be updated includes: determining a start column and a stop column corresponding to the multiple pixels to be updated, and determining the image region formed by the start column and the stop column as the image region to be updated. Here, the start column refers to the first column in the first image data containing pixels to be updated, and the stop column refers to the last column in the first image data containing pixels to be updated.
[0042] Step 106: Determine the area of the image region to be updated and the area of the image corresponding to the first image data.
[0043] The region area refers to the area of the image region to be updated. The region area can be represented by the number of pixels included in the image region to be updated, or by the area of the image region to be updated within the first image corresponding to the first image data. The image area refers to the area of the first image data. The image area can be represented by the number of pixels included in the first image data, or by the area of the first image corresponding to the first image data.
[0044] For example, the processor of the electronic device determines the image area of the first image corresponding to the first image data, and determines the area of the image region to be updated in the first image.
[0045] Step 108: If the area ratio between the region area and the image area is less than the first ratio threshold, determine the target refresh rate; the target refresh rate is greater than the refresh rate of the display screen. The target refresh rate is used to indicate the target region corresponding to the image region to be updated on the display screen, and refresh is performed according to the target refresh rate.
[0046] The area ratio refers to the ratio between the area of the region and the area of the image, and the area ratio is less than or equal to 1. The first ratio threshold is the maximum area ratio for which the target refresh rate needs to be determined. The first ratio threshold can be set according to actual conditions; for example, it can be 1 / 2 or 2 / 3. The target refresh rate is the frequency at which the target area corresponding to the image area to be updated on the display screen is refreshed. The target refresh rate is greater than the update refresh rate. The target refresh rate can be a preset frequency or calculated based on the area ratio and the update refresh rate. For example, if the update refresh rate is 120Hz, the target refresh rate can be set to 240Hz or 360Hz. The target area refers to the area on the display screen used to display the image data corresponding to the image area to be updated; the target area is a local area on the display screen.
[0047] A display screen refers to the screen in an electronic device used to display image data. Display screens can be of different types; for example, a display screen can be an LTPO (Low Temperature Polycrystalline Oxide) display. The refresh rate refers to the frequency at which the displayed image on the screen is updated. It can be understood as the frequency at which the entire display screen is updated. To improve the smoothness of the displayed image, the maximum refresh rate of the screen is generally set to the refresh rate. For example, an LTPO display screen can achieve adaptive frequency conversion from 1Hz to 120Hz, and the refresh rate is generally set to 120Hz.
[0048] For example, the processor of the electronic device determines the area ratio between the region area and the image area, compares the area ratio with a first ratio threshold, and if the area ratio is less than the first ratio threshold, determines the preset refresh frequency as the target refresh frequency. The preset refresh frequency is greater than the refresh frequency of the display screen, and the target refresh frequency is used to indicate the target area corresponding to the image area to be updated in the display screen, and refreshes according to the target refresh frequency.
[0049] In one embodiment, the processor of the electronic device determines the area ratio between the region area and the image area, compares the area ratio with a first ratio threshold, and if the area ratio is less than the first ratio threshold, determines a target refresh frequency based on the area ratio, the first ratio threshold, the second ratio threshold, and the refresh frequency; the target refresh frequency is greater than the refresh frequency of the display screen, and the target refresh frequency is used to indicate the target area corresponding to the image area to be updated in the display screen, and refreshes according to the target refresh frequency.
[0050] The refresh rate determination method described above determines the image region to be updated using first image data and second image data. The image region to be updated represents the area where the image data in the first image data and the second image data differs significantly. If the display screen directly updates from the second image data to the first image data, the smoothness of the display screen will decrease because the image data of the image region to be updated differs significantly between the first and second image data. When the area ratio between the region area and the image area is less than a first ratio threshold, a target refresh rate higher than the update refresh rate is determined, and the target region corresponding to the image region to be updated on the display screen is refreshed according to the target refresh rate. Since the target region is refreshed according to the target refresh rate, the number of refreshes of the target region within one frame increases, thereby displaying more image data corresponding to the image region to be updated, thus improving the smoothness of the display screen.
[0051] In one embodiment, determining the image region to be updated based on first image data and second image data includes:
[0052] For each first pixel in the first image data, a pixel difference value is determined based on the pixel value of the first pixel and the pixel value of the corresponding pixel in the second image data; based on the pixel difference values of each first pixel, the image region to be updated is determined.
[0053] Here, the first pixel refers to the pixel in the first image data. The pixel value is a numerical value representing the brightness of the pixel. The pixel difference value is a numerical value representing the difference between the pixel value of the first pixel and the pixel value of the corresponding pixel in the second image data.
[0054] For example, the processor of the electronic device obtains the pixel value of the first pixel from the first image data for each first pixel in the first image data, obtains the pixel value of the corresponding pixel from the second image data, subtracts the pixel value of the first pixel from the pixel value of the corresponding pixel to obtain the pixel difference value corresponding to the first pixel; determines the pixels with non-zero pixel difference values as pixels to be updated, and determines the image region to be updated based on multiple pixels to be updated.
[0055] In one embodiment, the processor of the electronic device, for each first pixel in the first image data, obtains the pixel value of the first pixel from the first image data, obtains the pixel value of the corresponding pixel from the second image data, determines the absolute value of the difference between the pixel value of the first pixel and the pixel value of the corresponding pixel as the pixel difference value corresponding to the first pixel, determines the pixel difference value of the first pixel as the pixel difference value corresponding to the first pixel, determines the pixel with the pixel difference value greater than the difference threshold as the pixel to be updated, and determines the image region to be updated based on the multiple pixels to be updated.
[0056] In this embodiment, the pixel difference value corresponding to the first pixel is determined by comparing the pixel value of the first pixel with the pixel value of the corresponding pixel in the second image data. The pixel difference value represents the difference between pixels at the same coordinate in the first image data and the second image data. The image region to be updated is determined based on the pixel difference value corresponding to each first pixel, thereby improving the accuracy of the image region to be updated.
[0057] In one embodiment, such as Figure 2 As shown, based on the pixel difference values corresponding to each first pixel, the image region to be updated is determined, including:
[0058] Step 202: For each first pixel, compare the pixel difference value corresponding to the first pixel with the difference threshold, and determine the first pixel corresponding to the pixel difference value that is greater than the difference threshold as the pixel to be updated.
[0059] The difference threshold refers to the minimum pixel difference value that determines the first pixel as the pixel to be updated.
[0060] For example, after determining the absolute value of the difference between the pixel value of the first pixel and the pixel value of the corresponding pixel as the pixel difference value of the first pixel, the processor of the electronic device compares the pixel difference value of the first pixel with a difference threshold. If the pixel difference value is greater than the difference threshold, the first pixel is determined as a pixel to be updated; if the pixel difference value is less than or equal to the difference threshold, the first pixel is determined as a non-updating pixel.
[0061] Step 204: Compare the position coordinates of multiple pixels to be updated to obtain the first position coordinate and the second position coordinate; the horizontal coordinate value of the first position coordinate is the smallest horizontal coordinate value among multiple position coordinates, the vertical coordinate value of the first position coordinate is the smallest vertical coordinate value among multiple position coordinates, the horizontal coordinate value of the second position coordinate is the largest horizontal coordinate value among multiple position coordinates, and the vertical coordinate value of the first position coordinate is the largest vertical coordinate value among multiple position coordinates.
[0062] The horizontal coordinate value refers to the coordinate value in the horizontal direction, and the vertical coordinate value refers to the coordinate value in the vertical direction. For example, if the position coordinates are (x, y), then x is the horizontal coordinate value and y is the vertical coordinate value.
[0063] For example, the processor of the electronic device compares the horizontal coordinate values of the position coordinates of multiple pixels to be updated to obtain the minimum horizontal coordinate value and the maximum horizontal coordinate value, compares the vertical coordinate values of the position coordinates of multiple pixels to be updated to obtain the minimum vertical coordinate value and the maximum vertical coordinate value, determines the position coordinates composed of the minimum horizontal coordinate value and the minimum vertical coordinate value as the first position coordinates, and determines the position coordinates composed of the maximum horizontal coordinate value and the maximum vertical coordinate value as the second position coordinates.
[0064] Step 206: Determine the image region to be updated based on the first and second position coordinates.
[0065] For example, when pixel units in a display screen are controlled by rows, the processor of an electronic device determines the row containing the first position coordinate as the start row, the row containing the second position coordinate as the end row, and the area formed by the start and end rows as the image area to be updated. This can be understood as the GOA (Gate-Only-Array) circuit driving the display screen controlling one or more rows of pixel units in the display screen, i.e., the pixel units of the display screen are controlled by rows.
[0066] In one embodiment, when the pixel units in the display screen are controlled by columns, the processor of the electronic device determines the column where the first position coordinates are located as the start column, the column where the second position coordinates are located as the end column, and the area formed by the start column and the end column as the image area to be updated.
[0067] In this embodiment, the first pixel corresponding to the pixel difference value greater than the difference threshold is determined as the pixel to be updated. That is, the pixel to be updated is the pixel with a large difference in pixel value between the first image data and the second image data. Based on the pixel to be updated, the image region to be updated is determined. Then, the updated image region represents the region with a large difference in image data between the first image data and the second image data.
[0068] In one embodiment, determining the target refresh rate when the area ratio between the region area and the image area is less than a first ratio threshold includes:
[0069] If the area ratio is less than the first ratio threshold, the target refresh frequency is determined based on the area ratio and the update refresh frequency; the target refresh frequency is inversely proportional to the area ratio.
[0070] For example, if the area ratio is less than a first ratio threshold, the processor of the electronic device will update the refresh frequency by dividing the area ratio to obtain the target refresh frequency.
[0071] In one embodiment, when the area ratio is less than a first ratio threshold, the processor of the electronic device determines the target ratio range where the area ratio lies, obtains the target ratio coefficient corresponding to the target ratio range, and multiplies the update refresh frequency by the target ratio coefficient to obtain the target refresh frequency. The ratio range consists of a lower threshold and an upper threshold. The lower threshold is less than the upper threshold, and the interval between the lower and upper thresholds is the ratio range. There is a one-to-one correspondence between the ratio range and the ratio coefficient, and the upper threshold and the ratio coefficient within the ratio range are inversely proportional. For example, if the ratio ranges are (0, 1 / 3) and (1 / 3, 1 / 2), the ratio coefficient corresponding to (0, 1 / 3) is 3, and the ratio coefficient corresponding to (1 / 3, 1 / 2) is 2. If the area ratio is 5 / 12 and the update refresh frequency is 120Hz, then the target ratio range where the area ratio lies is (1 / 3, 1 / 2), the target ratio coefficient is 3, and the target refresh frequency is 120Hz × 3 = 360Hz.
[0072] In this embodiment, a smaller area ratio indicates a smaller proportion of the image area to be updated in the first image corresponding to the first image data. That is, the target area corresponding to the image area to be updated on the display screen is smaller. The smaller the target area, the shorter the time required to refresh the target area. Therefore, the target refresh frequency of the target area can be higher. The target refresh frequency is determined based on the area ratio and the update refresh frequency. The target refresh frequency is inversely proportional to the area ratio. The target refresh frequency determined in this way is greater than the update refresh frequency, which increases the refresh frequency of the target area on the display screen. In the same time period, the refresh frequency of the target area increases, thereby displaying more image data corresponding to the image area to be updated, thereby improving the smoothness of the display screen.
[0073] In one embodiment, such as Figure 3 As shown, when the area ratio is less than the first ratio threshold, the target refresh frequency is determined based on the area ratio and the update refresh frequency, including:
[0074] Step 302: If the area ratio is less than the first ratio threshold and greater than the second ratio threshold, the first refresh frequency is determined as the target refresh frequency; the second ratio threshold is less than the first ratio threshold, and the first refresh frequency is greater than the update refresh frequency.
[0075] The first refresh frequency refers to the preset refresh frequency, which is greater than the update refresh frequency. For example, the update refresh frequency is 120Hz and the first refresh frequency is 240Hz, or the update refresh frequency is 90Hz and the first refresh frequency is 180Hz.
[0076] For example, if the area ratio of an electronic device is less than a first ratio threshold, the processor compares the area ratio with a second ratio threshold. If the area ratio is greater than the second ratio threshold, the first refresh frequency is determined as the target refresh frequency.
[0077] Step 304: If the area ratio is less than or equal to the second ratio threshold, the second refresh frequency is determined as the target refresh frequency; the second refresh frequency is greater than the first refresh frequency.
[0078] The second refresh frequency refers to the preset refresh frequency, which is greater than the first refresh frequency. For example, if the update refresh frequency is 120Hz, the second refresh frequency is 360Hz, or if the update refresh frequency is 90Hz, the first refresh frequency is 270Hz.
[0079] For example, if the area ratio of an electronic device is less than a first ratio threshold, the processor compares the area ratio with a second ratio threshold. If the area ratio is less than or equal to the second ratio threshold, the second refresh frequency is determined as the target refresh frequency.
[0080] In this embodiment, the target refresh frequency is determined based on the relationship between the area ratio and the first ratio threshold and the second ratio threshold. The smaller the area ratio, the higher the target refresh frequency. That is, the smaller the target area corresponding to the image area to be updated on the display screen, the shorter the time required to refresh the target area, and the higher the target refresh frequency of the target area.
[0081] In one embodiment, such as Figure 4 As shown, after determining the target refresh rate, the following steps are also included:
[0082] Step 402: Save the image data to be updated for the image area to be updated in the storage area of the display driver chip corresponding to the display screen.
[0083] The image data to be updated refers to the set of pixel data in the image region to be updated. There are at least two sets of image data to be updated: one set consists of the position coordinates and pixel values of the pixels in the image region to be updated from the first image data set; the other set consists of at least one set of intermediate image data corresponding to the image region to be updated. These at least two sets of image data to be updated must be in a specific order. The storage area refers to the memory inside the display driver chip, used to store image data and control instructions.
[0084] For example, the processor of the electronic device acquires at least two sets of image data to be updated for the image area to be updated, and saves the image data to be updated sequentially in the storage area of the display driver chip that controls the display screen based on the order of the at least two sets of image data to be updated.
[0085] Step 404: Based on the image data to be updated, the display driver chip determines the target area on the display screen that corresponds to the area of the image to be updated, and controls the refresh frequency of the target area to be the target refresh frequency.
[0086] For example, the display driver chip of the electronic device reads the image data to be updated from the storage area, determines the target area on the display screen according to the position coordinates of the pixels in the image data to be updated, and controls the target area to display the image data to be updated based on the target refresh rate.
[0087] In this embodiment, the processor of the electronic device stores the image data to be updated for the image area to be updated in the storage area of the display driver chip corresponding to the display screen. The display driver chip reads the image data to be updated from the storage area, determines the target area on the display screen according to the position coordinates of the pixels in the image data to be updated, and controls the target area to display the image data to be updated based on the target refresh frequency, thereby achieving a higher refresh frequency for the target area and improving the smoothness of the display screen.
[0088] In one embodiment, before saving the image data to be updated for the image area to be updated in the storage area of the display driver chip corresponding to the display screen, the method further includes:
[0089] Based on the target refresh rate, an activation command is generated; during the time interval corresponding to the second image data, the activation command is sent to the display driver chip; the activation command is used to instruct the display driver chip to generate a target synchronization signal with the same target refresh rate, and the target synchronization signal is used to instruct the image data to be updated in the image area to be updated to be saved in the storage area.
[0090] The activation instruction is an instruction generated by the processor based on the target refresh rate and sent to the display driver chip. The activation instruction instructs the display driver chip to generate a target synchronization signal with a frequency equal to the target refresh rate. For example... Figure 5The target synchronization signal, as shown, operates at a frequency of 120Hz (the refresh rate) before the display driver chip receives the activation command. After receiving the activation command, the frequency changes to either 240Hz or 360Hz. The processor writes the image data to be updated into the display driver chip's storage area based on the target synchronization signal. The display driver chip converts the image data into control voltage values and controls the input voltage of each pixel element in the target area of the display screen to the corresponding control voltage value in the image data based on the gate signal. The display cycle includes an update time period and a gap time period (Porch area). The update time period is used to update and display image data, while the gap time period is used to optimize the display of image data to ensure stable and smooth display. The gap time period corresponding to the second image data refers to the gap time period within the display cycle corresponding to the second image data.
[0091] For example, after determining the target refresh frequency, the processor of the electronic device generates an activation command based on the target refresh frequency. During the interval time of the display cycle corresponding to the second image data, the activation command is sent to the display driver chip. After receiving the activation command, the display driver chip adjusts the frequency of the target synchronization signal to the target refresh frequency. Based on the target synchronization signal, the processor of the electronic device saves the image data to be updated of the image area to be updated in the storage area.
[0092] In this embodiment, after receiving the activation command, the display driver chip adjusts the frequency of the target synchronization signal to the target refresh frequency. Based on the target synchronization signal, the processor of the electronic device saves the image data to be updated of the image area to be updated in the storage area. The display driver chip reads the image data to be updated in the storage area, determines the target area on the display screen according to the position coordinates of the pixels in the image data to be updated, and controls the target area to display the image data to be updated based on the target refresh frequency, thereby achieving a higher refresh frequency of the target area and improving the smoothness of the display screen.
[0093] In one embodiment, before saving the image data to be updated for the image area to be updated in the storage area of the display driver chip corresponding to the display screen, the method further includes:
[0094] During the time interval corresponding to the second image data, a reset command is sent to the display driver chip; the reset command is used to instruct the display driver chip to update the refresh rate of the display screen to the new refresh rate.
[0095] The reset instruction, generated by the processor and sent to the display driver chip, instructs the display driver chip to update the refresh rate of the display screen to the update refresh rate. This can be understood as follows: when there is an image area to be updated in the second image data, the refresh rate of the target area of the image area to be updated in the second image data on the display screen is the target refresh rate corresponding to the second image data, i.e., the non-updating refresh rate. Before the display screen shows the image data to be updated corresponding to the image area to be updated in the first image data, the refresh rate of the target area of the image area to be updated in the second image data on the display screen needs to be updated to the update refresh rate to prepare for the display of the first image data.
[0096] For example, after determining the target refresh rate, the processor of the electronic device generates a reset command and sends the reset command to the display driver chip during the interval time corresponding to the display cycle of the second image data. After receiving the reset command, the display driver chip updates the refresh rate of the display screen to the updated refresh rate.
[0097] In one embodiment, during the time interval corresponding to the second image data, a reset command is sent to the display driver chip. The reset command instructs the display driver chip to update the refresh rate of the target area corresponding to the second image data on the display screen to the updated refresh rate. That is, only the refresh rate of the target area corresponding to the second image data on the display screen is updated to the updated refresh rate; the digital display frequency of non-target areas is the updated refresh rate, and no refresh rate update is required.
[0098] In this embodiment, after receiving a reset command, the display driver chip updates the refresh rate of the display screen to the updated refresh rate to avoid the refresh rate of a local area of the display screen being the non-updated refresh rate, thus preparing for the display of the first image data.
[0099] In one embodiment, the display driver chip is used to execute a reset instruction based on the time interval corresponding to the refresh rate.
[0100] The time interval corresponding to the update refresh rate refers to the period length corresponding to the update refresh rate.
[0101] For example, the display driver chip of an electronic device determines the period length corresponding to the refresh frequency, defines the period length as a time interval, and executes a reset command once every time interval.
[0102] In one embodiment, the processor of the electronic device sends a reset command to the display driver chip based on the time interval corresponding to the refresh rate. After receiving the reset command, the display driver chip executes the reset command.
[0103] In this embodiment, the display driver chip executes a reset instruction based on the time interval corresponding to the refresh rate. Compared to the electronic device sending a reset instruction to the display driver chip at every time interval, this reduces the communication between the processor and the display driver chip, saving the communication resources of the electronic device.
[0104] In one embodiment, such as Figure 5 As shown, after determining the target refresh rate, the following steps are included:
[0105] Step 502: Determine the frequency multiple between the target refresh frequency and the update refresh frequency.
[0106] The frequency multiplier refers to the ratio between the target refresh rate and the update refresh rate. For example, if the target refresh rate is 240Hz and the update refresh rate is 120Hz, then the frequency multiplier is 2.
[0107] For example, the processor of an electronic device divides the target refresh rate by the update refresh rate to obtain the frequency multiple.
[0108] Step 504: Based on the frequency multiple, the image data corresponding to the image region to be updated in the second image data, and the image data corresponding to the image region to be updated in the first image data, generate at least one intermediate image data corresponding to the image region to be updated.
[0109] Intermediate image data refers to the image data between two frames of image data. It can be understood that the image data corresponding to the image region to be updated in the second image data constitutes the second local image, and the image data corresponding to the image region to be updated in the first image data constitutes the first local image. An intermediate local image is generated based on the first local image and the second local image. The intermediate local image represents the transition image from the second local image to the first local image. The set of position coordinates and pixel values corresponding to the pixels in the intermediate local image is the intermediate image data.
[0110] For example, the processor of the electronic device determines the number of intermediate images based on a frequency multiple, the number of intermediate images being less than or equal to a quantity threshold, the quantity threshold being equal to the frequency multiple minus one; and generates intermediate image data for the number of intermediate images based on the image data corresponding to the image region to be updated in the second image data and the image data corresponding to the image region to be updated in the first image data.
[0111] In one embodiment, determining the number of intermediate images based on a frequency multiple includes: determining the image data corresponding to the image region to be updated in the second image data, the image similarity between the image data and the image data corresponding to the image region to be updated in the first image data, and determining the number of intermediate images based on the image similarity and the frequency multiple; the number of intermediate images is inversely proportional to the image similarity, and the number of intermediate images is less than or equal to a quantity threshold, the quantity threshold being equal to the frequency multiple minus one.
[0112] Step 506: Determine at least one intermediate image data and the image data corresponding to the image region to be updated in the first image data as the image data to be updated.
[0113] For example, the processor of the electronic device determines each intermediate image data as image data to be updated, and determines the image data corresponding to the image region to be updated in the first image data as image data to be updated, and determines the display order of each group of image data to be updated.
[0114] Step 508: Based on the target refresh rate, control the target area on the display screen to display the image data to be updated.
[0115] For example, the processor of the electronic device sequentially saves the image data to be updated in the storage area of the display driver chip based on the display order of each set of image data to be updated, and the display driver chip controls the target area in the display screen to sequentially display the image data to be updated according to the target refresh rate.
[0116] In this embodiment, intermediate image data corresponding to the image region to be updated is generated using the image data corresponding to the image region to be updated in the second image data and the image data corresponding to the image region to be updated in the first image data. Each intermediate image data is determined as the image data to be updated, and the image data corresponding to the image region to be updated in the first image data is also determined as the image data to be updated. The target area on the display screen is controlled to display the image data to be updated sequentially. That is, compared to displaying the first image data within one cycle of the update refresh frequency, adjusting the refresh frequency of the target area to the target refresh frequency allows the target area to be refreshed multiple times within the same time period, so as to display multiple image data to be updated in the target area, thereby improving the smoothness of the display screen.
[0117] In one embodiment, the refresh rate determination method further includes:
[0118] Obtain the display type of the display screen; compare the display type with the target type in the target type set; if the display type is determined to be the same as the target type, execute the acquisition of the first image data and the second image data.
[0119] Here, "display type" refers to the type of content displayed on the screen, which can be video, image, moving image, etc. "Target type set" refers to the collection of target types, which are the display types that require a refresh rate determination method. The target type set includes, but is not limited to, video and moving images.
[0120] For example, when the processor of an electronic device starts an application, it obtains the display type corresponding to the content displayed on the screen, compares the display type with the target type in the target type set, and if the display type is the same as the target type, it executes the acquisition of first image data and second image data.
[0121] In this embodiment, the step of the refresh rate determination method described above is determined by whether the display type of the display screen is the same as the target type in the target type set.
[0122] In an exemplary embodiment, the mobile phone includes an AP (Application Processor), a DDIC (Display Driver IC), and a display panel. When the mobile phone's processor launches an application, it obtains the display type corresponding to the content displayed on the display panel, compares the display type with target types in a target type set, and if the display type is the same as the target type (e.g., the display type is a game video), then it executes the following refresh rate determination method, including:
[0123] The phone's processor acquires first image data and the previous frame image data, and determines the previous frame image data as second image data. For each first pixel in the first image data, the processor acquires the pixel value of the first pixel from the first image data and the pixel value of the corresponding pixel from the second image data. The absolute value of the difference between the pixel value of the first pixel and the pixel value of the corresponding pixel is determined as the pixel difference value of the first pixel. The processor then compares the pixel difference value of the first pixel with a difference threshold. If the pixel difference value is greater than the difference threshold, the first pixel is determined as a pixel to be updated; if the pixel difference value is less than or equal to the difference threshold, the first pixel is determined as a pixel not to be updated.
[0124] The horizontal coordinates of multiple pixels to be updated are compared to obtain the minimum and maximum horizontal coordinates. The vertical coordinates of the pixels to be updated are also compared to obtain the minimum and maximum vertical coordinates. The coordinates formed by the minimum horizontal and minimum vertical coordinates are determined as the first coordinates, and the coordinates formed by the maximum horizontal and maximum vertical coordinates are determined as the second coordinates. The row containing the first coordinates is determined as the starting row, and the row containing the second coordinates is determined as the ending row. The region formed by the starting and ending rows is determined as the image region to be updated.
[0125] The image area corresponding to the first image data is determined, as is the area of the region to be updated within the first image. The region area is divided by the image area to obtain the area ratio. This area ratio is compared to a first ratio threshold of 1 / 2. If the area ratio is less than 1 / 2, it is compared to a second ratio threshold of 1 / 3. If the area ratio is greater than 1 / 3, a refresh rate of 2 times is set as the target refresh rate. If the area ratio is less than or equal to 1 / 3, a refresh rate of 3 times is set as the target refresh rate. For example, if the refresh rate is 120Hz and the area ratio is less than 1 / 2 but greater than 1 / 3, then 240Hz is set as the target refresh rate; if the area ratio is less than or equal to 1 / 3, then 360Hz is set as the target refresh rate. Alternatively, if the refresh rate is 90Hz and the area ratio is less than 1 / 2 but greater than 1 / 3, then 180Hz is set as the target refresh rate; if the area ratio is less than or equal to 1 / 3, then 270Hz is set as the target refresh rate.
[0126] After the phone's processor generates the activation instruction based on the target refresh rate, the timing diagram of the link between the processor and the display driver chip is as follows: Figure 6 As shown, during the interval between display cycles corresponding to the second image data, activation and reset commands are sent to the display driver chip via LP (Low Power) or HS (High Speed) methods. Taking a typical Qualcomm platform as an example, the display cycle is 8.3 milliseconds. The first 6.3 milliseconds are when the processor saves the image data to the storage area of the display driver chip via MIPI (Mobile Industry Processor Interface). The last 2 milliseconds are the interval between display cycles (Porch area), during which the processor sends control commands to the display driver chip to control the behavior of the display driver chip in the next frame.
[0127] After receiving a reset command, the display driver chip outputs VGLO (Gate Low Voltage), typically ranging from -3V to -9V, restoring all registers in the display's internal overclocking circuit to their initial values. This resets the overclocking circuit's potential, updating the display's refresh rate to the new refresh rate. When the display driver chip receives the first reset command, there are two possible logics: first, the processor issues a reset command every 8.3ms in a fixed interval; second, the display driver chip executes a reset command every 8.3ms after receiving the first reset command. Upon receiving the activation command, the display driver chip's CMOS (Complementary Metal-Oxide-Semiconductor) circuitry generates a target synchronization signal for the target refresh rate.
[0128] The processor sends the start line 2A and end line 2B of the image area to be updated to the display driver chip. Based on the start line 2A and end line 2B of the image area to be updated, the display driver chip determines the start line 2A' and end line 2B' of the target area of the display screen. For example, ... Figure 7 The rectangular area shown is the phone's display screen. The area between the starting line 2A' and the ending line 2B' is the target area. The display driver chip controls the GOA (Gate-Only-Array) circuit in the target area to generate a pulse signal with the same frequency as the target synchronization signal. The GOA circuit generates two signals: EM (Emission) and Gate (gate signal). For example, as shown... Figure 5 As shown, the EM includes 3 pulses in one frame (8.3ms). When the level is high, the display is in a black state and does not emit light. When the level is low, the display emits light. The Gate manages the writing of the control voltage through the Driving TFT (Driving Thin-Film Transistor). When the level is low, the control voltage is written to the pixel elements in the display.
[0129] The processor divides the target refresh rate by the update refresh rate to obtain a frequency multiple; based on the frequency multiple, the image data corresponding to the image region to be updated in the second image data, and the image data corresponding to the image region to be updated in the first image data, it generates at least one intermediate image data corresponding to the image region to be updated; it determines each intermediate image data as the image data to be updated, and determines the image data corresponding to the image region to be updated in the first image data as the image data to be updated, thus determining the display order of each group of image data to be updated; based on the display order of each group of image data to be updated and the target synchronization signal, it sequentially saves the image data to be updated in the storage area of the display driver chip.
[0130] The display driver chip controls the target area of the display screen to sequentially display the image data to be updated according to the target refresh rate. For example, when the display screen refresh rate is 120Hz, the display screen can only display the first image data within 8.3 milliseconds. When the target refresh rate of the target area of the display screen is 360Hz, the target area of the display screen can display 3 sets of image data to be updated within 8.3 milliseconds.
[0131] The refresh rate determination method described above determines the image region to be updated using first image data and second image data. The image region to be updated represents the area where the image data in the first image data and the second image data differs significantly. If the display screen directly updates from the second image data to the first image data, the smoothness of the display screen will decrease because the image data of the image region to be updated differs significantly between the first and second image data. When the area ratio between the region area and the image area is less than a first ratio threshold, a target refresh rate higher than the update refresh rate is determined, and the target region corresponding to the image region to be updated on the display screen is refreshed according to the target refresh rate. Since the target region is refreshed according to the target refresh rate, the number of refreshes of the target region within one frame increases, thereby displaying more image data corresponding to the image region to be updated, thus improving the smoothness of the display screen.
[0132] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.
[0133] Based on the same inventive concept, this application also provides a refresh frequency determining apparatus for implementing the refresh frequency determining method described above. The solution provided by this apparatus is similar to the implementation described in the above method; therefore, the specific limitations in one or more refresh frequency determining apparatus embodiments provided below can be found in the limitations of the refresh frequency determining method described above, and will not be repeated here.
[0134] In one exemplary embodiment, such as Figure 8 As shown, a refresh rate determination device is provided, including: an acquisition module 802, a region determination module 804, an area determination module 806, and a frequency determination module 808, wherein:
[0135] The acquisition module 802 is used to acquire first image data and second image data; the second image data is the image data of the previous frame of the first image data.
[0136] The region determination module 804 is used to determine the image region to be updated based on the first image data and the second image data;
[0137] The area determination module 806 is used to determine the area of the region to be updated and the area of the image corresponding to the first image data;
[0138] The frequency determination module 808 is used to determine the target refresh frequency when the area ratio between the region area and the image area is less than a first ratio threshold. The target refresh frequency is greater than the refresh frequency of the display screen. The target refresh frequency is used to indicate the target area corresponding to the image area to be updated in the display screen and refresh it according to the target refresh frequency.
[0139] In one embodiment, the region determination module 804 is further configured to: for each first pixel in the first image data, determine a pixel difference value corresponding to the first pixel based on the pixel value of the first pixel and the pixel value of the corresponding pixel in the second image data; and determine the image region to be updated based on the pixel difference values corresponding to each first pixel.
[0140] In one embodiment, the region determination module 804 is further configured to: for each first pixel, compare the pixel difference value corresponding to the first pixel with a difference threshold, and determine the first pixel corresponding to the pixel difference value greater than the difference threshold as the pixel to be updated; compare the position coordinates of multiple pixels to be updated to obtain a first position coordinate and a second position coordinate; the horizontal coordinate value in the first position coordinate is the smallest horizontal coordinate value among multiple position coordinates, the vertical coordinate value in the first position coordinate is the smallest vertical coordinate value among multiple position coordinates, the horizontal coordinate value in the second position coordinate is the largest horizontal coordinate value among multiple position coordinates, and the vertical coordinate value in the first position coordinate is the largest vertical coordinate value among multiple position coordinates; and determine the image region to be updated based on the first position coordinate and the second position coordinate.
[0141] In one embodiment, the frequency determination module 808 is further configured to: determine a target refresh frequency based on the area ratio and the update refresh frequency when the area ratio is less than a first ratio threshold; the target refresh frequency is inversely proportional to the area ratio.
[0142] In one embodiment, the frequency determination module 808 is further configured to: determine the first refresh frequency as the target refresh frequency when the area ratio is less than the first ratio threshold and greater than the second ratio threshold; the second ratio threshold is less than the first ratio threshold and the first refresh frequency is greater than the update refresh frequency; determine the second refresh frequency as the target refresh frequency when the area ratio is less than or equal to the second ratio threshold; the second refresh frequency is greater than the first refresh frequency.
[0143] In one embodiment, the refresh frequency determination further includes a storage module, which is used to: store the image data to be updated of the image area to be updated in the storage area of the display driver chip corresponding to the display screen; and determine the target area in the display screen corresponding to the image area to be updated based on the image data to be updated by the display driver chip, and control the refresh frequency of the target area to be the target refresh frequency.
[0144] In one embodiment, the refresh frequency determination further includes an instruction sending module, which is configured to: generate an activation instruction based on the target refresh frequency; send the activation instruction to the display driver chip during the interval time corresponding to the second image data; the activation instruction is used to instruct the display driver chip to generate a target synchronization signal with the same target refresh frequency, and the target synchronization signal is used to instruct the image data to be updated in the image area to be updated to be saved in the storage area.
[0145] In one embodiment, the refresh rate determination further includes an instruction sending module, which is configured to: send a reset instruction to the display driver chip during the time interval corresponding to the second image data; the reset instruction is used to instruct the display driver chip to update the refresh rate of the display screen to the updated refresh rate.
[0146] In one embodiment, the display driver chip is used to execute a reset instruction based on the time interval corresponding to the refresh frequency.
[0147] In one embodiment, the refresh frequency determination further includes a data determination module, which is configured to: determine the frequency multiple between the target refresh frequency and the update refresh frequency; generate at least one intermediate image data corresponding to the image region to be updated based on the frequency multiple, the image data corresponding to the image region to be updated in the second image data, and the image data corresponding to the image region to be updated in the first image data; determine the at least one intermediate image data and the image data corresponding to the image region to be updated in the first image data as the image data to be updated; and control the target area on the display screen to display the image data to be updated based on the target refresh frequency.
[0148] In one embodiment, the acquisition module 802 is further configured to: acquire the display type of the display screen; compare the display type with the target type in the target type set; and, if it is determined that the display type is the same as the target type, acquire the first image data and the second image data.
[0149] The modules in the refresh rate determination device described above can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor of the electronic device in hardware form or independent of it, or stored in the memory of the electronic device in software form, so that the processor can call and execute the operations corresponding to each module.
[0150] In one exemplary embodiment, an electronic device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 9As shown, this electronic device includes a processor, memory, input / output interface, communication interface, display driver chip, display screen, and input device. The processor, memory, and input / output interface are connected via a system bus. The communication interface, display driver chip, and input device are also connected to the system bus via the input / output interface. The display driver chip controls the display screen to display image data. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The input / output interface is used for exchanging information between the processor and external devices. The communication interface is used for wired or wireless communication with external terminals. Wireless communication can be achieved through Wi-Fi, mobile cellular networks, Near Field Communication (NFC), or other technologies. When the computer program is executed by the processor, it implements a refresh rate determination method. The display unit of this electronic device forms a visually visible image and can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be an LCD screen or an e-ink screen. The input device of the electronic device can be a touch layer covering the display screen, or buttons, trackballs, or touchpads set on the casing of the electronic device, or external keyboards, touchpads, or mice, etc.
[0151] Those skilled in the art will understand that Figure 9 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the electronic device to which the present application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements.
[0152] In one embodiment, an electronic device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above-described method embodiments.
[0153] In one embodiment, an electronic device is provided, which further includes a display driver chip and a display screen, wherein the display driver chip is used to control a target area in the display screen to refresh according to a target refresh rate.
[0154] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the steps in the above method embodiments.
[0155] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above method embodiments.
[0156] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data must comply with relevant regulations.
[0157] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, artificial intelligence (AI) processors, etc., and are not limited to these.
[0158] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.
[0159] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.
Claims
1. A method for determining refresh frequency, characterized in that, The method includes: If the display type of the screen is determined to be the target type, first image data and second image data are obtained; the second image data is the image data of the frame preceding the first image data. Based on the first image data and the second image data, determine the image region to be updated; Determine the area of the region to be updated and the area of the image corresponding to the first image data; If the area ratio between the region area and the image area is less than a first ratio threshold and greater than a second ratio threshold, the first refresh frequency is determined as the target refresh frequency; the second ratio threshold is less than the first ratio threshold, and the first refresh frequency is greater than the update refresh frequency of the display screen; the target refresh frequency is used to indicate the target region corresponding to the image region to be updated in the display screen, and refreshes it according to the target refresh frequency; If the area ratio is less than or equal to the second ratio threshold, the second refresh frequency is determined as the target refresh frequency; the second refresh frequency is greater than the first refresh frequency.
2. The method according to claim 1, characterized in that, The step of determining the image region to be updated based on the first image data and the second image data includes: For each first pixel in the first image data, a pixel difference value corresponding to the first pixel is determined based on the pixel value of the first pixel and the pixel value of the corresponding pixel in the second image data. Based on the pixel difference value corresponding to each of the first pixels, the image region to be updated is determined.
3. The method according to claim 2, characterized in that, The step of determining the image region to be updated based on the pixel difference values corresponding to each of the first pixels includes: For each first pixel, the pixel difference value corresponding to the first pixel is compared with the difference threshold, and the first pixel corresponding to the pixel difference value that is greater than the difference threshold is determined as the pixel to be updated. The position coordinates of multiple pixels to be updated are compared to obtain a first position coordinate and a second position coordinate; the horizontal coordinate value of the first position coordinate is the smallest horizontal coordinate value among the multiple position coordinates, the vertical coordinate value of the first position coordinate is the smallest vertical coordinate value among the multiple position coordinates, the horizontal coordinate value of the second position coordinate is the largest horizontal coordinate value among the multiple position coordinates, and the vertical coordinate value of the first position coordinate is the largest vertical coordinate value among the multiple position coordinates. Based on the first and second position coordinates, the image region to be updated is determined.
4. The method according to claim 1, characterized in that, The step of determining the image region to be updated based on the first image data and the second image data includes: A motion mask is determined between the first image data and the second image data; the mask value in the motion mask is a first identifier or a second identifier, the first identifier indicating that the pixel is a moving pixel, and the second identifier indicating that the pixel is a non-moving pixel; The pixel with the mask value as the first identifier is identified as the pixel to be updated. Based on the multiple pixels to be updated, the image region to be updated is determined.
5. The method according to claim 4, characterized in that, The step of determining the image region to be updated based on multiple pixels to be updated includes: Based on the pixels to be updated, determine the start row and end row corresponding to multiple pixels to be updated; The image region formed by the starting row and the ending row is determined as the image region to be updated.
6. The method according to claim 1, characterized in that, After determining the target refresh rate, the following is also included: The image data to be updated for the image area to be updated is stored in the storage area of the display driver chip corresponding to the display screen; The display driver chip determines the target area on the display screen corresponding to the area of the image to be updated based on the image data to be updated, and controls the refresh frequency of the target area to be the target refresh frequency.
7. The method according to claim 6, characterized in that, Before storing the image data to be updated for the image area to be updated in the storage area of the display driver chip corresponding to the display screen, the method further includes: Based on the target refresh rate, an activation command is generated; During the time interval corresponding to the second image data, the activation instruction is sent to the display driver chip; the activation instruction is used to instruct the display driver chip to generate a target synchronization signal with the same target refresh rate, and the target synchronization signal is used to instruct the image data to be updated in the image area to be updated to be saved in the storage area.
8. The method according to claim 6, characterized in that, Before storing the image data to be updated for the image area to be updated in the storage area of the display driver chip corresponding to the display screen, the method further includes: During the time interval corresponding to the second image data, a reset command is sent to the display driver chip; the reset command is used to instruct the display driver chip to update the refresh rate of the display screen to the updated refresh rate.
9. The method according to claim 8, characterized in that, The display driver chip is used to execute the reset command based on the time interval corresponding to the update refresh frequency.
10. The method according to claim 1, characterized in that, After determining the target refresh rate, the following is included: Determine the frequency multiple between the target refresh frequency and the update refresh frequency; Based on the frequency multiple, the image data corresponding to the image region to be updated in the second image data, and the image data corresponding to the image region to be updated in the first image data, at least one intermediate image data corresponding to the image region to be updated is generated; At least one of the intermediate image data and the image data corresponding to the image region to be updated in the first image data are determined as the image data to be updated; Based on the target refresh rate, the target area on the display screen is controlled to display the image data to be updated.
11. The method according to claim 1, characterized in that, Before acquiring the first image data and the second image data when the display type of the screen is determined to be the target type, and before the second image data is the image data of the previous frame of the first image data, the method further includes: Obtain the display type of the display screen; The display type is compared with the target type in the target type set.
12. A refresh frequency determining device, characterized in that, The device includes: The acquisition module is used to acquire first image data and second image data when the display type of the display screen is determined to be the target type; the second image data is the image data of the previous frame of the first image data; The region determination module is used to determine the image region to be updated based on the first image data and the second image data; An area determination module is used to determine the area of the region to be updated in the image, and the area of the image corresponding to the first image data. A frequency determination module is configured to determine a first refresh frequency as a target refresh frequency when the area ratio between the region area and the image area is less than a first ratio threshold and greater than a second ratio threshold; the second ratio threshold is less than the first ratio threshold, and the first refresh frequency is greater than the refresh frequency of the display screen; the target refresh frequency is used to instruct the target region corresponding to the image region to be updated in the display screen to be refreshed according to the target refresh frequency; when the area ratio is less than or equal to the second ratio threshold, a second refresh frequency is determined as the target refresh frequency; the second refresh frequency is greater than the first refresh frequency.
13. An electronic device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 11.
14. The electronic device according to claim 13, characterized in that, The electronic device also includes a display driver chip and a display screen, wherein the display driver chip is used to control the target area in the display screen to refresh according to a target refresh rate.
15. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 11.
16. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 11.
Citation Information
Patent Citations
Method and device for adjusting refreshing rate of screen
CN104269155A
Game frame rate dynamic regulation and control method and device and computer readable storage medium
CN114356146A
Display device and refresh driving method
CN115311996A
Screen updating method and device, electronic equipment and readable storage medium
CN116225356A
Display method, display device and computer readable medium
CN117916798A