Display screen refreshing method and device, and electronic device

Abstract

The application discloses a display screen refreshing method and device and electronic equipment, and belongs to the technical field of image processing. The method comprises the following steps: acquiring a first TE signal output by a display screen of an electronic equipment; in the case that the first TE signal and N second TE signals meet a preset condition, generating a first refreshing signal based on the first TE signal, the N second TE signals being TE signals output by the display screen for the last N times before the first TE signal; and controlling the display screen to refresh based on the first refreshing signal, wherein N is a positive integer.

Description

Technical Field

[0001] This application belongs to the field of image processing technology, specifically relating to a display screen refresh method, apparatus, and electronic device. Background Technology

[0002] Currently, during the display of an electronic device's screen, the screen can send a tearing effect (TE) signal to the Central Processing Unit (CPU) to indicate that the current frame of the image has been refreshed and the next frame can be sent. Upon receiving the TE signal, the CPU processes it to obtain a Hardware Vertical Synchronization (HW-VSYNC) signal, which is then reported to the image processing module within the electronic device. This image processing module then controls the screen's refresh rate. For example, the HW-VSYNC signal can be reported to the SurfaceFlinger within the electronic device, thereby controlling the screen's refresh rate through the SurfaceFlinger.

[0003] However, after the HW-VSYNC signal is reported, if the image processing module synthesizes the current frame image before the previous frame image is fully displayed, the previous frame image and the current frame image will be displayed on the screen at the same time, resulting in the phenomenon of two frames of images overlapping on the screen, which leads to poor image display effect of the electronic device's screen. Summary of the Invention

[0004] The purpose of this application is to provide a display screen refresh method, apparatus, and electronic device that can improve the display effect of images.

[0005] In a first aspect, embodiments of this application provide a display screen refresh method, the method comprising: acquiring a first tearing effect TE signal output by the display screen of an electronic device; generating a first refresh signal based on the first TE signal when the first TE signal and N second TE signals satisfy a preset condition, wherein the N second TE signals are the TE signals most recently output by the display screen before the first TE signal; and controlling the display screen to refresh based on the first refresh signal; wherein N is a positive integer.

[0006] Secondly, embodiments of this application provide a display screen refresh device, which includes: an acquisition module and a processing module; the acquisition module is used to acquire a first tearing effect TE signal output by the display screen of an electronic device; the processing module is used to generate a first refresh signal based on the first TE signal when the first TE signal acquired by the acquisition module and N second TE signals satisfy a preset condition, wherein the N second TE signals are the TE signals most recently output by the display screen before the first TE signal; the processing module is further used to control the display screen to refresh based on the first refresh signal; wherein N is a positive integer.

[0007] Thirdly, embodiments of this application provide an electronic device including a processor and a memory, wherein the memory stores programs or instructions executable on the processor, and the programs or instructions, when executed by the processor, implement the steps of the method described in the first aspect.

[0008] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method described in the first aspect.

[0009] Fifthly, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the method as described in the first aspect.

[0010] In a sixth aspect, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the method described in the first aspect.

[0011] In this embodiment, a first TE signal output by the display screen of an electronic device is acquired; if the first TE signal and N second TE signals satisfy a preset condition, a first refresh signal is generated based on the first TE signal, where the N second TE signals are the N most recent TE signals output by the display screen before the first TE signal; based on the first refresh signal, the display screen is controlled to refresh; where N is a positive integer. This scheme allows for determining whether to generate a refresh signal by combining the new TE signal with the N TE signals received before it upon receipt. Therefore, by generating a refresh signal only when preset conditions are met, the display screen refresh can be controlled, reducing the frequency of refresh signal generation to be lower than the frequency of TE signals. This avoids the phenomenon of two frames of images overlapping on the display screen, thus improving the image display effect of the electronic device's display screen. Attached Figure Description

[0012] Figure 1This is a schematic diagram of a workflow for displaying an image provided in an embodiment of this application;

[0013] Figure 2 This is a schematic diagram of the output frequency of Fix-TE and Multi-TE provided in an embodiment of this application;

[0014] Figure 3 This is a schematic diagram of a workflow for simultaneously displaying two frames of images provided in an embodiment of this application;

[0015] Figure 4 This is a flowchart of a display screen refresh method provided in an embodiment of this application;

[0016] Figure 5 This is a schematic diagram of the generation frequency of an HW-VSYNC signal provided in an embodiment of this application;

[0017] Figure 6 This is a schematic diagram of the structure of a display screen refresh device provided in an embodiment of this application;

[0018] Figure 7 This is one of the hardware structure diagrams of an electronic device provided in the embodiments of this application;

[0019] Figure 8 This is a second schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0020] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0021] The terms "first," "second," etc., used in this application's specification are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such terms can be used interchangeably where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class, without limiting the number of objects; for example, a first object can be one or more. Furthermore, in the specification, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects have an "or" relationship.

[0022] The terms "at least one" and "at least one" in this application's specification refer to any one, any two, or a combination of two or more of the included objects. For example, "at least one of a, b, and c" can mean "a", "b", "c", "a and b", "a and c", "b and c", and "a, b, and c", where a, b, and c can be single or multiple. Similarly, "at least two" refers to two or more, and its meaning is similar to "at least one". The identifiers in this application are text, symbols, images, etc., used to indicate information, and can use identifiers or other containers as carriers for displaying information, including but not limited to text identifiers, image identifiers, and symbol identifiers.

[0023] The following explains some terms and nouns used in the embodiments of this application.

[0024] 1. SurfaceFlinger is a graphics processing module in electronic devices. It can receive and process multi-layer image data, synthesize them, and then send them to the display screen of the electronic device.

[0025] 2. The TE signal is a hardware refresh signal output by the display screen of an electronic device. It is used to synchronize the display screen with the CPU of the electronic device to prevent screen tearing.

[0026] 3. HW-VSYNC is the hardware refresh signal received by SurfaceFlinger, which is the result of the electronic device processing the TE signal.

[0027] 4. The Vact and Vblank areas can be used to indicate the display's frame refresh state. The Vact area indicates that the display is in progressive scan mode, while the Vblank area indicates that the display is in an idle state. It can be understood that when the display is in frame refresh mode, it can prevent screen tearing by refreshing; while when the display is in an idle state, it can stop refreshing to save power.

[0028] 5. Display frame rate refers to the number of frames displayed on the screen per second. A high frame rate means that the images on the screen are updated more quickly, resulting in a smoother visual experience.

[0029] 6. Display refresh rate refers to the number of times the display refreshes its image per second. A high refresh rate reduces image flickering on the screen, making the picture more stable.

[0030] The display refresh method, apparatus, and electronic device provided in this application will be described in detail below with reference to the accompanying drawings and through specific embodiments and application scenarios.

[0031] The display refresh method, apparatus, and electronic device provided in this application can be applied to scenarios where electronic devices display images through a display screen.

[0032] like Figure 1 The diagram illustrates the workflow of an electronic device displaying images on a screen. Each frame of the image needs to be rendered by the application, composited by SurfaceFlinger, and finally displayed on the screen.

[0033] It should be noted that, Figure 1 The frame-1 shown is used to represent the image of the frame preceding frame 0.

[0034] To optimize the stuttering issue caused by timeouts in intermediate steps during image processing, a refresh rate of 360Hz, 480Hz, or even higher can be provided to the display to receive frame refresh requests from SurfaceFlinger and refresh the display screen more quickly.

[0035] The aforementioned high-frequency frame-refreshing techniques can include Fix-TE and Multi-TE. Among them, such as... Figure 2 As shown, Fix-TE technology means that the TE frequency is fixed and can reach 360Hz or higher, regardless of whether the display is in frame refresh or idle state; Multi-TE technology means that the high-frequency TE signal is output in a time-division manner. When the display is refreshing frames (i.e., Vact area), the high-frequency TE is not output, but only at the beginning and end positions. When not refreshing frames (i.e., Vblank area), the high-frequency TE is output.

[0036] It should be noted that although the display can output TE signals at 360Hz or higher frequencies, its screen refresh rate is usually limited to a maximum of 120Hz due to module power consumption and cost constraints, and cannot reach higher frequencies for the time being.

[0037] Therefore, since the TE signal frequency output by the display is higher than the display frame rate, if a high-frequency HW-VSYNC signal with the same TE frequency is directly reported to SurfaceFlinger, such as... Figure 3 As shown, this may cause the two frames to overlap on the screen.

[0038] The display refresh method, apparatus, and electronic device provided in this application can, upon receiving a new TE signal, combine the new TE signal with N previously received TE signals to determine whether to generate a refresh signal. This allows for control of the display refresh by generating a refresh signal only when preset conditions are met, thereby reducing the frequency of refresh signal generation to be lower than the frequency of TE signals. This prevents the display from displaying two overlapping frames, thus improving the image display effect of the electronic device's screen.

[0039] The display refresh method provided in this application can be implemented by a display refresh device. Exemplarily, the display refresh device can be an electronic device or a component within that electronic device, such as an integrated circuit or a chip. The display refresh method provided in this application will be described executively below using an electronic device as an example.

[0040] This application provides a display screen refresh method. Figure 4 A flowchart illustrating a display screen refresh method provided in an embodiment of this application is shown, which can be applied to electronic devices. Figure 4 As shown, the display refresh method provided in this application embodiment may include the following steps 401 to 403.

[0041] Step 401: The electronic device acquires the first TE signal output by the display screen of the electronic device.

[0042] In some embodiments of this application, the aforementioned first TE signal may be the latest TE signal output by the display screen of the electronic device, or the currently output TE signal. That is, the first TE signal is the last TE signal output by the display screen of the electronic device at the current moment.

[0043] Step 402: When the first TE signal and N second TE signals meet the preset conditions, the electronic device generates a first refresh signal based on the first TE signal.

[0044] Among them, the above N second TE signals can be the TE signals most recently output by the display screen before the first TE signal, where N is a positive integer.

[0045] In some embodiments of this application, the N most recent TE signals output before the first TE signal can be the N TE signals output after the electronic device outputs the refresh signal and before the display screen outputs the first TE signal.

[0046] For example, taking N=8 as an example, the above-mentioned N second TE signals can be the 8 TE signals output by the electronic device after the last output refresh signal and before the display screen outputs the first TE signal.

[0047] In some embodiments of this application, the first refresh signal described above can be used to trigger the electronic device display screen to refresh frames.

[0048] For example, the first refresh signal mentioned above can be the HW-VSYNC signal.

[0049] For example, such as Figure 5As shown, the electronic device can determine whether the TE signal currently output by the display screen meets the preset conditions with the N previously output TE signals only when the display screen updates the image, and generate an HW-VSYNC signal based on the currently received TE signal to convert the high-frequency TE signal into a low-frequency fixed-frequency HW-VSYNC signal, thereby solving the screen tearing problem and achieving frame stabilization.

[0050] It should be noted that, Figure 5 The dashed line in the diagram represents one generation of the HW-VSYNC signal. That is to say, Figure 5 The frequency of the HW-VSYNC signal shown is the same as the display frame rate.

[0051] In some embodiments of this application, upon receiving a first TE signal, the electronic device can first combine the N most recent TE signals output by the display screen before the first TE signal to determine whether to generate a first refresh signal. This allows the high-frequency TE signal to be converted into a low-frequency, fixed-frequency refresh signal without generating a first refresh signal, achieving frame stabilization and preventing the display screen from displaying two overlapping frames.

[0052] Step 403: The electronic device controls the display screen to refresh based on the first refresh signal.

[0053] In some embodiments of this application, the electronic device can send a first refresh signal to the display screen through an image synthesis module, so that the display screen can refresh frames.

[0054] For example, an electronic device can send a refresh request (i.e., a first refresh signal) to the display via SurfaceFlinger, so that the display can refresh based on the refresh request.

[0055] In some embodiments of this application, step 403 can be specifically implemented by step 403a as described below.

[0056] Step 403a: The electronic device refreshes the display screen by controlling the image processing module of the electronic device based on the first refresh signal.

[0057] In some embodiments of this application, the image processing module described above may be SurfaceFlinger.

[0058] For example, taking the HW-VSYNC signal as the first refresh signal. During the display of an electronic device's screen, the screen can send a TE signal to the CPU of the electronic device to indicate that the image of the current frame has been refreshed and the next frame can be sent. After receiving the TE signal, the CPU can process the TE signal to obtain the HW-VSYNC signal, and report the HW-VSYNC signal to the SurfaceFlinger in the electronic device. The image processing module then sends a refresh request to the display screen to refresh the screen.

[0059] The display refresh method provided in this application can, upon receiving a new TE signal, combine the new TE signal with N previously received TE signals to determine whether to generate a refresh signal. This allows the display refresh to be controlled by generating a refresh signal only when preset conditions are met, thereby reducing the frequency of refresh signal generation to be lower than the frequency of TE signals. This prevents the phenomenon of two frames of images overlapping on the display screen, thus improving the image display effect of the electronic device's screen.

[0060] In some embodiments of this application, the methods for determining whether a first refresh signal has been generated may include the cumulative method and the time window method.

[0061] Among them, the cumulative method can set a threshold, and generate a refresh signal when the number of acquired TE signals reaches or exceeds the threshold; the time window method can determine an effective time window for the refresh signal based on the electronic device display screen, and generate a refresh signal only when the acquired TE signals are within the effective time window.

[0062] Furthermore, in the time window method, the electronic device can also adjust the effective time window according to the actual generation time of the refresh signal.

[0063] In some embodiments of this application, before step 402 above, the display refresh method provided in this application may further include step 404 below, and step 402 above may include step 402a below.

[0064] Step 404: When the frequencies of the N second TE signals match, the electronic device acquires the first TE signal and the total number of the N second TE signals, N+1.

[0065] In some embodiments of this application, the matching of the frequencies of the above-mentioned N second TE signals can be understood as: the frequencies of the N second TE signals output by the electronic device display screen are all equal.

[0066] For example, an electronic device can output N second TE signals at the same frequency in Fix-TE mode.

[0067] In some embodiments of this application, the total number mentioned above may refer to the total number of one first TE signal and N second TE signals obtained, which is N+1.

[0068] Step 402a: When the total number N+1 reaches the first threshold, the electronic device generates a first refresh signal based on the first TE signal.

[0069] The first threshold can be the ratio of the frequency of the TE signal output by the display screen to the frame rate of the display screen.

[0070] In some embodiments of this application, after generating a first refresh signal based on a first TE signal, the electronic device can set the number of TE signals to 0 and restart accumulating the number of TE signals output by the display screen, so that when the number of newly acquired TE signals and the total number of accumulated N TE signals N+1 reach the first threshold again, a corresponding refresh signal is generated.

[0071] For example, if the frequency of the TE signal output by the display is 480Hz, the display frame rate is 60Hz, and the refresh information is HW-VSYNC, then the first threshold is 480Hz / 60Hz = 8. Thus, the electronic device can generate a refresh signal after the display outputs 8 TE signals, and control the display to refresh based on this refresh signal.

[0072] Understandably, in this scenario, for every 8 TE signals output by the display screen, the electronic device can generate a signal and control the display screen based on that signal.

[0073] Thus, since electronic devices can output a refresh signal only after the display outputs multiple TE signals based on the ratio of the frequency of the output TE signal to the display frame rate, the frequency of generating refresh signals can be reduced, thereby avoiding the phenomenon of two frames of images overlapping on the display. This improves the image display effect of the electronic device's screen.

[0074] In some embodiments of this application, before step 402 above, the display refresh method provided in this application may further include steps 405 and 406 below, and step 402 above may include step 402b below.

[0075] Step 405: In the case that the frequencies of some of the N second TE signals are mismatched, the electronic device determines the first output time difference between the first TE signal and the third TE signal.

[0076] The aforementioned third TE signal can be the last of the N second TE signals.

[0077] In some embodiments of this application, the frequency mismatch of some of the N second TE signals can be understood as: some of the N second TE signals have frequencies different from the frequencies of the other second TE signals.

[0078] For example, in Multi-TE mode, an electronic device can output a TE signal in the Vact region at a first frequency and in the Vblank region at a second frequency, wherein the first frequency and the second frequency are different.

[0079] Understandably, for Multi-TE mode, when using the cumulative method, the electronic device needs to distinguish whether the first TE signal acquired belongs to the Vact region or the Vblank region.

[0080] In some embodiments of this application, the first output time difference may represent the output time difference between the last two TE signals output by the electronic device display screen.

[0081] Step 406: The electronic device determines the second value based on the first output time difference and the first value.

[0082] The first value mentioned above can be determined by the display screen frame rate.

[0083] In some embodiments of this application, the first value mentioned above may indicate the duration value corresponding to the Vact area.

[0084] For example, the first value mentioned above can be half the time required for each screen refresh. It can be understood that the time required for each screen refresh is determined by the screen's frame rate.

[0085] For example, an electronic device can divide 1 by the display frame rate to obtain the time required for each display refresh.

[0086] In some embodiments of this application, after obtaining the first value, the electronic device can determine whether the first TE signal belongs to the Vblank region or the Vact region by comparing the first output time difference with the first value.

[0087] In some embodiments of this application, the electronic device can determine the second value based on the judgment result of whether the first TE signal belongs to the Vblank region or the Vact region.

[0088] In some embodiments of this application, step 406 may include step 406a or step 406b described below.

[0089] Step 406a: If the first output time difference is less than the first value, the electronic device adds 1 to the number N of the second TE signal to obtain the second value.

[0090] In some embodiments of this application, the fact that the first output time difference is less than a first value indicates that the first TE signal belongs to the Vblank region. Therefore, the electronic device can add 1 to the number N of the second TE signals to obtain a second value.

[0091] Step 406b: If the first output time difference is greater than or equal to the first value, the electronic device adds the third value to the number N of the second TE signal to obtain the second value.

[0092] The third value mentioned above can be the ratio of the frequency of the TE signal output by the display screen to the frame rate of the display screen.

[0093] In some embodiments of this application, the first output time difference being greater than or equal to a first value can indicate that the first TE signal belongs to the Vact region. Therefore, the electronic device can add the number N of the second TE signals to a third value to obtain a second value.

[0094] In some embodiments of this application, the above-mentioned display screen frame rate can be the highest frame rate of the display screen.

[0095] Step 402b: When the second value reaches the first threshold, the electronic device generates a first refresh signal based on the first TE signal.

[0096] The first threshold is the ratio of the frequency of the TE signal output by the display screen to the frame rate of the display screen.

[0097] For example, consider an electronic device in Multi-TE mode, with a maximum TE signal frequency of 480Hz, a display frame rate of 60Hz, a maximum display frame rate of 120Hz, a first threshold Threshold of 480Hz / 60Hz = 8, and the output time of the last second TE signal among N second TE signals as LastTime. After acquiring the first TE signal, the electronic device can record its output time as CurrentTime. Then, it can calculate the output time difference between the last second TE signal and the first TE signal: DeltaTime = CurrentTime – LastTime. Based on DeltaTime, it can determine whether the first TE signal belongs to the Vact region or the Vblank region.

[0098] If DeltaTime is less than half of the Vact region, the electronic device can determine that the first TE signal belongs to the Vblank region. In this case, the electronic device can add 1 to the number N of the second TE signal to obtain the second value. If DeltaTime is greater than or equal to half of the Vact region, the electronic device can determine that the first TE signal belongs to the Vact region. In this case, the electronic device can add 4 to the ratio of 480Hz to 120Hz, which is 4, to the number N of the second TE signal to obtain the second value.

[0099] Then, the electronic device can generate a first refresh signal if the second value is greater than or equal to 8.

[0100] In some embodiments of this application, the electronic device may, after generating the first signal, set the number of TE signals already output by the display screen to 0, so as to restart the counting of TE signals.

[0101] In some embodiments of this application, when the second value is less than the first threshold, the electronic device may not generate a refresh signal, and when a new TE signal is obtained, it may repeat steps 401 to 406 above to generate a first refresh signal when the new second value reaches the first threshold.

[0102] Thus, since electronic devices can output a refresh signal only after the display outputs multiple TE signals based on the ratio of the frequency of the output TE signal to the display frame rate, the frequency of generating refresh signals can be reduced, thereby avoiding the phenomenon of two frames of images overlapping on the display. This improves the image display effect of the electronic device's screen.

[0103] In some embodiments of this application, after step 402 above, the display refresh method provided in this application may further include step 407 below.

[0104] Step 407: The electronic device sets the number of TE signals already output by the display screen to the seventh value.

[0105] In some embodiments of this application, after the electronic device generates a first refresh signal based on the first TE signal, the electronic device can reset the value of the number of TE signals already output by the display screen and restart the accumulation of the TE signals already output by the display screen, so that when the display screen outputs a new TE signal again, it can re-determine whether to generate a refresh signal.

[0106] In some embodiments of this application, the aforementioned first value can be a default value of the electronic device or a value set by the user. This application does not impose specific limitations on the embodiments.

[0107] For example, the seventh value mentioned above can be 0. For instance, for every 8 TE signals output by the display screen, the electronic device can generate a refresh signal and restart the accumulation of the number of TE signals already output by the display screen. That is, the number of TE signals already output by the display screen is set to 0.

[0108] Thus, by resetting the number of TE signals already output by the display screen after generating the refresh signal, it is possible to accurately determine whether to generate a refresh signal based on the currently output TE signal, thereby improving the accuracy of refreshing signal generation.

[0109] In some embodiments of this application, before step 402 above, the display refresh method provided in this application may further include steps 408 and 409 below, and step 402 above may include step 402c below.

[0110] Step 408: The electronic device obtains the fourth value based on the display frame rate.

[0111] The fourth value mentioned above can be the image refresh cycle value corresponding to the display screen frame rate.

[0112] In some embodiments of this application, the electronic device can calculate the fourth value using the following formula (1).

[0113]

[0114] Here, Cycle can represent the fourth value, and FreqSystem can represent the display frame rate.

[0115] Step 409: The electronic device uses the difference between the fourth and fifth values ​​as the lower limit of the interval and the sum of the fourth and fifth values ​​as the upper limit of the interval to obtain the first interval.

[0116] Among them, the fifth value mentioned above can be the refresh period value corresponding to the frequency of the TE signal output by the display screen.

[0117] In some embodiments of this application, the electronic device can calculate the fifth value using the following formula (2).

[0118]

[0119] Among them, CycleTE can represent the fifth value, and FreqTE can represent the frequency of the TE signal output by the display screen.

[0120] In some embodiments of this application, the electronic device can calculate the lower limit value of the interval EffectiveCycleLow using the following formula (3) and calculate the upper limit value of the interval EffectiveCycleHigh using the following formula (4) to obtain the first interval EffectiveCycle.

[0121] EffectiveCycleLow=Cycle-CycleTE formula (3)

[0122] EffectiveCycleHigh=Cycle+CycleTE formula (4)

[0123] Step 402c: When the second output time difference is within the first interval, or when the second output time difference is greater than the upper limit of the first interval, the electronic device generates a first refresh signal based on the first TE signal.

[0124] The second output time difference can be the output time difference between the first TE signal and the second refresh signal, and the second refresh signal can be the refresh signal generated before the display outputs the first TE signal.

[0125] In some embodiments of this application, after the electronic device acquires the first TE signal, the electronic device can use the output time of the first TE signal, CurrentTime, and the electronic device can calculate the second output time difference, Period, using the following formula (5).

[0126] Period=CurrentTime–LastVsyncTime Formula (5)

[0127] Here, LastVsyncTime can represent the generation time of the second refresh signal.

[0128] In some embodiments of this application, the electronic device may continue to acquire new TE signals after generating the first refresh signal in order to determine whether a new refresh signal should be generated.

[0129] Thus, since electronic devices can determine whether to output a refresh signal based on whether the TE signal output by the display screen is within the desired time window, the frequency of refresh signal generation can be reduced by decreasing the number of refresh signals generated, thereby avoiding the phenomenon of two frames of images overlapping on the display screen. This improves the image display effect of the electronic device's screen.

[0130] In some embodiments of this application, the display refresh method provided in this application may further include the following steps 410 or 411.

[0131] Step 410: If the second output time difference is within the first interval, and the second output time difference is greater than the midpoint of the first interval, then the electronic device adjusts the upper limit and lower limit of the first interval.

[0132] In some embodiments of this application, the electronic device can adjust the time window according to the true frequency of the refresh signal when the second output time difference is within the first interval, so as to more accurately determine whether to generate the corresponding refresh signal after the TE signal is acquired.

[0133] In some embodiments of this application, the electronic device can immediately adjust the upper and lower limits of the first interval when the second output time difference is within the first interval; or it can calculate the average value of the multiple second output time differences when multiple TE signals are detected to be within the first interval, and adjust the upper and lower limits of the first interval based on the average value.

[0134] For example, consider the case where the electronic device detects that the second output time difference corresponding to 10 TE signals is within the first interval. The electronic device can calculate the average value of the output time difference, RealCycleAverage, using the following formula (6), and calculate the median value of the first interval, EffectiveCycleMiddle, using the following formula (7).

[0135]

[0136] In some embodiments of this application, if the second output time difference is greater than the median value of the first interval, it indicates that the coverage of the first interval is lower than the period corresponding to the output frequency of the refresh signal. Therefore, the electronic device can correct the coverage of the first interval by adjusting the upper and lower limits of the first interval.

[0137] In some embodiments of this application, step 410 may include step 410a as described below.

[0138] Step 410a: The electronic device increases the upper limit and lower limit of the first interval by the sixth value.

[0139] Among them, the sixth value mentioned above can be the difference between the second output time difference and the median value of the first interval.

[0140] In some embodiments of this application, the electronic device can calculate the lower limit of the first interval after adjustment using the following formula (8), and calculate the upper limit of the first interval after adjustment using the following formula (9).

[0141] EffectiveCycleLow=EffectiveCycleLow+(RealCycleAverage-EffectiveCycleMiddle) Formula (8)

[0142] EffectiveCycleHigh=EffectiveCycleHigh+(ReakCycleAverage-EffectiveCycleMiddle) Formula (9)

[0143] Thus, since electronic devices can determine whether to output a refresh signal based on whether the TE signal output by the display screen is within the desired time window, the frequency of refresh signal generation can be reduced by decreasing the number of refresh signals generated, thereby avoiding the phenomenon of two frames of images overlapping on the display screen. This improves the image display effect of the electronic device's screen.

[0144] Step 411: If the second output time difference is within the first interval, and if the second output time difference is less than the midpoint of the first interval, the electronic device lowers the upper and lower limits of the first interval.

[0145] In some embodiments of this application, step 410 may include step 410a as described below.

[0146] Step 411a: The electronic device lowers the upper limit and lower limit of the first interval by the sixth value.

[0147] In some embodiments of this application, if the second output time difference is less than the median value of the first interval, it indicates that the coverage of the first interval is lower than the period corresponding to the output frequency of the refresh signal. Therefore, the electronic device can correct the coverage of the first interval by lowering the upper limit and lower limit of the first interval.

[0148] In some embodiments of this application, the electronic device can calculate the lower limit of the first interval after reduction using the following formula (10), and calculate the upper limit of the first interval after reduction using the following formula (11).

[0149] EffectiveCycleLow=EffectiveCycleLow-(EffectiveCycleMiddle-RealCycleAverage) Formula (10)

[0150] EffectiveCycleHigh=EffectiveCycleHigh-(EffectiveCycleMiddle-RealCycleAverage) Formula (11)

[0151] It should be noted that if the second output time difference is equal to the midpoint of the first interval, it can be said that the coverage of the first interval is periodically matched with the output frequency of the refresh signal.

[0152] Thus, by adjusting the first cell, the electronic device can improve the accuracy of its judgment on whether to generate a refresh signal. This reduces the frequency of refresh signal generation, thereby preventing the phenomenon of two frames overlapping on the display screen. This improves the image display effect of the electronic device's screen.

[0153] In some embodiments of this application, the display refresh method provided in this application may further include the following step 412.

[0154] Step 412: If the second output time difference is less than the lower limit of the first interval, the electronic device does not generate the first refresh signal.

[0155] In some embodiments of this application, when the second output time difference is less than the lower limit of the first interval, the electronic device may not generate a refresh signal, and when a new TE signal is obtained, it may repeat steps 401 to 412 above to generate a first refresh signal when the new second output time is in or greater than the upper limit of the first interval.

[0156] Thus, since electronic devices can determine whether to output a refresh signal based on whether the TE signal output by the display screen is within the desired time window, the frequency of refresh signal generation can be reduced by decreasing the number of refresh signals generated, thereby avoiding the phenomenon of two frames of images overlapping on the display screen. This improves the image display effect of the electronic device's screen.

[0157] Each of the above-described method embodiments, or various possible implementations of each method embodiment, can be executed individually or in combination of any two or more. The specific implementation can be determined according to actual usage requirements, and this application does not impose any restrictions on this.

[0158] The display refresh method provided in this application can be executed by a display refresh device. This application uses a display refresh device executing the display refresh method as an example to illustrate the display refresh device provided in this application.

[0159] Figure 6 A schematic diagram of a possible structure of the display refresh device involved in an embodiment of this application is shown. For example... Figure 6 As shown, the display refresh device 60 may include an acquisition module 61 and a processing module 62.

[0160] The acquisition module 61 is used to acquire the first tearing effect TE signal output by the display screen of the electronic device; the processing module 62 is used to generate a first refresh signal based on the first TE signal when the first TE signal acquired by the acquisition module 61 and N second TE signals meet preset conditions, wherein the N second TE signals are the TE signals most recently output by the display screen before the first TE signal; and to control the display screen to refresh based on the first refresh signal; wherein N is a positive integer.

[0161] In one possible implementation, the acquisition module 61 is further configured to acquire the total number N+1 of the first TE signal and the N second TE signals, provided that the frequencies of the N second TE signals match, before the processing module 62 generates the first refresh signal based on the first TE signal.

[0162] The aforementioned processing module 62 is specifically used to generate a first refresh signal based on the first TE signal when the total number N+1 reaches the first threshold.

[0163] The first threshold is the ratio of the frequency of the TE signal output by the display screen to the frame rate of the display screen.

[0164] In one possible implementation, the processing module 62 is further configured to determine a first output time difference between the first TE signal and the third TE signal, where the frequencies of some of the N second TE signals are mismatched, before generating the first refresh signal based on the first TE signal; and to determine a second value based on the first output time difference and a first value, wherein the first value is determined by the display frame rate.

[0165] The aforementioned processing module 62 is specifically used to generate a first refresh signal based on the first TE signal when the second value reaches the first threshold.

[0166] The first threshold is the ratio of the frequency of the TE signal output by the display screen to the frame rate of the display screen.

[0167] In one possible implementation, the aforementioned processing module 62 is specifically used for:

[0168] If the first output time difference is less than the first value, the number N of the second TE signal is incremented by 1 to obtain the second value;

[0169] If the first output time difference is greater than or equal to the first value, the number N of the second TE signal is added to the third value to obtain the second value;

[0170] The third value is the ratio of the frequency of the TE signal output by the display screen to the display screen frame rate.

[0171] In one possible implementation, the processing module 62 is further configured to obtain a fourth value based on the display frame rate before generating the first refresh signal based on the first TE signal, wherein the fourth value is the value of the image refresh cycle corresponding to the display frame rate; and to use the difference between the fourth value and the fifth value as the lower limit of the interval and the sum of the fourth value and the fifth value as the upper limit of the interval to obtain a first interval, wherein the fifth value is the value of the refresh cycle corresponding to the frequency of the TE signal output by the display.

[0172] The aforementioned processing module 62 is specifically used to generate a first refresh signal based on the first TE signal when the second output time difference is located in the first interval, or when the second output time difference is greater than the upper limit of the first interval.

[0173] The second output time difference is the output time difference between the first TE signal and the second refresh signal, and the second refresh signal is the refresh signal generated before the display outputs the first TE signal.

[0174] In one possible implementation, the processing module 62 is further configured to, when the second output time difference is within the first interval, adjust the upper limit and lower limit of the first interval if the second output time difference is greater than the median value of the first interval; and adjust the upper limit and lower limit of the first interval if the second output time difference is less than the median value of the first interval.

[0175] In one possible implementation, the aforementioned processing module 62 is specifically used to increase the upper limit value and lower limit value of the first interval by a sixth value, respectively.

[0176] Processing module 62 is specifically used to lower the upper limit and lower limit of the first interval by the sixth value respectively;

[0177] The sixth value is the difference between the second output time difference and the median value of the first interval.

[0178] In one possible implementation, the processing module 62 is further configured not to generate a first refresh signal if the second output time difference is less than the lower limit of the first interval.

[0179] In one possible implementation, the aforementioned processing module 62 is specifically used to set the number of TE signals already output by the display screen to a seventh value.

[0180] In one possible implementation, the aforementioned processing module 62 is specifically used to control the display screen to refresh based on the first refresh signal via the image processing module of the electronic device.

[0181] This application provides a display screen refresh device that, upon receiving a new TE signal, combines the new TE signal with N previously received TE signals to determine whether to generate a refresh signal. This allows the display screen refresh to be controlled by generating a refresh signal only when preset conditions are met, thereby reducing the frequency of refresh signal generation to be lower than the frequency of TE signals. This prevents the phenomenon of two frames of images overlapping on the display screen, thus improving the image display effect of the electronic device's screen.

[0182] The display refresh device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the specific type of device.

[0183] The display refresh device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system used.

[0184] The display screen refresh device provided in this application embodiment can realize the various processes implemented in the above-described display screen refresh method embodiment, and achieve the same technical effect. To avoid repetition, it will not be described again here.

[0185] Optionally, such as Figure 7As shown, this application embodiment also provides an electronic device 700, including a processor 701 and a memory 702. The memory 702 stores a program or instructions that can run on the processor 701. When the program or instructions are executed by the processor 701, they implement the various steps of the above-described display refresh method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0186] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.

[0187] Figure 8 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.

[0188] The electronic device 1000 includes, but is not limited to, components such as: radio frequency unit 1001, network module 1002, audio output unit 1003, input unit 1004, sensor 1005, display unit 1006, user input unit 1007, interface unit 1008, memory 1009, and processor 1010.

[0189] Those skilled in the art will understand that the electronic device 1000 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 1010 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 8 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0190] The processor 1010 is configured to acquire a first tearing effect TE signal output by the display screen of the electronic device; and to generate a first refresh signal based on the first TE signal when the first TE signal acquired by the processor 1010 and N second TE signals satisfy a preset condition, wherein the N second TE signals are the TE signals most recently output by the display screen before the first TE signal; and to control the display screen to refresh based on the first refresh signal; wherein N is a positive integer.

[0191] In one possible implementation, the processor 1010 is further configured to, before the processor 1010 generates the first refresh signal based on the first TE signal, obtain the total number N+1 of the first TE signal and the N second TE signals, provided that the frequencies of the N second TE signals are matched.

[0192] The processor 1010 is specifically used to generate a first refresh signal based on the first TE signal when the total number N+1 reaches a first threshold.

[0193] The first threshold is the ratio of the frequency of the TE signal output by the display screen to the frame rate of the display screen.

[0194] In one possible implementation, the processor 1010 is further configured to determine a first output time difference between the first TE signal and the third TE signal, wherein the frequencies of some of the N second TE signals are mismatched, before generating the first refresh signal based on the first TE signal; and is further configured to determine a second value based on the first output time difference and a first value, wherein the first value is determined by the display frame rate.

[0195] The processor 1010 described above is specifically used to generate a first refresh signal based on the first TE signal when the second value reaches the first threshold.

[0196] The first threshold is the ratio of the frequency of the TE signal output by the display screen to the frame rate of the display screen.

[0197] In one possible implementation, the processor 1010 described above is specifically used for:

[0198] If the first output time difference is less than the first value, the number N of the second TE signal is incremented by 1 to obtain the second value;

[0199] If the first output time difference is greater than or equal to the first value, the number N of the second TE signal is added to the third value to obtain the second value;

[0200] The third value is the ratio of the frequency of the TE signal output by the display screen to the display screen frame rate.

[0201] In one possible implementation, the processor 1010 is further configured to obtain a fourth value based on the display frame rate before generating the first refresh signal based on the first TE signal, wherein the fourth value is the value of the image refresh cycle corresponding to the display frame rate; and to use the difference between the fourth value and the fifth value as the lower limit of the interval and the sum of the fourth value and the fifth value as the upper limit of the interval to obtain a first interval, wherein the fifth value is the value of the refresh cycle corresponding to the frequency of the TE signal output by the display.

[0202] The processor 1010 is specifically used to generate a first refresh signal based on the first TE signal when the second output time difference is located in the first interval, or when the second output time difference is greater than the upper limit of the first interval.

[0203] The second output time difference is the output time difference between the first TE signal and the second refresh signal, and the second refresh signal is the refresh signal generated before the display outputs the first TE signal.

[0204] In one possible implementation, the processor 1010 is further configured to, when the second output time difference is within the first interval, raise the upper limit and lower limit of the first interval if the second output time difference is greater than the median value of the first interval; and lower the upper limit and lower limit of the first interval if the second output time difference is less than the median value of the first interval.

[0205] In one possible implementation, the processor 1010 is specifically used to increase the upper limit and lower limit of the first interval by a sixth value, respectively.

[0206] Processor 1010 is specifically used to lower the upper limit and lower limit of the first interval by the sixth value respectively;

[0207] The sixth value is the difference between the second output time difference and the median value of the first interval.

[0208] In one possible implementation, the processor 1010 is further configured not to generate a first refresh signal if the second output time difference is less than the lower limit of the first interval.

[0209] In one possible implementation, the processor 1010 is specifically configured to set the number of TE signals already output by the display screen to a seventh value.

[0210] In one possible implementation, the processor 1010 is specifically used to control the display screen to refresh based on the first refresh signal via the image processing module of the electronic device.

[0211] This application provides an electronic device that, upon receiving a new TE signal, combines the new TE signal with N previously received TE signals to determine whether to generate a refresh signal. This allows the display screen to be refreshed only when preset conditions are met, thereby reducing the frequency of refresh signal generation to be lower than the TE signal frequency. This prevents the display from displaying two overlapping frames, thus improving the image display effect of the electronic device's screen.

[0212] It should be understood that, in this embodiment, the input unit 1004 may include a graphics processing unit (GPU) 10041 and a microphone 10042. The GPU 10041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 1006 may include a display panel 10061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 1007 includes a touch panel 10071 and at least one of other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.

[0213] The memory 1009 can be used to store software programs and various data. The memory 1009 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 1009 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 1009 in this embodiment includes, but is not limited to, these and any other suitable types of memory.

[0214] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into the processor 1010.

[0215] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described display refresh method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0216] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0217] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described display refresh method embodiment and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0218] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0219] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the above-described display refresh method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0220] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0221] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0222] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A display screen refresh method, characterized in that, The method includes: Acquire the first tearing effect TE signal output by the display screen of the electronic device; When the first TE signal and N second TE signals meet a preset condition, a first refresh signal is generated based on the first TE signal. The N second TE signals are the TE signals that the display screen has output the most recent N times before the first TE signal. Among the N second TE signals, some second TE signals have frequencies that are different from the frequencies of other second TE signals. Based on the first refresh signal, control the display screen to refresh; Wherein, N is a positive integer; the preset conditions include any one of the following: the second value reaches the first threshold, the second output time difference is located in the first interval, and the second output time difference is greater than the upper limit of the first interval; The second value is determined based on the first output time difference and the first value between the first TE signal and the last of the N second TE signals, where the first value is determined by the display screen frame rate; the first threshold is the ratio of the frequency of the display screen output TE signal to the display screen frame rate; the second output time difference is the output time difference between the first TE signal and the second refresh signal; the second refresh signal is the refresh signal generated before the display screen outputs the first TE signal; the first interval is obtained by taking the difference between the value of the image refresh period corresponding to the display screen frame rate and the value of the refresh period corresponding to the frequency of the display screen output TE signal as the lower limit of the interval, and the sum of the value of the image refresh period corresponding to the display screen frame rate and the value of the refresh period corresponding to the frequency of the display screen output TE signal as the upper limit of the interval.

2. The method according to claim 1, characterized in that, If the first output time difference is less than the first value, the second value is: the value obtained by adding 1 to the number N of the second TE signal; When the first output time difference is greater than or equal to the first value, the second value is: the value obtained by adding the third value to the number N of the second TE signal; The third value is the ratio of the frequency of the TE signal output by the display screen to the highest frame rate of the display screen.

3. The method according to claim 1, characterized in that, The method further includes: If the second output time difference is within the first interval, and the second output time difference is greater than the median value of the first interval, then the upper limit and lower limit of the first interval are increased. If the second output time difference is less than the median value of the first interval, then the upper limit and lower limit of the first interval are lowered.

4. The method according to claim 3, characterized in that, The adjustment of the upper and lower limits of the first interval includes: Increase the upper and lower limits of the first interval by the sixth value respectively; The reduction of the upper and lower limits of the first interval includes: The upper and lower limits of the first interval are respectively lowered by the sixth value; The sixth value is the difference between the second output time difference and the median value of the first interval.

5. The method according to claim 1, characterized in that, The method further includes: If the second output time difference is less than the lower limit of the first interval, the first refresh signal is not generated.

6. The method according to any one of claims 1 to 5, characterized in that, After generating the first refresh signal based on the first TE signal, the method further includes: Set the number of TE signals already output by the display screen to the seventh value.

7. The method according to any one of claims 1 to 5, characterized in that, The step of controlling the display screen to refresh based on the first refresh signal includes: Based on the first refresh signal, the display screen is controlled to refresh by the image processing module of the electronic device.

8. A display screen refresh device, characterized in that, The device includes: an acquisition module and a processing module; The acquisition module is used to acquire the first tearing effect TE signal output by the display screen of the electronic device; The processing module is configured to generate a first refresh signal based on the first TE signal when the first TE signal and N second TE signals obtained by the acquisition module meet a preset condition. The N second TE signals are the TE signals that the display screen has output the most recent N times before the first TE signal. Among the N second TE signals, some second TE signals have frequencies that are different from the frequencies of other second TE signals. The processing module is also used to control the display screen to refresh based on the first refresh signal; Wherein, N is a positive integer; the preset conditions include any one of the following: the second value reaches the first threshold, the second output time difference is located in the first interval, and the second output time difference is greater than the upper limit of the first interval; The second value is determined based on the first output time difference and the first value between the first TE signal and the last of the N second TE signals, where the first value is determined by the display screen frame rate; the first threshold is the ratio of the frequency of the display screen output TE signal to the display screen frame rate; the second output time difference is the output time difference between the first TE signal and the second refresh signal; the second refresh signal is the refresh signal generated before the display screen outputs the first TE signal; the first interval is obtained by taking the difference between the value of the image refresh period corresponding to the display screen frame rate and the value of the refresh period corresponding to the frequency of the display screen output TE signal as the lower limit of the interval, and the sum of the value of the image refresh period corresponding to the display screen frame rate and the value of the refresh period corresponding to the frequency of the display screen output TE signal as the upper limit of the interval.

9. An electronic device, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the display refresh method as described in any one of claims 1 to 7.

Images