Display method, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a display method, electronic equipment and a storage medium. In the method, the electronic equipment determines a target duration of a second adjustment period according to synthesis time consumption of at least one display frame in a first adjustment period so as to obtain a first interface image drawn by a target application in the second adjustment period, and determines an expected TE signal arrival time of a first display frame corresponding to the first interface image, and determining a frame synthesis triggering moment corresponding to the first interface image according to the expected TE signal arrival moment and the target duration of the second adjustment period, synthesizing a first display frame according to the first interface image at the frame synthesis triggering moment, and further displaying the first display frame. Therefore, the electronic equipment can periodically adjust the target duration, so that the hand-following time delay in the screen operation process of a user is reduced, the hand-following performance is improved, the picture display fluency is improved, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the technical field of intelligent terminals, and in particular to a display method, an electronic device and a storage medium. Background Art

[0002] With the advancement of technology, the performance of various terminal devices (such as mobile phones) is getting better and better, and users' performance requirements for various terminal devices are also getting higher and higher. For example, chirality has an important impact on the user experience of terminal devices.

[0003] Chirality refers to the performance of the terminal device responding to the user's operation in a timely manner when the user touches the screen. During the use of the terminal device, the user needs to perform various operations on it, such as browsing web pages, playing games, watching videos, etc. When the user operates the terminal device screen during the use of the terminal device, the terminal device can respond according to the user's operation.

[0004] The time it takes for a user to operate on the screen and for the screen to display the image corresponding to the user's operation is called tracking delay. The lower the tracking delay, the more timely the terminal device responds, the better the tracking performance, and the smoother the picture. Summary of the invention

[0005] The embodiment of the present application provides a display method, an electronic device and a storage medium. In this method, the electronic device can periodically adjust the time interval between the image synthesis moment and the image display moment, thereby reducing the hand tracking delay during the user's screen operation, improving the hand tracking performance, increasing the smoothness of the screen display, and improving the user experience.

[0006] In the first aspect, an embodiment of the present application provides a display method. The method includes: in response to the movement of the target operation, the target application in the electronic device draws at least one interface image; the electronic device determines the target duration of the second adjustment cycle according to the synthesis time of at least one display frame in the first adjustment cycle; the electronic device obtains the first interface image drawn by the target application in the second adjustment cycle, and determines the expected tearing effect TE signal arrival time of the first display frame corresponding to the first interface image; the electronic device determines the frame synthesis triggering time corresponding to the first interface image according to the expected TE signal arrival time of the first display frame and the target duration of the second adjustment cycle; the electronic device synthesizes the first display frame according to the first interface image at the frame synthesis triggering time corresponding to the first interface image; the electronic device displays multiple display frames corresponding to at least one interface image, and the multiple display frames include the first display frame.

[0007] The second adjustment period may be the next adjustment period adjacent to the first adjustment period, and the target duration may be the time interval between the display triggering moment and the synthesis triggering moment of the display frame.

[0008] Specifically, at the synthesis trigger moment, SurfaceFlinger can synthesize the display frames. At the display trigger moment, the display screen can display the synthesized display frames.

[0009] Exemplarily, the synthesis trigger moment can be the moment when SurfaceFlinger receives the VsyncSF signal. The display trigger moment can be the moment when the TE signal in the display screen arrives. The target duration can be the time interval between the VsyncSF signal and the TE signal, that is, SF WorkDuration.

[0010] Among them, the target operation can be the operation of the user sliding the screen. The target application can be the application corresponding to the target operation. The synthesis time consumption can be the time consumption generated by synthesizing the display frames. Specifically, the synthesis time consumption can be determined by SurfaceFlinger according to the synthesis start time and synthesis end time of the display frames.

[0011] Among them, the first interface image can be one of the multiple interface images drawn by the target application. The first display frame can be any one of the synthesized display frames within the second adjustment period. The expected TE signal arrival moment can be the moment when the display screen is expected to display the display frame. It can be understood that each display frame corresponds to an expected TE signal arrival moment. The frame synthesis trigger moment can be the moment when frame synthesis is triggered.

[0012] In this way, the electronic device can dynamically adjust the target duration periodically to reduce the follow-up latency during the process of the user operating the screen, thereby improving the follow-up performance, increasing the smoothness of the screen display, and improving the user experience.

[0013] According to the first aspect, for the electronic device to determine the target duration of the second adjustment period according to the synthesis time consumption of at least one display frame within the first adjustment period, it can include: within the first adjustment period, the electronic device determines the target synthesis time consumption corresponding to the first adjustment period according to the synthesis time consumption of at least one display frame within the first adjustment period; after the first adjustment period ends, the electronic device determines the preset idle time consumption, and determines the sum value of the target synthesis time consumption and the preset idle time consumption as the duration to be adjusted, so as to determine the target duration of the second adjustment period according to the duration to be adjusted.

[0014] Among them, the target synthesis time consumption can be the target value of a synthesis time consumption within the adjustment period. Exemplarily, the target synthesis time consumption can be the synthesis time consumption of any display frame that exceeds the time consumption threshold, or the average value of the synthesis time consumptions of multiple display frames that exceed the time consumption threshold, or the maximum time consumption among the synthesis time consumptions of each display frame.

[0015] Among them, the preset idle time consumption can be the preset idle time consumption after the display frame synthesis.

[0016] In this way, the electronic device determines the target duration of the second adjustment period according to the sum value of the target synthesis time corresponding to the first adjustment period and the preset idle time, so as to realize the dynamic adjustment of the target duration.

[0017] According to the first aspect, or any implementation manner of the above first aspect, the electronic device determines the target synthesis time corresponding to the first adjustment period according to the synthesis time of at least one display frame in the first adjustment period, which may include: at the start time of the first adjustment period, the electronic device sets the target synthesis time to the initial value, and sequentially takes each display frame synthesized in the first adjustment period as the current display frame; the electronic device obtains the synthesis time of the current display frame, and updates the value of the target synthesis time to the synthesis time of the current display frame when the synthesis time of the current display frame is greater than the target synthesis time.

[0018] Exemplarily, the initial value may be 0.

[0019] In this way, the electronic device determines the synthesis time of the current display frame greater than the target synthesis time as the target synthesis time corresponding to the first adjustment period, so as to more accurately determine the maximum value of the synthesis time in the first adjustment period.

[0020] According to the first aspect, or any implementation manner of the above first aspect, the electronic device determines the target duration of the second adjustment period according to the duration to be adjusted, which may include: the electronic device obtains the first duration; when the duration to be adjusted is greater than the first duration, the electronic device determines the duration to be adjusted as the target duration of the second adjustment period, and when the duration to be adjusted is less than the first duration, the electronic device determines the first duration as the target duration of the second adjustment period.

[0021] Wherein, the first duration may be the minimum SF WorkDuration set in advance.

[0022] In this way, when the duration to be adjusted is less than the first duration, the electronic device determines the first duration as the target duration of the second adjustment period, so as to avoid frame loss caused by too small SF WorkDuration in the second adjustment period.

[0023] According to the first aspect, or any implementation manner of the above first aspect, before the electronic device determines the target duration of the second adjustment period according to the synthesis time of at least one display frame in the first adjustment period, it may further include: the electronic device determines the target duration of the first adjustment period;

[0024] The electronic device determines the target duration of the second adjustment period based on the synthesis time of at least one display frame within the first adjustment period, which may include: when the synthesis time of all display frames synthesized by the electronic device within the first adjustment period is less than the target duration of the first adjustment period, the electronic device determines the target duration of the second adjustment period according to the synthesis time of at least one display frame within the first adjustment period.

[0025] In this way, when the synthesis time of all display frames within the first adjustment period is less than the target duration of the first adjustment period, the electronic device adjusts the target duration of the second adjustment period, thereby achieving periodic adjustment of the target duration.

[0026] According to the first aspect, or any implementation manner of the above first aspect, the electronic device determines the synthesis time of the second display frame within the first adjustment period; when the synthesis time of the second display frame is greater than the target duration of the first adjustment period, the electronic device determines the target duration corresponding to the penalty period and starts the penalty period timing; within the penalty period, the electronic device acquires the third interface image drawn by the target application and determines the expected arrival time of the TE signal corresponding to the third display frame; the electronic device determines the frame synthesis trigger time corresponding to the third interface image according to the expected arrival time of the TE signal of the third display frame and the target duration corresponding to the penalty period, so as to synthesize the third display frame according to the third interface image at the frame synthesis trigger time corresponding to the third interface image; after the penalty period timing ends, the electronic device determines the next adjustment period.

[0027] Wherein, the target duration of the next adjustment period is the second duration. The second duration may be the initial value corresponding to the pre-set SFWorkDuration. The next adjustment period may be the first adjustment period after the penalty period ends.

[0028] Wherein, the second display frame may be the display frame corresponding to another interface image drawn by the target application. Specifically, the second display frame may be any one of the display frames synthesized within the first adjustment period.

[0029] Wherein, the third interface image may be another one of the multiple interface images drawn by the target application. Specifically, the third display frame may be any one of the display frames synthesized within the penalty period.

[0030] Specifically, when the synthesis time of the second display frame is greater than the target duration of the first adjustment period, the electronic device starts the penalty period timing. In this way, the start time of the penalty period may be slightly later than the synthesis end time of the second display frame. That is, the time interval between the start time of the penalty period and the synthesis end time of the second display frame may be less than the preset interval value. Among them, the preset interval value may be a very small interval value.

[0031] In this way, when the synthesis time of the second display frame is greater than the target duration of the first adjustment period, the electronic device determines the target duration corresponding to the penalty period, and can adjust the target duration in a timely manner when a frame is dropped, thereby avoiding continuous frame drops and improving the user experience.

[0032] According to the first aspect, or any implementation manner of the above first aspect, the electronic device determines the target duration corresponding to the penalty period, including: the electronic device determines the second duration as the target duration corresponding to the penalty period.

[0033] In this way, when a frame is dropped, the electronic device can adjust the target duration to the second duration to avoid continuous frame drops, thereby improving the user experience.

[0034] According to the first aspect, or any implementation manner of the above first aspect, the electronic device may determine the start time of the penalty period as the synthesis end time of the second display frame.

[0035] In this way, when a frame is dropped, the electronic device can enter the penalty period in a timely manner, thereby avoiding continuous frame drops and improving the user experience.

[0036] According to the first aspect, or any implementation manner of the above first aspect, the electronic device may further determine the synthesis end time of the third display frame and the end time of the penalty period; when the synthesis end time of the third display frame exceeds the end time of the penalty period, the electronic device determines the synthesis end time of the third display frame as the start time of the next adjustment period.

[0037] Specifically, the end time of the penalty period can be determined according to the penalty duration of the penalty period and the start time of the penalty period.

[0038] In this way, after the penalty period ends, the electronic device can enter the adjustment period again to continue dynamically adjusting the target duration after the penalty period ends, thereby reducing the follow-up latency during the user's operation of the screen and improving the user experience.

[0039] According to the first aspect, or any implementation manner of the above first aspect, when the electronic device determines the target duration of the first adjustment period, it may include: when the first adjustment period is the first adjustment period, the electronic device obtains the second duration and determines the second duration as the target duration of the first adjustment period.

[0040] Among them, the first adjustment period may be the first adjustment period after the user's operation.

[0041] In this way, the electronic device can determine the second duration as the target duration of the first adjustment period.

[0042] According to the first aspect, or any implementation manner of the above first aspect, the electronic device determines the end time of the synthesis of the fourth display frame within the first adjustment period and the end time of the first adjustment period, and when the end time of the synthesis of the fourth display frame exceeds the end time of the first adjustment period, determines the end time of the synthesis of the fourth display frame as the start time of the second adjustment period.

[0043] Among them, the fourth display frame may be a display frame corresponding to another interface image drawn by the target application. Specifically, the start time of the synthesis of the fourth display frame may be before the end of the first adjustment period or after the end of the first adjustment period. If the start time of the synthesis of the fourth display frame is after the end of the first adjustment period, the synthesis of the fourth display frame may be the first frame synthesis after the end of the first adjustment period.

[0044] Specifically, the end time of the first adjustment period may be determined according to the period duration of the first adjustment period and the start time of the first adjustment period.

[0045] In this way, the electronic device can determine the start time of the second adjustment period, enter the second adjustment period at the start time of the second adjustment period, and then draw, synthesize, or display each display frame within the second adjustment period.

[0046] According to the first aspect, or any implementation manner of the above first aspect, the frequency of the TE signal of the electronic device is greater than the screen refresh frequency of the electronic device.

[0047] Exemplarily, the frequency of the TE signal may be 360 Hz, and the screen refresh frequency may be 120 Hz.

[0048] In this way, the electronic device can display the display frame to be displayed in a high-frequency TE signal scenario to avoid frame loss, thereby increasing the smoothness of the screen display and improving the user experience.

[0049] In a second aspect, an embodiment of the present application provides an electronic device. The electronic device includes: one or more processors; a memory; and one or more computer programs, where one or more computer programs are stored on the memory, and when the computer programs are executed by one or more processors, the electronic device is caused to execute the display method of the first aspect and any one of the first aspects.

[0050] The second aspect and any implementation manner of the second aspect respectively correspond to the first aspect and any implementation manner of the first aspect. The technical effects corresponding to the second aspect and any implementation manner of the second aspect can refer to the technical effects corresponding to the first aspect and any implementation manner of the first aspect above, and will not be elaborated here.

[0051] In a third aspect, an embodiment of the present application provides a computer-readable storage medium. The computer-readable storage medium includes a computer program, which, when running on an electronic device, causes the electronic device to execute the display method according to the first aspect and any one of the first aspect.

[0052] The third aspect and any implementation manner of the third aspect respectively correspond to the first aspect and any implementation manner of the first aspect. For the technical effects corresponding to the third aspect and any implementation manner of the third aspect, reference may be made to the technical effects corresponding to the first aspect and any implementation manner of the first aspect above, which will not be elaborated here.

[0053] In a fourth aspect, an embodiment of the present application provides a computer program product, including a computer program, which, when running, causes a computer to execute the display method according to the first aspect or any one of the first aspect.

[0054] The fourth aspect and any implementation manner of the fourth aspect respectively correspond to the first aspect and any implementation manner of the first aspect. For the technical effects corresponding to the fourth aspect and any implementation manner of the fourth aspect, reference may be made to the technical effects corresponding to the first aspect and any implementation manner of the first aspect above, which will not be elaborated here.

[0055] In a fifth aspect, the present application provides a chip, which includes a processing circuit and transceiver pins. Among them, the transceiver pins and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the display method according to the first aspect or any one of the first aspect to control the receiving pin to receive a signal and control the sending pin to send a signal.

[0056] The fifth aspect and any implementation manner of the fifth aspect respectively correspond to the first aspect and any implementation manner of the first aspect. For the technical effects corresponding to the fifth aspect and any implementation manner of the fifth aspect, reference may be made to the technical effects corresponding to the first aspect and any implementation manner of the first aspect above, which will not be elaborated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] Figure 1 It is a schematic diagram of the hardware structure of an exemplary electronic device;

[0058] Figure 2 It is a schematic diagram of the software structure of an exemplary electronic device;

[0059] Figure 3a It is a schematic diagram of the principle of an exemplary interface display;

[0060] Figure 3b It is a schematic diagram of module interaction during an exemplary interface display process;

[0061] Figure 4 Schematic diagram showing conventional TE signals and high-frequency TE signals for exemplary illustration;

[0062] Figures 5 - 6 Schematic diagram showing the interaction of functional modules for exemplary illustration;

[0063] Figures 7a - 7f Timing diagram during the interface display process for exemplary illustration;

[0064] Figures 8a - 8b Schematic timing diagram showing the adjustment period and the penalty period for exemplary illustration. Detailed implementation manners

[0065] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without making creative efforts belong to the scope of protection of the present application.

[0066] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may represent: A exists alone, A and B exist simultaneously, and B exists alone. These three situations.

[0067] The terms "first", "second", etc. in the description and claims of the embodiments of the present application are used to distinguish different objects, rather than to describe a specific order of the objects. For example, the first target object and the second target object are used to distinguish different target objects, rather than to describe a specific order of the target objects.

[0068] In the embodiments of the present application, words such as "exemplary" or "for example" are used to represent examples, illustrations or explanations. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present application should not be construed as being more preferred or more advantageous than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "for example" is intended to present relevant concepts in a specific manner.

[0069] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "a plurality" refers to two or more. For example, a plurality of processing units refers to two or more processing units; a plurality of systems refers to two or more systems.

[0070] Next, some terms in the embodiments of the present application will be explained to facilitate the understanding of those skilled in the art.

[0071] (1) A frame refers to a single picture, which is the smallest unit in interface display. A frame can be regarded as a still picture, and quickly and continuously displaying multiple connected frames can create the illusion of object movement.

[0072] It should be noted that before the interface display frame, processes such as frame drawing and frame composition are usually required.

[0073] Frame drawing refers to the drawing of pictures on the display interface. The display interface can be composed of one or more views. Each view can be drawn by visual controls of the view system. Each view is composed of sub-views, and one sub-view corresponds to a widget in the view. For example, one of the sub-views corresponds to a symbol in the picture view.

[0074] Frame composition refers to the process of combining multiple of the above-mentioned one or more drawn views into a display interface.

[0075] (2) Vertical scanning mechanism (Vsync), the vertical scanning mechanism is a top-down refreshing mechanism. In the vertical scanning mechanism, the electronic device can periodically generate a vertical synchronization signal. The vertical synchronization signal can include a software Vsync signal. The software Vsync signal can trigger frame drawing and frame composition of the electronic device.

[0076] Specifically, the software Vsync signal can include VsyncAPP signal and VsyncSF signal. The VsyncAPP signal is used to trigger the frame drawing process. That is, when the application program of the electronic device receives the VsyncAPP signal, it can perform frame drawing. The VsyncSF signal is used to trigger the frame composition process. That is, when the image composition system (SurfaceFlinger) of the electronic device receives the VsyncSF signal, it can perform frame composition on the frame after frame drawing.

[0077] (3) Tearing effect (TE) signal, the TE signal is a signal output by the timing controller of the electronic device, which is used to prevent the tearing problem during screen refreshing in the process of image display. This TE signal can be regarded as a hardware-generated vertical synchronization signal. The TE signal can be set according to the screen refresh frequency. For example, when the screen refresh frequency is 60Hz, the TE signal period can be 16.6ms, that is, the terminal device generates a control signal every 16.6ms to trigger the TE signal period.

[0078] Exemplarily, when the electronic device is ready to refresh the next frame of image, the electronic device generates a TE signal; when the electronic device detects the rising edge (i.e., high level) of this TE signal, the display screen of the electronic device starts to display the next frame of image.

[0079] It can be understood that the electronic device can preset the time intervals between the VsyncAPP signal, the VsyncSF signal, and the TE signal. That is to say, the electronic device can generate the VsyncSF signal after a period of time from generating the VsyncAPP signal, and generate the TE signal after a period of time from generating the VsyncSF signal.

[0080] The display method provided by the embodiments of the present application can be applied to an electronic device. Optionally, the electronic device in the embodiments of the present application can be a mobile phone with a display function, a sports camera (GoPro), a digital camera, a tablet computer, a handheld computer, a vehicle-mounted device, an ultra-mobile personal computer (UMPC), a netbook, as well as a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) / virtual reality (VR) device, etc. The embodiments of the present application do not impose special restrictions on the specific form of the electronic device.

[0081] To better understand the embodiments of the present application, the structure of the electronic device in the embodiments of the present application will be introduced below:

[0082] As Figure 1 shown is a schematic structural diagram of the electronic device 100. Optionally, the electronic device 100 can be a terminal, also known as a terminal device. The terminal can be a device with a display function such as a cellular phone or a tablet computer (pad), which is not limited in the present application.

[0083] It should be understood that Figure 1 the shown electronic device 100 is only an example of an electronic device, and the electronic device 100 can have more or fewer components than those shown in the figure, can combine two or more components, or can have different component configurations. Figure 1 The various components shown in

[0084] The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor, a gyroscope sensor, an acceleration sensor, a temperature sensor, a motion sensor, a barometric pressure sensor, a magnetic sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0085] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0086] Among them, the controller may be the nerve center and command center of the electronic device 100. The controller may generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching and executing instructions.

[0087] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory.

[0088] The wireless communication function of the electronic device 100 may be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc.

[0089] Antenna 1 and Antenna 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, Antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0090] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc. applied to the electronic device 100. The mobile communication module 150 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc.

[0091] The wireless communication module 160 can provide solutions for wireless communications including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. applied to the electronic device 100.

[0092] In some embodiments, Antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and Antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technologies.

[0093] The electronic device 100 realizes the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphic rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change the display information.

[0094] The display screen 194 is used to display images, play videos, and receive user operations, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0095] The electronic device 100 can implement the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, etc.

[0096] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and the light passes through the lens and is transmitted to the camera sensor. The light signal is converted into an electrical signal, and the camera sensor transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye.

[0097] The camera 193 is used to capture static images or videos. The object generates an optical image through the lens and projects it onto the sensor. The sensor can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The sensor converts the light signal into an electrical signal and then transmits the electrical signal to the ISP to convert it into a digital image signal.

[0098] The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into a standard image signal in formats such as RGB and YUV.

[0099] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function.

[0100] The internal memory 121 can be used to store computer-executable program codes, and the executable program codes include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121, for example, enabling the electronic device 100 to implement the display method in the embodiments of the present application. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, application programs required for at least one function (such as a sound playback function, an image playback function, etc.). The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.). In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0101] The electronic device 100 can implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, and an application processor, etc. For example, music playback, recording, etc.

[0102] The pressure sensor is used to sense a pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor may be disposed on the display screen 194. The electronic device 100 can also calculate the position of the touch according to the detection signal of the pressure sensor.

[0103] The touch sensor, also known as the "touch panel". The touch sensor can be disposed on the display screen 194, and the touch sensor and the display screen 194 form a touch screen, also known as the "touch screen". The touch sensor is used to detect a touch operation acting thereon or nearby. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event.

[0104] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In the embodiments of the present application, taking the Android system with a layered architecture as an example, the software structure of the electronic device 100 is exemplarily described.

[0105] Figure 2 is the software structure block diagram of the electronic device 100 in the embodiments of the present application.

[0106] The layered architecture of the electronic device 100 divides software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into five layers, from top to bottom, namely the application layer, the application framework layer, Android Runtime and system libraries, the hardware abstraction layer (HAL), and the kernel layer.

[0107] The application layer may include a series of application packages.

[0108] As Figure 2 shown, the application packages may include the camera, the gallery, and third-party applications with camera functions, etc. Exemplarily, the application packages may include applications such as the camera, the gallery, the calendar, the call, the map, the navigation, the WLAN, the Bluetooth, the music, the video, the short message, etc.

[0109] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer, including various components and services to support developers' Android development. The application framework layer includes some predefined functions.

[0110] As Figure 2 shown, the application framework layer may include the window manager, the content provider, the view system, the resource manager, the notification manager, etc.

[0111] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0112] The content provider is used to store and obtain data, and make this data accessible to applications. The data may include videos, images, audios, dialed and answered calls, browsing history and bookmarks, phone books, etc.

[0113] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.

[0114] The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc.

[0115] The notification manager enables an application to display notification information in the status bar. It can be used to convey messages of the notification type, and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform that a download is complete, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialogue window. For example, it can prompt text information in the status bar, emit a prompt sound, vibrate the electronic device, blink the indicator light, etc.

[0116] The application framework layer also includes an input manager and an image composition system.

[0117] The input manager is a program for managing input devices. For example, the input manager can be an input system that can determine input operations such as mouse click operations, keyboard input operations, and touch swipes.

[0118] The image composition system includes an image composition module, a dropped frame penalty module, and a period adjustment module. The image composition module is used to control frame composition and generate a vertical synchronization signal. The dropped frame penalty module is used to punitively adjust the follow-up latency when a dropped frame is detected to avoid continuous dropped frames. The period adjustment module is used to periodically adjust the follow-up latency to reduce the follow-up latency during the user's operation of the screen and improve the smoothness of the screen display.

[0119] Android Runtime includes a core library and a virtual machine. Android Runtime is responsible for the scheduling and management of the Android system.

[0120] The core library consists of two parts: one part is the functional functions that need to be called by the Java language, and the other part is the core library of Android.

[0121] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0122] The system library can include multiple functional modules. For example: surface manager, Media Libraries, 3D graphics processing library (e.g., OpenGL ES), 2D graphics engine (e.g., SGL), etc.

[0123] The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

[0124] The media library supports the playback and recording of multiple common audio and video formats, as well as static image files, etc. The media library can support multiple audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0125] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc.

[0126] The 2D graphics engine is a drawing engine for 2D drawing.

[0127] The HAL layer is an interface layer located between the operating system kernel and the hardware circuit. The HAL layer includes but is not limited to: the camera HAL module, the audio HAL module. Among them, the camera HAL module is used to process the image stream, and the audio HAL module is used to process the audio stream (for example, perform noise reduction, directional enhancement, etc. on the audio stream).

[0128] The kernel layer is the layer between the hardware and the software. The kernel layer at least includes a display driver, an audio driver, a touch screen driver, a sensor driver, etc.

[0129] The hardware at least includes a processor, a display screen, a touch sensor, etc.

[0130] It can be understood that Figure 2 The layers in the shown software structure and the components included in each layer do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer layers than shown, and each layer may include more or fewer components, which are not limited in the present application.

[0131] It can be understood that in order for the electronic device to implement the display method in the embodiments of the present application, it includes the corresponding hardware and / or software modules for performing various functions. Combining the algorithm steps of each example described in the embodiments disclosed in this article, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the way of hardware or computer software driving the hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described function for each specific application in combination with the embodiments, but such implementation should not be considered to exceed the scope of the present application.

[0132] The following introduces an application scenario of interface display provided by the embodiments of the present application. In this scenario, the electronic device is taken as a mobile phone for explanation.

[0133] As users' requirements for the performance experience of mobile phones are getting higher and higher, the interface display technology of mobile phones is becoming more and more perfect. When users use mobile phones, they usually need to perform various operations on the mobile phones, such as browsing the web, playing games, watching videos, etc. When users operate on the screen, the mobile phone can display the image corresponding to the user's operation on the screen according to the user's operation.

[0134] Exemplarily, when using a mobile phone to browse the web, users can refresh the content displayed on the screen by swiping the screen. The mobile phone responds to the user's operation of swiping the screen and displays the refreshed content on the screen. When using a mobile phone to play games, users can control the actions of game characters by swiping the screen. The mobile phone responds to the user's operation of swiping the screen and displays the image corresponding to the actions of game characters on the screen. When using a mobile phone to watch videos, users can adjust the video progress by swiping the screen. The mobile phone responds to the user's operation of swiping the screen and displays the corresponding video image on the screen.

[0135] The following will detail the processing flow of the electronic device in the process from when the user operates on the screen to when the screen displays the image corresponding to the user's operation.

[0136] Figure 3a It is a schematic diagram showing the principle of interface display for exemplary illustration. As Figure 3a shown, when the user performs a touch operation on the mobile phone, the touch screen will capture the touch operation and generate a touch event. The touch screen passes the touch event to the input system, and the input system processes the touch event and converts it into a touch event that the application layer can understand, and then passes the touch event to the corresponding application program.

[0137] When the application program receives the VsyncApp signal, it performs frame drawing according to the received touch event. After the application program completes frame drawing, it sends the drawn frame to SurfaceFlinger. Among them, the frame drawn by the application program can be the interface image frame of the application program.

[0138] It can be understood that during the process of the application program performing frame drawing, the application program can store the interface content in a buffer (cache), and this buffer is created by the application program for convenient data processing and transmission. When the application program sends the drawn frame to SurfaceFlinger, it can send the buffer to SurfaceFlinger.

[0139] When SurfaceFlinger receives the VsyncSF signal, it performs frame composition based on the frames that the application has sent as being drawn complete, and after SurfaceFlinger has completed frame composition, it sends the composed frame to the display screen. Among them, the frame composed by SurfaceFlinger can be the display image frame of the electronic device.

[0140] It can be understood that when SurfaceFlinger performs frame composition, it can perform frame composition based on one or more frames that have been drawn complete. Exemplarily, when SurfaceFlinger performs frame composition, it can compose the interface image frame, time view, battery view, signal strength view, etc. that the application has drawn complete into a display image frame.

[0141] When the TE signal arrives, the display screen displays the composed frame on the mobile phone screen.

[0142] The following details the interface display process in combination with a specific scenario. Figure 3b It is a schematic diagram of module interaction during the interface display process shown for exemplification.

[0143] As Figure 3b shown, the interface display process provided by the embodiments of the present application may specifically include:

[0144] S101. The touchscreen driver responds to the user operation and sends an initial touch event to the input manager.

[0145] In the embodiments of the present application, the user operation may be an operation of the user swiping the screen.

[0146] The initial touch event may be a touch event generated by the touchscreen driver according to the user operation.

[0147] After the user touches the screen, when the touch sensor in the electronic device receives the touch operation, the touchscreen driver processes the touch operation to generate an initial touch event. The initial touch event may include information such as touch coordinates, touch force, touch operation timestamp, etc. After the touchscreen driver generates the initial touch event, it can send the initial touch event to the input manager through the kernel layer. Regarding the related processing process of the touchscreen driver generating the initial touch event, reference can be made to the existing technology and will not be elaborated here.

[0148] S102. The input manager processes the initial touch event to obtain a target touch event and sends the target touch event to the application.

[0149] The target touch event may be a touch event that the application layer can understand.

[0150] The input manager processes the received initial touch event, converts it into a target touch event that can be understood by the application layer, and sends the target touch event to the application. Regarding the relevant processing flow of the input manager for the initial touch event, reference can be made to the prior art and will not be elaborated here.

[0151] S103. After receiving the target touch event sent by the input manager, the application sends a VsyncAPP signal request to the image synthesis system. After receiving the VsyncAPP signal request, the image synthesis system sends a VsyncAPP signal to the application.

[0152] After receiving the target touch event, the application can send a VsyncAPP signal request to the image synthesis system. After receiving the VsyncAPP signal, the image synthesis system waits for the VsyncAPP signal and, when receiving the VsyncAPP signal, sends the VsyncAPP signal to the application.

[0153] Exemplarily, assuming that the application sends a VsyncAPP signal request to the image synthesis system at time a, the image synthesis system can send the first VsyncAPP signal received after time a to the application.

[0154] S104. When receiving the VsyncAPP signal, the application performs frame drawing according to the position information in the target touch event, and after the frame drawing is completed, sends the drawn frame to the image synthesis system.

[0155] At the moment when the application receives the VsyncAPP signal, it performs frame drawing according to the position information in the target touch event. Frame drawing can be understood as application interface drawing, frame image drawing, etc. In the embodiments of the present application, the above expressions have the same meaning, that is, the above expressions can all represent drawing the interface image frame of the application.

[0156] Regarding the relevant processing flow of the application for frame drawing, reference can be made to the prior art and will not be elaborated here.

[0157] S105. When receiving the VsyncSF signal, the image synthesis system performs frame synthesis according to the drawn frame, and after the frame synthesis is completed, sends the synthesized frame to the display screen.

[0158] At the moment when the image synthesis system receives the VsyncSF signal, it performs frame synthesis according to the drawn frame. Regarding the relevant processing flow of the image synthesis system for frame synthesis, reference can be made to the prior art and will not be elaborated here.

[0159] S106. When the display screen receives the TE signal, it updates the screen according to the synthesized frame.

[0160] When the display screen receives the TE signal, it updates the screen according to the synthesized frame to display the interface on the display screen.

[0161] Continue to refer to Figure 3a , during the process from the user's operation on the screen to the display of the image corresponding to the user's operation on the screen, the time interval between the image synthesis system receiving the VsyncSF signal and the display screen receiving the TE signal is SFWorkDuration. That is, the start time of SF WorkDuration is the moment when the image synthesis system receives the VsyncSF signal, and the end time of SF WorkDuration is the moment when the display screen receives the TE signal.

[0162] During SF WorkDuration, the image synthesis system performs frame synthesis. It can be understood that the process of the image synthesis system performing frame synthesis also takes a certain amount of time. However, affected by factors such as the CPU frequency point and the amount of synthesized content, the time consumption of the frame synthesis process fluctuates.

[0163] During the process of displaying the interface, the electronic device can set SFWorkDuration according to the synthesis time consumption requirements of SurfaceFlinger.

[0164] If SF WorkDuration is set too short, then at the end time of SF WorkDuration, the image synthesis system may not complete frame synthesis, so that when the display screen receives the TE signal, the synthesized frame cannot be displayed on the screen, and then the situation of frame dropping occurs, resulting in the mobile phone being unable to respond to the user's operation in time, and the screen picture being stuck and not smooth.

[0165] If SF WorkDuration is set long enough, before the end of SF WorkDuration, the image synthesis system can complete frame synthesis, that is, the synthesized frame can be normally displayed on the screen when the display screen receives the TE signal. However, if SF WorkDuration is set too long, there is a long idle time consumption after the image synthesis system completes frame synthesis, which may increase the follow-up latency and reduce the followability of the mobile phone, thus affecting the user experience.

[0166] In addition, during the interface display process, each frame corresponds to an expected TE signal. For the time being, the expected TE signal is called the expected TE point. That is, the electronic device will display the corresponding frame at the moment when the expected TE point arrives. However, if frame synthesis is not completed at the moment when the expected TE point arrives, the frame cannot be displayed at the moment when the expected TE point arrives, and can only be displayed at the moment when the next TE signal after the expected TE point arrives. At this time, if the refresh frequency of the TE signal is low and the TE signal period is long, that is, the time interval between the expected TE point and the next TE signal is long, the situation of frame freezing will occur.

[0167] To solve the above technical problems, an embodiment of the present application provides a display method. In this method, the electronic device can increase the refresh frequency of the TE signal, that is, set the TE signal of the electronic device as a high-frequency TE signal. In this way, in the scenario of the high-frequency TE signal, the electronic device can set an adjustment period for the SF WorkDuration and dynamically adjust the SF WorkDuration at the end of each adjustment period. Thus, during the interface display process, the image synthesis system can perform frame synthesis according to the dynamically adjusted SF WorkDuration. In addition, in the scenario of the high-frequency TE signal, the electronic device can also set a penalty period for the SF WorkDuration. The electronic device starts penalty period timing when a frame is lost and sets the SF WorkDuration to the default value during the penalty period.

[0168] In this way, during the interface display process, the electronic device can dynamically adjust the SF WorkDuration periodically in the high-frequency TE signal scenario and timely adjust the SF WorkDuration back to the default value when a frame is lost, so as to reduce the follow-up latency and avoid continuous frame loss, thereby increasing the smoothness of the frame display and improving the user experience.

[0169] The following details the high-frequency TE signal scenario in the display method of the embodiment of the present application.

[0170] "High-frequency" in the high-frequency TE signal means that the frequency of the TE signal exceeds the screen refresh frequency, that is, the frequency of the high-frequency TE signal exceeds the screen refresh frequency. Usually, the frequency of the TE signal is consistent with the screen refresh frequency.

[0171] Figure 4 Schematic diagrams showing the display of a conventional TE signal and a high-frequency TE signal for exemplary illustration. As Figure 4As shown, the screen refresh rate is 120 Hz (Hertz), and the frequency of the regular TE signal is also 120 Hz. Then, the frequency of the high-frequency TE signal can be 360 Hz. During the display process, the expected TE points corresponding to Frame 1 are the regular TE signal 21 and the high-frequency TE signal 31, and the expected TE points corresponding to Frame 2 are the regular TE signal 22 and the high-frequency TE signal 34.

[0172] Referring to Figure 4 , the process of the electronic device synthesizing and displaying Frame 1 specifically includes:

[0173] When SurfaceFlinger receives the VsyncSF signal 11, it starts to perform frame synthesis on Frame 1 and completes the frame synthesis at time a. The display screen receives the synthesized frame at time a. When the display screen receives the regular TE signal 21, it starts to display Frame 1; or when the display screen receives the high-frequency TE signal 31, it starts to display Frame 1.

[0174] Since SurfaceFlinger completes the synthesis of Frame 1 at time a, that is, the synthesis time of Frame 1 is less than SFWorkDuration. Therefore, Frame 1 can be displayed at the arrival time of the expected TE point (the regular TE signal 21, or the high-frequency TE signal 31).

[0175] Continuing to refer to Figure 4 , the process of the electronic device synthesizing and displaying Frame 2 specifically includes:

[0176] When SurfaceFlinger receives the VsyncSF signal 12, it starts to perform frame synthesis on Frame 2 and completes the frame synthesis at time b. The display screen receives the synthesized frame at time b, but does not receive the synthesized frame when receiving the regular TE signal 22 or the high-frequency TE signal 34. That is, the display screen cannot display Frame 2 when receiving the expected TE point (the regular TE signal 22, or the high-frequency TE signal 34). At this time, Frame 2 can be called a late frame, that is, the arrival time of Frame 2 is later than the arrival time of the expected TE point.

[0177] Since SurfaceFlinger completes the synthesis of Frame 2 at time b, that is, the synthesis time of Frame 2 is greater than SFWorkDuration. Therefore, Frame 2 needs to be displayed at the arrival time of the next TE signal (the regular TE signal 22, or the high-frequency TE signal 34) of the expected TE point.

[0178] After the display screen receives the synthesized frame at time b, it waits for the regular TE signal 23 or the high-frequency TE signal 35, and displays frame 2 when it receives the regular TE signal 23 or the high-frequency TE signal 35. However, the period of the regular TE signal is greater than the period of the high-frequency TE signal, that is, the arrival time of the regular TE signal 22 is later than that of the high-frequency TE signal 34. Thus, in the high-frequency TE signal scenario, frame 2 can be displayed faster.

[0179] Thus, in the high-frequency TE signal scenario, the display screen can display the late frame faster, so as to respond to user operations more quickly, reduce the follow-up delay during the process of the user operating the screen, and improve the user experience.

[0180] In the embodiment of the present application, the process of the electronic device setting the TE signal to a high-frequency TE signal may include: the image synthesis system sends a high-frequency TE activation request to the display screen. After receiving the high-frequency TE activation request, the display screen sets the high-frequency TE and notifies the image synthesis system that the high-frequency TE has been activated. Regarding the relevant processing flow of the display screen setting the high-frequency TE, reference can be made to the prior art and will not be elaborated here.

[0181] The following uses a specific example to elaborate in detail on the specific process of adjusting SF WorkDuration in the display method of the embodiment of the present application. Figures 5 - 6 It is a schematic diagram of the interaction of each functional module shown exemplarily.

[0182] In the embodiment of the present application, SF WorkDuration is adjusted in the high-frequency TE signal scenario. It should be noted that the adjustment of SF WorkDuration in the embodiment of the present application is performed during the process of the user sliding the screen. If the user leaves the screen, the adjustment of SF WorkDuration stops.

[0183] Refer to Figure 5 and Figure 6 , the process of adjusting SF WorkDuration in the embodiment of the present application specifically includes:

[0184] S201. At the start moment of each adjustment period, the period adjustment module sets the target synthesis time-consuming to 0 and sends an instruction to enter the adjustment period to the image synthesis module.

[0185] Within one adjustment period, SF WorkDuration remains unchanged, and the image synthesis system performs frame synthesis according to SFWorkDuration. After the end of this adjustment period, SF WorkDuration is adjusted, and the next adjustment period is entered. In the next adjustment period, the image synthesis system performs frame synthesis according to the adjusted SF WorkDuration.

[0186] Exemplarily, the period duration of the adjustment period can be set to 200 ms (milliseconds). It should be noted that the period duration of the adjustment period can be configured according to requirements, and the embodiments of the present application do not limit this.

[0187] It can be understood that the image synthesis system performs frame synthesis according to SF WorkDuration. It can be that the image synthesis module in the image synthesis system determines the trigger moment of the VsyncSF signal according to SF WorkDuration and the expected TE point corresponding to the frame, and sends a VsyncSF signal request to the Vsync generation module in the image synthesis system; the Vsync generation module in the image synthesis system generates a VsyncSF signal at the trigger moment of the VsyncSF signal according to the VsyncSF signal request, and returns the VsyncSF signal to the image synthesis module in the image synthesis system; the image synthesis module in the image synthesis system performs frame synthesis when receiving the VsyncSF signal. Correspondingly, the processing flow of the image synthesis system for frame synthesis according to the adjusted SF WorkDuration is the same.

[0188] The start moment of the first adjustment period can be the synthesis end moment when the image synthesis system performs frame synthesis for the first time after the user touches the screen.

[0189] If the user does not leave the screen and does not enter the penalty period, then after the end of the previous adjustment period, the next adjustment period can be entered. At this time, the start moment of the next adjustment period can be the synthesis end moment of the first frame after the end of the previous adjustment period.

[0190] If the user does not leave the screen but enters the penalty period, then after the end of the penalty period, the next adjustment period is performed. At this time, the start moment of the next adjustment period can be the synthesis end moment of the first frame after the end of the penalty period.

[0191] The target synthesis time consumption can be the target value of a synthesis time consumption within an adjustment period. The instruction to enter the adjustment period can be the instruction to enter the adjustment period.

[0192] The period adjustment module can set the target synthesis time consumption to 0 at the start moment of each adjustment period, and send an instruction to enter the adjustment period to the image synthesis module at the start moment of each adjustment period.

[0193] In an alternative embodiment, the target synthesis time consumption can be set to a non-zero fixed value, and this fixed value can be, for example, the synthesis time consumption threshold.

[0194] S202. After receiving the instruction to enter the adjustment period, when the synthesis of the first current frame ends, the image synthesis module determines the synthesis end time of the first current frame and the synthesis duration of the first current frame, and sends the synthesis end time of the first current frame and the synthesis duration of the first current frame to the frame dropping penalty module.

[0195] During the adjustment period, it does not affect processes such as frame drawing, frame synthesis, and screen update. That is, during the adjustment period, the application performs frame drawing when receiving the VsyncAPP signal, the image synthesis system performs frame synthesis when receiving the VsyncSF signal, and the display screen performs screen update when receiving the TE signal.

[0196] During the adjustment period, the image synthesis system can receive multiple VsyncSF signals, that is, multiple frame synthesis processes can be performed. At the end of each frame synthesis, the synthesis end time and synthesis duration of each frame can be determined.

[0197] The first current frame can be any frame during the adjustment period. The synthesis duration is the duration generated during the frame synthesis process. It can be understood that the synthesis durations of different frames can be different.

[0198] During the adjustment period, when the synthesis of each first current frame ends, the image synthesis module can determine the synthesis end time of each first current frame and the synthesis duration of each first current frame, and send the synthesis end time of each first current frame and the synthesis duration of each first current frame to the frame dropping penalty module.

[0199] S203. The frame dropping penalty module determines whether the synthesis duration of the first current frame is less than the current SF WorkDuration; if so, execute S204; if not, execute S211.

[0200] The current SF WorkDuration can be the SF WorkDuration within the current adjustment period. That is, during the adjustment period, frame synthesis is performed according to the current SF WorkDuration.

[0201] It should be noted that in the first adjustment period, the current SF WorkDuration is the default value. In each adjustment period after the first adjustment period, the current SF WorkDuration within each adjustment period is the adjusted SF WorkDuration at the end of the previous adjustment period.

[0202] During the adjustment period, after receiving the synthesis duration of each first current frame, the frame dropping penalty module determines whether the synthesis duration of each first current frame is greater than the current SF WorkDuration.

[0203] If the composition time of each first current frame is less than the current SF WorkDuration, the composition time and the composition end time of each first current frame can be sent to the cycle adjustment module.

[0204] Refer to Figure 7a , within the adjustment cycle (i.e., after the start time of the adjustment cycle), when the image composition system receives the VsyncSF signal 11, it composes frame 1; when the display screen receives the high-frequency TE signal 21, it displays frame 1. Among them, the time interval between the VsyncSF signal 11 and the high-frequency TE signal 21 is SF WorkDuration_1.

[0205] From Figure 7a it can be seen that the composition time of frame 1 is less than SF WorkDuration_1. Thus, after the composition of frame 1 ends, the adjustment cycle does not change, and SF WorkDuration does not change either.

[0206] Continue to refer to Figure 7a , when the image composition system receives the VsyncSF signal 12, it composes frame 2; when the display screen receives the high-frequency TE signal 24, it displays frame 2. Among them, the time interval between the VsyncSF signal 12 and the high-frequency TE signal 24 is SF WorkDuration_1.

[0207] If the composition time of one of the first current frames is greater than the current SF WorkDuration, it means that this first current frame cannot be displayed at the expected TE point, that is, this first current frame will experience frame loss. Then, the current SFWorkDuration can be updated to the default SF WorkDuration, so that the image composition system composes frames according to the default SF WorkDuration, thereby preventing continuous frame loss.

[0208] Refer to Figure 7b , within the adjustment cycle (i.e., after the start time of the adjustment cycle), when the image composition system receives the VsyncSF signal 1a, it composes frame h; when the display screen receives the high-frequency TE signal 2b + 4, it displays frame h. Among them, the time interval between the VsyncSF signal 1a and the high-frequency TE signal 2b + 4 is greater than SF WorkDuration_1.

[0209] From Figure 7bIt can be known that the time interval between the VsyncSF signal 1a and the high-frequency TE signal 2b+3 is SFWorkDuration_1, that is, the synthesis time of frame h is greater than SF WorkDuration_1. At this time, SFWorkDuration_1 (the current SF WorkDuration) can be updated to SF WorkDuration_2 (the default SFWorkDuration).

[0210] Continue to refer to Figure 7b , within the penalty period (that is, after the start time of the penalty period), when the image synthesis system receives the VsyncSF signal 1a+2, it synthesizes frame h+1; when the display screen receives the high-frequency TE signal 2b+10, it displays frame h+1. Among them, the time interval between the VsyncSF signal 1a+2 and the high-frequency TE signal 2b+10 is SFWorkDuration_2.

[0211] S204. The frame dropping penalty module sends the synthesis end time of the first current frame and the synthesis time of the first current frame to the period adjustment module.

[0212] When the synthesis time of the first current frame is less than the current SF WorkDuration, it can be confirmed that the first current frame can be displayed at the expected TE point without frame dropping. Then, the frame dropping penalty module can send the synthesis end time of the first current frame and the synthesis time of the first current frame to the period adjustment module.

[0213] During the adjustment period, the frame dropping penalty module can send the synthesis end time and synthesis time of each first current frame with a synthesis time less than the current SF WorkDuration to the period adjustment module.

[0214] S205. The period adjustment module updates the target synthesis time according to the synthesis time of the first current frame.

[0215] After receiving the synthesis time of the first current frame, the period adjustment module can update the target synthesis time according to the synthesis time of each first current frame during the adjustment period.

[0216] When the synthesis time of the first current frame is greater than the target synthesis time, update the target synthesis time to the synthesis time of the first current frame. When the synthesis time of the first current frame is less than the target synthesis time, keep the target synthesis time unchanged.

[0217] In an alternative embodiment, when the target synthesis time is a non-zero fixed value, updating the target synthesis time according to the synthesis time of the first current frame may include: determining the magnitude relationship between the synthesis time of each first current frame and the target synthesis time, determining any one frame among the first current frames whose synthesis time is greater than the target synthesis time, and setting the synthesis time of this frame as the target synthesis time.

[0218] In another alternative embodiment, when the target synthesis time is a non-zero fixed value, updating the target synthesis time according to the synthesis time of the first current frame may further include: determining the magnitude relationship between the synthesis time of each first current frame and the target synthesis time, and setting the average value of the synthesis times of the first current frames whose synthesis time is greater than the target synthesis time as the target synthesis time.

[0219] S206. The cycle adjustment module determines whether the synthesis end time of the first current frame exceeds the end time of the adjustment cycle; if so, execute S207; if not, return to execute S206.

[0220] The end time of the adjustment cycle can be determined according to the cycle duration of the adjustment cycle and the start time of the adjustment cycle.

[0221] After updating the target synthesis time, the cycle adjustment module may determine whether the synthesis end time of the first current frame exceeds the end time of the adjustment cycle.

[0222] During the adjustment cycle, if the synthesis end time of each first current frame does not exceed the end time of the adjustment cycle, it indicates that the adjustment cycle has not ended. Then, the image synthesis system can be waited for to perform frame synthesis of the next second current frame until the synthesis end time of the first current frame received by the cycle adjustment module exceeds the end time of the adjustment cycle. It can be understood that during the adjustment cycle, the current SF WorkDuration remains unchanged.

[0223] Refer to Figure 7c , during the adjustment cycle (i.e., after the start time of the adjustment cycle), when the image synthesis system receives the VsyncSF signal 1c, it synthesizes frame i; when the display screen receives the high-frequency TE signal 2d, it displays frame i. The time interval between the VsyncSF signal 1c and the high-frequency TE signal 2d is SF WorkDuration_1.

[0224] From Figure 7c it can be seen that if the synthesis end time of frame i does not exceed the end time of the adjustment cycle, the adjustment cycle has not ended. Before the adjustment cycle ends, SF WorkDuration_1 remains unchanged.

[0225] Continue to refer to Figure 7c, when the image synthesis system receives the VsyncSF signal 1c + 1, it synthesizes frame i + 1; when the display screen receives the high-frequency TE signal 2d + 3, it displays frame i + 1. Among them, the time interval between the VsyncSF signal 1c + 1 and the high-frequency TE signal 2d + 3 is SF WorkDuration_1.

[0226] During the adjustment period, if the synthesis end time of a first current frame exceeds the end time of the adjustment period, it means that the adjustment period ends before the synthesis of this first current frame or at the synthesis end time of this first current frame. Then the period adjustment module can update the current SF WorkDuration, that is, the image synthesis system can perform frame synthesis according to the updated current SF WorkDuration.

[0227] Refer to Figure 7d , during the adjustment period (that is, after the start time of the adjustment period), when the image synthesis system receives the VsyncSF signal 1e, it synthesizes frame j; when the display screen receives the high-frequency TE signal 2f, it displays frame j. Among them, the time interval between the VsyncSF signal 1e and the high-frequency TE signal 2f is SF WorkDuration_1.

[0228] From Figure 7d it can be seen that the synthesis end time of frame j exceeds the end time of the adjustment period, that is, when the image synthesis system synthesizes frame j + 1, the adjustment period has ended. At the end of the adjustment period, SF WorkDuration_1 is updated to SF WorkDuration_3.

[0229] Continue to refer to Figure 7d , after the adjustment period ends (that is, after the end time of the adjustment period), when the image synthesis system receives the VsyncSF signal 1e + 1, it synthesizes frame j + 1; when the display screen receives the high-frequency TE signal 2f + 3, it displays frame j + 1. Among them, the time interval between the VsyncSF signal 1e + 1 and the high-frequency TE signal 2f + 3 is SFWorkDuration_3.

[0230] S207. The period adjustment module determines the target SFWorkDuration according to the target synthesis time consumption and the time consumption design margin.

[0231] The time consumption design margin can be a pre-set value of the spare time consumption, that is, the time consumption value for waiting for the expected TE point after the frame synthesis ends.

[0232] When the end time of the synthesis of the first current frame exceeds the end time of the adjustment period, the period adjustment module may determine the target SF WorkDuration according to the target synthesis duration and the design margin of the duration.

[0233] In the embodiments of the present application, the target SF WorkDuration may be equal to the sum of the target synthesis duration and the design margin of the duration.

[0234] S208. The period adjustment module determines whether the target SF WorkDuration is less than a preset minimum threshold; if so, execute S209; if not, execute S210.

[0235] The preset minimum threshold may be the pre-set minimum value of the SF WorkDuration.

[0236] After determining the target SF WorkDuration, the period adjustment module determines whether the target SF WorkDuration is less than the preset minimum threshold.

[0237] If the target SF WorkDuration is less than the preset minimum threshold, the current SF WorkDuration may be updated according to the preset minimum threshold, that is, the current SF WorkDuration is updated to the preset minimum threshold.

[0238] If the target SF WorkDuration is greater than the preset minimum threshold, the current SF WorkDuration may be updated according to the target SF WorkDuration, that is, the current SF WorkDuration is updated to the target SF WorkDuration.

[0239] S209. The period adjustment module updates the current SF WorkDuration according to the preset minimum threshold and sends the updated current SF WorkDuration to the image synthesis module.

[0240] Refer to Figure 7d , after the adjustment period ends, SF WorkDuration_1 (that is, the current SF WorkDuration) is updated to SF WorkDuration_3 (that is, the preset minimum threshold).

[0241] After receiving the updated current SF WorkDuration, the image synthesis module, the image synthesis system may perform frame synthesis according to the updated current SF WorkDuration.

[0242] S210. The cycle adjustment module updates the current SF WorkDuration according to the target SF WorkDuration, and sends the updated current SF WorkDuration to the image synthesis module.

[0243] Continue to refer to Figure 7d , after the adjustment cycle ends, update SF WorkDuration_1 (i.e., the current SF WorkDuration) to SF WorkDuration_3 (i.e., the target SF WorkDuration).

[0244] S211. The frame dropping penalty module updates the current SF WorkDuration according to the default SF WorkDuration and executes S301. After updating the current SF WorkDuration according to the default SF WorkDuration, the frame dropping penalty module sends the updated current SF WorkDuration to the image synthesis module.

[0245] The default SF WorkDuration can be the default value of the pre-set SF WorkDuration.

[0246] When the synthesis time of the first current frame is greater than the current SF WorkDuration, it means that the first current frame cannot be displayed at the expected TE point, that is, the first current frame will experience frame dropping. Then, the current SF WorkDuration can be updated to the default SF WorkDuration, and the synthesis end time of the first current frame is determined as the start time of the penalty period.

[0247] Continue to refer to Figure 7b , the synthesis time of frame h is greater than SF WorkDuration_1. Then, after the synthesis of frame h ends, update SF WorkDuration_1 (i.e., the current SF WorkDuration) to SF WorkDuration_2 (i.e., the default SF WorkDuration), enter the penalty period, and determine the synthesis end time of frame h as the start time of the penalty period.

[0248] S301. The frame dropping penalty module determines the synthesis end time of the first current frame as the start time of the penalty period, and sends an instruction to enter the penalty period to the image synthesis module.

[0249] The instruction to enter the penalty period can be an instruction to enter the penalty period.

[0250] When frame drops occur during the adjustment period, the adjustment period ends and the penalty period is entered. During the penalty period, the default SF WorkDuration remains unchanged. After the penalty period ends, the next adjustment period can be entered.

[0251] During an adjustment period, if the penalty period is not entered, the next adjustment period is entered after the adjustment period ends. During an adjustment period, if the penalty period is entered, the adjustment period ends and the next adjustment period is not entered until the penalty period ends.

[0252] Exemplarily, the duration of the penalty period can be set to 1 s (second). It should be noted that the duration of the penalty period can be configured according to requirements, and the embodiments of the present application do not limit this.

[0253] S302. When the second current frame synthesis ends, the image synthesis module determines the synthesis end time of the second current frame and sends the synthesis end time of the second current frame to the frame drop penalty module.

[0254] During the penalty period, processes such as frame drawing, frame synthesis, and screen update are not affected. That is, during the penalty period, the application performs frame drawing when receiving the VsyncAPP signal, the image synthesis system performs frame synthesis when receiving the VsyncSF signal, and the display screen performs screen update when receiving the TE signal.

[0255] During the penalty period, the image synthesis system can receive multiple VsyncSF signals, that is, multiple frame synthesis processes can be performed. At the end of each frame synthesis, the synthesis end time of each frame can be determined.

[0256] The second current frame can be any frame during the penalty period.

[0257] During the penalty period, when the synthesis of each second current frame ends, the image synthesis module can determine the synthesis end time of each second current frame and send the synthesis end time of each second current frame to the frame drop penalty module.

[0258] S303. The frame drop penalty module determines whether the synthesis end time of the second current frame exceeds the end time of the penalty period; if so, S304 is executed; if not, it returns to execute S303.

[0259] The end time of the penalty period can be determined according to the duration of the penalty period and the start time of the penalty period.

[0260] When receiving the synthesis end time of the second current frame, the frame drop penalty module can determine whether the synthesis end time of the second current frame exceeds the end time of the penalty period.

[0261] During the penalty period, if the synthesis end time of each second current frame does not exceed the end time of the penalty period, it means the penalty period has not ended. Then, the image synthesis system can be waited for to perform frame synthesis of the next second current frame until the synthesis end time of the second current frame received by the frame dropping penalty module exceeds the end time of the penalty period. It can be understood that during the penalty period, the SF WorkDuration is defaulted to remain unchanged.

[0262] Refer to Figure 7e , during the penalty period (i.e., after the start time of the penalty period), when the image synthesis system receives the VsyncSF signal 1m, it synthesizes frame k; when the display screen receives the high-frequency TE signal 2n, it displays frame k. Among them, the time interval between the VsyncSF signal 1m and the high-frequency TE signal 2n is SF WorkDuration_2.

[0263] From Figure 7e it can be known that if the synthesis end time of frame k does not exceed the end time of the penalty period, then the penalty period has not ended. Before the penalty period ends, SF WorkDuration_2 remains unchanged.

[0264] Continue to refer to Figure 7e , when the image synthesis system receives the VsyncSF signal 1m + 1, it synthesizes frame k + 1; when the display screen receives the high-frequency TE signal 2n + 3, it displays frame k + 1. Among them, the time interval between the VsyncSF signal 1m + 1 and the high-frequency TE signal 2n + 3 is SF WorkDuration_2.

[0265] During the penalty period, if the synthesis end time of one second current frame exceeds the end time of the penalty period, it means the penalty period ends before the synthesis end of this second current frame or at the synthesis end time of this second current frame. Then, the frame dropping penalty module can send the synthesis end time of the second current frame to the cycle adjustment module.

[0266] Refer to Figure 7f , during the penalty period (i.e., after the start time of the penalty period), when the image synthesis system receives the VsyncSF signal 1p, it synthesizes frame r; when the display screen receives the high-frequency TE signal 2q, it displays frame r. Among them, the time interval between the VsyncSF signal 1p and the high-frequency TE signal 2q is SF WorkDuration_2.

[0267] From Figure 7fIt can be known that the synthesis end time of frame r exceeds the end time of the penalty period, that is, when the image synthesis system synthesizes frame r+1, the penalty period has ended. After the penalty period ends, the synthesis end time of frame r is determined as the start time of the next adjustment period, that is, enter the next adjustment period. During the next adjustment period, keep SFWorkDuration_2 unchanged.

[0268] Continue to refer to Figure 7f , when the image synthesis system receives the VsyncSF signal 1p+1, it synthesizes frame r+1; when the display screen receives the high-frequency TE signal 2q+3, it displays frame r+1. Among them, the time interval between the VsyncSF signal 1p+1 and the high-frequency TE signal 2q+3 is SF WorkDuration_2.

[0269] S304. The frame dropping penalty module sends the synthesis end time of the second current frame to the cycle adjustment module, and the cycle adjustment module determines the synthesis end time of the second current frame as the start time of the adjustment period.

[0270] When the frame dropping penalty module determines that the synthesis end time of the second current frame exceeds the end time of the penalty period, it sends the synthesis end time of the second current frame to the cycle adjustment module. At this time, enter the adjustment period, and the cycle adjustment module determines the synthesis end time of the second current frame as the start time of the next adjustment period.

[0271] When the cycle adjustment module determines the synthesis end time of the second current frame as the start time of the adjustment period, enter the next adjustment period, and the cycle adjustment module returns to execute S201.

[0272] It can be understood that after the penalty period ends and enters the next adjustment period, within the adjustment period, the value of the current SFWorkDuration is the default SF WorkDuration value.

[0273] The following uses a specific example to elaborate in detail on the adjustment period and the penalty period in the display method of the embodiment of the present application. Figures 8a - 8b It is a timing diagram of the adjustment period and the penalty period shown exemplarily.

[0274] Refer to Figure 8a, the electronic device can enter the i-th adjustment period at the end of the synthesis of frame s (i.e., at time t1), and end the i-th adjustment period at time t2. The image synthesis system can adjust the SF WorkDuration at the end of the synthesis of frame s (i.e., at time t1). During the i-th adjustment period, the image synthesis system can synthesize each frame according to the adjusted SFWorkDuration, and the synthesis time of each frame is less than the SF WorkDuration corresponding to the i-th adjustment period.

[0275] Since the end time of the synthesis of frame s + n (i.e., at time t3) exceeds the end time of the i-th adjustment period (i.e., at time t2), the electronic device can enter the next adjustment period (i.e., the i + 1-th adjustment period) at the end time of the synthesis of frame s + n (i.e., at time t3), and end the i + 1-th adjustment period at time t4. The image synthesis system can adjust the SF WorkDuration at time t3. Similarly, during the i + 1-th adjustment period, the image synthesis system can synthesize each frame according to the adjusted SFWorkDuration, and the synthesis time of each frame is less than the SF WorkDuration corresponding to the i + 1-th adjustment period.

[0276] The electronic device can enter the i + 2-th adjustment period at the end time of the synthesis of the first frame after time t4 (i.e., frame s + m) (i.e., at time t5). The image synthesis system can adjust the SF WorkDuration at time t5. As Figure 8a shown, in the embodiment of the present application, the duration of each adjustment period of the electronic device can be 200 ms.

[0277] Referring to Figure 8b , during the i-th adjustment period, when the image synthesis system synthesizes frame s, the synthesis time of frame s is greater than the SF WorkDuration corresponding to the i-th adjustment period. In this way, the electronic device can end the i-th adjustment period at the end time of the synthesis of frame s (i.e., at time t1). That is, the electronic device can end the i-th adjustment period before the end time of the i-th adjustment period. Thus, the duration of the i-th adjustment period is less than 200 ms.

[0278] The electronic device can enter the penalty period at the end time of the synthesis of frame s + n (i.e., at time t2), and end the penalty period at time t3. The image synthesis system can adjust the SF WorkDuration at time t2. During the penalty period, the image synthesis system can synthesize each frame according to the adjusted SFWorkDuration.

[0279] Since the end time of the synthesis of frame s+m (i.e., time t4) exceeds the end time of the penalty period (i.e., time t3), the electronic device can enter the j-th adjustment period at the end time of the synthesis of frame s+m (i.e., time t4). The SF WorkDuration corresponding to the j-th adjustment period can be the same as the SF WorkDuration corresponding to the penalty period. That is, the image synthesis system does not need to adjust the SF WorkDuration at time t4.

[0280] Since the end time of the synthesis of frame s+p (i.e., time t6) exceeds the end time of the j-th adjustment period (i.e., time t5), the electronic device can enter the (j + 1)-th adjustment period at time t6 and end the (j + 1)-th adjustment period at time t7. The image synthesis system can adjust the SF WorkDuration at time t6.

[0281] This embodiment also provides a computer storage medium, in which computer instructions are stored. When the computer instructions run on an electronic device, the electronic device is enabled to execute the above-related method steps to implement the display method in the above embodiment.

[0282] This embodiment also provides a computer program product. When the computer program product runs on a computer, the computer is enabled to execute the above-related steps to implement the display method in the above embodiment.

[0283] In addition, an embodiment of the present application also provides a device, which may specifically be a chip, a component or a module. The device may include a processor and a memory connected to each other. The memory is used to store computer execution instructions. When the device runs, the processor may execute the computer execution instructions stored in the memory to enable the chip to execute the display method in each of the above method embodiments.

[0284] Among them, the electronic device (such as a mobile phone, etc.), computer storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, which will not be elaborated here.

[0285] Through the description of the above embodiments, those skilled in the art can understand that for the convenience and brevity of description, only the above division of each functional module is used as an example. In actual applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

[0286] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection between each other can be through some interfaces. The indirect coupling or communication connection of devices or units can be in electrical, mechanical or other forms.

[0287] As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the various embodiments of the present application.

Claims

1. A display method, characterized in that, The method includes: In response to the movement of a target operation, a target application draws at least one interface image; Determine the target duration of a second adjustment period according to the synthesis time consumption of at least one display frame within a first adjustment period; wherein, the second adjustment period is the next adjustment period adjacent to the first adjustment period, and the target duration is the time interval between the display trigger moment and the synthesis trigger moment of a display frame; Within the second adjustment period, obtain a first interface image drawn by the target application, and determine the arrival moment of an expected tearing effect TE signal of a first display frame corresponding to the first interface image; Determine the frame synthesis trigger moment corresponding to the first interface image according to the expected arrival moment of the TE signal of the first display frame and the target duration of the second adjustment period; At the frame synthesis trigger moment corresponding to the first interface image, synthesize the first display frame according to the first interface image; Display a plurality of display frames corresponding to the at least one interface image, and the plurality of display frames include the first display frame.

2. The method according to claim 1, characterized in that, The determining the target duration of the second adjustment period according to the synthesis time consumption of at least one display frame within the first adjustment period includes: Within the first adjustment period, determine the target synthesis time consumption corresponding to the first adjustment period according to the synthesis time consumption of at least one display frame within the first adjustment period; After the first adjustment period ends, obtain a preset idle time consumption, and determine the sum value of the target synthesis time consumption and the preset idle time consumption as the duration to be adjusted; Determine the target duration of the second adjustment period according to the duration to be adjusted.

3. The method according to claim 2, wherein The determining the target synthesis time consumption corresponding to the first adjustment period according to the synthesis time consumption of at least one display frame within the first adjustment period includes: At the start moment of the first adjustment period, set the target synthesis time consumption to an initial value; Successively use each display frame synthesized within the first adjustment period as the current display frame; Obtain the synthesis time consumption of the current display frame, and when the synthesis time consumption of the current display frame is greater than the target synthesis time consumption, update the value of the target synthesis time consumption to the synthesis time consumption of the current display frame.

4. The method according to claim 2, characterized in that The determining the target duration of the second adjustment period according to the duration to be adjusted includes: Obtain a first duration; When the duration to be adjusted is greater than the first duration, determine the duration to be adjusted as the target duration of the second adjustment period; When the duration to be adjusted is less than the first duration, determine the first duration as the target duration of the second adjustment period.

5. The method according to claim 1, wherein Before determining the target duration of the second adjustment period according to the synthesis time consumption of at least one display frame within the first adjustment period, it further includes: Determine the target duration of the first adjustment period; The determining the target duration of the second adjustment period according to the synthesis time consumption of at least one display frame within the first adjustment period includes: When the synthesis time consumption of all display frames synthesized within the first adjustment period is less than the target duration of the first adjustment period, determine the target duration of the second adjustment period according to the synthesis time consumption of at least one display frame within the first adjustment period.

6. The method according to claim 5, characterized in that The method further includes: During the first adjustment period, determining the synthesis time consumption of a second display frame; When the synthesis time consumption of the second display frame is greater than the target duration of the first adjustment period, determining the target duration corresponding to a penalty period and starting to count the penalty period; During the penalty period, obtaining a third interface image drawn by the target application and determining the expected arrival time of a TE signal of a third display frame corresponding to the third interface image; According to the expected arrival time of the TE signal of the third display frame and the target duration corresponding to the penalty period, determining a frame synthesis trigger time corresponding to the third interface image; At the frame synthesis trigger time corresponding to the third interface image, synthesizing the third display frame according to the third interface image; After the penalty period counting ends, determining a next adjustment period; wherein the target duration of the next adjustment period is a second duration.

7. The method according to claim 6, wherein The determining the target duration corresponding to the penalty period includes: Determining the second duration as the target duration corresponding to the penalty period.

8. The method according to claim 6, characterized in that, The method further includes: The start time of the penalty period is the synthesis end time of the second display frame.

9. The method according to claim 6, characterized in that, The method further includes: Determining the synthesis end time of the third display frame and the end time of the penalty period; When the synthesis end time of the third display frame exceeds the end time of the penalty period, determining the synthesis end time of the third display frame as the start time of the next adjustment period.

10. The method according to claim 5, wherein The determining the target duration of the first adjustment period includes: When the first adjustment period is the first adjustment period, obtaining a second duration; Determining the second duration as the target duration of the first adjustment period.

11. The method according to claim 1, wherein The method further includes: Determining the synthesis end time of a fourth display frame within the first adjustment period and the end time of the first adjustment period; When the synthesis end time of the fourth display frame exceeds the end time of the first adjustment period, determining the synthesis end time of the fourth display frame as the start time of the second adjustment period.

12. The method according to any one of claims 1 to 11, characterized in that, The method is applied to an electronic device, and the frequency of the TE signal of the electronic device is greater than the screen refresh frequency of the electronic device.

13. An electronic device, characterized in that, It includes: One or more processors; A memory; And one or more computer programs, wherein the one or more computer programs are stored on the memory, and when the computer programs are executed by the one or more processors, the electronic device executes the display method according to any one of claims 1-12.

14. A computer-readable storage medium, comprising a computer program, characterized in that, When the computer program runs on the electronic device, the electronic device executes the display method according to any one of claims 1-12.

Images