Image display method and electronic equipment
By adopting the first synthesis strategy and variable refresh rate mode in electronic devices, adjusting the refresh rate of the display screen, the problem of poor chirality of electronic devices is solved, and the effect of reducing jitter and power consumption is achieved, and the user experience is improved.
Patent Information
- Application Number
- CN202510200308.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-29
- Publication Date
- 2025-07-18
AI Technical Summary
Existing electronic devices have poor chirality when touching, resulting in lag in display and affecting user experience, especially in competitive games.
By adopting the first synthesis strategy and variable refresh rate mode in the electronic device, the refresh rate of the display screen is adjusted to shorten the time interval of the display image on the display screen, reduce the difference in the display time of the two adjacent frames, improve the chirality, and perform multi-dimensional detection through the touch module to avoid accidentally touching the adjustment refresh rate.
It effectively reduces jitter in the display interface, improves the chirality of electronic devices, and reduces power consumption and improves user experience.
Smart Images

Figure CN120335637A_ABST
Abstract
Description
[0001] This application is a divisional application of the invention patent application with the application number 202311872056.1, the application date of December 29, 2023, and the invention creation name of "Method for Screen Display and Electronic Device" submitted to the China National Patent Office. The entire content of the original application is incorporated herein by reference. Technical Field
[0002] This application relates to the terminal field, and in particular, to a method for image display and an electronic device. Background Art
[0003] With the continuous development of display screen technology, the display screens of more and more electronic devices support touch operations. For example, devices such as mobile phones, tablet computers, laptop computers, and in-vehicle computers. Touch control performance is a key indicator for measuring touch experience, and touch control performance covers many aspects such as sensitivity, continuity, followability, and accidental touch. The shorter the follow-up response time, the better the follow-up performance. The follow-up response time refers to the time required for an electronic device to display the page corresponding to a touch operation on the display screen after receiving the user's touch operation.
[0004] Currently, for some touch screen operation scenarios, there is still a problem of poor followability. That is, when an electronic device displays content, there is often a problem of display lag, which affects the user experience. For example, in a game scenario, especially in a competitive battle game, the movement of game characters lags, affecting the game result. Summary of the Invention
[0005] To solve the above technical problems, this application provides a method for image display and an electronic device, which can shorten the delay of the display screen in displaying the application interface, reduce the jitter problem generated when displaying the interface, and improve the followability of the electronic device.
[0006] In a first aspect, the present application provides a method for image display, which is applied to an electronic device and includes: when a first application adopts a first synthesis strategy, in response to a first touch operation input by a user on the interface of the first application, the interface corresponding to the first touch operation is displayed at a first refresh rate, where the first synthesis strategy is that when an image synthesizer in the electronic device receives an image frame rendered by the current application, the rendered image frame is system-synthesized; when a first adjustment instruction is received, it is detected whether the first application meets a preset adjustment condition, and the first adjustment instruction is used to indicate adjusting the first refresh rate mode of the first application, and the first refresh rate mode is that the display screen adopts a preset first refresh rate; when it is detected that the first application meets the adjustment condition, the first refresh rate mode of the first application is adjusted to a variable refresh rate mode, and the second refresh rate is greater than the first refresh rate; when the first application adopts the first synthesis strategy, in response to a second touch operation input by the user on the interface of the first application, at the moment when a preset effective condition is detected, the interface corresponding to the second touch operation is displayed at the second refresh rate.
[0007] In this way, when a first application (such as a game application, a browser, a video application) of an electronic device (such as a mobile phone, a tablet computer, a laptop computer, etc.) adopts the first synthesis strategy, at the moment when the effective condition is met, the image is displayed at the second refresh rate. Since the second refresh rate is greater than the first refresh rate, the time interval for the display screen to start displaying the image is shortened. When the display screen displays the image frame at the second refresh rate, even if the time for the application to render the image frame is too long, the image can be refreshed in time; in addition, since the difference in the display time of adjacent two frames of images is reduced, the jitter of the page is reduced. And since the time interval for the display screen to receive the vertical synchronization signal is shortened, the delay of the display screen displaying the image is reduced, and the followability of the electronic device is improved. In addition, since the second refresh rate is only adopted at the moment when the effective condition is met, the power consumption of the electronic device can be reduced.
[0008] According to the first aspect, the electronic device includes a touch module; when a first adjustment instruction is received, detecting whether the first application meets a preset adjustment condition includes: the touch module detecting whether the first application adopts the first synthesis strategy to obtain a first detection result; the touch module detecting whether the first application belongs to an application in a first preset list to obtain a second detection result; the touch module detecting whether the frame rate of the first application is a first preset frame rate to obtain a third detection result; the touch module detecting whether the electronic device supports adjusting the refresh mode of the display screen to a variable refresh mode to obtain a fourth detection result, and the variable refresh state is the state where the display screen adjusts the refresh rate within a preset range; according to the first detection result, the second detection result, the third detection result, and the fourth detection result, a fifth detection result is obtained, and the fifth detection result is used to indicate whether the first application meets the preset adjustment condition.
[0009] In this way, the touch control module can detect whether the first application meets the preset adjustment conditions through multiple judgment dimensions, which can avoid the problem of accidental touch by the user to turn on the refresh rate adjustment. In addition, multi-dimensional detection can also avoid high power consumption caused by the activation of applications that do not meet the conditions.
[0010] According to the first aspect, based on the first detection result, the second detection result, the third detection result, and the fourth detection result, obtaining a fifth detection result includes: when the first detection result indicates that the first application adopts a first synthesis strategy, the second detection result indicates that the first application belongs to the applications in the first preset list, the third detection result indicates that the frame rate of the first application is the first preset frame rate, and the fourth detection result indicates that the electronic device supports the refresh mode of the display screen to be adjusted to a variable refresh mode, determining that the fifth detection result indicates that the first application meets the preset adjustment conditions.
[0011] According to the first aspect, the electronic device includes a touch control module; in the case of detecting that the first application meets the adjustment conditions, adjusting the first refresh rate mode of the first application to a variable refresh rate mode includes: when the touch control module detects that the first application meets the adjustment conditions, sending a first indication message to the image synthesizer; the image synthesizer, according to the first indication message, sending a second indication message to the display screen, where the second indication message includes information about the target refresh rate mode of the display screen, and the information about the target refresh rate mode indicates that the target refresh mode is a variable refresh mode; the display screen, according to the second indication message, setting the variable refresh frequency in the variable refresh rate mode to the second refresh rate; at the moment of detecting that the preset effective condition is met, displaying the interface corresponding to the second touch operation at the second refresh rate, including: the display screen determining the effective moment of the second refresh rate according to the second refresh frequency; the display screen generating a tearing effect TE signal at the effective moment for the display screen to display the received image frame when detecting the TE signal.
[0012] In this way, the display screen can first set the refresh frequency to the second refresh frequency, but does not immediately display the received image frame at the second refresh frequency. Instead, a TE signal is added at the effective moment, so that the display screen can display the received image frame when detecting the TE signal. The way of dynamically adding the TE signal can reduce the power consumption of the electronic device.
[0013] According to the first aspect, for the display screen to determine the effective time of the second refresh rate according to the second refresh rate, it includes: the display screen obtains the starting time of the first image frame currently being displayed as the first time; the display screen obtains the time when the first image frame is received as the second time, and the first image frame is transmitted from the image synthesizer to the display screen; the display screen obtains the difference between the second time and the first time as the first difference; the display screen detects whether the first difference is greater than the target interval, and the target interval is the reciprocal of the second refresh rate; when the display screen detects that the first difference is greater than the target interval, it determines the effective time, and the effective time is the time before the display screen receives the next vertical synchronization signal, and the time between the effective time and the time when the display screen receives the next vertical synchronization signal is the target interval. In this way, in the scenario where the image synthesizer quickly transmits image frames to the display screen (that is, the first difference is greater than the target frame interval, for example, when the second refresh rate is 360Hz, the target frame interval is 2.7ms), compared with the unadjusted scenario, the display screen can start displaying image frames according to the second refresh rate 2.7ms earlier, shortening the delay of the display screen in displaying image frames.
[0014] According to the first aspect, for the display screen to determine the effective time of the second refresh rate according to the second refresh rate, it includes: when the display screen receives the current vertical synchronization signal, it detects whether it has received the first image frame transmitted from the image synthesizer, and the first image frame is the image frame corresponding to the current one; when it detects that the first image frame has not been received, then N effective times are obtained within the current vertical synchronization signal period, where N is an integer greater than 0. In this way, in the scenario where the application takes a long time to render an image, the display screen starts to display image frames according to the second refresh rate 2.7ms after receiving the current vertical synchronization signal, which can display the received image frames in a timely manner, reducing the difference in the display time of adjacent two frames of images, thereby reducing the occurrence of jitter.
[0015] According to the first aspect, the electronic device is installed with a second application, and the first application allows the second application to be launched on the interface of the first application. The method further includes: in response to the user's launch operation to launch the second application on the interface of the first application, the first application allows the display screen to display the interface of the second application; in response to the adjustment start operation input by the user on the interface of the second application, the second application sends a first adjustment instruction to the touch control module. In this way, the second application can be a management assistant for the first application. For example, if the first application is a game application, the second application is a game manager; the user's launch operation is, for example, clicking on the icon of the second application displayed in the first application; this method can quickly enter the second application without exiting the first application. And the user performs the opening and adjustment operation on the interface of the second application, so that the refresh rate of the modulated first application meets the user's needs.
[0016] According to a first aspect, the method further includes: in response to a user's operation of launching a second application on the interface of a first application, the first application allows the display screen to display the interface of the second application; in response to an adjustment and closing operation input by the user on the interface of the second application, the second application sends a second adjustment instruction to the touch control module, and the first adjustment instruction is used to indicate adjusting the refresh rate of the first application to a first refresh rate; when the touch control module receives the second adjustment instruction, it detects whether the first application meets a preset adjustment condition; when the touch control module detects that the first application meets the adjustment condition, it instructs the display screen to adjust the refresh rate of the first application to the first refresh rate. In this way, when the touch control module receives the adjustment and closing instruction, it also detects whether the first application meets the adjustment condition, which can avoid the situation of adjustment errors when adjusting the refresh rate of the first application back to the first refresh rate.
[0017] According to a first aspect, the method further includes: in response to a user's operation of launching a second application on the interface of a first application, the first application allows the display screen to display the interface of the second application; in response to an adjustment and closing operation input by the user on the interface of the second application, the second application sends a second adjustment instruction to the touch control module, and the first adjustment instruction is used to indicate adjusting the refresh rate of the first application to a first refresh rate; when the touch control module receives the second adjustment instruction, it instructs the display screen to adjust the refresh rate of the first application to the first refresh rate. In this way, the electronic device can timely adjust the refresh rate of the display screen back to the first refresh rate, reducing the power consumption of the electronic device.
[0018] In a second aspect, the present application provides an electronic device, including: one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored on the memory, and when the computer programs are executed by the one or more processors, the electronic device is enabled to execute the image display method corresponding to the first aspect and any implementation manner of the first aspect.
[0019] The second aspect and any implementation manner of the second aspect respectively correspond to the first aspect and any implementation manner of the first aspect. The technical effects corresponding to the second aspect and any implementation manner of the second aspect can refer to the technical effects corresponding to the first aspect and any implementation manner of the first aspect above, which will not be elaborated here.
[0020] In a third aspect, the present application provides a computer-readable medium for storing a computer program, and when the computer program runs on an electronic device, the electronic device is enabled to execute the image display method corresponding to the first aspect and any implementation manner of the first aspect above. Description of the Drawings
[0021] To more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings required for use in the description of the embodiments of the present application. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.
[0022] Figure 1 It is a schematic diagram of a scenario with poor followability of an application shown exemplarily;
[0023] Figure 2 It is a schematic diagram of the entire link of a touch delay shown exemplarily;
[0024] Figure 3 It is a schematic diagram of the structure of an electronic device shown exemplarily;
[0025] Figure 4 It is a software structure block diagram of an electronic device shown exemplarily;
[0026] Figure 5 It is a schematic diagram of an image display process shown exemplarily;
[0027] Figure 6 It is a schematic diagram of an image display process adopting a first synthesis strategy shown exemplarily;
[0028] Figure 7 It is an interaction diagram between modules when touch enhancement is turned on shown exemplarily;
[0029] Figure 8 It is a schematic diagram of a scenario of the refresh rate when touch enhancement is turned on
[0030] Figure 9 It is a schematic diagram of the refresh rate taking effect shown exemplarily
[0031] Figure 10 It is a schematic diagram of a scenario of the refresh rate taking effect shown exemplarily;
[0032] Figure 11 It is an interaction diagram between modules when touch enhancement is turned off shown exemplarily;
[0033] Figure 12 It is an interaction diagram between modules when touch enhancement is turned off shown exemplarily. Detailed implementation manners
[0034] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present application without creative efforts shall fall within the protection scope of the present application.
[0035] The term "and / or" in this document is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may represent three situations: A exists alone, A and B exist simultaneously, and B exists alone.
[0036] The terms "first", "second", etc. in the description and claims of the embodiments of the present application are used to distinguish different objects, rather than to describe the specific order of the objects. For example, the first target object and the second target object are used to distinguish different target objects, rather than to describe the specific order of the target objects.
[0037] In the embodiments of the present application, words such as "exemplary" or "for example" are used to represent examples, illustrations, or explanations. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present application should not be construed as being more preferred or having more advantages than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "for example" is intended to present relevant concepts in a specific manner.
[0038] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "a plurality" refers to two or more. For example, a plurality of processing units refers to two or more processing units; a plurality of systems refers to two or more systems.
[0039] Before describing the method for image display in the present application, some technical terms involved in the present application will be explained.
[0040] (1) Vertical scanning mechanism (Vsync), which is a top - down refreshing mechanism. In the vertical scanning mechanism, the electronic device can periodically generate a vertical synchronization signal. That is, the display driver of the electronic device generates a vertical synchronization signal at the same time interval. The vertical synchronization signal can trigger the electronic device to calculate, render, and synthesize image data. Specifically, when the processor of the electronic device (such as the central processing unit (CPU) and the graphics processing unit (GPU)) receives the vertical synchronization signal, it can calculate and render the image data. When the image synthesizer (SurfaceFlinger) of the electronic device receives the vertical synchronization signal, it can perform system synthesis on the rendered image data. When the display screen of the electronic device receives the vertical synchronization signal, it can display the image data after system synthesis. The electronic device can render, perform system synthesis, and display the image data in sequence according to the "rhythm" of the vertical synchronization signal.
[0041] (2) Touch panel (TP), which is used to capture touch events.
[0042] (3) Touch panel driver (TP Driver), which is used to report the occurrence location of touch events to the InputManagerService (IMS).
[0043] (4) InputManagerService (IMS), which includes a Reader and a Dispatcher. The Reader is used to process the received touch events and dispatch the processed input events to the Dispatcher. After receiving the input events from the Reader, the Dispatcher will search for a suitable window in the windows it manages and dispatch the touch events to the suitable window.
[0044] (5) Image synthesizer (SurfaceFlinger), which is used to perform system synthesis on the rendered image data.
[0045] (6) Tearing effect (TE) signal. The TE signal is a signal output by the timing controller of an electronic device to prevent tearing problems during the screen refresh in the image display process. Exemplarily, when the electronic device is ready to refresh the next frame of the image, the electronic device generates the TE signal; when the electronic device detects the rising edge (i.e., high level) of the TE signal, it outputs the next frame of the image to the display screen of the electronic device. This TE signal can be understood as a vertically synchronized signal generated by the hardware.
[0046] Before explaining the embodiments of the present application in detail, the application scenarios in the present application will be described first.
[0047] The display screen of the electronic device supports touch operations, and the followability is an important indicator to measure the touch controllability. Figure 1 As a schematic diagram of a scenario with poor followability for an exemplary application. As Figure 1 shown in 1a in [reference], the display screen of the mobile phone shows a game interface 101. At time T1, the user's finger presses at point A on the screen and moves in the direction of the black arrow so that the game character in the interface can follow the user's finger movement.
[0048] As Figure 1 shown in 1b in [reference], at time T2, the user's finger has moved to point B on the display screen (as shown, the finger has moved a distance of d1), while the game character is still at point A and has not followed the user's finger movement.
[0049] As Figure 1 shown in 1c in [reference], at time T3, the user's finger has left the display screen, and the game character in the game interface 101 has moved from point A to point B at this time.
[0050] In this scenario, the game character in the game interface 101 has a large delay when following the user's finger movement, that is, the follow-up response time in the current game is long. The follow-up response time is related to the touch latency. The shorter the touch latency, the shorter the follow-up response time.
[0051] Figure 2 As a schematic diagram of the full link of the touch latency for an exemplary illustration.
[0052] As Figure 2 shown, the touch delay is the process from when the electronic device receives the touch operation input by the user to when the display screen shows the page corresponding to the touch operation. This touch latency includes: peripheral latency, system transmission latency, application transmission latency, rendering latency, composition latency, and display latency. As Figure 2As shown, the peripheral device latency may include the latency generated when the touch screen acquires a touch operation and the latency generated when the touch screen driver reports a touch event. The system transmission latency includes the latency generated when the Reader processes the touch event and the latency generated when the Dispatcher dispatches the touch event to the appropriate window.
[0053] The application transmission latency includes the latency generated when the application obtains drawable image data based on the touch information and transmits it to the rendering module. The rendering latency includes: the latency generated when the rendering module renders the image data. The composition latency includes: the latency generated when SurfaceFlinger composes the image. The display latency includes the latency generated during the process from when the display screen receives the image composed by SurfaceFlinger to when the display screen displays the image.
[0054] From Figure 2 it can be seen that during the process from when the electronic device receives the touch operation input by the user to when the display screen displays the image after the touch operation, each processing module will generate latency. This application provides a method for image display. This method is executed by an electronic device (such as a mobile phone, a tablet computer, an in-vehicle computer, a laptop computer, etc.). The method for image display can adjust the refresh rate of the display screen according to the operation of enabling touch enhancement input by the user (i.e., the adjustment enabling operation) to reduce the display latency.
[0055] Figure 3 FIG. 12 is a schematic structural diagram of an electronic device 100 shown in an embodiment of this application. It should be understood that Figure 3 the electronic device 100 shown is only an example of an electronic device, and the electronic device 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. Figure 3 The various components shown in FIG. 12 can be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and / or application specific integrated circuits. In this example, the electronic device 100 takes a mobile phone as an example.
[0056] The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.
[0057] Figure 4 It is a software structure block diagram of the electronic device 100 according to an embodiment of the present application. The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, which are the application layer, the application framework layer, the Android runtime and the system libraries, and the kernel layer.
[0058] The application layer may include a series of application packages. Such as Figure 4 shown, the application packages may include applications such as short videos, cameras, galleries, calendars, text messages, etc.
[0059] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The application framework layer includes some predefined functions.
[0060] Such as Figure 4 shown, the application framework layer may include an activity manage service (AMS). Among them, the AMS is used to uniformly schedule each application process and start and manage the life cycle of the activity.
[0061] In addition, the application framework layer may further include a window manager, a content provider, a view system, a telephone manager, a resource manager, a notification manager, etc.
[0062] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data, and make this data accessible to application programs. The data can include videos, images, audio, incoming and outgoing calls, browsing history and bookmarks, phone books, etc. The view system can be used to build application programs. The phone manager is used to provide the communication function of the electronic device 100. For example, the management of call status (including connection, hangup, etc.). The resource manager provides various resources for application programs, such as localized strings, icons, pictures, layout files, video files, and so on. The notification manager enables application programs to display notification information in the status bar, which can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction.
[0063] The Android runtime includes a core library and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.
[0064] The system library can include a Native layer, which is used to cache the mapping relationship between the domain name and IP address of an application program, and set the storage time and TTL of the IP address.
[0065] The system library can also include, for example, multiple functional modules such as a surface manager, medialibraries, a 3D graphics processing library (such as OpenGL ES), a 2D graphics engine (such as SGL), etc. Figure 4 (not shown in the figure).
[0066] The kernel layer is the layer between hardware and software. The kernel layer at least includes a display driver, a sensor driver, etc. For the sake of easy understanding, the following embodiments of this application will take an electronic device with Figure 3 and Figure 4 the shown structure as an example, and in combination with the accompanying drawings and application scenarios, specifically elaborate on the application program startup method provided by the embodiments of this application.
[0067] Figure 5 It is a schematic diagram of an image display process shown exemplarily. In this example, the first application is taken as an example. The first application can be a game application, a video application, a browser application, etc. The refresh rate of the electronic device can include 60Hz, 120Hz, 360Hz. In this example, the refresh rate of 120Hz is taken as an example for illustration. When the user inputs a touch operation on the interface of the first application, for example, the user performs a dragging touch operation on the display interface of the video application; such as the user moves the game character on the game interface, etc.
[0068] Such as Figure 5As shown, in response to the user's touch operation, after receiving the first Vsync signal, the first application renders the first frame of image data in the GPU. When the SurfaceFlinger of the electronic device receives the second Vsync signal, it can perform system composition on the rendered image data. When the display screen of the electronic device (such as Figure 5 the LCD in Figure 5 ) receives the third Vsync signal, it can display the image data after system composition. As
[0069] shown, the display screen displays the first frame of image during the third Vsync cycle to the fourth Vsync cycle, and the duration of each Vsync cycle is 8.3 ms. The display screen displays the second frame of image during the fifth Vsync cycle to the sixth Vsync cycle, and displays the third frame of image during the seventh Vsync cycle to the eighth Vsync cycle.
[0069] In this example, it can be Figure 5 seen that for each frame of image, it takes at least 2 Vsync cycles from the start of application drawing and rendering to hardware display. For example, the first frame of image starts application drawing and rendering in the first Vsync cycle, and can be displayed at least in the third Vsync cycle, resulting in long touch latency and affecting the user experience.
[0070] In some embodiments, in order to reduce the number of cycles from application drawing and rendering to hardware display, the application can adopt a first composition strategy, which is: after receiving the rendered image data sent by the GPU, SurfaceFlinger immediately performs system composition on the image data, rather than starting to perform system composition on the rendered image data only when receiving the Vsync signal.
[0071] Figure 6 The figure is a schematic diagram of an image display process adopting the first composition strategy for exemplary illustration. In this example, the first application takes a game as an example. The refresh rate of the electronic device is taken as 120 Hz. When the user inputs a touch operation on the interface of the game application, for example, the user moves a game character on the game interface, etc. In response to the user's touch operation, the game application can render the first frame of image data in the GPU at the start of the first Vsync signal. When SurfaceFlinger receives the first frame of image data rendered in the GPU, it can perform system composition on the rendered image data. When the display screen receives the second Vsync signal, it can display the image data after system composition. As Figure 6 shown, the display screen displays the first frame of image at the start of the second Vsync cycle.
[0072] The game application renders the second frame of image data in the GPU at the start of the 3rd Vsync signal. After SurfaceFlinger receives the second frame of image data rendered in the GPU, it can perform system composition on the second frame of image data after rendering. When the display screen receives the 4th Vsync signal and does not receive the second frame of image data sent by SurfaceFlinger, the display screen continues to display the first frame of image data. When the display screen receives the 5th Vsync signal, it can display the second frame of image data after system composition.
[0073] The game application renders the third frame of image data in the GPU at the start of the 5th Vsync signal. After SurfaceFlinger receives the third frame of image data rendered in the GPU, it can perform system composition on the third frame of image data after rendering. When the display screen receives the 6th Vsync signal, it can display the third frame of image data after system composition.
[0074] From Figure 6 it can be seen that when the time for the GPU to render an image is short, for each frame of image, it takes 1 Vsync cycle from the start of application drawing and rendering to hardware display. Compared with Figure 5 the case where the application in [reference] adopts the first composition strategy, after the electronic device adopts the first composition strategy, the time from the start of application drawing and rendering to the display screen showing the first frame of image is shortened.
[0075] However, when the time for the GPU to render an image and for SurfaceFlinger to perform system composition on the image is greater than the frame interval duration, such as Figure 6 the case where the GPU renders the second frame of image data in [reference], when the display screen receives the 4th Vsync signal, it has not received the second frame of data sent by SurfaceFlinger, resulting in a shortened display duration of the second frame of image on the display screen (the display duration of the second frame of image is 8.3 ms). Since the display duration of the first frame of image is 24.9 ms and the display duration of the second frame is 8.3 ms, the display time difference between adjacent frames of images is large, resulting in obvious jitter on the interface and poor touch followability.
[0076] In some embodiments, when the electronic device adopts the first composition strategy, it can, in response to an operation of enabling the touch enhancement function input by the user, adjust the refresh frequency of the electronic device to shorten the time to generate the TE signal, reduce the duration from receiving the image data by SurfaceFlinger to displaying on the display screen, and improve the touch followability of the application.
[0077] Figure 7 It is a schematic diagram of the interaction between modules when the exemplary electronic device executes the method of image display.
[0078] In this example, the electronic device is taken as a mobile phone. The display screen of the mobile phone can be a screen that supports variable refresh rate (VRR), such as a low temperature polycrystalline oxide (LTPO) screen. This screen adjusts the refresh rate within the range of 1 Hz to 360 Hz. In this example, different applications in the mobile phone can adopt different refresh rates. For example, web browsing can default to a refresh rate of 60 Hz, and game applications default to a refresh rate of 120 Hz.
[0079] For the convenience of understanding, in this application, the game application is taken as an example for illustration.
[0080] When the mobile phone starts a game application, the game application can send a first request to the touch module, and the first request can be used to request the touch module to adopt a first synthesis strategy. Optionally, the first request can include the identification information of the game application (such as the application package name). Among them, the touch module is located at the application framework layer.
[0081] Optionally, when the game application allows the game manager to run, the game manager can also send a first request to the touch module in response to an operation of the user to turn on the first synthesis strategy.
[0082] After receiving the first request, the touch module can detect whether the game application belongs to the applications in the second preset list. The second preset list can be pre-stored in the electronic device and is used to store the identification information of the applications that the electronic device allows to use the first synthesis strategy.
[0083] When the touch module detects that the game application belongs to the applications in the second preset list, it can detect whether the refresh rate supported by the electronic device meets the first condition, and the first condition is that the refresh rate is greater than or equal to 60 Hz. When the touch module detects that the refresh rate supported by the electronic device meets the first condition, it instructs SurfaceFligner to perform system synthesis on the rendered image after receiving the image rendered by the game application. When the touch module detects that the refresh rate supported by the electronic device does not meet the first condition, the process ends.
[0084] For example, the refresh rates supported by the screen of mobile phone A include: 1 Hz to 360 Hz; when the touch module of the mobile phone detects that the game application belongs to the applications in the second preset list, it detects whether the refresh rate supported by the mobile phone A meets the first condition. When the touch module detects that the refresh rate supported by the mobile phone A meets the first condition, it sends a first instruction to SurfaceFligner. The first instruction is used to instruct SurfaceFligner to perform system composition on the rendered image after receiving the image rendered by the game application in the GPU. SurfaceFligner performs the operation of composing the image according to the instruction of the touch module, that is, SurfaceFligner performs system composition on the rendered image after receiving the image rendered by the game application in the GPU.
[0085] It should be noted that after sending the first instruction, the touch module can record the state of the first composition strategy adopted by the game application. For example, the touch module sets "XSync = true" in the game application. This "XSync" can be used to represent the state of the first composition strategy, and "true" is used to indicate that the application has adopted the first composition strategy. Among them, the first instruction is used to instruct SurfaceFligner to perform system composition on the rendered image after receiving the image rendered by the game application.
[0086] In some embodiments, when the game application adopts the first composition strategy, there will be Figure 6 the problem of page jitter as shown. The user can turn on the touch enhancement function through the game manager to reduce the page jitter.
[0087] Step 701: The game manager sends a first message to the touch module in response to the user's operation of turning on the enhancement function.
[0088] Specifically, the user opens the game manager application in the game application. The game manager can optimize the touch function of the game, for example, the touch enhancement function. The game manager can also provide auxiliary tools for the game application, for example, it can include functions such as screenshot function and screen recording function.
[0089] The user inputs an operation to turn on the touch enhancement function on the interface of the game manager. In response to this operation, the game manager can send a first message to the touch module. The first message can include an instruction to request to turn on the touch enhancement function (i.e., the first adjustment instruction) and the package name of the current game application.
[0090] For example, such as Figure 8As shown in 8a, a game image is displayed in the game interface 801 of the game application, and a control 802 of the game steward is displayed on the game interface 801. When the user clicks on the control 802, the interface 803 of the game steward is displayed on the interface 801, as Figure 8 shown in 8b. The game steward includes a touch enhancement option, and the user clicks on the turn-on button 804 in the touch enhancement option. In response to the user's operation of turning on the touch enhancement, the game steward obtains the package name "XXX.apk" of the game application, and sends the package name of the game application and the instruction to request the turn-on of the touch enhancement function to the touch module.
[0091] Optionally, in this example, the way the game steward is displayed in the game application interface is not limited to the ways listed in this application.
[0092] It should be noted that when the first application is a browser or a video application, the auxiliary application can run on the video application or the browser, and the auxiliary application is used to optimize the touch function of the application. The auxiliary application can include a touch enhancement function. In response to the user's input operation of turning on the touch enhancement, the auxiliary application sends a first message to the touch module, and the first message includes the package name of the first application and the instruction to request the turn-on of the touch enhancement function.
[0093] Step 702: The touch module determines whether to turn on the high-frequency TE. When the touch module determines that the condition for turning on the high-frequency TE is met, step 703 can be executed.
[0094] Specifically, the touch module can pre-store a first preset list, which is used to store the identification information (such as the package name of the application) of the applications on the electronic device that are allowed to turn on the touch enhancement function. The first preset list can be set by the user. For example, the user can add an application to the first preset list. The first preset list can also be obtained by service distribution. The server can regularly update the applications in the first preset list and distribute them to the electronic device.
[0095] After receiving the first request sent by the game steward, the touch module detects whether the game application meets the conditions for turning on the touch enhancement function. The conditions for the touch enhancement function include: the application adopts a first synthesis strategy, the application belongs to the applications in the first preset list, the frame rate of the application is the preset frame rate, and the refresh rate of the electronic device meets the refresh rate condition, and the refresh rate condition is that the refresh rate is greater than 120 Hz. The preset frame rate can be greater than or equal to 60 FPS. For example, the frame rate is 60 FPS or 120 FPS. In this example, the preset frame rate is 60 FPS.
[0096] Optionally, the refresh rate condition can also be that the refresh rate is 360 Hz. When the touch module detects that the game application meets the conditions for the touch enhancement function, it instructs SurfaceFlinger to turn on the high-frequency TE.
[0097] For example, the touch module receives the first message sent by the game manager, obtains the package name of the game application, and obtains the configuration file of the application. The configuration file includes the frame rate of the game application, the usage status of the first composition strategy of the application, and the refresh rate supported by the electronic device.
[0098] The touch module can detect whether the usage status of the first composition strategy of the game application is "true" and obtain the first detection result. If the usage status of the first composition strategy is "false", the process ends.
[0099] The touch module detects whether the game application belongs to the applications in the first preset list to obtain the second detection result. The touch module detects whether the frame rate of the game application is the first preset frame rate (such as 60FPS, 90FPS) to obtain the third detection result.
[0100] The touch module detects whether the display screen supports the variable refresh rate state to obtain the fourth detection result. For example, the touch module obtains the refresh rate mode supported by the electronic device. For example, when the touch module detects that the VRR information is "0", it is determined that the display screen is in the mode that does not support the variable refresh rate. When the touch module detects that the VRR information is "1", this information indicates that the display screen supports the preset refresh rate mode, so it is determined that the display screen does not support the variable refresh rate mode, and the preset refresh rate is 120Hz; when the touch module detects that the VRR information is "2", it is determined that the display screen supports the variable refresh rate mode, that is, the refresh rate of the display screen can be adjusted between 1Hz and 360Hz.
[0101] When the touch module determines that the first detection result indicates that the game application adopts the first composition strategy, the second detection result indicates that the game application belongs to the applications in the first preset list, the third detection result indicates that the frame rate of the game application is the first preset frame rate, and the fourth detection result indicates that the display screen supports the variable refresh rate state (which can be understood as the variable refresh rate mode), it is determined to enable the touch enhancement function.
[0102] When the first detection result indicates that the game application does not adopt the first composition strategy, or the second detection result indicates that the game application does not belong to the applications in the first preset list, or the third detection result indicates that the frame rate of the game application is not the first preset frame rate, or the fourth detection result indicates that the display screen does not support the variable refresh rate state, the process ends.
[0103] Step 703: The touch module instructs SurfaceFlinger to turn on the high-frequency TE.
[0104] The touch module determines to enable the touch enhancement function for the application and can send a touch enhancement start indication to SurfaceFlinger. The indication information may include a target refresh rate (i.e., the second refresh rate). For example, the target refresh rate is 360 Hz.
[0105] Step 704: SurfaceFlinger instructs the display screen to adjust the refresh rate in the game application.
[0106] SurfaceFlinger sets the target refresh rate state of the display screen to the variable refresh rate state and sends a second indication information to the display screen. The second indication information includes the status information that the display screen is in the variable refresh rate state, and the second indication information may also include the frame rate of the game application.
[0107] Step 705: The display screen refreshes the page according to the set TE signal.
[0108] After receiving the start instruction, the display screen adjusts the generation period of the TE signal and determines the effective time of the new period according to the target refresh rate.
[0109] Specifically, the display screen obtains the target refresh rate to be adjusted, determines the interval between each TE signal according to the target refresh rate, and uses the interval between each TE signal as the target interval. For example, if the target refresh rate is 360 Hz, then the target interval = 1 / 360 * (1000) = 2.7 ms. When the display screen is at the original refresh rate, after detecting the i-th Vsync signal, it displays the image sent by SurfaceFlinger. The display screen can obtain the first duration (i.e., the first difference) between the moment when the display screen receives the sent image and the start moment of displaying the image. i is an integer greater than 0. If the display screen detects that the first duration is greater than the target interval, the display screen obtains the moment when the next vertical synchronization signal is detected, and uses the moment 2.7 ms (i.e., the duration of the target interval) before that moment as the effective time. The display screen appends a frame of TE signal at the effective time so that the display screen can display the next frame of image in advance. Among them, the period of the Vsync signal is 1 / 120 * (1000) = 8.3 ms; the period of the TE signal is 1 / 360 * (1000) = 2.7 ms.
[0110] If the display screen detects that the first duration is less than the target interval (such as 2.7 ms), it is determined that no TE signal is appended before the next Vsync signal. The display screen continues to detect whether there is a situation that meets the effective condition until the touch enhancement function is turned off.
[0111] It should be noted that in this example, the display screen does not change the original refresh rate, and appends TE signals within the Vsync period when detecting that the effective condition is met.
[0112] For example, as shown in 9a in Figure 9 , the time for the GPU to render an image is short, and the time for SurfaceFlinger to synthesize an image is short, so that the frame sending speed of SurfaceFlinger is fast. Taking the original refresh rate of the electronic device as 120Hz as an example, assume that the variable refresh rate to be adjusted is 360Hz. After the display screen receives the start instruction, it obtains the first duration t1 between the moment when the 4th Vsync signal is detected and the moment when the image to be displayed is received. When the display screen detects that t1 is greater than 2.7ms, it can be determined that a TE signal is added at the moment of 2.7ms before the 6th Vsync signal, that is, a TE signal is added at moment a. After the display screen receives this signal, it confirms that the system has synthesized the 3rd frame of image, and the display screen starts to display the 3rd frame of image from moment a.
[0113] In another example, when the display screen detects a Vsync signal, it does not receive the image sent by SurfaceFlinger. The display screen can add a TE signal after 2.7ms after the current Vsync signal becomes effective, and multiple TE signals can be added within this Vsync cycle. For example, as shown in 9b in Figure 9 , when the display screen detects the 4th Vsync signal, it does not receive the image data of the 2nd frame. The variable refresh rate is 360Hz, and the original target refresh rate of the display screen is 120Hz. Multiple TE signals are added within each Vsync cycle, such as adding 1, 2, etc., until the display screen can display the image sent by SurfaceFlinger. As shown in 9b in Figure 9 , the display screen can add a TE signal at moment b, or add a TE signal at both moment b and moment c, where the time difference between moment b and moment c is 2.7ms. Among them, the time interval between moment b and the moment of the 4th Vsync signal is 2.7ms.
[0114] If the display screen does not detect a situation that meets the condition for adding a TE signal, it can not add a TE signal.
[0115] In this example, after the display screen detects that the effective condition is met, it adds a TE signal to improve the followability.
[0116] From Figure 9 the flowchart of the electronic device displaying an image, it can be seen that in the case where the application adopts the first synthesis strategy, after the touch enhancement function is enabled, whether the frame sending is fast or slow, the display duration of each frame of image is balanced, thereby reducing the page jitter and increasing the followability of the application.
[0117] Figure 10Schematic diagram of the game application with enhanced touch enabled for exemplary illustration.
[0118] As Figure 10 shown at 10a in [reference], after the game application enables enhanced touch, the user presses at point A on the interface 1001 and moves the finger in the direction of the black arrow. When the user's finger moves to point B, the game character also moves to point B. The game character follows the finger movement, and the delay in the movement of the game character is reduced.
[0119] In one embodiment, when the game steward receives an operation to turn off the enhanced touch function, it sends a turn-off instruction to the touch module. The touch module adjusts the refresh rate of the electronic device to the default refresh rate according to the turn-off instruction. The following combines Figure 11 to specifically illustrate the process of turning off the enhanced touch function.
[0120] Step 1101: The game steward responds to the user's operation to turn off the enhanced function and sends a second message to the touch module.
[0121] The user inputs an operation to turn off the enhanced touch function on the interface of the game steward, which can send a second message to the touch module. The second message can include an instruction to request turning off the enhanced touch function and the package name of the current game application.
[0122] Step 1102: The touch module determines whether the condition for enabling high-frequency TE is met. When the touch module determines that the condition for enabling high-frequency TE is met, step 1103 can be executed.
[0123] After receiving the second message sent by the game steward, the touch module detects whether the game application meets the condition for enabling the enhanced touch function. The process of the touch module detecting whether the game application meets the condition for enabling the enhanced touch function can refer to the relevant description in step 702 and will not be elaborated here.
[0124] When the touch module detects that the game application meets the condition for enabling the enhanced touch function, step 1103 can be executed.
[0125] Step 1103: The touch module instructs SurfaceFlinger to turn off high-frequency TE.
[0126] The touch module can send a turn-off indication message for turning off high-frequency TE to SurfaceFlinger. The turn-off indication message can include the default refresh rate, such as the default refresh rate is 120Hz.
[0127] Step 1104: SurfaceFlinger instructs the display screen to turn off high-frequency TE.
[0128] Specifically, SurfaceFlinger sends a shutdown indication message to the display screen. After receiving this shutdown indication message, the display screen adjusts the screen refresh rate to the default refresh rate.
[0129] Step 1105: The display screen refreshes the page at the default refresh rate.
[0130] In another embodiment, after receiving an indication to turn off the touch enhancement function, the touch module can directly instruct SurfaceFlinger to turn off the high-frequency TE without detecting whether the game application meets the conditions for enabling the touch enhancement function. The process of turning off the touch enhancement function is as Figure 12 shown.
[0131] Step 1201: In response to the user's operation of turning off the enhancement function, the game manager sends a second message to the touch module.
[0132] This step can refer to the relevant description in Step 1101 and will not be elaborated here.
[0133] Step 1202: The touch module instructs SurfaceFlinger to turn off the high-frequency TE.
[0134] The touch module can send a shutdown indication message to turn off the high-frequency TE to SurfaceFlinger. This shutdown indication message can include the second message, which is used to indicate that the display screen is in a fixed refresh rate mode, such as a fixed refresh rate of 120 Hz.
[0135] Step 1203: SurfaceFlinger instructs the display screen to turn off the high-frequency TE.
[0136] Specifically, SurfaceFlinger sends a shutdown indication message to the display screen. After receiving this shutdown indication message, the display screen no longer appends the TE signal within the original Vsync period.
[0137] Step 1204: The display screen refreshes the page at the default refresh rate.
[0138] In this application, the response touch operation times of two different game applications in the case of adopting the first synthesis strategy when the touch enhancement function is enabled and disabled are compared. In the following 4 tables, Tables 1 and 2 are for the same application. The frame rate of the game application in Table 1 is 60 FPS, and the frame rate of the game application in Table 2 is 90 FPS; Tables 1 and 2 are for the same application. The frame rate of the game application in Table 3 is 60 FPS, and the frame rate of the game application in Table 4 is 90 FPS. From the data in the 4 tables, it can be seen that after the touch enhancement function is enabled, the followability of the application has been significantly improved.
[0139] Table 1
[0140] Game Application 1 (60FPS) Touch Enhancement Off (unit: ms) Touch Enhancement On (unit: ms) Two-finger Tap 73.6 53.9 Character Movement 159.7 131.9 Skill Back-and-forth Movement 100.8 65 Average Value 111.4 83.6
[0141] Table 2
[0142] Game Application 1 (90FPS) Touch Enhancement Off (unit: ms) Touch Enhancement On (unit: ms) Two-finger Tap 78.9 46.7 Character Movement 156.9 125.3 Skill Back-and-forth Movement 108.3 62.2 Average Value 114.7 78.1
[0143] Table 3
[0144] Game Application 2 (60FPS) Touch Enhancement Off (unit: ms) Touch Enhancement On (unit: ms) Two-finger Tap 79.7 69.4 Character Movement 137.2 123 Skill Back-and-forth Movement 85 72.2 Average Value 100.6 88.2
[0145] Table 4
[0146] Game Application 2 (90FPS) Touch Enhancement Off (unit: ms) Touch Enhancement On (unit: ms) Two-finger Tap 71.9 55.8 Character Movement 119.7 93.9 Skill Back-and-forth Movement 80.8 64.2 Average Value 90.8 71.3
[0147] It can be understood that, in order to implement the above functions, the electronic device includes the corresponding hardware and / or software modules for executing each function. Combining the algorithm steps of each example described in the embodiments disclosed in this article, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the manner of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to exceed the scope of the present application.
[0148] The embodiment of the present application also provides a chip system, which includes at least one processor and at least one interface circuit. The processor and the interface circuit can be interconnected through a line. For example, the interface circuit can be used to receive signals from other devices (such as the memory of an electronic device). For another example, the interface circuit can be used to send signals to other devices (such as the processor). Exemplarily, the interface circuit can read the instructions stored in the memory and send the instructions to the processor. When the instructions are executed by the processor, the electronic device can execute each step in the above embodiments. Of course, the chip system can also include other discrete devices, and the embodiments of the present application do not make specific limitations on this.
[0149] The present embodiment also provides a computer storage medium, in which computer instructions are stored. When the computer instructions run on an electronic device, the electronic device executes the above-related method steps to implement the method for image display in the above embodiments. The storage medium includes: various media that can store program codes such as USB flash drives, mobile hard disks, read only memory (ROM), random access memory (RAM), magnetic disks, or optical discs.
[0150] This embodiment also provides a computer program product. When the computer program product runs on a computer, the computer is caused to execute the above-mentioned related steps to implement the method for image display in the above embodiment.
[0151] Among them, the electronic device, computer storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding method for image display provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be elaborated here.
[0152] Any content of each embodiment of this application, as well as any content of the same embodiment, can be freely combined. Any combination of the above content is within the scope of this application.
[0153] The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Under the inspiration of the present application, those of ordinary skill in the art can also make many forms without departing from the purpose of the present application and the scope protected by the claims, and all belong to the protection scope of the present application.
Claims
1. An image display method, characterized in that, Applied to an electronic device, including: Present an interface of a first application; The first application performs rendering processing on an image within a first Vsync period to obtain a first image frame, where the first Vsync period is a Vsync signal period between a first Vsync signal and a second Vsync signal; An image synthesizer obtains the first image frame within the first Vsync period and performs synthesis processing on the first image frame within the first Vsync period to obtain a first synthesized image frame; A display screen displays the first synthesized image frame in a second Vsync period, where the second Vsync period is a Vsync signal period between the second Vsync signal and a third Vsync signal; The first application performs rendering processing on an image within the third Vsync period to obtain a second image frame, where the third Vsync period is a Vsync signal period between the third Vsync signal and a fourth Vsync signal; The image synthesizer obtains the second image frame within the third Vsync period and performs synthesis processing on the second image frame within the third Vsync period and a fourth Vsync period to obtain a second synthesized image frame, where the fourth Vsync period is a Vsync signal period between the fourth Vsync signal and a fifth Vsync signal, and the moment when the image synthesizer completes the synthesis processing of the second image frame is the first moment; The display screen displays the first synthesized image frame in the third Vsync period; The display screen displays the first synthesized image frame before a second moment within the fourth Vsync period, where the second moment is after the first moment or the second moment is the same as the first moment; The display screen displays the second synthesized image frame after the second moment within the fourth Vsync period; The display screen displays the second synthesized image frame in the fifth Vsync period; The first application performs rendering processing on an image within the fifth Vsync period to obtain a third image frame, where the fifth Vsync period is a Vsync signal period between a fifth Vsync signal and a sixth Vsync signal; The image synthesizer obtains the third image frame within the fifth Vsync period and performs synthesis processing on the third image frame within the fifth Vsync period to obtain a third synthesized image frame; The display screen displays the third synthesized image frame in the sixth Vsync period, where each of the first Vsync period to the sixth Vsync period corresponds to a first refresh rate.
2. The method according to claim 1, characterized in that, The display screen displays the second synthesized image frame after the second moment within the fourth Vsync period, including: The display screen displays the second synthesized image frame after the second moment within the fourth Vsync period according to a first tearing effect TE signal set at the second moment.
3. The method according to claim 1, characterized in that, A plurality of TE signals are set after the moment when the fourth Vsync signal is generated. The time interval between any two adjacent TE signals among the plurality of TE signals is the same as the reciprocal of the second refresh rate, and the second refresh rate is greater than the first refresh rate. The first TE signal is the first TE signal among the plurality of TE signals that is located at or after the first moment.
4. The method according to claim 3, wherein Before a plurality of TE signals are set after the moment when the fourth Vsync signal is generated, the method further includes: When the display screen adopts a variable refresh mode, the display screen detects whether it receives the second image frame sent by the image synthesizer at the moment when the fourth Vsync signal is generated; When the display screen determines that it does not receive the second image frame sent by the image synthesizer at the moment when the fourth Vsync signal is generated, it determines to set a plurality of TE signals after the moment when the fourth Vsync signal is generated.
5. The method according to claim 4, wherein The electronic device is installed with a second application, and the start control of the second application is displayed on the interface of the first application; the method further includes In response to a click operation of the user on the start control, the first application allows the display screen to display the interface of the second application; In response to an adjustment opening operation input by the user on the interface of the second application, the second application sends a first adjustment instruction to the touch control module of the electronic device; The touch control module responds to the first adjustment instruction and determines whether the first application meets a preset adjustment condition; When the touch control module determines that the first application meets the adjustment condition, it instructs the display screen to adopt a variable refresh rate mode through the image synthesizer.
6. The method according to claim 5, wherein When the touch control module determines that the first application meets the adjustment condition and instructs the display screen to adopt a variable refresh rate mode through the image synthesizer, it includes: The touch control module sends first indication information to the image synthesizer; The image synthesizer responds to the first indication information and sets the refresh mode of the display screen to a variable refresh mode; The image synthesizer sends second indication information to the display screen, and the second indication information includes information that the target refresh mode of the display screen is a variable refresh mode; The display screen sets the variable refresh frequency in the variable refresh rate mode to the second refresh rate according to the second indication information.
7. The method according to claim 5, characterized in that, When the touch control module responds to the first adjustment instruction and determines whether the first application meets a preset adjustment condition, it includes: The touch control module detects whether the first application adopts a first synthesis strategy to obtain a first detection result. The first synthesis strategy is that when the image synthesizer of the electronic device receives an image frame rendered by the current application, it performs system synthesis processing on the rendered image frame; The touch control module detects whether the first application belongs to an application in a first preset list to obtain a second detection result; The touch control module detects whether the frame rate of the first application is a first preset frame rate to obtain a third detection result; The touch module detects whether the electronic device supports adjusting the refresh mode of the display screen to a variable refresh mode, and obtains a fourth detection result; The touch module obtains a fifth detection result according to the first detection result, the second detection result, the third detection result, and the fourth detection result, and the fifth detection result is used to indicate whether the first application meets the adjustment condition.
8. The method according to claim 7, wherein The touch module obtains a fifth detection result according to the first detection result, the second detection result, the third detection result, and the fourth detection result, including: When the first detection result indicates that the first application adopts the first synthesis strategy, the second detection result indicates that the first application belongs to the applications in the first preset list, the third detection result indicates that the frame rate of the first application is the first preset frame rate, and the fourth detection result indicates that the electronic device supports adjusting the refresh mode of the display screen to a variable refresh mode, the touch module determines that the fifth detection result indicates that the first application meets the adjustment condition.
9. The method according to any one of claims 1-8, characterized in that, The electronic device is installed with a second application, and a start control of the second application is displayed on the interface of the first application; the method further includes: In response to a click operation of the user on the start control, the first application allows the display screen to display the interface of the second application; In response to an adjustment close operation input by the user on the interface of the second application, the second application sends a second adjustment instruction to the touch module of the electronic device; The touch module determines whether the first application meets a preset adjustment condition in response to the second adjustment instruction; When the touch module detects that the first application meets the adjustment condition, the touch module instructs the display screen to adjust the refresh rate of the first application to the first refresh rate through the image synthesizer.
10. The method according to any one of claims 1-8, characterized in that, The electronic device is installed with a second application, and a start control of the second application is displayed on the interface of the first application; the method further includes: In response to a click operation of the user on the start control, the first application allows the display screen to display the interface of the second application; In response to an adjustment close operation input by the user on the interface of the second application, the second application sends a second adjustment instruction to the touch module of the electronic device; The touch module instructs the display screen to adjust the refresh rate of the first application to the first refresh rate through the image synthesizer in response to the second adjustment instruction.
11. The method according to claim 1, characterized in that The display screen is a low-temperature polycrystalline oxide LTPO screen.
12. An electronic device, characterized in that, Including: A memory and a processor, the memory is coupled with the processor; The memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the method for image display according to any one of claims 1 to 11.
13. A computer-readable storage medium, comprising a computer program, characterized in that, When the computer program runs on the electronic device, the electronic device executes the method for image display according to any one of claims 1 to 11.