Display control method and device, electronic equipment and storage medium

Abstract

The invention discloses a display control method and device, electronic equipment and a storage medium, and belongs to the technical field of electronics. The method comprises the steps that under the condition that the electronic equipment generates a first interface image of a first application, the display time interval of the first interface image and a second interface image is determined according to the frame rate corresponding to the first interface image, and the second interface image is in an interface image sequence of the first application; and determining a screen refreshing delay according to the display time interval and the refreshing rate of the screen on an interface image which is displayed before the first interface image and is adjacent to the first interface image, determining a target screen refreshing moment based on the screen refreshing delay, and controlling the screen to be refreshed at the target screen refreshing moment so as to display the first interface image.

Description

Technical Field

[0001] The present application belongs to the field of electronic technology, and specifically relates to a display control method, device, electronic device and storage medium. Background Art

[0002] With the rapid development of electronic device technology, display application scenarios (such as cameras / videos / games, etc.) in electronic devices are becoming more and more abundant. Currently, when displaying an image, the electronic device displays the image according to the frame rate corresponding to the image.

[0003] In the related art, electronic devices synchronize the frame rate and refresh rate according to the Vsync (Vertical Synchronization) signal. Specifically, when the electronic device receives the current Vsync signal, it triggers the synthesis and display of one frame of the image, and after receiving the next Vsync signal, it triggers the synthesis and display of the next frame of the image. Under normal circumstances, when the synthesis and display of the image are controlled by the Vsync signal, due to the influence of software technology (frame repetition technology, buffer management, and frame rate conversion algorithm, etc.), the actual displayed frame rate is a value between the frame rate and the refresh rate, resulting in a mismatch between the actual frame rate and the expected frame rate corresponding to the image, which causes a freeze when displaying the image, and then causes the electronic device to have a low smoothness when displaying the picture. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a display control method, device, electronic device and storage medium, which can avoid the problem of mismatch between the actual frame rate and the expected frame rate corresponding to the image, thereby improving the smoothness of displaying the picture, and increasing the frame rate of the picture display to maintain stability and smoothness and enable timely display.

[0005] In a first aspect, an embodiment of the present application provides a display control method, which includes: when generating a first interface image of a first application, determining a display time interval between the first interface image and a second interface image according to a frame rate corresponding to the first interface image, the second interface image being an interface image displayed before the first interface image and adjacent to the first interface image in the interface image sequence of the first application; determining a screen refresh delay according to the display time interval and the screen refresh rate; determining a target screen refresh time based on the screen refresh delay, and controlling the screen refresh at the target screen refresh time to display the first interface image.

[0006] In the second aspect, an embodiment of the present application provides a display control device, which includes: a determination module and a processing module, wherein: the above-mentioned determination module is used to determine the display time interval between the first interface image and the second interface image according to the frame rate corresponding to the first interface image when generating a first interface image of a first application, and the second interface image is an interface image displayed before the first interface image in the interface image sequence of the first application and is adjacent to the first interface image; the above-mentioned determination module is also used to determine the screen refresh delay according to the display time interval and the screen refresh rate; the above-mentioned processing module is used to determine the target screen refresh time based on the screen refresh delay, and control the screen refresh at the target screen refresh time to display the first interface image.

[0007] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0008] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0009] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0010] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0011] In an embodiment of the present application, when generating a first interface image of a first application, the electronic device can determine the display time interval between the first interface image and the second interface image according to the frame rate corresponding to the first interface image, the second interface image being an interface image displayed before the first interface image and adjacent to the first interface image in the interface image sequence of the first application, the electronic device determines the screen refresh delay based on the display time interval and the screen refresh rate; and determines the target screen refresh time based on the screen refresh delay, and controls the screen refresh at the target screen refresh time to display the first interface image. In this solution, since the screen refresh delay is determined according to the expected frame rate corresponding to the first interface image and the screen refresh rate, the electronic device controls the screen refresh based on the screen refresh delay, which can make the actual frame rate of the interface image consistent with the expected frame rate corresponding to the image, so that the screen refresh is synchronized with the switching of the interface image, so that by making full use of the screen refresh rate and combining the screen refresh delay to control the screen refresh, the problem of mismatch between the actual frame rate and the expected frame rate corresponding to the image caused by the traditional control of the screen refresh through the vertical synchronization signal is avoided, thereby improving the smoothness of the display screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 is one of the flow charts of the display control method provided by some embodiments of the present application;

[0013] Figure 2 is one of the schematic diagrams of the actual frame rate and the expected frame rate of the display control method provided by some embodiments of the present application;

[0014] Figure 3 It is a schematic diagram of the process of drawing, synthesizing and displaying the interface image provided by some embodiments of the present application;

[0015] Figure 4 This is the second flow chart of the display control method provided by some embodiments of the present application;

[0016] Figure 5 This is a second schematic diagram of an actual frame rate and an expected frame rate of a display control method provided in some embodiments of the present application;

[0017] Figure 6 This is the third flow chart of the display control method provided by some embodiments of the present application;

[0018] Figure 7 3 is a schematic diagram of an actual frame rate and an expected frame rate of a display control method provided in some embodiments of the present application;

[0019] Figure 8 This is a fourth flow chart of a display control method provided by some embodiments of the present application;

[0020] Fig. 9 is a fifth flow chart of a display control method provided by some embodiments of the present application;

[0021] Fig.10 This is the sixth flow chart of the display control method provided by some embodiments of the present application;

[0022] Fig.11 is a schematic diagram of the structure of a display control device provided in some embodiments of the present application;

[0023] Fig.12 is a schematic diagram of the structure of an electronic device provided by some embodiments of the present application;

[0024] Fig.13 It is a schematic diagram of the hardware structure of an electronic device provided in some embodiments of the present application. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0026] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0027] The terms "at least one (item)", "at least one of" and the like in the specification and claims of the present application refer to any one, any two or a combination of more than two of the objects included therein. For example, at least one (item) of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", where a, b, and c can be single or multiple. Similarly, "at least two (items)" refers to two or more, and its meaning is similar to that of "at least one (item)".

[0028] With the rapid development of electronic equipment technology, the display application scenarios in electronic equipment (such as cameras / videos / games, etc.) are becoming more and more abundant. At present, traditional screens need to set refresh rates such as 120Hz, 60Hz, etc. The system performs frame synchronization according to the vertical synchronization (Vertical Synchronization, Vsync) frequency. The Vsync frequency is consistent with the screen refresh rate. Among them, Vsync is a technology in computer image processing, which is used to synchronize the work of display hardware and GPU to ensure smooth image display; when the image is updated, it is necessary to wait for the next Vsync signal to trigger the update. If the image is not updated, the screen will repeatedly refresh the data of the previous frame. Therefore, the supportable upper screen frame rate is a frequency that can be divided by the Vsync frequency. The upper screen frame rate is the actual display frequency on the screen when the frame picture is updated. For example, if the Vsync frequency is 60Hz, then the supported upper screen frequency is 60 / N (N is an integer greater than 1), that is, the Vsync frequency is 60Hz / 30Hz / 20Hz, etc.

[0029] However, in the traditional method, it is usually executed synchronously according to the signal of a specific frequency. Since different frames have different waiting times for the Vsync signal, it is easy for the actual frame rate to not match the expected frame rate corresponding to the image, resulting in the problem of long and short frames, thereby reducing the smoothness of the display. For example, when the screen refresh rate is 60Hz and a 24-frame / second video is played, the Vsync frequency is consistent with the screen refresh rate of 60Hz, the application frame rate, that is, the video frame rate, is 24 frames / second, and the screen frame rate is 20Hz (3 refresh frames) or 30Hz (2 refresh frames); since the image needs to wait until the next Vsync signal to trigger the synthesis and screen update, if no signal appears, the previous frame data is repeated; and different frames have different waiting times for the Vsync signal, resulting in different intervals between image frames when they are on the screen, that is, the actual frame rate is inconsistent with the expected frame rate corresponding to the image, so that the frame synchronization affects the display speed, resulting in reduced display smoothness.

[0030] The display control method provided by the present application determines the display time interval between the first interface image and the second interface image according to the frame rate corresponding to the first interface image when generating the first interface image of the first application, wherein the second interface image is the previous adjacent interface image of the first interface image; then determines the screen refresh delay according to the display time interval and the refresh rate of the screen; thereby controlling the screen refresh according to the screen refresh delay to display the first interface image. Therefore, the present application makes full use of the refresh rate gear supported by the screen, allowing the system to specify the time for each frame to be displayed on the screen, and controls the screen adaptive refresh rate accordingly, optimizing the problem of mismatch between the actual frame rate and the expected frame rate corresponding to the image, so that the display refresh rate is consistent with the application frame rate of scenes such as video or shooting, thereby improving the display smoothness; at the same time, there is no need to wait for the synchronization of the signal of a specific frequency, so that the display drawing, synthesis and displaying can be executed continuously, optimizing the synchronization time, and improving the response speed from drawing to displaying on the screen.

[0031] It should be noted that the display control method provided in the embodiments of the present application can be executed by electronic devices such as mobile phones, tablet computers, laptop computers, PDAs, and vehicle-mounted electronic devices. In some embodiments of the present application, the display control method provided in the embodiments of the present application is described by taking the electronic device as the execution subject to execute the display control method.

[0032] The display control method provided in the embodiment of the present application is described in detail below through specific embodiments and application scenarios in conjunction with the accompanying drawings.

[0033] The present application embodiment provides a display control method, such as Figure 1 As shown, the display control method includes the following steps 301 to 303:

[0034] Step 301: When generating a first interface image of a first application, the electronic device determines a display time interval between the first interface image and the second interface image according to a frame rate corresponding to the first interface image.

[0035] In some embodiments of the present application, the above-mentioned first application may correspond to a type of application scenario. Exemplarily, the application scenario includes but is not limited to one of the following: a camera scene, a video scene, and a game scene.

[0036] In some embodiments of the present application, the user enters the application scenario by clicking on the first application.

[0037] In some embodiments of the present application, the application type of the at least one application includes but is not limited to any of the following: multimedia application, instant messaging application, game application, office application, etc.

[0038] In some embodiments of the present application, the first application is an application in a preset application set, the preset application set includes at least one application, and different applications correspond to different frame rates.

[0039] Exemplarily, the frame rates include 24 frames / second, 25 frames / second, 30 frames / second, 50 frames / second, and the like.

[0040] It should be noted that the film industry generally uses 24 frames per second, the television broadcast standard often uses 25 frames per second, 30 frames per second is a widely used frame rate, suitable for a variety of games or videos, and 50 frames per second is suitable for high-demand video shooting or games.

[0041] In this way, by setting the corresponding frame rate for each application according to the specific scenarios and needs of each application, the application's screen can present a better display effect. For example, for applications that require high-dynamic images (such as games, live sports events), a high frame rate (such as 60fps or higher) is used to significantly improve the smoothness of the picture, reduce blur and tearing, and thus enhance the user's viewing experience. For another example, when a user watches a movie or documentary through a video playback application, a standard frame rate (such as 24fps) is used to create a more realistic movie feel.

[0042] In some embodiments of the present application, at least one application included in the preset application set may be an application preset by the system, or an application selected by the user.

[0043] In some embodiments of the present application, one application in the preset application set may correspond to one frame rate. Further, the frame rate of each application is determined by the electronic device based on the actual display requirements of the application, or is user-defined, or is determined by the application.

[0044] Exemplarily, taking the preset application set including instant messaging APP, multimedia playback APP and office APP as an example, the frame rate corresponding to the instant messaging APP can be 30 frames / second to 60 frames / second, the frame rate corresponding to the multimedia playback APP can be 60 frames / second, 120 frames / second and 240 frames / second, and the frame rate corresponding to the office APP can be 30 frames / second to 60 frames / second.

[0045] In this way, by setting an application set and setting the frame rates for the applications in the application set respectively, one application can correspond to one frame rate. The present application can make full use of the screen refresh rate of the corresponding application for different applications, and control the screen refresh in combination with the screen refresh delay, thereby avoiding the limitations of the display control method when different applications appear, thereby improving the smoothness of the display screens of different applications.

[0046] In some embodiments of the present application, the first interface image may be any interface image in the first application.

[0047] In some embodiments of the present application, the first interface image may be composed of at least one interface image element.

[0048] In some embodiments of the present application, the second interface image is an interface image in the interface image sequence of the first application, which is displayed before the first interface image and is adjacent to the first interface image.

[0049] It should be noted that the application's user interface image refers to the visual interface that the application presents to the user. It is usually a complete view composed of various graphics, texts, controls and other interface elements. The interface image is the interface that the user directly interacts with when operating the application, and it displays the application's functions, status and information.

[0050] In some embodiments of the present application, after the electronic device starts the first application and enters the application scenario of the first application, it switches to a refresh-and-display mode. In this mode, the display system and the screen do not need to display according to the trigger of the Vsync signal, but instead display the interface image according to the frame rate of the interface image and the refresh rate of the screen.

[0051] It should be noted that the refresh-and-display mode refers to a mode that does not rely on the Vsync signal to display images. The refresh-and-display mode can also be called an adaptive refresh rate mode.

[0052] In some embodiments of the present application, the electronic device can determine the frame rate corresponding to the first interface image, and when generating the first interface image of the first application, calculate the display time interval between the first interface image and the previous frame interface image (i.e., the second interface image) based on the frame rate.

[0053] It can be understood that the display time interval can be the display duration of the second interface image.

[0054] Exemplarily, assuming that the frame rate corresponding to the first interface image determined by the electronic device is 120 frames per second, when generating the first interface image of the first application, the display time interval between the first interface image and the previous frame interface image based on the frame rate corresponding to the first interface image is 1 / 120ms, which is approximately 8.33ms, that is, the display time interval between the first interface image and the previous frame interface image is approximately 8.33ms.

[0055] For example, taking the first application as a video application, the interface image A of the video application is the rising sun on the lake, and the previous frame interface image B of the interface image A of the video application is the lake surface. Assuming that the frame rate corresponding to the interface image A is 120 frames / second, based on the frame rate corresponding to the interface image A, the display time interval between the interface image A and the previous frame interface image B is 1 / 120ms, which is approximately 8.33ms.

[0056] In some embodiments of the present application, the above-mentioned display time interval may be determined according to the display time of the first interface image and the second interface image.

[0057] In some embodiments of the present application, the electronic device may determine the frame rate corresponding to the interface image of the first application according to the display requirements of the application scenario corresponding to the first application, and obtain the display time of the corresponding interface image based on the frame rate corresponding to the interface image.

[0058] In some embodiments of the present application, the above-mentioned display time is the display time corresponding to the first interface image, and the display time can be determined according to the frame rate corresponding to the first interface image, wherein the frame rate can be determined according to the application scenario of the first application.

[0059] Exemplarily, taking the first application as a camera application, when the electronic device generates an interface image of the camera application, it obtains the display time of the interface image based on the frame rate information corresponding to the interface image. Assuming that the frame rate corresponding to the interface image of the camera application is 50 frames / second, according to calculation, the display time is 1 / 50ms, or about 20ms.

[0060] Exemplarily, taking the first application as a video application, when the electronic device generates an interface image of the video application, it obtains the relevant display time based on the frame rate information corresponding to the interface image. Assuming that the frame rate corresponding to the interface image of the video application is 60 frames / second, according to calculation, the relevant display time is 1 / 60ms, which is approximately 16.67ms.

[0061] Exemplarily, taking the first application as a game application, when the electronic device generates an interface image of the game application, it obtains the relevant display time based on the frame rate information corresponding to the interface image. Assuming that the frame rate corresponding to the interface image of the game application is 120 frames / second, according to calculation, the display time is 1 / 120ms, which is approximately 8.33ms.

[0062] In some embodiments of the present application, the above-mentioned display time may be a timestamp, that is, the relevant display time obtained by using the frame rate corresponding to the first interface image, wherein the frame rate may be determined according to the application scenario of the first application.

[0063] Exemplarily, the system service of the electronic device sets the timestamp that the corresponding layer is expected to display according to the requirements of the corresponding scene. For example, in a camera scene, the camera service configures the preview layer timestamp according to exposure, etc., and in a video scene, the decoding service configures the video layer timestamp according to the bitstream, etc.

[0064] It should be noted that the timestamp at which the corresponding layer is expected to be displayed is a point in time when the corresponding layer should be displayed or rendered on the screen. This point in time is the timestamp at which the corresponding layer is expected to be displayed. By controlling the timestamp of the layer, the layer can be displayed at the expected frame rate.

[0065] In some embodiments of the present application, the electronic device saves the display time interval between the first interface image and the second interface image in the frame rate information, and transmits it to the display driver by saving the display time interval between the first interface image and the second interface image in the frame rate information, wherein the display time interval between the first interface image and the second interface image remains unchanged during the transmission process.

[0066] In this way, by saving the display time interval between the first interface image and the second interface image in the frame rate information, and then passing the display time interval to the display driver through the frame rate information, since the display time interval can remain unchanged during the process of transmission to the display driver, the accuracy and completeness of the display time interval information during the transmission process are effectively improved.

[0067] Step 302: The electronic device determines a screen refresh delay according to a display time interval and a screen refresh rate.

[0068] In some embodiments of the present application, the screen of the electronic device may support one or more refresh rates, that is, the screen of the electronic device has one or more refresh rate gears.

[0069] In some embodiments of the present application, the refresh rate of the screen is one of a plurality of refresh rate levels supported by the screen.

[0070] In some embodiments of the present application, the electronic device may determine the refresh rate of the screen according to the technical specifications of the screen display or the needs of the user.

[0071] In some embodiments of the present application, the electronic device determines the screen refresh delay based on the display time interval and screen refresh rate obtained above by subtracting the time required for one refresh from the display time interval and the screen refresh rate.

[0072] Exemplarily, the screen refresh rate range of the electronic device may include 60 Hz to 75 Hz, 100 Hz to 165 Hz, and 240 Hz, etc.

[0073] It should be noted that 60Hz to 75Hz can be used in scenes with low requirements such as movies or TV series, 100Hz to 165Hz can be used in scenes such as competitive games or graphic design; around 240Hz can be used in scenes such as highly dynamic images that pursue extreme performance.

[0074] For example, assuming that the screen refresh rate is set to 60 Hz according to the technical specifications of the screen display and the needs of the user, the time required for one refresh of the screen is 1 / 60 ms, which is about 16.67 ms, meaning that it is refreshed every 16.67 ms.

[0075] It is understandable that the time corresponding to the refresh rate is the duration of a refresh using the refresh rate.

[0076] Exemplarily, in combination with the above example, assuming that the frame rate corresponding to the first interface image is 30 frames per second and the refresh rate of the screen is 60 Hz, the display time interval between the first interface image and the second interface image is approximately 33.33 ms, and the time required for a refresh corresponding to the screen refresh rate is approximately 16.67 ms. Therefore, the display time interval is subtracted from the time required for a refresh corresponding to the screen refresh rate to obtain a screen refresh delay of approximately 16.67 ms.

[0077] For example, taking the first application as a game application, interface image 1 of the game application is a screen of a character running, and interface image 2 is a screen of a character running and shooting. Assuming that the frame rate corresponding to interface image 1 is 30 frames per second and the refresh rate of the screen is 60 Hz, it can be obtained that the display time interval between interface image 1 and interface image 2 is approximately 33.33 ms, and the time required for a refresh corresponding to the screen refresh rate is approximately 16.67 ms. Therefore, the screen refresh delay is approximately 16.67 ms by subtracting the display time interval from the time required for a refresh corresponding to the screen refresh rate.

[0078] Step 303: The electronic device determines a target screen refresh time based on the screen refresh delay, and controls the screen refresh at the target screen refresh time to display the first interface image.

[0079] In some embodiments of the present application, the electronic device can determine the target screen refresh time according to the screen refresh delay through the display driver, and control the screen refresh at the target screen refresh time to display the first interface image.

[0080] In some embodiments of the present application, the screen refresh delay is a time that needs to be added due to the mismatch between the display time interval and the screen refresh rate, so that the display time interval matches the screen refresh rate, wherein the mismatch between the display time interval and the screen refresh rate refers to the mismatch between the actual frame rate and the expected frame rate corresponding to the image.

[0081] In some embodiments of the present application, the electronic device switches to the swipe-and-display mode by identifying and clicking on an application to enter an application scenario. In the swipe-and-display mode, the electronic device can determine the frame rate corresponding to the first interface image and the screen refresh rate according to the display requirements corresponding to the application scenario, and then obtain the display time interval between the first interface image and the second interface image based on the frame rate corresponding to the first interface image, and obtain the screen refresh delay in combination with the screen refresh rate. After the first interface image is generated and before the first interface image is displayed, the screen refresh delay is added to control the refresh of the screen and refresh the second interface image to the first interface image to display the first interface image.

[0082] For example, assuming that the screen refresh rate is 60Hz and a 24 frames / second video is played, the display time interval between the first interface image and the second interface image is 1 / 24ms, or approximately 41.66ms. The time required for a refresh corresponding to the screen refresh rate is 1 / 60ms, or approximately 16.67ms, which means that it is refreshed every 16.67ms. Therefore, the display time interval is subtracted from the time required for a refresh corresponding to the screen refresh rate to obtain a screen refresh delay of approximately 24.99ms. In order to match the display time interval with the screen refresh rate, a screen refresh delay of 24.99ms needs to be added to keep the picture display stable and smooth.

[0083] For example, taking the first application as a video application, the frame rate of the video being played by the video application is 24 frames per second, assuming that the screen refresh rate is 60Hz, the interface image A of the video application is a rainy lake surface, and the previous frame interface image B of the interface image A of the video application is the lake surface, then the display time interval between interface image A and interface image B is 1 / 24ms, which is approximately 41.66ms, and the time required for a refresh corresponding to the screen refresh rate is 1 / 60ms, which is approximately 16.67ms. By subtracting the display time interval from the time required for a refresh corresponding to the screen refresh rate, it can be obtained that the screen refresh delay is approximately 24.99ms. In order to match the display time interval with the screen refresh rate, a screen refresh delay of 24.99ms needs to be added to keep the picture display stable and smooth.

[0084] The display control method provided in the embodiment of the present application is described below with reference to the accompanying drawings.

[0085] like Figure 2As shown, assuming that the frame rate corresponding to the first application is 24fps, after the electronic device draws and synthesizes the Nth frame interface image of the first application, it determines the display time interval between the interface image and the previous frame interface image according to the frame rate corresponding to the interface image, and determines the screen refresh delay according to the display time interval and the screen refresh rate, and then controls the screen refresh according to the screen refresh delay to display the interface image, that is, performs screen display on the interface image, so that the actual screen frame rate of the image interface is 24fps, so that the actual screen frame rate of the image interface is consistent with the expected frame rate.

[0086] It should be noted that the above example only takes the Nth frame interface image as an example. The display process of the N+1th frame interface image and the N+2th frame interface image is consistent with the Nth frame interface image, which will not be repeated here.

[0087] In the related art, electronic devices synchronize the frame rate and refresh rate according to the Vsync signal. However, since the image needs to wait until the next Vsync signal to trigger synthesis and screen display when updating, and different frames have different waiting times for Vsync, the intervals between image frames when displaying on the screen will be different, resulting in inconsistency between the screen frame rate and the application frame rate. For example, when the screen refresh rate is 60hz, when playing a video with a frame rate of 24 frames per second, the actual playback frame rate of the video screen is 20hz or 30hz. At this time, if the next Vsync signal appears, the image synthesis and screen update will be triggered. If no signal appears, the previous frame data will be repeated. At the same time, the system needs to draw, synthesize, and send the display according to the specific frame synchronization signal Vsync signal cycle before the image can be updated on the screen. At present, the mismatch between the display time interval and the screen refresh rate often occurs in traditional display devices, resulting in long and short frames in the display device, which in turn causes the display device to have a reduced smoothness when displaying the screen.

[0088] In an embodiment of the present application, when generating a first interface image of a first application, the electronic device can determine the display time interval between the first interface image and the second interface image according to the frame rate corresponding to the first interface image, the second interface image being an interface image displayed before the first interface image and adjacent to the first interface image in the interface image sequence of the first application, the electronic device determines the screen refresh delay based on the display time interval and the screen refresh rate; and determines the target screen refresh time based on the screen refresh delay, and controls the screen refresh at the target screen refresh time to display the first interface image. In this solution, since the screen refresh delay is determined according to the expected frame rate corresponding to the first interface image and the screen refresh rate, the electronic device controls the screen refresh based on the screen refresh delay, which can make the actual frame rate of the interface image consistent with the expected frame rate corresponding to the image, so that the screen refresh is synchronized with the switching of the interface image, so that by making full use of the screen refresh rate and combining the screen refresh delay to control the screen refresh, the problem of mismatch between the actual frame rate and the expected frame rate corresponding to the image caused by the traditional control of the screen refresh through the vertical synchronization signal is avoided, thereby improving the smoothness of the display screen.

[0089] In some embodiments of the present application, the display framework in the electronic device controls the synthesis time point according to the frame rate, and continuously performs image synthesis and on-screen display at the corresponding time point, and no longer needs to wait for the Vsync cycle synchronization of a specific frequency and can be executed as soon as possible.

[0090] The display control method provided in the embodiment of the present application is described below with reference to the accompanying drawings.

[0091] like Figure 3 As shown, after the electronic device draws the Nth frame interface image of the first application according to the frame rate, it does not rely on a specific signal to trigger the synchronous drawing mechanism, but synthesizes at the corresponding time point. In the synthesis stage, the electronic device synthesizes the drawn interface image to generate a complete image to be displayed on the screen. This process is executed immediately after the drawing is completed, without waiting for the arrival of the next cycle signal; then, the synthesized image will be sent to the display driver for on-screen operation. The on-screen process is also carried out continuously and is no longer restricted by a fixed screen refresh rate or other synchronization signals. This means that the entire process from drawing to the final display of the image on the screen is accelerated, that is, the synchronization time is optimized, thereby improving the response speed from drawing to on-screen display.

[0092] In some embodiments of the present application, Figure 4 As shown, combined with the above Figure 1 , the above step 303 may include the following steps 303a and 303b:

[0093] Step 303a: The electronic device obtains a first screen refresh time corresponding to the first interface image.

[0094] Step 303b: The electronic device determines a target screen refresh time according to the first screen refresh time and the screen refresh delay corresponding to the first interface image.

[0095] In some embodiments of the present application, the first screen refresh time is the start display time corresponding to the first interface image.

[0096] In some embodiments of the present application, the first screen refresh time can be obtained according to a determined screen refresh rate.

[0097] It should be noted that the start display time is the display time calculated according to the refresh rate of the screen, rather than the start display time when the first interface image is actually displayed.

[0098] Exemplarily, assuming that the screen refresh time corresponding to the first interface image after starting the first application is T ms, assuming that the first interface image is the second interface image after starting the first application, and the screen refresh rate is 60Hz, then the duration of a refresh is 16.67ms, and the first screen refresh time corresponding to the second interface image is T+16.67ms.

[0099] In some embodiments of the present application, the electronic device can determine the first screen refresh time, and then obtain the screen refresh delay based on the display time interval and the first screen refresh time, and use the first screen refresh time and screen refresh delay corresponding to the first interface image to determine the screen refresh time corresponding to the first interface image (i.e., the target screen refresh time).

[0100] Exemplarily, assuming that the screen refresh rate is 60 Hz, the frame rate corresponding to the first interface image is 30 frames per second, assuming that the second interface image is the first frame interface image of the first application, and the first interface image is the second frame interface image of the first application, the display time interval between the first interface image and the second interface image is calculated to be 1 / 30 ms, which is approximately 33.33 ms, and the first screen refresh time corresponding to the first interface image is calculated to be 16.67 ms according to the screen refresh rate, and then the display time interval is subtracted from the first screen refresh time corresponding to the first interface image to obtain a screen refresh delay of approximately 16.67 ms (i.e. 33.33-16.67). Then, based on the first screen refresh time corresponding to the first interface image (i.e. 16.67 ms) and the screen refresh delay (16.67 ms), it can be determined that the target screen refresh time corresponding to the first interface image is 33.33 ms (i.e. 16.67+16.67). In this way, by calculating the expected time interval between the first interface image and the previous interface image of the first interface image, that is, the second interface image, according to the expected frame rate corresponding to the first interface image, and based on the time interval and the first screen refresh time of the first interface image, the screen refresh time corresponding to the first interface image is postponed from the first screen refresh time to the target screen refresh time, that is, the screen refresh time corresponding to the first interface image is postponed from 16.67ms to 33.33ms, so that the final display frame rate is consistent with the expected frame rate.

[0101] It is understandable that since the screen refresh rate is 60Hz, the duration of a refresh is 16.67ms. Since the first interface image is refreshed from 16.67ms, when refreshing according to the screen refresh rate, the first interface image will be refreshed at an interval of 16.67ms. That is, the refresh time of the first interface image determined by the existing method is 16.67ms, which cannot meet the expected frame rate requirement. The present application increases the screen refresh delay on the basis of the first screen refresh time determined based on the refresh rate, so as to delay the screen refresh time corresponding to the interface image, thereby meeting the expected frame rate requirement.

[0102] In some embodiments of the present application, the electronic device utilizes the screen hardware characteristics and the supported refresh rate gears to add a screen refresh delay, and controls the screen refresh at the target screen refresh time to display the first interface image. Finally, after the electronic device recognizes that the user exits the specific scene, it will automatically exit the refresh-and-display mode.

[0103] Exemplarily, assuming that the electronic device determines that the screen hardware characteristics and the supported refresh rate gear are 60Hz, the frame rate corresponding to the first interface image is 30 frames per second, the first screen refresh time is 16.67ms, and the screen refresh delay is 16.67ms, the target screen refresh time is determined to be 33.33ms based on the first screen refresh and the screen refresh delay. In this way, the electronic device can combine the screen hardware characteristics and the supported refresh rate gear, and add the screen refresh delay. At the target screen refresh time, it controls the screen refresh to display the first interface image, thereby achieving consistency between the screen refresh rate and the display time interval.

[0104] In this way, by combining the screen hardware characteristics and the supported refresh rate gears, and using the screen refresh delay to control the screen refresh, the screen refresh rate is kept consistent with the actual time interval, thereby reducing screen tearing and jitter and improving picture smoothness.

[0105] The display control method provided in the embodiment of the present application is described below with reference to the accompanying drawings.

[0106] like Figure 5 As shown, after drawing and synthesizing the Nth frame interface image of the first application, the electronic device determines the display time, i.e., the timestamp, of the interface image and the previous frame interface image according to the frame rate corresponding to the interface image, determines the display time interval based on the timestamps of the interface image and the previous frame interface image, and transmits the display time interval between the interface image and the previous frame interface image to the display driver, thereby determining the screen refresh delay according to the display time interval and the screen refresh rate, and then controlling the screen refresh according to the screen refresh delay to display the interface image, i.e., performing on-screen display of the interface image, so that the actual on-screen frame rate of the image interface is consistent with the expected frame rate, thereby keeping the picture display stable and smooth.

[0107] In some embodiments of the present application, Figure 6 As shown, combined with the above Figure 1 , the above step 302 may include the following steps 302a and 302b:

[0108] Step 302a: The electronic device determines the first screen refresh time corresponding to the first interface image according to the screen refresh rate.

[0109] Step 302b: The electronic device determines the difference between the first screen refresh time and the display time interval as the screen refresh delay.

[0110] In some embodiments of the present application, the electronic device may determine the first screen refresh time corresponding to the first interface image based on the refresh rate of the screen and the frame number of the second interface image.

[0111] For example, assuming that the screen refresh rate is 60 Hz, assuming that the first interface image is the second image frame of the first application, and the first screen refresh time corresponding to the first image frame of the first application is 0 ms, and the time taken by the electronic device to refresh an image frame each time is 16.67 ms, then the first screen refresh time corresponding to the second image frame is approximately 16.67 ms (i.e., 0 ms plus 16.67 ms).

[0112] In some embodiments of the present application, the electronic device obtains the screen refresh delay by using the difference between the display time interval between the first interface image and the second interface image and the first screen refresh time obtained by determining the screen refresh rate.

[0113] Exemplarily, assuming that the frame rate of the corresponding interface image is 30 frames per second, the display time interval between the first interface image and the second interface image is converted to 1 / 30ms, which is approximately 33.33ms. It is saved in the frame information and transmitted from drawing, synthesis and screen in sequence. During the transmission process, the display time interval remains unchanged.

[0114] Exemplarily, assuming that the screen refresh rate gear supported by the screen is 60 Hz, it can be determined that the refresh rate of the screen is 60 Hz, then the first screen refresh time is 1 / 60 ms, which is approximately 16.67 ms.

[0115] For example, assuming that the screen supports a screen refresh rate of 60Hz, it can be determined that the screen refresh rate is 60Hz, and the frame rate of the corresponding interface image is 30 frames per second, so that the first screen refresh time is 1 / 60ms, which is approximately 16.67ms, and the display time interval between the first interface image and the second interface image is 1 / 30ms, which is approximately 33.33ms. Using the difference between the determined first screen refresh time and the display time interval between the first interface image and the second interface image, it is determined that the screen refresh delay is approximately 16.67ms.

[0116] In this way, the electronic device determines the screen refresh delay by obtaining the first screen refresh moment and the display time interval between the first interface image and the second interface image, and then based on the difference between the first screen refresh moment and the display time interval between the first interface image and the second interface image. This can effectively solve the problem of mismatch between the display time interval between the first interface image and the second interface image and the screen refresh rate, that is, the problem of mismatch between the frame rate and the screen refresh rate, thereby improving the smoothness of the screen display.

[0117] The display control method provided in the embodiment of the present application is described below with reference to the accompanying drawings.

[0118] like Figure 7As shown, after drawing and synthesizing the Nth frame interface image of the first application, the electronic device determines the display time interval between the interface image and the previous frame interface image according to the layer frame rate corresponding to the interface image, and thus determines the screen refresh delay according to the display time interval and the screen refresh rate. The display driver controls the screen refresh according to the synthesis time and the refresh rate supported by the screen, combined with the screen refresh delay, to display the interface image, that is, to perform on-screen execution of the interface image. In this way, the actual on-screen frame rate of the image interface is consistent with the expected frame rate, thereby maintaining a stable and smooth screen display.

[0119] In some embodiments of the present application, the screen supports at least two different refresh rates. For example, Figure 8 As shown, combined with the above Figure 1 Before the above step 302, the method of the present application further includes the following steps 304 and 305:

[0120] Step 304: The electronic device calculates the difference between the frame rate currently used by the screen and each of the at least two refresh rates.

[0121] Step 305: The electronic device adjusts the current refresh rate of the screen to a target refresh rate among at least two refresh rates.

[0122] In some embodiments of the present application, the target refresh rate is a refresh rate with the smallest difference from the frame rate currently used by the screen among at least two refresh rates.

[0123] In some embodiments of the present application, the screen supports at least two different refresh rates, and the electronic device calculates the difference between the frame rate corresponding to the first interface image and each of the at least two refresh rates through the frame rate corresponding to the first interface image and the at least two refresh rates determined as above.

[0124] For example, assuming that the frame rate corresponding to the first interface image is 30 frames per second, and at least two refresh rates are 60 Hz and 100 Hz respectively, by calculating the difference between the frame rate corresponding to the first interface image and each of the at least two refresh rates, the differences can be obtained as 30 and 70 respectively.

[0125] In some embodiments of the present application, based on the difference between the frame rate corresponding to the first interface image determined in step 304 and each of the at least two refresh rates, the refresh rate corresponding to the at least two refresh rates with the smallest difference between the frame rate corresponding to the first interface image is determined as the refresh rate of the screen.

[0126] Exemplarily, according to the above calculation, the difference between the frame rate corresponding to the first interface image and each of the at least two refresh rates is determined to be 30 and 70 respectively, and the refresh rate corresponding to the at least two refresh rates with the smallest difference between the frame rate corresponding to the first interface image is used as the refresh rate of the screen. At this time, the smallest difference between the at least two refresh rates and the frame rate corresponding to the first interface image is 30, and the corresponding refresh rate is 60Hz, that is, the screen refresh rate is determined to be 60Hz.

[0127] In this way, by selecting the refresh rate that is closest to the frame rate corresponding to the interface image as the refresh rate actually used, the picture display is more coherent and smooth, especially in scenes with high dynamic content, which can significantly improve the smoothness of the picture display.

[0128] It should be noted that the above steps 304 and 305 may be performed after the above step 301 , or before the above step 301 , or simultaneously with the step 301 .

[0129] In some embodiments of the present application, the above step 305 may include the following steps 305a:

[0130] Step 305a: When the electronic device executes screen refresh, each time the screen refresh is executed, the current refresh rate of the screen is increased by a first value until the current refresh rate of the screen matches the target refresh rate.

[0131] In some embodiments of the present application, when an electronic device is performing a screen refresh and the currently used refresh rate does not match the target refresh rate, the electronic device will increase a first value on the current refresh rate of the screen each time the screen refresh is performed until the currently used refresh rate of the screen matches the target refresh rate.

[0132] For example, assuming that the current refresh rate of the current screen is 60Hz, the target refresh rate is 75Hz, and the first value is 1, the electronic device will add 1 to 60Hz each time it refreshes the screen until the current refresh rate of the screen increases from 60Hz to 75Hz, so that the current refresh rate of 75Hz shown on the screen matches the target refresh rate of 75Hz.

[0133] In this way, by gradually increasing the screen refresh rate to the target refresh rate, screen tearing caused by sudden changes in the refresh rate can be avoided, thereby effectively improving the smoothness of the picture display and meeting the needs of users.

[0134] In some embodiments of the present application, before the above step 302, the method of the present application further includes the following steps 306 and 307:

[0135] Step 306: When the first application is started, the electronic device obtains a first frame rate corresponding to the first application.

[0136] Step 307: The electronic device renders the interface image of the first application at the first frame rate.

[0137] In some embodiments of the present application, the first frame rate is a current screen refresh rate of the first application.

[0138] In some embodiments of the present application, after starting the first application, the electronic device obtains the current screen refresh rate corresponding to the first application, and then the electronic device renders the interface image of the first application according to the current corresponding screen refresh rate.

[0139] For example, assuming that the first frame rate corresponding to the current first application is 65 Hz, when the electronic device starts the first application, the first frame rate corresponding to the first application is obtained at 65 Hz. At this time, the electronic device will render the interface image of the first application at 65 Hz.

[0140] It should be noted that the above steps 306 and 307 may be performed before or after the above step 301 .

[0141] In this way, after starting the first application, the electronic device can obtain the frame rate corresponding to the first application, and after switching the application, the frame rate can be synchronously switched to the frame rate corresponding to the current application. Therefore, when displaying the interface images of different applications, the interface images can be displayed according to the expected frame rate corresponding to the application, thereby ensuring the smoothness of the interface image and improving the user experience.

[0142] The above display control method is explained below through two specific examples.

[0143] For example, Fig. 9 As shown, the display control method may include the following steps 101 to 107.

[0144] Step 101: The electronic device starts an application and enters an application scenario.

[0145] Exemplarily, the user enters the application scenario by clicking an icon of an application in the electronic device.

[0146] Exemplarily, the application scenarios include but are not limited to camera scenarios, video scenarios, and game scenarios.

[0147] Step 102: When the electronic device recognizes that the user has entered an application scenario, it switches to a swipe-and-display mode.

[0148] It should be noted that the instant display mode means that the display system switches to the instant display mode and the screen switches to the adaptive refresh rate mode.

[0149] Step 103: The system service in the electronic device sets the expected display time of the corresponding interface image according to the requirements of the corresponding application scenario.

[0150] For example, in the camera scenario, the camera service configures the preview interface image display time based on exposure and other parameters; in the video scenario, the decoding service configures the video interface image display time based on the bitstream; in the game scenario, the game interface image display time is configured according to the frame rate set in its own application interface, such as smoothness or resolution.

[0151] Step 104: The display system in the electronic device immediately triggers the drawing, synthesis and screen display operations, and executes them quickly and continuously without waiting for the Vsync cycle synchronization of a specific frequency.

[0152] Step 105: The electronic device saves the display time of the corresponding interface image in the frame information and transmits it to the display driver.

[0153] Exemplarily, the electronic device saves the display time of the corresponding interface image in step 103 in the frame information and transmits it to the display driver.

[0154] It should be noted that the display time of the corresponding interface image is transmitted to the display driver according to the interface image information, and the display time remains unchanged during the transmission process.

[0155] Step 106: The screen driver in the electronic device performs frame rate stabilization processing according to the display time, combines the screen hardware characteristics and the supported refresh rate gear, and adds a screen refresh delay to keep the frame rate of the screen display stable and smooth, and display it in time.

[0156] Step 107: After the system in the electronic device recognizes that the user exits the application scenario, it will automatically exit the instant display mode.

[0157] In this way, by making full use of the screen refresh rate and combining the screen refresh delay to control the screen refresh, the problem of mismatch between the actual frame rate and the expected frame rate corresponding to the image is avoided, thereby improving the smoothness of the displayed image.

[0158] For example, Fig.10 As shown, the display control method may include the following steps 201 to 207.

[0159] Step 201: The electronic device starts an application and enters an application scenario.

[0160] Exemplarily, the user enters the application scenario by clicking an icon of an application in the electronic device.

[0161] Exemplarily, the application scenarios include but are not limited to camera scenarios, video scenarios, and game scenarios.

[0162] Step 202: When the electronic device recognizes that the user has entered an application scenario, it switches to a swipe-and-display mode.

[0163] It should be noted that the instant display mode means that the display system switches to the instant display mode and the screen switches to the adaptive refresh rate mode.

[0164] Step 203: The system service in the electronic device sets the expected display time of the corresponding interface image according to the requirements of the corresponding application scenario.

[0165] For example: in the camera scenario, the camera service configures the preview interface image display time based on exposure, etc.; in the video scenario, the decoding service configures the video interface image display time based on the bitstream; in the game scenario, the game interface image display time is configured according to the frame rate set in its own application interface, such as fluency or resolution.

[0166] Step 204: The image system in the electronic device immediately triggers drawing. After drawing is completed, the screen refresh delay is added according to the set frame rate information to control the synthesis time point to ensure that the generated buffer is sent to the display framework for synthesis and display at the set frame rate.

[0167] Step 205: The display framework in the electronic device uses the frame rate to control the synthesis time point, and continuously performs image synthesis and screen display at the corresponding time point.

[0168] Exemplarily, the display framework in the electronic device controls the synthesis time point according to the frame rate of step 204, continuously performs image synthesis and on-screen display at the corresponding time point, and no longer needs to wait for the Vsync cycle synchronization of a specific frequency and can be executed as quickly as possible.

[0169] Step 206: The screen driver in the electronic device adds a screen refresh delay according to the time taken to synthesize the interface image and the refresh rate gear supported by the screen to ensure that the time from synthesis to display of each frame remains consistent, taking into account both the stability of the frame rate and the speed of display.

[0170] Step 207: After the system in the electronic device recognizes that the user exits the application scenario, it will automatically exit the instant display mode.

[0171] It should be noted that the above two examples are how electronic devices optimize the display process in specific application scenarios. During the display process, Example 1 does not need to wait for the Vsync cycle of a specific frequency to be synchronized, and can quickly execute the display. After the drawing is completed, Example 2 will add a screen refresh delay according to the set frame rate information to control the synthesis time point and ensure that the generated image is sent to the display framework for subsequent processing at the set frame rate. At the same time, the two examples can control the time point of the screen by adding a screen refresh delay, thereby ensuring the consistency of the actual frame rate and the expected frame rate.

[0172] This application makes full use of the refresh rate gears supported by the screen, combined with the screen refresh delay, to improve the frame rate jitter and display delay problems caused by the mismatch between the frame rate and the refresh rate. At the same time, there is no need to wait for specific signals to be executed synchronously, so that the display drawing, synthesis and screen display can be executed continuously, optimizing the synchronization time, thereby improving the overall smoothness and display speed of the picture display.

[0173] It should be noted that the above-mentioned method embodiments, or various possible implementation methods in each method embodiment, can be executed separately, or, under the premise that there is no contradiction, can also be executed in combination with each other. The specific implementation can be determined according to actual usage requirements, and the embodiments of the present application do not limit this.

[0174] The display control method provided in the embodiment of the present application can be executed by a display control device. In the embodiment of the present application, a method for executing display control by a display control device is taken as an example to illustrate the display control device provided in the embodiment of the present application.

[0175] Fig.11 A schematic diagram of a display control device provided in an embodiment of the present application, such as Fig.11 As shown, the display control device 1100 may include: a determination module 1101 and a processing module 1102, wherein: the above-mentioned determination module 1101 is used to determine the display time interval between the first interface image and the second interface image according to the frame rate corresponding to the first interface image when generating a first interface image of the first application, and the second interface image is an interface image in the interface image sequence of the first application, which is displayed before the first interface image and is adjacent to the first interface image; the above-mentioned determination module 1101 is also used to determine the screen refresh delay according to the display time interval and the screen refresh rate; the above-mentioned processing module 1102 is used to determine the target screen refresh time based on the screen refresh delay, and control the screen refresh at the target screen refresh time to display the first interface image.

[0176] In some embodiments of the present application, the above-mentioned processing module is specifically used to obtain the first screen refresh time corresponding to the first interface image; and determine the target screen refresh time according to the first screen refresh time corresponding to the first interface image and the screen refresh delay.

[0177] In some embodiments of the present application, the above-mentioned determination module is specifically used to determine the first screen refresh time corresponding to the first interface image according to the screen refresh rate; and determine the difference between the first screen refresh time and the display time interval as the screen refresh delay.

[0178] In some embodiments of the present application, the above-mentioned processing module is also used to calculate the difference between the frame rate currently used by the screen and each refresh rate of at least two refresh rates; thereby adjusting the current refresh rate of the screen to the target refresh rate among at least two refresh rates, and the target refresh rate is the refresh rate among at least two refresh rates with the smallest difference between the frame rate currently used by the screen.

[0179] In some embodiments of the present application, the above-mentioned processing module is specifically used to increase the current refresh rate of the screen by a first value each time the screen refresh is performed when a screen refresh is performed until the refresh rate currently used by the screen matches the target refresh rate.

[0180] In some embodiments of the present application, the first application is an application in a preset application set, the preset application set includes at least one application, and different applications correspond to different frame rates.

[0181] In some embodiments of the present application, the above-mentioned processing module is also used to determine the display time interval between the first interface image and the second interface image based on the frame rate corresponding to the first interface image, and when the first application is started, obtain the first frame rate corresponding to the first application; and render the interface image of the first application according to the first frame rate.

[0182] In an embodiment of the present application, when generating a first interface image of a first application, the electronic device can determine the display time interval between the first interface image and the second interface image according to the frame rate corresponding to the first interface image, the second interface image being an interface image displayed before the first interface image and adjacent to the first interface image in the interface image sequence of the first application, the electronic device determines the screen refresh delay based on the display time interval and the screen refresh rate; and determines the target screen refresh time based on the screen refresh delay, and controls the screen refresh at the target screen refresh time to display the first interface image. In this solution, since the screen refresh delay is determined according to the expected frame rate corresponding to the first interface image and the screen refresh rate, the electronic device controls the screen refresh based on the screen refresh delay, which can make the actual frame rate of the interface image consistent with the expected frame rate corresponding to the image, so that the screen refresh is synchronized with the switching of the interface image, so that by making full use of the screen refresh rate and combining the screen refresh delay to control the screen refresh, the problem of mismatch between the actual frame rate and the expected frame rate corresponding to the image caused by the traditional control of the screen refresh through the vertical synchronization signal is avoided, thereby improving the smoothness of the display screen.

[0183] The display control device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0184] The display control device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0185] The display control device provided in the embodiment of the present application can achieve Figures 1 to 10 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0186] Alternatively, if Fig.12 As shown, an embodiment of the present application further provides an electronic device 1200, including a processor 1201 and a memory 1202, wherein the memory 1202 stores programs or instructions that can be executed on the processor 1201, and when the program or instructions are executed by the processor 1201, the various steps of the above-mentioned display control method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0187] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0188] Fig.13 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0189] The electronic device 1300 includes but is not limited to: a radio frequency unit 1301, a network module 1302, an audio output unit 1303, an input unit 1304, a sensor 1305, a display unit 1306, a user input unit 1307, an interface unit 1308, a memory 1309, and a processor 1310 and other components.

[0190] Those skilled in the art will appreciate that the electronic device 1300 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1310 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.13 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0191] Among them, the above-mentioned processor 1310 is used to determine the display time interval between the first interface image and the second interface image according to the frame rate corresponding to the first interface image when generating the first interface image of the first application, and the second interface image is an interface image displayed before the first interface image in the interface image sequence of the first application and is adjacent to the first interface image; the processor 1310 is also used to determine the screen refresh delay according to the display time interval and the screen refresh rate; it is also used to determine the target screen refresh time based on the screen refresh delay, and control the screen refresh at the target screen refresh time to display the first interface image.

[0192] In some embodiments of the present application, the processor 1310 is specifically used to obtain the first screen refresh time corresponding to the first interface image; thereby determining the target screen refresh time according to the first screen refresh time corresponding to the first interface image and the screen refresh delay.

[0193] In some embodiments of the present application, the processor 1310 is specifically used to determine the first screen refresh time corresponding to the first interface image according to the screen refresh rate; and determine the difference between the first screen refresh time and the display time interval as the screen refresh delay.

[0194] In some embodiments of the present application, the above-mentioned processor 1310 is also used to calculate the difference between the frame rate currently used by the screen and each refresh rate of at least two refresh rates; thereby adjusting the current refresh rate of the screen to a target refresh rate among at least two refresh rates, and the target refresh rate is the refresh rate with the smallest difference between the frame rate currently used by the screen among at least two refresh rates.

[0195] In some embodiments of the present application, the processor 1310 is specifically configured to increase the current refresh rate of the screen by a first value each time a screen refresh is performed when a screen refresh is performed until the refresh rate currently used by the screen matches the target refresh rate.

[0196] In some embodiments of the present application, the first application is an application in a preset application set, the preset application set includes at least one application, and different applications correspond to different frame rates.

[0197] In some embodiments of the present application, the above-mentioned processor 1310 is also used to determine the display time interval between the first interface image and the second interface image based on the frame rate corresponding to the first interface image, and obtain the first frame rate corresponding to the first application when the first application is started; and then render the interface image of the first application according to the first frame rate.

[0198] In an embodiment of the present application, when generating a first interface image of a first application, the electronic device can determine the display time interval between the first interface image and the second interface image according to the frame rate corresponding to the first interface image, the second interface image being an interface image displayed before the first interface image and adjacent to the first interface image in the interface image sequence of the first application, the electronic device determines the screen refresh delay based on the display time interval and the screen refresh rate; and determines the target screen refresh time based on the screen refresh delay, and controls the screen refresh at the target screen refresh time to display the first interface image. In this solution, since the screen refresh delay is determined according to the expected frame rate corresponding to the first interface image and the screen refresh rate, the electronic device controls the screen refresh based on the screen refresh delay, which can make the actual frame rate of the interface image consistent with the expected frame rate corresponding to the image, so that the screen refresh is synchronized with the switching of the interface image, so that by making full use of the screen refresh rate and combining the screen refresh delay to control the screen refresh, the problem of mismatch between the actual frame rate and the expected frame rate corresponding to the image caused by the traditional control of the screen refresh through the vertical synchronization signal is avoided, thereby improving the smoothness of the display screen.

[0199] It should be understood that in the embodiment of the present application, the input unit 1304 may include a graphics processor (Graphics Processing Unit, GPU) 13041 and a microphone 13042, and the graphics processor 13041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1306 may include a display panel 13061, and the display panel 13061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1307 includes a touch panel 13071 and at least one of other input devices 13072. The touch panel 13071 is also called a touch screen. The touch panel 13071 may include two parts: a touch detection device and a touch controller. Other input devices 13072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0200] The memory 1309 can be used to store software programs and various data. The memory 1309 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1309 may include a volatile memory or a non-volatile memory, or the memory 1309 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1309 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0201] The processor 1310 may include one or more processing units; optionally, the processor 1310 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1310.

[0202] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned display control method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0203] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0204] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned display control method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0205] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0206] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned display control method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0207] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0208] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0209] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A display control method, characterized in that: The method includes: When generating a first interface image of a first application, determining a display time interval between the first interface image and a second interface image according to a frame rate corresponding to the first interface image, wherein the second interface image is an interface image displayed before the first interface image and adjacent to the first interface image in the interface image sequence of the first application; Determining a screen refresh delay according to the display time interval and the screen refresh rate; A target screen refresh time is determined based on the screen refresh delay, and the screen refresh is controlled at the target screen refresh time to display the first interface image.

2. The method according to claim 1, characterized in that The determining a target screen refresh time based on the screen refresh delay includes: Obtaining a first screen refresh time corresponding to the first interface image; The target screen refresh time is determined according to the first screen refresh time corresponding to the first interface image and the screen refresh delay.

3. The method according to claim 1, characterized in that Determining the screen refresh delay according to the display time interval and the refresh rate of the screen includes: Determining a first screen refresh time corresponding to the first interface image according to a refresh rate of the screen; The difference between the first screen refresh time and the display time interval is determined as the screen refresh delay.

4. The method according to claim 1, wherein the screen supports at least two different refresh rates; before determining the display time interval between the first interface image and the second interface image according to the frame rate corresponding to the first interface image when generating the first interface image of the first application, the method further comprises: Calculating a difference between a frame rate currently used by the screen and each of the at least two refresh rates; The current refresh rate of the screen is adjusted to a target refresh rate among the at least two refresh rates, wherein the target refresh rate is: a refresh rate among the at least two refresh rates having the smallest difference with a frame rate currently used by the screen.

5. The method according to claim 4, characterized in that The step of adjusting the current refresh rate of the screen to the target refresh rate includes: When executing screen refresh, each time the screen refresh is executed, the current refresh rate of the screen is increased by a first value until the refresh rate currently used by the screen matches the target refresh rate.

6. The method according to claims 1 to 5, characterized in that The first application is an application in a preset application set, the preset application set includes at least one application, and different applications correspond to different frame rates.

7. The method according to claim 6, characterized in that Before determining the display time interval between the first interface image and the second interface image according to the frame rate corresponding to the first interface image, the method further includes: When the first application is started, obtaining a first frame rate corresponding to the first application; Render an interface image of the first application according to the first frame rate.

8. A display control device, characterized in that: The device comprises: a determination module and a processing module, wherein: The determining module is used to determine, when generating a first interface image of a first application, a display time interval between the first interface image and a second interface image according to a frame rate corresponding to the first interface image, wherein the second interface image is an interface image displayed before the first interface image and adjacent to the first interface image in the interface image sequence of the first application; The determination module is further used to determine the screen refresh delay according to the display time interval and the screen refresh rate; The processing module is used to determine a target screen refresh time based on the screen refresh delay, and control screen refresh at the target screen refresh time to display the first interface image.

9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the display control method according to any one of claims 1 to 7 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the display control method according to any one of claims 1 to 7 are implemented.

Images