Display control method and device, equipment and storage medium

Abstract

The invention provides a display control method and device, equipment and a storage medium, and the method comprises the steps: obtaining a current refresh rate and a to-be-switched target refresh rate in response to a refresh rate switching request; determining switching calibration time corresponding to the refresh rate switching request according to the target refresh rate; determining a target switching strategy according to frame data display information and / or a display detection result and the switching calibration time; and switching the current refresh rate to a target refresh rate according to the target switching strategy to obtain a refresh rate switching result. According to the technical scheme, instant switching or delayed switching of the refresh rate can be dynamically carried out according to the terminal display scene, so that the problem of lagging in the refresh rate switching process is avoided, and the display fluency of the terminal is improved.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular, to a display control method, apparatus, device, and storage medium. Background Art

[0002] Currently, with the rapid development of the display technology and the intelligent terminal technology fields, more and more intelligent terminals can support multiple system refresh rates (such as 60Hz, 75Hz, 120Hz, 144Hz, and variable refresh rate, etc.), so that the intelligent terminal can display the corresponding content at a higher frame rate when rendering the display content to improve the terminal display smoothness. However, when switching the refresh rate during the display process of the existing intelligent terminal, there will be a brief frame drop or stutter, resulting in poor terminal smoothness and affecting the user experience. Summary of the Invention

[0003] Embodiments of this application provide a display control method, apparatus, device, and storage medium, aiming to solve the technical problem that the intelligent display terminal has poor smoothness during the display process due to switching the refresh rate in the prior art.

[0004] On the one hand, embodiments of this application provide a display control method, and the display control method includes the following steps:

[0005] Respond to a refresh rate switching request, and obtain the current refresh rate and the target refresh rate to be switched;

[0006] Determine the switching calibration time corresponding to the refresh rate switching request according to the target refresh rate;

[0007] Determine a target switching strategy according to the frame data display information and / or the display detection result, and the switching calibration time;

[0008] Switch the current refresh rate to the target refresh rate according to the target switching strategy to obtain a refresh rate switching result.

[0009] In a possible implementation manner of this application, the determining the switching calibration time corresponding to the refresh rate switching request according to the target refresh rate includes:

[0010] Determine the number of calibration cycles corresponding to the refresh rate switching request according to the target refresh rate;

[0011] Determine the switching calibration time according to the refresh cycle duration corresponding to the target refresh rate and the number of calibration cycles.

[0012] In a possible implementation manner of this application, the determining the target switching strategy according to the frame data display information and / or the display detection result, and the switching calibration time includes:

[0013] Determine the frame data display information corresponding to the refresh rate switching request, and read the frame data to be displayed and the current display frame rate in the frame data display information;

[0014] Calculate the expected display time corresponding to the frame data to be displayed by using the current display frame rate;

[0015] Determine a target switching strategy according to the expected display time and / or display detection result, and the switching calibration time.

[0016] In a possible implementation manner of the present application, the determining a target switching strategy according to the expected display time and / or display detection result, and the switching calibration time includes:

[0017] If the expected display time is greater than the switching calibration time, determine an immediate switching strategy as the target switching strategy corresponding to the refresh rate switching request;

[0018] If the expected display time is less than the switching calibration time, perform a timeout display detection on the display interaction events within the update synchronization period to obtain a display detection result;

[0019] Determine the target switching strategy corresponding to the refresh rate switching request based on the display detection result.

[0020] In a possible implementation manner of the present application, the performing a timeout display detection on the display interaction events within the update synchronization period to obtain a display detection result includes:

[0021] Obtain the display interaction events triggered in the update synchronization period, and extract the display interaction information of the display interaction events;

[0022] Obtain the detected display frame and / or layer refresh type in the display interaction information, and perform a display detection according to the detected display frame and / or layer refresh type to obtain a display detection result.

[0023] In a possible implementation manner of the present application, the determining the target switching strategy corresponding to the refresh rate switching request based on the display detection result includes:

[0024] If the display detection result is an animation display result, determine an immediate switching strategy as the target switching strategy corresponding to the refresh rate switching request;

[0025] If the display detection result is a regional refresh result, determine the immediate switching strategy as the target switching strategy corresponding to the refresh rate switching request;

[0026] If the display detection result is a global refresh result, determine a delayed switching strategy as the target switching strategy corresponding to the refresh rate switching request.

[0027] In a possible implementation manner of the present application, the refresh rate switching result includes a first refresh rate switching result and a second refresh rate switching result;

[0028] The step of switching the current refresh rate to the target refresh rate according to the target switching strategy to obtain a refresh rate switching result includes:

[0029] If the target switching strategy is an immediate switching strategy, then use the immediate switching strategy to switch the current refresh rate to the target refresh rate by using the target composite layer to obtain a first refresh rate switching result;

[0030] If the target switching strategy is a delayed switching strategy, then switch the current refresh rate to the target refresh rate according to the update synchronization period corresponding to the display detection result and the delay of the target composite layer to obtain a second refresh rate switching result.

[0031] On the other hand, the present application provides a display control device, and the display control device includes:

[0032] A refresh rate acquisition module, configured to respond to a refresh rate switching request and acquire the current refresh rate and the target refresh rate to be switched;

[0033] A calibration duration module, configured to determine a switching calibration time corresponding to the refresh rate switching request according to the target refresh rate;

[0034] A switching strategy module, configured to determine a target switching strategy according to the frame data display information and / or the display detection result, and the switching calibration time;

[0035] A refresh rate switching module, configured to switch the current refresh rate to the target refresh rate according to the target switching strategy to obtain a refresh rate switching result.

[0036] On the other hand, the present application further provides a display control device, and the display control device includes:

[0037] One or more processors;

[0038] A memory; and

[0039] One or more applications, where the one or more applications are stored in the memory and configured to be executed by the processor to implement the steps of the display control method.

[0040] On the other hand, the present application further provides a computer-readable storage medium, on which a computer program is stored, and the computer program is loaded by a processor to execute the steps in the display control method.

[0041] In this application, by responding to a refresh rate switching request, the current refresh rate and the target refresh rate to be switched are obtained; the switching calibration time corresponding to the refresh rate switching request is determined according to the target refresh rate; a target switching strategy is determined according to the frame data display information and / or the display detection result, and the switching calibration time; the current refresh rate is switched to the target refresh rate according to the target switching strategy to obtain a refresh rate switching result. When the terminal needs to switch the refresh rate, the switching calibration time required for vertical synchronization processing is determined according to the current refresh rate and the target refresh rate to be switched, and a target switching strategy for immediately / delay switching the refresh rate is determined according to the frame data display information and / or the display detection result of the terminal, and the switching calibration time, and the current refresh rate is immediately / delay switched to the target refresh rate by using the target switching strategy, so as to realize dynamically immediate or delay switching the refresh rate according to the terminal display scenario, avoid the jamming problem during the refresh rate switching process, and improve the terminal display fluency. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention, and those skilled in the art can obtain other drawings without creative efforts based on these drawings.

[0043] Figure 1 It is a schematic diagram of the scenario of the display control method in the embodiment of the present application;

[0044] Figure 2 It is a schematic flowchart of an embodiment of the display control method in the embodiment of the present application;

[0045] Figure 3 It is a schematic flowchart of an embodiment of determining the target switching strategy in the display control method provided by the embodiment of the present application;

[0046] Figure 4 It is a schematic flowchart of an embodiment of determining the target switching strategy according to the display detection result in the display control method provided by the embodiment of the present application;

[0047] Figure 5 It is a schematic structural diagram of an embodiment of the display control device provided by the embodiment of the present application;

[0048] Figure 6 It is a schematic structural diagram of an embodiment of the display control device provided by the embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0049] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0050] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings. It is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus cannot be construed as a limitation to the present invention. In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be construed as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include one or more of the described features. In the description of the present invention, "a plurality" means two or more, unless otherwise specifically defined.

[0051] In the present application, the term "exemplary" is used to mean "serving as an example, illustration, or description". Any embodiment described as "exemplary" in the present application is not necessarily to be construed as more preferred or advantageous than other embodiments. In order for any person skilled in the art to implement and use the present invention, the following description is given. In the following description, details are set forth for the purpose of explanation. It should be understood that those of ordinary skill in the art can recognize that the present invention can be implemented without these specific details. In other instances, well-known structures and processes are not described in detail to avoid unnecessary details from obscuring the description of the present invention. Therefore, the present invention is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed in the present application.

[0052] Currently, with the rapid development of the display technology and the intelligent terminal technology fields, more and more intelligent terminals can support multiple system refresh rates (such as 60Hz, 75Hz, 120Hz, 144Hz, and variable refresh rates, etc.), so that the intelligent terminal can display the corresponding content at a higher frame rate when rendering the display content to improve the terminal display smoothness. However, when switching the refresh rate during the display process of the existing intelligent terminals, there will be brief frame drops or lags, resulting in poor terminal smoothness and affecting the user experience.

[0053] Based on this, the present application proposes a display control method, device, equipment, and computer-readable storage medium to solve the technical problem that the smoothness of intelligent display terminals is poor during the display process due to the switching of the refresh rate in the prior art.

[0054] The display control method in the embodiments of the present invention is applied to a display control device, which is set in a display control device. The display control device is provided with one or more processors, a memory, and one or more application programs. One or more application programs are stored in the memory and are configured to be executed by the processor to implement the display control method. Among them, the display control device can be an intelligent terminal, such as a mobile phone, a tablet computer, a smart TV, a network device, and a smart computer, etc. Optionally, the display control device can also be a server, or a service cluster composed of multiple servers.

[0055] As Figure 1 shown, Figure 1 It is a schematic diagram of the scenario of the display control method in the embodiments of the present application. In the embodiments of the present invention, the display control scenario includes a display control device 100 (the display control device 100 integrates a display control device) and a target service terminal 200. A computer-readable storage medium corresponding to the display control method runs in the display control device 100 to execute the steps of the display control method.

[0056] It can be understood that Figure 1 The display control device in the display control method scenario shown, or the device included in the display control device does not constitute a limitation to the embodiments of the present invention. That is, the number of devices, the types of devices of the display control device included in the display control method scenario, or the number of devices and the types of devices included in each device do not affect the overall implementation of the technical solution in the embodiments of the present invention, and can all be regarded as equivalent replacements or derivatives of the technical solution required to be protected in the embodiments of the present invention.

[0057] The display control device 100 in the embodiments of the present invention is mainly used for: responding to a refresh rate switching request, obtaining the current refresh rate and the target refresh rate to be switched; determining the switching calibration time corresponding to the refresh rate switching request according to the target refresh rate; determining a target switching strategy according to the frame data display information and / or the display detection result, and the switching calibration time; and switching the current refresh rate to the target refresh rate according to the target switching strategy to obtain a refresh rate switching result.

[0058] The display control device 100 in the embodiments of the present invention can be an independent display control device, such as intelligent terminals such as mobile phones, tablet computers, network devices, smart TVs, and smart computers, or a display control network or a display control cluster composed of multiple display control devices (such as a multi-screen collaborative display cluster).

[0059] Embodiments of the present application provide a display control method, apparatus, device, and computer-readable storage medium, which will be described in detail below.

[0060] Those skilled in the art can understand that Figure 1 the application environment shown is only one of the application scenarios related to the solution of the present application, and does not constitute a limitation on the application scenario of the solution of the present application. Other application environments may also include more or fewer display control devices than Figure 1 shown, or the display control network connection relationship. For example Figure 1 only one display control device is shown in. It can be understood that the scenario of this display control method may also include one or more display control devices, which are not specifically limited here; the display control device 100 may also include a memory for storing refresh rate data and other data.

[0061] It should be noted that Figure 1 the schematic diagram of the scenario of the display control method shown is only an example. The scenario of the display control method described in the embodiments of the present invention is for more clearly explaining the technical solution of the embodiments of the present invention, and does not constitute a limitation on the technical solution provided by the embodiments of the present invention.

[0062] Based on the above scenario of the display control method, various embodiments of the display control method disclosed in the present invention are proposed.

[0063] As Figure 2 shown, Figure 2 is a flowchart of an embodiment of the display control method in the embodiments of the present application. The display control method includes the following steps 201 to 204:

[0064] 201. Respond to the refresh rate switching request, and obtain the current refresh rate and the target refresh rate to be switched;

[0065] The display control method in this embodiment is applied to a display control device. The type and number of display control devices are not specifically limited. That is, the display control device may be one or more intelligent terminals or servers. In a specific embodiment, the display control device is an intelligent computer.

[0066] Among them, the current refresh rate represents the number of times the display system of the display control device or the running application program refreshes the image frames per second. That is, the current refresh rate is the system refresh rate ability of the display control device to display image frames currently. Optionally, in a specific embodiment, the current refresh rate may be 30 Hz, 60 Hz, 75 Hz, 90 Hz, 120 Hz, 144 Hz, 180 Hz, 240 Hz, etc. Optionally, in other embodiments, the current refresh rate may also be set to other refresh rates other than the above-listed refresh rates according to actual scenario requirements.

[0067] Among them, the target refresh rate is the specified refresh rate to be switched after the display control device performs a refresh rate switching operation. Optionally, in a specific embodiment, the target refresh rate can be 30 Hz, 60 Hz, 75 Hz, 90 Hz, 120 Hz, 144 Hz, 180 Hz, 240 Hz, etc. Optionally, in other embodiments, the target refresh rate can also be set to other refresh rates other than the above-listed refresh rates according to the actual scenario requirements. For example, the display control device can set different target refresh rates according to the actual terminal requirements or application requirements. For example, the display control device can set the target refresh rate in the low power mode or power saving mode to 30 Hz. Optionally, in other embodiments, the application in the display control device can also set different target refresh rates according to the actual application type.

[0068] Specifically, during the operation of the display control device, it responds to a refresh rate switching request. Among them, the refresh rate switching request is an operation event that drives the display control device to perform a refresh rate switching to switch the current refresh rate of the display control device to the target refresh rate for display. Optionally, the triggering method of the refresh rate switching request is not specifically limited here. That is, the refresh rate switching request can be triggered by the application in the display control device. That is, the application in the display control device can request to switch the refresh rate according to the actual operation requirements, thereby triggering the refresh rate switching request. In addition, the display control device can also automatically trigger the refresh rate switching request. For example, a refresh rate control process is pre-set in the display control device, and when the display control device triggers a mode switch (such as switching to operating modes such as power saving mode, performance mode, and balanced mode), the refresh rate switching request is automatically triggered.

[0069] Specifically, after the display control device obtains the refresh rate switching request, it parses the refresh rate switching request to obtain the current refresh rate of the display control device and the target refresh rate that the display control device is to switch to according to the refresh rate switching request.

[0070] 202. Determine the switching calibration time corresponding to the refresh rate switching request according to the target refresh rate;

[0071] Specifically, when the display control device switches the refresh rate, it needs to wait for the vertical synchronization model to perform the switching and calibration operation. Otherwise, due to the calculation error of the vertical synchronization model, there will be a deviation between the refresh rate simulated by the application program and the actual screen refresh rate during the refresh rate switching process, resulting in the display control device having short-term frame drops or stuttering, causing the user to perceive the stuttering phenomenon of the display control device and affecting the user experience. Therefore, after the display control device obtains the current refresh rate and the target refresh rate, it also determines the switching calibration time corresponding to the refresh rate switching request based on the current refresh rate and the target refresh rate. Optionally, in a specific embodiment, the vertical synchronization model is a Vsync calculation model.

[0072] Specifically, after the display control device obtains the current refresh rate and the target refresh rate, it also determines the switching calibration time corresponding to the refresh rate switching request based on the current refresh rate and the target refresh rate, and then determines whether it can immediately perform the refresh rate switching operation based on the refresh rate switching request according to the switching calibration time in the subsequent steps, so as to complete the refresh rate switching without affecting the display of the current frame.

[0073] Specifically, the display control device determines the number of calculation calibration cycles required by the vertical synchronization model corresponding to the refresh rate switching request according to the current refresh rate and the target refresh rate, and determines the number of calibration cycles corresponding to the refresh rate switching request as the number of calculation calibration cycles. Wherein, the calculation calibration cycle is the refresh cycle duration corresponding to the vertical synchronization operation of the target refresh rate. The number of calibration cycles is the number of cycles of the calculation calibration cycle. Optionally, in a specific embodiment, the number of cycles required by the vertical synchronization model is at least 2. That is, when the vertical synchronization model performs the refresh rate switching calculation, at least two vertical synchronization cycles are required to complete the model calibration calculation, and then the refresh rate switching operation is performed. Among them, the number of calibration cycles corresponding to different target refresh rates is different. In a specific embodiment, when the target refresh rate is 120hz, the number of calibration cycles corresponding to the target refresh rate is 3. That is, when the vertical synchronization model performs the refresh rate switching calculation, at least three vertical synchronization cycles are required to complete the model calibration.

[0074] Specifically, after determining the number of calibration cycles, the display control device further calculates the switching calibration time according to the refresh cycle duration corresponding to the target refresh rate and the number of calibration cycles. That is, the display control device calculates the ratio of the unit display time to the target refresh rate to obtain the refresh cycle duration corresponding to the target refresh rate, and multiplies the refresh cycle duration by the number of calibration cycles to obtain the switching calibration time for the target refresh rate. Optionally, in a specific embodiment, the unit display time is 1000 ms (unit: millisecond). For another example, in a specific embodiment, if the target refresh rate of the display control device is 120 Hz (unit: hertz), the display control device determines that the refresh cycle duration corresponding to the target refresh rate is 1000 ms / 120 = 8.33 ms, and calculates the switching calibration time corresponding to the target refresh rate as 8.33 * 2 = 16.66 ms or 8.33 * 3 = 24.99 ms according to the refresh cycle duration and the number of calibration cycles (2 or 3).

[0075] 203. Determine a target switching strategy according to the frame data display information and / or the display detection result, and the switching calibration time;

[0076] Specifically, after determining the switching calibration time corresponding to the refresh rate switching request, the display control device further determines the target switching strategy corresponding to the refresh rate switching request according to the frame data display information and / or the display detection result, and the switching calibration time corresponding to the refresh rate switching request, where the target switching strategy is a control strategy for characterizing whether to perform an immediate refresh rate switching or a delayed refresh rate switching on the display control device. Optionally, in a specific embodiment, the target switching strategy includes an immediate switching strategy and a delayed switching strategy. Among them, the immediate switching strategy is a control strategy for driving the display control device to immediately perform a refresh rate switching operation. The delayed switching strategy is a control strategy for driving the display control device to perform a refresh rate switching operation after a preset duration of delay.

[0077] Specifically, after obtaining the refresh rate switching request, the display control device further determines the frame data display information corresponding to the refresh rate switching request. Among them, the frame data display information is display information for characterizing the current display parameters of the display control device and the frame data to be displayed. Optionally, in a specific embodiment, the frame data display information includes the frame data to be displayed and the current display frame rate of the display control device. Among them, the frame data to be displayed is the frame image data that is about to be displayed in the display control device. The current display frame rate is for characterizing the number of images currently rendered per second by the image processor in the display control device.

[0078] Specifically, after obtaining the frame data to be displayed and the current display frame rate, the display control device further calculates the expected display time of the frame data to be displayed according to the current display frame rate. Among them, the expected display time represents the processing time for the display control device to render and display the frame data to be displayed. That is, the display control device calculates the ratio of the unit display time to the current display frame rate, and determines the ratio of the unit display time to the current display frame rate as the expected display time of the frame data to be displayed. For example, in a specific embodiment, the current display frame rate is 30 Fps (unit: frame / second), and the display control device calculates the ratio of the unit display time to the current display frame rate, and obtains the expected display time of 1000 / 30 = 33.33 ms (unit: millisecond).

[0079] Specifically, after obtaining the expected display time of the frame data to be displayed, the display control device compares the expected display time with the switching calibration time, so as to determine whether to drive the display control device to perform an immediate refresh rate switch or a delayed refresh rate switch, and obtain the corresponding target switching strategy.

[0080] Optionally, in other embodiments, the display control device further determines whether to perform a timeout display detection on the display interaction events in the next update synchronization period in the display control device according to the comparison result of the expected display time and the switching calibration time, so as to obtain a display detection result, where the display detection result represents the display event detection result of the display control device in the update synchronization period after the expiration of the expected display time.

[0081] Specifically, after obtaining the display detection result, the display control device further determines whether to drive the display control device to perform an immediate refresh rate switch or a delayed refresh rate switch according to the display detection result, so as to determine the target switching strategy corresponding to the refresh rate switching request.

[0082] 204. Switch the current refresh rate to the target refresh rate according to the target switching strategy to obtain a refresh rate switching result.

[0083] Specifically, after obtaining the target switching strategy corresponding to the refresh rate switching request, the display control device further switches the current refresh rate to the target refresh rate according to the target switching strategy, so as to obtain a refresh rate switching result.

[0084] Optionally, in a specific embodiment, if the display control device determines that the target switching strategy corresponding to the refresh rate switching request is an immediate switching strategy, that is, the display control device determines that no abnormal display problems such as frame loss and stuttering will occur when immediately performing the refresh rate switching operation, the display control device immediately switches the current refresh rate to the target refresh rate according to the immediate switching strategy by using the target composition layer, and obtains a first refresh rate switching result, where the first refresh rate switching result is a refresh rate switching result for controlling the display control device to immediately perform the refresh rate switching. That is, the display control device uses the immediate switching strategy to control the target composition layer to perform sample acquisition and uses the vertical synchronization model for function fitting, so as to immediately switch the current refresh rate to the target refresh rate.

[0085] Optionally, in a specific embodiment, if the display control device determines that the target switching strategy corresponding to the refresh rate switching request is a delayed switching strategy, that is, the display control device determines that there is not enough time to perform the frame rate switching within the expected display time of the to-be-displayed frame data, and immediately performing the refresh rate switching operation will cause abnormal display problems such as frame loss and stuttering on the display control device. Therefore, the display control device switches the current refresh rate to the target refresh rate according to the delayed switching strategy based on the update synchronization period corresponding to the display detection result and the target composition layer, and obtains a second refresh rate switching result, where the second refresh rate switching result is a refresh rate switching result for controlling the display control device to perform the refresh rate switching according to the update synchronization period. That is, the display control device uses the delayed switching strategy to control the target composition layer to perform sample acquisition in the update synchronization period after the expected display time and uses the vertical synchronization model for function fitting, so as to switch the current refresh rate to the target refresh rate.

[0086] In this embodiment, the display control device responds to the refresh rate switching request, obtains the current refresh rate and the target refresh rate to be switched; determines the switching calibration time corresponding to the refresh rate switching request according to the target refresh rate; determines the target switching strategy according to the frame data display information and / or the display detection result, and the switching calibration time; and switches the current refresh rate to the target refresh rate according to the target switching strategy, and obtains a refresh rate switching result. When the terminal needs to perform a refresh rate switch, the vertical synchronization processing's required switching calibration time is determined according to the current refresh rate and the target refresh rate to be switched, and the target switching strategy for immediately / delaying the refresh rate switch is determined according to the frame data display information and / or the display detection result of the terminal, and the switching calibration time. The current refresh rate is immediately / delayed switched to the target refresh rate by using the target switching strategy, so as to realize dynamically immediate or delayed refresh rate switching according to the terminal display scenario, avoid stuttering problems during the refresh rate switching process, and improve the terminal display smoothness.

[0087] Such asFigure 3 As shown in Figure 3 FIG. 3 is a flowchart of an embodiment for determining a target switching strategy in the display control method provided by the embodiment of the present application. Specifically, in this embodiment, the display control method further includes steps 301 to 303:

[0088] 301. If the expected display time is greater than the switching calibration time, determine the immediate switching strategy as the target switching strategy corresponding to the refresh rate switching request;

[0089] 302. If the expected display time is less than the switching calibration time, perform timeout display detection on display interaction events within the update synchronization period to obtain a display detection result;

[0090] 303. Determine the target switching strategy corresponding to the refresh rate switching request based on the display detection result.

[0091] Based on the above embodiments, in this embodiment, after obtaining the expected display time of the to-be-displayed frame data, the display control device compares the expected display time with the switching calibration time, so as to determine whether to drive the display control device to perform immediate refresh rate switching or delayed refresh rate switching, and obtain the corresponding target switching strategy.

[0092] Optionally, if the expected display time is greater than the switching calibration time, the display control device determines that there is sufficient calibration time for refresh rate switching within the expected display time corresponding to the to-be-displayed frame data, and the display control device determines the immediate switching strategy as the target switching strategy corresponding to the refresh rate switching request.

[0093] Optionally, if the expected display time is less than the switching calibration time, the display control device determines that there is not enough calibration time for frame rate switching within the expected display time corresponding to the to-be-displayed frame data, and the display control device performs timeout display detection on display interaction events within the update synchronization period corresponding to the expected display time, so as to determine whether there are display interaction events in the next vertical synchronization period corresponding to the expected display event, and determine whether the refresh rate switching will cause display impact on the display interaction event, so as to obtain a display detection result.

[0094] Specifically, after obtaining the display detection result, the display control device also determines whether to allow immediate refresh rate switching within the update synchronization period according to the display detection result, and further determines the target switching strategy corresponding to the refresh rate switching request.

[0095] In this embodiment, the display control device compares the expected display time with the switching calibration time. If it is determined that the expected display time is greater than the switching calibration time, the immediate switching policy is determined as the target switching policy corresponding to the refresh rate switching request; if the expected display time is less than the switching calibration time, timeout display detection is performed on the display interaction events within the update synchronization period to obtain a display detection result; and the target switching policy corresponding to the refresh rate switching request is determined based on the display detection result. This realizes dynamically determining the target switching policy corresponding to the refresh rate switching request according to the expected display time of the display control device and the display interaction situation within the update synchronization period, so as to accurately determine whether to immediately or delay the refresh rate switching, reduce the impact of the refresh rate switching on the display effect of the display control device, and improve the display fluency of the terminal.

[0096] As Figure 4 shown, Figure 4 FIG. is a schematic flowchart of an embodiment of determining a target switching policy according to a display detection result in the display control method provided by an embodiment of the present application. Specifically, in this embodiment, the display control method further includes steps 401 to 403:

[0097] 401. If the display detection result is an animation display result, the immediate switching policy is determined as the target switching policy corresponding to the refresh rate switching request;

[0098] 402. If the display detection result is a region refresh result, the immediate switching policy is determined as the target switching policy corresponding to the refresh rate switching request;

[0099] 403. If the display detection result is a global refresh result, the delayed switching policy is determined as the target switching policy corresponding to the refresh rate switching request.

[0100] Based on the above embodiment, in this embodiment, after the display control device determines that the expected display time is less than the switching calibration time, timeout display detection is performed on the display interaction events within the update synchronization period corresponding to the expected display time, so as to judge whether there are display interaction events in the next vertical synchronization period corresponding to the expected display event, and judge whether the refresh rate switching will cause a display impact on the display interaction event, so as to obtain a display detection result, and determine the target switching policy corresponding to the refresh rate switching request according to the display detection result.

[0101] Specifically, the display control device determines the next vertical synchronization period of the expected display time corresponding to the frame data to be displayed as the update synchronization period, obtains the display interaction events in this update synchronization period, and extracts the display interaction information corresponding to the display interaction events. Among them, the display interaction event is an interaction event that drives the display control device to perform corresponding display operations. Optionally, the display interaction event may be an interaction operation event such as a frame data submission event and / or a layer refresh event, etc.

[0102] Specifically, after the display control device obtains the display interaction events within the update synchronization period, it parses the display interaction information corresponding to the display interaction events, obtains the detected display frame in the display interaction information and / or the layer refresh type in the display interaction information, and performs display detection based on the detected display frame and / or the image refresh type to obtain a display detection result, and determines a corresponding target switching strategy according to the display detection result.

[0103] Optionally, in other embodiments, the display control device can also output a corresponding display detection result according to whether there are display interaction events to be consumed in the update synchronization period, as well as the arrival of the detection timeout time and the number of display detections.

[0104] Optionally, if the display detection result of the display control device is an animation display result, that is, the display control device determines that the display interaction event is only the display interaction event corresponding to the submission of animation frame data, then it determines that the display detection result is an animation display result, and determines that the impact of switching the refresh rate on this display interaction event is small at this time, and determines the immediate switching strategy as the target switching strategy corresponding to the refresh rate switching request;

[0105] Optionally, if the display control device determines that the display detection result is a region refresh result, that is, the display control device determines that the display interaction event is a region refresh event that drives the layer to perform a specified display region refresh, then it determines that the display detection result is a region refresh result, and determines that the impact of switching the refresh rate on this display interaction event is small at this time, and determines the immediate switching strategy as the target switching strategy corresponding to the refresh rate switching request;

[0106] Optionally, if the display control device determines that the display detection result is a global refresh result, that is, the display control device determines that the display interaction event is a global refresh result that drives the layer to perform a global refresh, and determines that the impact of switching the refresh rate on this display interaction event is large at this time, then it determines the delayed switching strategy as the target switching strategy corresponding to the refresh rate switching request.

[0107] Optionally, in other embodiments, if the display control device determines that the display detection result is a no-event detection result, that is, the display control device determines that no frame data has been submitted during the update synchronization period, then it determines that the target switching strategy corresponding to the display detection result is an immediate switching strategy.

[0108] Optionally, in other embodiments, if the display control device determines that the display detection result is a timeout detection result, that is, the display control device determines that the system time has reached the display time corresponding to the update synchronization period, then it determines that the target switching strategy corresponding to the display detection result is an immediate switching strategy.

[0109] Optionally, in other embodiments, if the display control device determines that the display detection result is a multiple-detection result, that is, the display control device determines that multiple display detections have been performed on the display interaction event during the update synchronization period, then it determines that the target switching strategy corresponding to the display detection result is an immediate switching strategy.

[0110] Specifically, in this embodiment, after obtaining the target switching strategy corresponding to the refresh rate switching request, the display control device also switches the current refresh rate to the target refresh rate according to the target switching strategy to obtain a refresh rate switching result.

[0111] In this embodiment, the display control device performs a display detection on the display interaction event in the update synchronization period to obtain a display detection result. If the display detection result is an animation display result, it determines the immediate switching strategy as the target switching strategy corresponding to the refresh rate switching request; if the display detection result is a region refresh result, it determines the immediate switching strategy as the target switching strategy corresponding to the refresh rate switching request; if the display detection result is a global refresh result, it determines the delayed switching strategy as the target switching strategy corresponding to the refresh rate switching request. It realizes intelligent recognition of the impact of refresh rate switching on the display scene during the display interaction process, and then allocates the corresponding target switching strategy to reduce the impact of refresh rate switching on the display effect of the display control device and improve the terminal display fluency.

[0112] To better implement the display control method in the embodiments of the present application, on the basis of the display control method, the embodiments of the present application also provide a display control device, as Figure 5 shown, Figure 5 is a schematic structural diagram of an embodiment of the display control device provided in the embodiments of the present application. Specifically, the display control device 500 includes:

[0113] A refresh rate acquisition module 501, configured to respond to a refresh rate switching request and acquire the current refresh rate and the target refresh rate to be switched.

[0114] The calibration duration module 502 is configured to determine a switching calibration time corresponding to the refresh rate switching request according to the target refresh rate;

[0115] The switching strategy module 503 is configured to determine a target switching strategy according to the frame data display information and / or the display detection result, and the switching calibration time;

[0116] The refresh rate switching module 504 is configured to switch the current refresh rate to the target refresh rate according to the target switching strategy to obtain a refresh rate switching result.

[0117] In a possible implementation manner of this embodiment, the display control device determines the switching calibration time corresponding to the refresh rate switching request according to the target refresh rate, including:

[0118] Determine the number of calibration cycle corresponding to the refresh rate switching request according to the target refresh rate;

[0119] Determine the switching calibration time according to the refresh cycle duration corresponding to the target refresh rate and the number of calibration cycles.

[0120] In a possible implementation manner of this embodiment, the display control device determines the target switching strategy according to the frame data display information and / or the display detection result, and the switching calibration time, including:

[0121] Determine the frame data display information corresponding to the refresh rate switching request, and read the frame data to be displayed and the current display frame rate in the frame data display information;

[0122] Calculate the expected display time corresponding to the frame data to be displayed by using the current display frame rate;

[0123] Determine the target switching strategy according to the expected display time and / or the display detection result, and the switching calibration time.

[0124] In a possible implementation manner of this embodiment, the display control device determines the target switching strategy according to the expected display time and / or the display detection result, and the switching calibration time, including:

[0125] If the expected display time is greater than the switching calibration time, determine the immediate switching strategy as the target switching strategy corresponding to the refresh rate switching request;

[0126] If the expected display time is less than the switching calibration time, perform an overtime display detection on the display interaction events within the update synchronization period to obtain a display detection result;

[0127] Determine the target switching strategy corresponding to the refresh rate switching request based on the display detection result.

[0128] In a possible implementation of this embodiment, the display control device performs timeout display detection on display interaction events within an update synchronization period to obtain a display detection result, including:

[0129] Obtain the display interaction events triggered during the update synchronization period, and extract the display interaction information of the display interaction events;

[0130] Obtain the detected display frame and / or layer refresh type in the display interaction information, and perform display detection based on the detected display frame and / or layer refresh type to obtain a display detection result.

[0131] In a possible implementation of this embodiment, the display control device determines a target switching strategy corresponding to the refresh rate switching request based on the display detection result, including:

[0132] If the display detection result is an animation display result, determine the immediate switching strategy as the target switching strategy corresponding to the refresh rate switching request;

[0133] If the display detection result is a regional refresh result, determine the immediate switching strategy as the target switching strategy corresponding to the refresh rate switching request;

[0134] If the display detection result is a global refresh result, determine the delayed switching strategy as the target switching strategy corresponding to the refresh rate switching request.

[0135] In a possible implementation of this embodiment, the display control device switches the current refresh rate to the target refresh rate according to the target switching strategy to obtain a refresh rate switching result, including:

[0136] If the target switching strategy is the immediate switching strategy, use the immediate switching strategy to switch the current refresh rate to the target refresh rate using the target composite layer to obtain a first refresh rate switching result;

[0137] If the target switching strategy is the delayed switching strategy, switch the current refresh rate to the target refresh rate according to the update synchronization period corresponding to the display detection result and the delay of the target composite layer to obtain a second refresh rate switching result.

[0138] In this embodiment, the display control device obtains the current refresh rate and the target refresh rate to be switched by responding to a refresh rate switching request; determines the switching calibration time corresponding to the refresh rate switching request according to the target refresh rate; determines a target switching strategy according to the frame data display information and / or the display detection result, and the switching calibration time; and switches the current refresh rate to the target refresh rate according to the target switching strategy to obtain a refresh rate switching result. When the terminal needs to switch the refresh rate, the vertical synchronization processing switching calibration time is determined according to the current refresh rate and the target refresh rate to be switched, and whether to immediately / delay the refresh rate switching target switching strategy is determined according to the frame data display information and / or the display detection result of the terminal and the switching calibration time, and the current refresh rate is immediately / delayed switched to the target refresh rate by using the target switching strategy, so as to realize dynamically immediate or delayed refresh rate switching according to the terminal display scenario, avoid the jamming problem in the refresh rate switching process, and improve the terminal display fluency.

[0139] An embodiment of the present invention further provides a display control device, as Figure 6 shown, Figure 6 is a schematic structural diagram of an embodiment of the display control device provided in the embodiment of the present application.

[0140] The display control device integrates any one of the display control devices provided in the embodiments of the present invention. The display control device includes:

[0141] one or more processors;

[0142] a memory; and

[0143] one or more applications, where the one or more applications are stored in the memory and are configured to be executed by the processor to perform the steps in the display control method in any one of the embodiments of the above display control method embodiment.

[0144] Specifically: The display control device may include a processor 601 with one or more processing cores, a memory 602 with one or more computer-readable storage media, a power supply 603, an input unit 604 and other components. Those skilled in the art can understand that Figure 6 the display control device structure shown in

[0145] The processor 601 is the control center of the display control device, connecting various parts of the entire display control device through various interfaces and circuits. By running or executing software programs and / or modules stored in the memory 602, and calling data stored in the memory 602, it executes various functions of the display control device and processes data, thereby monitoring the display control device as a whole. Optionally, the processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor. Among them, the application processor mainly processes the operating system, user interface, application programs, etc., and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor may not be integrated into the processor 601 either.

[0146] The memory 602 can be used to store software programs and modules. The processor 601 executes various functional applications and data processing by running the software programs and modules stored in the memory 602. The memory 602 mainly includes a program storage area and a data storage area. Among them, the program storage area can store the operating system, application programs required for at least one function (such as the sound playback function, image playback function, etc.); the data storage area can store data created according to the use of the display control device. In addition, the memory 602 can include high-speed random access memory, and can also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage devices. Correspondingly, the memory 602 can also include a memory controller to provide the processor 601 with access to the memory 602.

[0147] The display control device further includes a power supply 603 for powering each component. Preferably, the power supply 603 can be logically connected to the processor 601 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system. The power supply 603 can also include any components such as one or more DC or AC power supplies, a recharge system, a power failure detection circuit, a power converter or inverter, and a power status indicator.

[0148] The display control device may further include an input unit 604, which can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls.

[0149] Although not shown, the display control device may further include a display unit, etc., which will not be elaborated here. Specifically, in this embodiment, the processor 601 in the display control device will load the executable files corresponding to the processes of one or more application programs into the memory 602 according to the following instructions, and the processor 601 will run the application programs stored in the memory 602 to achieve various functions as follows:

[0150] In response to a refresh rate switching request, obtain the current refresh rate and the target refresh rate to be switched.

[0151] Determine the switching calibration time corresponding to the refresh rate switching request according to the target refresh rate.

[0152] Determine a target switching strategy according to the frame data display information and / or the display detection result, and the switching calibration time.

[0153] Switch the current refresh rate to the target refresh rate according to the target switching strategy to obtain a refresh rate switching result.

[0154] For this reason, an embodiment of the present invention provides a computer-readable storage medium, which may include: a read-only memory (ROM, Read Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disc, etc. A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps in any of the display control methods provided by the embodiments of the present invention. For example, when the computer program is loaded by the processor, the following steps may be executed:

[0155] In response to a refresh rate switching request, obtain the current refresh rate and the target refresh rate to be switched.

[0156] Determine the switching calibration time corresponding to the refresh rate switching request according to the target refresh rate.

[0157] Determine a target switching strategy according to the frame data display information and / or the display detection result, and the switching calibration time.

[0158] Switch the current refresh rate to the target refresh rate according to the target switching strategy to obtain a refresh rate switching result.

[0159] In the above embodiments, the descriptions of the respective embodiments have their own emphases. For parts not detailed in a certain embodiment, reference may be made to the detailed descriptions of other embodiments above, and details will not be repeated here.

[0160] In specific implementation, the above-mentioned respective units or structures may be implemented as independent entities, or may be combined arbitrarily to be implemented as the same or several entities. For the specific implementation of the above-mentioned respective units or structures, reference may be made to the method embodiments above, and details will not be repeated here.

[0161] For the specific implementation of the above respective operations, reference may be made to the foregoing embodiments, and details will not be repeated here.

[0162] The above has introduced in detail a display control method provided by an embodiment of the present application. Specific embodiments are used herein to elaborate on the principles and implementation manners of the present invention. The description of the above embodiments is only used to help understand the method and its core idea of the present invention; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation manners and application scopes. In summary, the content of this specification should not be construed as a limitation on the present invention.

Claims

1. A display control method, characterized in that The display control method includes: In response to a refresh rate switching request, obtain the current refresh rate and the target refresh rate to be switched; Determine the switching calibration time corresponding to the refresh rate switching request according to the target refresh rate; Determine a target switching strategy according to the frame data display information and / or the display detection result, and the switching calibration time; Switch the current refresh rate to the target refresh rate according to the target switching strategy to obtain a refresh rate switching result.

2. The display control method according to claim 1, wherein The determining the switching calibration time corresponding to the refresh rate switching request according to the target refresh rate includes: Determine the number of calibration cycle corresponding to the refresh rate switching request according to the target refresh rate; Determine the switching calibration time according to the refresh cycle duration corresponding to the target refresh rate and the number of calibration cycles.

3. The display control method according to claim 1, characterized in that, The determining the target switching strategy according to the frame data display information and / or the display detection result, and the switching calibration time includes: Determine the frame data display information corresponding to the refresh rate switching request, and read the frame data to be displayed and the current display frame rate in the frame data display information; Calculate the expected display time corresponding to the frame data to be displayed by using the current display frame rate; Determine a target switching strategy according to the expected display time and / or the display detection result, and the switching calibration time.

4. The display control method according to claim 3, wherein The determining the target switching strategy according to the expected display time and / or the display detection result, and the switching calibration time includes: If the expected display time is greater than the switching calibration time, determine the immediate switching strategy as the target switching strategy corresponding to the refresh rate switching request; If the expected display time is less than the switching calibration time, perform an overtime display detection on the display interaction events within the update synchronization period to obtain a display detection result; Determine the target switching strategy corresponding to the refresh rate switching request based on the display detection result.

5. The display control method according to claim 4, wherein The performing an overtime display detection on the display interaction events within the update synchronization period to obtain a display detection result includes: Obtain the display interaction events triggered in the update synchronization period, and extract the display interaction information of the display interaction events; Obtain the detected display frame and / or the layer refresh type in the display interaction information, and perform a display detection according to the detected display frame and / or the layer refresh type to obtain a display detection result.

6. The display control method according to claim 5, characterized in that, The determining the target switching strategy corresponding to the refresh rate switching request based on the display detection result includes: If the display detection result is an animation display result, determine the immediate switching strategy as the target switching strategy corresponding to the refresh rate switching request; If the display detection result is a region refresh result, determine the immediate switching strategy as the target switching strategy corresponding to the refresh rate switching request; If the display detection result is a global refresh result, determine the delayed switching strategy as the target switching strategy corresponding to the refresh rate switching request.

7. The display control method according to any one of claims 1-6, characterized in that, The refresh rate switching result includes a first refresh rate switching result and a second refresh rate switching result; The switching the current refresh rate to the target refresh rate according to the target switching strategy to obtain a refresh rate switching result includes: If the target switching strategy is an immediate switching strategy, use the immediate switching strategy to switch the current refresh rate to the target refresh rate using the target composite layer, and obtain a first refresh rate switching result; If the target switching strategy is a delayed switching strategy, switch the current refresh rate to the target refresh rate according to the update synchronization period corresponding to the display detection result and the target composite layer delay, and obtain a second refresh rate switching result.

8. A display control device, characterized in that, The display control device includes: A refresh rate acquisition module configured to respond to a refresh rate switching request and acquire the current refresh rate and the target refresh rate to be switched; A calibration duration module configured to determine the switching calibration time corresponding to the refresh rate switching request according to the target refresh rate; A switching strategy module configured to determine a target switching strategy according to the frame data display information and / or the display detection result, and the switching calibration time; A refresh rate switching module configured to switch the current refresh rate to the target refresh rate according to the target switching strategy, and obtain a refresh rate switching result.

9. A display control device, characterized in that, The display control device includes: One or more processors; A memory; and One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the steps of the display control method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, A computer program is stored thereon, and the computer program is loaded by the processor to execute the steps of the display control method according to any one of claims 1 to 7.

Images