Display control method and device, equipment and storage medium

Abstract

The invention provides a display control method and device, equipment and a storage medium, and the method comprises the steps: obtaining the layer interaction data of an application display layer in response to a display control request for the application display layer; determining a predicted refresh rate of the application display layer according to the layer interaction data and a display prediction model; and performing display control on the application display layer based on the predicted refresh rate and the terminal operation mode to obtain a display control result. According to the technical scheme, hardware does not need to be adjusted, and the display refresh rate of each application display layer is dynamically controlled according to the predicted refresh rate and the terminal operation mode, so that the display effect and performance of the terminal are improved, and the display power consumption of the terminal is remarkably reduced.

Description

Technical Field

[0001] This application relates to the field of computer technology, and specifically to a display control method, apparatus, device, and storage medium. Background Technology

[0002] Currently, with the widespread use of high refresh rate screens (such as 120Hz, 144Hz and above) on smart devices, high refresh rate displays can bring users a smoother display experience. However, high refresh rate displays also lead to a significant increase in hardware power consumption. Furthermore, the current application layer graphics rendering process uses a unified rendering signal strategy, meaning that all application layers are refreshed according to the same cycle. This causes application layers with low refresh requirements to refresh frequently because they cannot adjust the signal cycle, resulting in a significant increase in power consumption and affecting display performance. Summary of the Invention

[0003] This application provides a display control method, apparatus, device, and storage medium, aiming to solve the technical problem of high display power consumption in high refresh rate display scenarios in the prior art.

[0004] On one hand, embodiments of this application provide a display control method, which includes the following steps: In response to a display control request for an application display layer, obtain the layer interaction data of the application display layer; The predicted refresh rate of the application display layer is determined based on the layer interaction data and the display prediction model; The display of the application display layer is controlled based on the predicted refresh rate and the terminal operating mode to obtain the display control result.

[0005] In one possible implementation of this application, determining the predicted refresh rate of the application display layer based on the layer interaction data and the display prediction model includes: Feature extraction is performed on the layer interaction data to obtain the layer display features of the application display layer; The predicted refresh rate of the application display layer is generated based on the display prediction model and the layer display characteristics.

[0006] In one possible implementation of this application, generating the predicted refresh rate of the application display layer based on the display prediction model and the layer display characteristics includes: Obtain the feature priority parameter corresponding to the layer display feature in the display prediction model. The feature priority parameter is a variable learning parameter corresponding to the layer display feature obtained by machine learning from the display prediction model. Calculate feature prediction parameters based on the feature priority parameters corresponding to the layer display features and the layer display features; The sum of the feature prediction parameters corresponding to the application display layer is calculated to obtain the predicted refresh rate of the application display layer.

[0007] In one possible implementation of this application, the refresh rate prediction algorithm corresponding to the predicted refresh rate in the display prediction model is as follows:

[0008] in, To predict refresh rate, , , , , To display the layer display features corresponding to the application's display layer, , , , and Display the feature priority parameters corresponding to the features of the layer.

[0009] In one possible implementation of this application, display control of the application display layer is performed based on the predicted refresh rate and the terminal operating mode to obtain a display control result, including: Read the terminal operation identifier and determine the terminal operation mode corresponding to the terminal operation identifier; The target refresh rate of the application display layer is determined based on the preset refresh rate corresponding to the terminal operating mode and the predicted refresh rate. The display of the application display layer is controlled according to the target refresh rate to obtain the display control result.

[0010] In one possible implementation of this application, the target refresh rate includes a first target refresh rate and a second target refresh rate; Determining the target refresh rate of the application display layer based on the preset refresh rate corresponding to the terminal operating mode and the predicted refresh rate includes: If the terminal is in the first operating mode, then the preset refresh rate corresponding to the first operating mode is determined as the target refresh rate of the application display layer. If the terminal is in the second operating mode, then the predicted refresh rate is determined as the target refresh rate of the application display layer.

[0011] In one possible implementation of this application, display control of the application display layer is performed according to the target refresh rate to obtain a display control result, including: Obtain the initial display signal frequency corresponding to the application display layer; The initial display signal frequency is updated according to the target refresh rate to obtain the target display signal frequency; Based on the target display signal frequency, the layer image frame of the application display layer is displayed to obtain the display control result.

[0012] On the other hand, this application provides a display control device, the display control device comprising: The data acquisition module is configured to respond to a display control request for an application display layer and acquire the layer interaction data of the application display layer. The refresh prediction module is configured to determine the predicted refresh rate of the application display layer based on the layer interaction data and the display prediction model. The display control module is configured to control the display of the application display layer based on the predicted refresh rate and the terminal operating mode, and obtain the display control result.

[0013] On the other hand, this application also provides a display control device, the display control device comprising: One or more processors; Memory; and One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the steps of the display control method.

[0014] On the other hand, this application also provides a computer-readable storage medium having a computer program stored thereon, the computer program being loaded by a processor to execute the steps in the display control method.

[0015] This application obtains layer interaction data of an application display layer in response to a display control request; determines the predicted refresh rate of the application display layer based on the layer interaction data and a display prediction model; and performs display control on the application display layer based on the predicted refresh rate and the terminal operating mode to obtain a display control result. This achieves the goal of obtaining layer interaction data for each application's corresponding application display layer, and using this data and a pre-trained display prediction model to infer and determine the predicted refresh rate for that application display layer. This allows for independent calculation of a suitable predicted refresh rate for each application display layer, and display control based on the predicted refresh rate and the terminal operating mode. This enables dynamic control of the display refresh rate of each application display layer based on the predicted refresh rate and the terminal operating mode without hardware adjustments, thereby improving terminal display effects and performance, and significantly reducing terminal display power consumption. Attached Figure Description

[0016] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 This is a schematic diagram illustrating a scenario of the control method in an embodiment of this application; Figure 2 This is a flowchart illustrating one embodiment of the control method shown in this application. Figure 3 A flowchart illustrating an embodiment of the display control method for generating a predicted refresh rate provided in this application; Figure 4 A flowchart illustrating one embodiment of the display control method for determining a target refresh rate provided in this application; Figure 5 A schematic diagram of the structure of one embodiment of the display control device provided in this application; Figure 6 This is a schematic diagram of one embodiment of the display control device provided in this application. Detailed Implementation

[0018] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0019] In the description of this invention, it should be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," and "outer," etc., indicating orientation or positional relationships based on the orientation or positional relationships shown in the accompanying drawings, are only for the convenience of describing the invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the invention. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include one or more of the stated features. In the description of this invention, "a plurality of" means two or more, unless otherwise explicitly specified.

[0020] In this application, the term "exemplary" is used to mean "serving as an example, illustration, or description." Any embodiment described as "exemplary" in this application is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is provided to enable any person skilled in the art to make and use the invention. Details are set forth in the following description for purposes of explanation. It should be understood that those skilled in the art will recognize that the invention can be made without using these specific details. In other instances, well-known structures and processes will not be described in detail to avoid obscuring the description of the invention with unnecessary detail. Therefore, the invention is not intended to be limited to the embodiments shown, but is consistent with the broadest scope of the principles and features disclosed in this application.

[0021] Currently, with the widespread use of high refresh rate screens (such as 120Hz, 144Hz and above) on smart devices, high refresh rate displays can bring users a smoother display experience. However, high refresh rate displays also lead to a significant increase in hardware power consumption. Furthermore, the current application layer graphics rendering process uses a unified rendering signal strategy, meaning that all application layers are refreshed according to the same cycle. This causes application layers with low refresh requirements to refresh frequently because they cannot adjust the signal cycle, resulting in a significant increase in power consumption and affecting display performance.

[0022] Based on this, this application proposes a display control method, apparatus, device, and computer-readable storage medium to solve the technical problem of high display power consumption in high refresh rate display scenarios in the prior art.

[0023] The display control method in this embodiment of the invention is applied to a display control device, which is disposed in a display control equipment. The display control equipment is provided with one or more processors, a memory, and one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the processor to implement the display control method. The display control equipment can be a smart display terminal, such as a mobile phone, tablet computer, smart TV, smart wearable device (such as smart glasses, smartwatch, smart bracelet, AR / VR / XR head-mounted display device, etc.), and smart computer, etc. Optionally, the display control equipment can also be a server or a service cluster composed of multiple servers.

[0024] like Figure 1 As shown, Figure 1 This is a schematic diagram of a display control method according to an embodiment of the present application. The display control scenario in this embodiment includes a display control device 100 (the display control device 100 integrates a display control unit), and the display control device 100 has a computer-readable storage medium corresponding to the display control method running in it to execute the steps of the display control method.

[0025] Understandable Figure 1 The display control device in the scenario of the display control method, or the device included in the display control device, does not constitute a limitation on the embodiments of the present invention. That is, the number or type of display control device included in the scenario of the display control method, or the number or type of device included in each device, does not affect the overall implementation of the technical solution in the embodiments of the present invention, and can all be considered as equivalent substitutions or derivatives of the technical solutions claimed in the embodiments of the present invention.

[0026] In this embodiment of the invention, the display control device 100 is mainly used to: respond to a display control request for an application display layer and obtain the layer interaction data of the application display layer; The predicted refresh rate of the application display layer is determined based on the layer interaction data and the display prediction model; The display of the application display layer is controlled based on the predicted refresh rate and the terminal operating mode to obtain the display control result.

[0027] The display control device 100 in this embodiment of the invention can be an independent smart display terminal, such as a mobile phone, tablet computer, smart TV, smart wearable device (such as smart glasses, smart watch, smart bracelet, AR / VR / XR head-mounted display device, etc.) and smart computer, or it can be a display control network or display control cluster composed of multiple display control devices.

[0028] This application provides a display control method, apparatus, device, and computer-readable storage medium, which will be described in detail below.

[0029] It will be understood by those skilled in the art that Figure 1 The application environment shown is only one application scenario related to the solution of this application and does not constitute a limitation on the application scenario of this application. Other application environments may include more than one application scenario. Figure 1 The number of display control devices shown, or the display control network connections, for example... Figure 1 Only one display control device is shown in the diagram. It is understood that the scenario of this display control method may also include one or more display control devices, which are not specifically limited here. The display control device 100 may also include a memory for storing layer interaction data, predicted refresh rate and other data of each application display layer.

[0030] It should be noted that, Figure 1 The schematic diagram of the display control method shown is merely an example. The scenarios of the display control method described in the embodiments of the present invention are intended to more clearly illustrate the technical solutions of the embodiments of the present invention and do not constitute a limitation on the technical solutions provided in the embodiments of the present invention.

[0031] Based on the scenarios described above for display control methods, various embodiments of the display control method disclosed in this invention are proposed.

[0032] like Figure 2 As shown, Figure 2 This is a flowchart illustrating one embodiment of the display control method in this application. The display control method includes the following steps 201 to 203: 201. Respond to the display control request for the application display layer and obtain the layer interaction data of the application display layer; The display control method in this embodiment is applied to a display control device. The type and number of display control devices are not specifically limited. That is, the display control device can be one or more smart display terminals with high refresh rate screens (e.g., display screens with refresh rates of 120Hz, 144Hz and above). In a specific embodiment, the display control device can be any one or more of the following smart display terminals: mobile phone, tablet computer, smart TV, smart wearable device (e.g., smart glasses, smartwatch, smart bracelet, AR / VR / XR head-mounted display device, etc.) and smart computer.

[0033] The application display layer is a logical unit in the display control device that displays the processing interface associated with the application. It is used to organize and manage the display content. Each application display layer can contain different types or modalities of display content. For example, an application display layer can display images, text, and videos. Optionally, in other embodiments, the application display layer can also display other types or modalities of display content.

[0034] Optionally, the display control device can overlay at least one application display layer to form the final display content corresponding to the application. The application can also interact with the display control device through the layer interface to create, modify, and delete application display layers. In addition, the application can also draw display content in the corresponding application display layer and control the layer attributes of the application display layer.

[0035] Optionally, due to the drawbacks of existing technologies in high refresh rate screens, such as excessive power consumption, uneven resource allocation, and limited display performance caused by the uniform use of display signals, i.e., all application display layers are refreshed and scheduled according to the same cycle, the display control device also responds to display control requests for application display layers during operation, and sets independent refresh rates for application display layers through these display control requests to dynamically schedule refreshes, thereby improving the flexibility and performance of terminal display and reducing terminal display power consumption.

[0036] Optionally, the display control request is a control event that drives the display control device to predict the refresh rate and dynamically schedule the refresh of the application display layer. Optionally, the triggering method of this display control request is not specifically limited here; that is, the display control request can be actively triggered by the user. For example, the user can trigger a display control request for the display layer corresponding to any application by clicking the dynamic control button corresponding to any application on the display control interface provided by the display control device. In addition, the display control request can also be automatically triggered by the display control device. For example, the display control device has a display control process set up, and when the dynamic control conditions corresponding to the display control process are met, the display control request corresponding to that display control process is automatically triggered. The dynamic control conditions can be that the system time is in the range of [8:00-11:30] or the display control device is in [high refresh rate] display mode. Optionally, in other embodiments, corresponding dynamic control conditions can be set according to other display requirements; this embodiment does not specifically limit this.

[0037] Optionally, the layer interaction data is historical behavior data describing the application display layer during startup or dynamic tasks, used to analyze the layer refresh requirements and behavior patterns of the application display layer. The layer refresh requirement characterizes the refresh rate configuration required by the application display layer. Optionally, in one specific embodiment, the layer interaction data is obtained by the display control device monitoring the application display layer during startup or dynamic tasks to record its layer behavior data. Optionally, in one specific embodiment, the layer interaction data includes any one or more of the following: layer change frequency, layer update interval, layer interaction data, layer change amplitude, and layer focus state.

[0038] Optionally, the layer change frequency is information that characterizes how frequently the application displays layers undergo changes (such as creation, modification, or deletion).

[0039] Optionally, the layer update interval is the average time difference that occurs when the application displays a layer that has been updated.

[0040] Optionally, layer interaction data refers to interactive behavior data that characterizes the human-computer interaction between the user and the application's display layers.

[0041] Optionally, the layer change magnitude is the range of pixels representing the change in the layer area when the application displays a layer change and / or a layer update.

[0042] Optionally, the layer focus state indicates whether the layer being displayed by the application is the layer with focus.

[0043] Optionally, when the display control device is in a display mode corresponding to a high refresh rate, it performs real-time layer monitoring on each application display layer, obtains the layer interaction data corresponding to each application display layer, and after obtaining a display control request, determines the application display layer to which the display control request points and reads the layer interaction data corresponding to that application display layer.

[0044] 202. Determine the predicted refresh rate of the application display layer based on the layer interaction data and the display prediction model; Optionally, after acquiring the layer interaction data of the application display layer, the display control device also determines the predicted refresh rate of the application display layer based on the layer interaction data and the display prediction model.

[0045] Optionally, the display prediction model is an artificial intelligence model used to predict the refresh rate of any application display layer. Optionally, in one specific embodiment, the display prediction model is a machine learning model trained to generate a refresh rate prediction algorithm. This refresh rate prediction algorithm is used to predict the layer refresh requirements of the application display layer and generate corresponding algorithm information for the predicted refresh rate. Optionally, the refresh rate prediction algorithm can predict the layer refresh requirements of the application display layer using feature priority parameters obtained from training the display prediction model and layer display features corresponding to layer interaction data, and generate corresponding algorithm information for the predicted refresh rate.

[0046] Optionally, the predicted refresh rate is the refresh rate data predicted by the display prediction model to meet the layer refresh requirements of the application display layer. That is, the display prediction model can independently generate a corresponding layer refresh rate for each application display layer, so as to independently perform dynamic refresh rate adaptation and control of the application display layer, thereby improving the flexibility and performance of the terminal display and reducing the power consumption of the terminal display.

[0047] Optionally, the display control device pre-configures a display prediction model for dynamically adapting the refresh rate of each application display layer. This display prediction model trains an initial model using layer interaction data from each dynamically refreshed application display layer to obtain a machine learning model with feature priority parameters.

[0048] Optionally, after obtaining the display prediction model, the display control device also uses the display prediction model to perform refresh rate prediction processing by applying the layer interaction data of the display layer to obtain the predicted refresh rate.

[0049] Optionally, the display control device can extract features from the layer interaction data through the feature extraction module in the display prediction model and / or other independent feature extraction modules to obtain the layer display features of the application display layer, and generate the predicted refresh rate of the application display layer based on the display prediction model and the layer display features.

[0050] Optionally, the layer display feature is a multi-dimensional feature vector obtained by extracting features from the layer interaction data of the application display layer. Optionally, in a specific embodiment, the layer display feature includes feature vector data corresponding to at least one modality or type of layer interaction data. That is, the layer display feature includes a combination of multi-modal feature vector data corresponding to each layer interaction data arranged in a preset order. Optionally, in a specific embodiment, a specific representation of the layer display feature is [Tavg, fchange, winteraction, Adelta, Ffocus]. Wherein, Tavg is the feature vector data corresponding to the layer update interval, in milliseconds. Fchange is the feature vector data corresponding to the layer change frequency, in the number of times. Winteraction is the feature vector data corresponding to the layer interaction data, represented as weight data, with a value range of [0, 1]. Adelta is the feature vector data corresponding to the layer change amplitude, in pixels. Ffocus is the feature vector data corresponding to the layer focus state, which is binary data, where 1 indicates that the layer focus state exists; 0 indicates that the layer focus state does not exist.

[0051] Optionally, after generating the layer display features corresponding to the application display layer, the display control device uses the layer display features as the model input of the display prediction model, inputs the layer display features into the display prediction model, and uses the display prediction model and the layer display features to perform model inference to generate the predicted refresh rate of the application display layer, so as to independently perform dynamic refresh rate adaptation and control of the application display layer, thereby improving the terminal display flexibility and display performance and reducing the terminal display power consumption.

[0052] 203. Based on the predicted refresh rate and terminal operating mode, perform display control on the application display layer to obtain the display control result.

[0053] Optionally, after generating the predicted refresh rate for each application display layer using the display prediction model, the display control device further performs display control on the application display layer based on the predicted refresh rate and the terminal operating mode, obtaining a display control result. The display control result represents the control result of independently adjusting the refresh rate of the application display layer.

[0054] Optionally, the display control device, after generating the predicted refresh rate corresponding to each application display layer, further determines the terminal operating mode corresponding to the display terminal to which the display control device or application display layer is to be displayed, and determines the target refresh rate of the application display layer based on the preset refresh rate corresponding to the terminal operating mode and the predicted refresh rate. The preset refresh rate is the default refresh rate of the layer pre-set in the terminal operating mode. In one specific embodiment, the terminal operating mode is a first operating mode representing low-power saving operation, and the corresponding preset refresh rate is the minimum refresh rate. The target refresh rate is the refresh rate to be applied to the application display layer. The target refresh rate can be either the preset refresh rate or the predicted refresh rate.

[0055] That is, after determining the predicted refresh rate, the display control device also reads the terminal operation identifier to determine the terminal operation mode corresponding to the terminal operation identifier. The terminal operation identifier is identification information representing the terminal operation mode. This terminal operation mode represents the system operation mode currently selected by the display control device or other terminal. Optionally, this terminal operation mode includes a first operation mode indicating that the display control device or other terminal is in power-saving priority (low power operation), and a second operation mode indicating that the display control device or other terminal is in performance priority.

[0056] Optionally, after determining the terminal's operating mode, the display control device also obtains the preset refresh rate corresponding to that operating mode, selects the target refresh rate for the application display layer from the preset refresh rate and the predicted refresh rate, and dynamically controls the display of the application display layer according to the target refresh rate to obtain a display control result. This display control result represents the control result of independently controlling the refresh rate of the application display layer.

[0057] Optionally, in one specific embodiment, after obtaining the target refresh rate corresponding to the application display layer, the display control device also obtains the initial display signal frequency corresponding to the application display layer. The initial display signal frequency is the display signal frequency of the application display layer before refresh rate control, and is used to control the frame output of the application display layer. Optionally, in one specific embodiment, the initial display signal is an unadjusted VSYNC (Vertical Synchronization) signal.

[0058] Optionally, the display control device updates the initial display signal frequency according to the target refresh rate to obtain the target display signal frequency. That is, the display control device adjusts the initial display signal frequency corresponding to the application display layer by increasing or decreasing it based on the target refresh rate to obtain the target display signal frequency. For example, in one specific embodiment, if the target refresh rate corresponding to the application display layer is 120Hz, the display control device increases the initial display signal frequency corresponding to the application display layer to obtain the target display signal frequency, so that a new display frame is submitted for each initial display signal. If the target refresh rate corresponding to the application display layer is 60Hz, the display control device decreases the initial display signal frequency corresponding to the application display layer to obtain the target display signal frequency, so that a new display frame is submitted for every other initial display signal.

[0059] Optionally, the display control device displays the layer image frame of the application display layer based on the target display signal frequency to obtain the display control result. That is, the display control device controls the display signal output corresponding to the application display layer based on the target display signal frequency to achieve independent and dynamic display control of each application display layer. This allows different application display layers to be displayed at the target refresh rate that meets the layer refresh requirements, thereby achieving dynamic control of the display refresh rate of each application display layer based on the predicted refresh rate and the terminal operating mode without hardware adjustments. This improves the terminal display effect and performance and significantly reduces the terminal display power consumption.

[0060] In this embodiment, the display control device obtains layer interaction data of the application display layer in response to a display control request for that layer; determines the predicted refresh rate of the application display layer based on the layer interaction data and a display prediction model; and performs display control on the application display layer based on the predicted refresh rate and the terminal operating mode to obtain a display control result. This achieves the goal of obtaining layer interaction data for each application's corresponding display layer, and using this data and a pre-trained display prediction model to infer and determine the predicted refresh rate for that application display layer. This allows for independent calculation of the appropriate predicted refresh rate for each application display layer, and display control based on the predicted refresh rate and the terminal operating mode. This eliminates the need for hardware adjustments, dynamically controlling the display refresh rate of each application display layer based on the predicted refresh rate and the terminal operating mode, thereby improving the terminal's display effect and performance, and significantly reducing terminal display power consumption.

[0061] like Figure 3 As shown, Figure 3 A flowchart illustrating an embodiment of the display control method for generating a predicted refresh rate provided in this application is shown below. Figure 3As shown, the display control method further includes steps 301 to 303: 301. Obtain the feature priority parameters corresponding to the layer display features in the display prediction model; 302. Calculate feature prediction parameters based on the feature priority parameters corresponding to the layer display features and the layer display features; 303. Calculate the sum of the feature prediction parameters corresponding to the application display layer to obtain the predicted refresh rate of the application display layer.

[0062] Based on the above embodiments, in this embodiment, after the control device obtains the layer display characteristics of the application display layer, it also determines the predicted refresh rate of the application display layer based on the layer display characteristics and the display prediction model.

[0063] Optionally, the display control device obtains feature priority parameters corresponding to the layer display features in the display prediction model. These feature priority parameters are variable learning parameters corresponding to the layer display features obtained by the display prediction model through machine learning. That is, the display control device pre-trains the display prediction model to obtain variable learning parameters corresponding to each layer display feature, generating feature priority parameters. These feature priority parameters are used to control the priority of associated layer display features. In one specific embodiment, the feature priority parameters include update interval priority parameters, change frequency priority parameters, interaction priority parameters, change magnitude priority parameters, and focus priority parameters.

[0064] The update interval priority parameter is a priority evaluation parameter corresponding to the layer update interval. The value range of this update frequency priority parameter is α < 0, indicating that the update interval of the application display layer has a negative impact on the priority; that is, the shorter the update interval of the application display layer, the higher the corresponding update interval priority.

[0065] The change frequency priority parameter is a priority evaluation parameter corresponding to the layer's change frequency. The value range of this change frequency priority parameter is β∈(0,1), indicating that the layer change frequency has a positive impact on priority. That is, the higher the change frequency of the applied display layer, the higher the corresponding change frequency priority. Furthermore, the closer the value is to 1, the higher the corresponding change frequency priority.

[0066] The interaction priority parameter is the interaction weight parameter corresponding to the layer's interaction data. This parameter ranges from γ∈(0,1), indicating a positive correlation between the frequency of layer changes and the priority. That is, the higher the interactivity of the displayed layer, the higher the corresponding interaction priority. Furthermore, the closer the value is to 1, the higher the corresponding interaction priority.

[0067] The change magnitude priority parameter represents the priority corresponding to the change magnitude of the layer. Its value range is δ∈(0,1), indicating that the change magnitude of the layer has a positive impact on the priority. That is, the larger the area of ​​change in the displayed layer, the higher the corresponding interaction priority. Furthermore, the closer the value is to 1, the higher the corresponding interaction priority.

[0068] The focus priority parameter represents the priority corresponding to the focus state of the layer. Its value range is η∈(0,1), indicating that the focus state has a relatively high positive impact on the priority. That is, if the application displays a layer with focus, the corresponding interaction priority is high.

[0069] Optionally, after obtaining the feature priority parameters, the display control device also calculates feature prediction parameters based on the feature priority parameters corresponding to the display features of that layer and the display features of that layer. That is, the display control device calculates the product between the feature priority parameters corresponding to the layer features and the display features of that layer to obtain the feature prediction parameters.

[0070] Optionally, after obtaining the feature prediction parameters corresponding to the display features of each layer, the display control device calculates the sum of the feature prediction parameters corresponding to the application display layer to obtain the predicted refresh rate of the application display layer. Optionally, in a specific embodiment, the refresh rate prediction algorithm for the predicted refresh rate is:

[0071] in, To predict refresh rate, , , , , To display the layer display features corresponding to the application's display layer, , , , and Display the feature priority parameters corresponding to the features of the layer.

[0072] Optionally, in generating the predicted refresh rate for each application display layer, the display control device further determines the terminal operating mode corresponding to the display terminal to be displayed by the display control device or the application display layer, and determines the target refresh rate of the application display layer according to the preset refresh rate and the predicted refresh rate of the terminal operating mode, and independently adjusts the refresh rate of the application display layer according to the target refresh rate to obtain the display control result.

[0073] In this embodiment, the display control device obtains feature priority parameters corresponding to the layer display features in the display prediction model. These feature priority parameters are variable learning parameters corresponding to the layer display features obtained through machine learning by the display prediction model. Feature prediction parameters are calculated based on the feature priority parameters and the layer display features. The sum of the feature prediction parameters corresponding to the application display layer is calculated to obtain the predicted refresh rate of the application display layer. This allows for the independent calculation of the predicted refresh rate for each application display layer using its own layer display features and the display prediction model. The predicted refresh rate is then used to dynamically control the display refresh rate of each application display layer, thereby improving the terminal display effect and performance, and significantly reducing terminal display power consumption.

[0074] like Figure 4 As shown, Figure 4 A flowchart illustrating one embodiment of the display control method for determining the target refresh rate provided in this application is shown below. Figure 4 In the illustrated embodiment, the display control method further includes 401-402: 401. If the terminal operating mode is the first operating mode, then the preset refresh rate corresponding to the first operating mode is determined as the target refresh rate of the application display layer; 402. If the terminal operating mode is the second operating mode, then the predicted refresh rate is determined as the target refresh rate of the application display layer.

[0075] Based on the above embodiments, in this embodiment, after generating the predicted refresh rate corresponding to each application display layer through the display prediction model, the display control device also performs display control on the application display layer based on the predicted refresh rate and the terminal operating mode to obtain the display control result.

[0076] That is, after determining the predicted refresh rate, the display control device also reads the terminal operation identifier to determine the terminal operation mode corresponding to the terminal operation identifier. The terminal operation identifier is identification information representing the terminal operation mode. This terminal operation mode represents the system operation mode currently selected by the display control device or other terminal. Optionally, this terminal operation mode includes a first operation mode indicating that the display control device or other terminal is in power-saving priority (low power operation), and a second operation mode indicating that the display control device or other terminal is in performance priority.

[0077] Optionally, after determining the terminal's operating mode, the display control device also obtains the preset refresh rate corresponding to that operating mode, selects the target refresh rate for the application display layer from the preset refresh rate and the predicted refresh rate, and dynamically controls the display of the application display layer according to the target refresh rate to obtain a display control result. This display control result represents the control result of independently controlling the refresh rate of the application display layer.

[0078] Optionally, if the display control device determines that the terminal's operating mode is the first operating mode, then the preset refresh rate corresponding to the first operating mode is determined as the target refresh rate of the application display layer, and the application display layer is controlled to display at a more power-saving preset refresh rate.

[0079] Optionally, if the display control device determines that the terminal is operating in the second operating mode, it determines the predicted refresh rate as the target refresh rate of the application display layer, thereby setting the corresponding target refresh rate for each application display layer for display control and realizing dynamic adjustment of each application display layer.

[0080] In this embodiment, the display control device determines the target refresh rate of the application display layer by setting the preset refresh rate corresponding to the first operating mode when the terminal operating mode is determined to be a first operating mode; if the terminal operating mode is a second operating mode, the predicted refresh rate is determined to be the target refresh rate of the application display layer. This enables dynamic configuration of the display refresh rate of each application display layer based on the terminal operating mode and the predicted refresh rate, thereby significantly reducing device power consumption.

[0081] To better implement the display control method in the embodiments of this application, a display control device is also provided in the embodiments of this application, such as... Figure 5 As shown, Figure 5 This is a schematic diagram of one embodiment of the display control device provided in this application. Specifically, the display control device 500 includes: The data acquisition module 501 is configured to acquire the layer interaction data of the application display layer in response to a display control request for the application display layer. The refresh prediction module 502 is configured to determine the predicted refresh rate of the application display layer based on the layer interaction data and the display prediction model; The display control module 503 is configured to control the display of the application display layer based on the predicted refresh rate and the terminal operating mode, and obtain the display control result.

[0082] In one possible implementation of this embodiment, the display control device determines the predicted refresh rate of the application display layer based on the layer interaction data and the display prediction model, including: Feature extraction is performed on the layer interaction data to obtain the layer display features of the application display layer; The predicted refresh rate of the application display layer is generated based on the display prediction model and the layer display characteristics.

[0083] In one possible implementation of this embodiment, the display control device generates the predicted refresh rate of the application display layer based on the display prediction model and the layer display characteristics, including: Obtain the feature priority parameter corresponding to the layer display feature in the display prediction model. The feature priority parameter is a variable learning parameter corresponding to the layer display feature obtained by machine learning from the display prediction model. Calculate feature prediction parameters based on the feature priority parameters corresponding to the layer display features and the layer display features; The sum of the feature prediction parameters corresponding to the application display layer is calculated to obtain the predicted refresh rate of the application display layer.

[0084] In one possible implementation of this embodiment, the refresh rate prediction algorithm corresponding to the predicted refresh rate in the display prediction model of the display control device is as follows:

[0085] in, To predict refresh rate, , , , , To display the layer display features corresponding to the application's display layer, , , , and Display the feature priority parameters corresponding to the features of the layer.

[0086] In one possible implementation of this embodiment, the display control device performs display control on the application display layer based on the predicted refresh rate and the terminal operating mode to obtain a display control result, including: Read the terminal operation identifier and determine the terminal operation mode corresponding to the terminal operation identifier; The target refresh rate of the application display layer is determined based on the preset refresh rate corresponding to the terminal operating mode and the predicted refresh rate. The display of the application display layer is controlled according to the target refresh rate to obtain the display control result.

[0087] In one possible implementation of this embodiment, the target refresh rate in the display control device includes a first target refresh rate and a second target refresh rate; The display control device determines the target refresh rate of the application display layer based on the preset refresh rate corresponding to the terminal operating mode and the predicted refresh rate, including: If the terminal is in the first operating mode, then the preset refresh rate corresponding to the first operating mode is determined as the target refresh rate of the application display layer. If the terminal is in the second operating mode, then the predicted refresh rate is determined as the target refresh rate of the application display layer.

[0088] In one possible implementation of this embodiment, the display control device performs display control on the application display layer according to the target refresh rate to obtain a display control result, including: Obtain the initial display signal frequency corresponding to the application display layer; The initial display signal frequency is updated according to the target refresh rate to obtain the target display signal frequency; Based on the target display signal frequency, the layer image frame of the application display layer is displayed to obtain the display control result.

[0089] In this embodiment, the display control device obtains layer interaction data of the application display layer in response to a display control request for that layer; determines the predicted refresh rate of the application display layer based on the layer interaction data and a display prediction model; and performs display control on the application display layer based on the predicted refresh rate and the terminal operating mode to obtain a display control result. This achieves the goal of obtaining layer interaction data for each application's corresponding display layer, and using this data and a pre-trained display prediction model to infer and determine the predicted refresh rate for that application display layer. This allows for independent calculation of a suitable predicted refresh rate for each application display layer, and display control based on the predicted refresh rate and the terminal operating mode. This eliminates the need for hardware adjustments, dynamically controlling the display refresh rate of each application display layer based on the predicted refresh rate and the terminal operating mode, thereby improving the terminal's display effect and performance, and significantly reducing terminal display power consumption.

[0090] This invention also provides a display control device, such as... Figure 6 As shown, Figure 6 This is a schematic diagram of one embodiment of the display control device provided in this application.

[0091] The display control device integrates any of the display control devices provided in the embodiments of the present invention, and the display control device includes: One or more processors; Memory; and One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor of the steps in the display control method described in any of the above embodiments of the display control method.

[0092] Specifically, the display control device may include components such as a processor 601 with one or more processing cores, a memory 602 with one or more computer-readable storage media, a power supply 603, and an input unit 604. Those skilled in the art will understand that... Figure 6 The display control device structure shown does not constitute a limitation on the display control device. It may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein: The processor 601 is the control center of the display control device. It connects various parts of the display control device via various interfaces and lines. By running or executing software programs and / or modules stored in the memory 602, and by calling data stored in the memory 602, it performs various functions and processes data of the display control device, thereby providing overall monitoring of the display control device. Optionally, the processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 601.

[0093] The memory 602 can be used to store software programs and modules. The processor 601 executes various functional applications and display control by running the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created based on the use of the display control device, etc. In addition, the memory 602 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602.

[0094] The display control device also includes a power supply 603 that supplies power to the various components. Preferably, the power supply 603 can be logically connected to the processor 601 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 603 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0095] The display control device may also include an input unit 604, which can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0096] Although not shown, the display control device may also include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 601 in the display control device loads the executable files corresponding to the processes of one or more application programs into the memory 602 according to the following instructions, and the processor 601 runs the application programs stored in the memory 602 to realize various functions, as follows: In response to a display control request for an application display layer, obtain the layer interaction data of the application display layer; The predicted refresh rate of the application display layer is determined based on the layer interaction data and the display prediction model; The display of the application display layer is controlled based on the predicted refresh rate and the terminal operating mode to obtain the display control result.

[0097] Therefore, embodiments of the present invention provide a computer-readable storage medium, which may include: read-only memory (ROM), random access memory (RAM), a magnetic disk, or an optical disk, etc. A computer program is stored thereon, which is loaded by a processor to execute the steps in any of the display control methods provided in the embodiments of the present invention. For example, the computer program loaded by the processor can execute the following steps: In response to a display control request for an application display layer, obtain the layer interaction data of the application display layer; The predicted refresh rate of the application display layer is determined based on the layer interaction data and the display prediction model; The display of the application display layer is controlled based on the predicted refresh rate and the terminal operating mode to obtain the display control result.

[0098] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the detailed descriptions of other embodiments above, which will not be repeated here.

[0099] In practice, each of the above units or structures can be implemented as an independent entity or can be arbitrarily combined to be implemented as the same or several entities. For the specific implementation of each of the above units or structures, please refer to the previous method embodiments, which will not be repeated here.

[0100] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0101] The above provides a detailed description of a display control method provided by the embodiments of this application. Specific embodiments have been used to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A display control method, characterized in that, The display control method includes: In response to a display control request for an application display layer, obtain the layer interaction data of the application display layer; The predicted refresh rate of the application display layer is determined based on the layer interaction data and the display prediction model. The display of the application display layer is controlled based on the predicted refresh rate and the terminal operating mode to obtain the display control result.

2. The display control method according to claim 1, characterized in that, Determining the predicted refresh rate of the application display layer based on the layer interaction data and the display prediction model includes: Feature extraction is performed on the layer interaction data to obtain the layer display features of the application display layer; The predicted refresh rate of the application display layer is generated based on the display prediction model and the layer display characteristics.

3. The display control method according to claim 2, characterized in that, The step of generating the predicted refresh rate of the application display layer based on the display prediction model and the layer display features includes: Obtain the feature priority parameter corresponding to the layer display feature in the display prediction model. The feature priority parameter is a variable learning parameter corresponding to the layer display feature obtained by machine learning from the display prediction model. Calculate feature prediction parameters based on the feature priority parameters corresponding to the layer display features and the layer display features; The sum of the feature prediction parameters corresponding to the application display layer is calculated to obtain the predicted refresh rate of the application display layer.

4. The display control method according to claim 2, characterized in that, The refresh rate prediction algorithm corresponding to the predicted refresh rate in the display prediction model is as follows: in, To predict refresh rate, , , , , To display the layer display features corresponding to the application's display layer, , , , and Display the feature priority parameters corresponding to the features of the layer.

5. The display control method according to claim 1, characterized in that, The step of controlling the display of the application display layer based on the predicted refresh rate and the terminal operating mode to obtain the display control result includes: Read the terminal operation identifier and determine the terminal operation mode corresponding to the terminal operation identifier; The target refresh rate of the application display layer is determined based on the preset refresh rate corresponding to the terminal operating mode and the predicted refresh rate. The display of the application display layer is controlled according to the target refresh rate to obtain the display control result.

6. The display control method according to claim 5, characterized in that, The target refresh rate includes a first target refresh rate and a second target refresh rate; Determining the target refresh rate of the application display layer based on the preset refresh rate corresponding to the terminal operating mode and the predicted refresh rate includes: If the terminal is in the first operating mode, then the preset refresh rate corresponding to the first operating mode is determined as the target refresh rate of the application display layer. If the terminal is in the second operating mode, then the predicted refresh rate is determined as the target refresh rate of the application display layer.

7. The display control method according to claim 5, characterized in that, The step of controlling the display of the application display layer according to the target refresh rate to obtain the display control result includes: Obtain the initial display signal frequency corresponding to the application display layer; The initial display signal frequency is updated according to the target refresh rate to obtain the target display signal frequency; Based on the target display signal frequency, the layer image frame of the application display layer is displayed to obtain the display control result.

8. A display control device, characterized in that, The display control device includes: The data acquisition module is configured to respond to a display control request for an application display layer and acquire the layer interaction data of the application display layer. The refresh prediction module is configured to determine the predicted refresh rate of the application display layer based on the layer interaction data and the display prediction model. The display control module is configured to control the display of the application display layer based on the predicted refresh rate and the terminal operating mode, and obtain the display control result.

9. A display control device, characterized in that, The display control device includes: One or more processors; Memory; and One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the steps of the display control method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, It stores a computer program, which is loaded by a processor to execute the steps of the display control method according to any one of claims 1 to 7.

Images