Terminal control method and device and electronic equipment

Abstract

The invention provides a terminal control method and device and electronic equipment, and relates to the technical field of artificial intelligence, in particular to the technical field of terminal control. According to the method, after it is determined that the state related to the image displayed in the display window of the application on the terminal is changed, the target parameter related to the display effect of the first image in the terminal can be adjusted, so that the terminal is prevented from continuously running with high performance or low performance; the problem that the power consumption of the terminal is increased or the display effect cannot meet the user requirement is solved, and the user experience is improved.

Description

[0001] This application is a divisional application of the original application with the application number 202080103255.4 and the original filing date of December 31, 2020, and the entire contents of the original application are incorporated herein by reference. TECHNICAL FIELD

[0002] The present application relates to the technical field of artificial intelligence, and in particular to a terminal control method and device and electronic equipment. BACKGROUND

[0003] At present, terminals such as mobile phones and computers have become necessities in people's lives. When a user uses a terminal, the user can install various application programs (APPs) on the terminal, such as video, game, social, news, and other application programs. However, when the user uses an application program on the terminal, the terminal often presents the content that the application program can provide, such as image content such as pictures and videos, to the user in the display window of the application program according to the display effect set by the user in the application program or the system default display effect, which makes the display effect of the content displayed in the display window of the application program unchanged during the user's use of the application program on the terminal. When the display effect of the content displayed in the display window of the application program on the terminal is unchanged, the terminal often continuously operates in a high-performance state or a low-performance state, which causes problems such as increased power consumption of the terminal or the display effect failing to meet the user's demand. Therefore, how to avoid the terminal continuously operating in a high-performance state or a low-performance state is a technical problem that needs to be solved at present. SUMMARY

[0004] The present application provides a terminal control method and device and electronic equipment, which can avoid the terminal continuously operating in a high-performance state or a low-performance state, help solve problems such as increased power consumption of the terminal or the display effect failing to meet the user's demand, and improve the user experience.

[0005] In a first aspect, the present application provides a terminal control method, which includes: determining that a target state is switched from a first state to a second state, the target state including at least one of a display state of a display window of a first application on a terminal or a user state of a user currently using the terminal, wherein the first application displays a first image on the display window; and adjusting a target parameter in the terminal, the target parameter being related to a display effect of the first image. Thus, in the present application, after determining that the state related to the image displayed in the display window of the application on the terminal changes, the parameter related to the display effect of the first image in the terminal is adjusted to adjust the display effect of the first image, thereby avoiding the terminal continuously operating in a high-performance state or a low-performance state, helping to solve problems such as increased power consumption of the terminal or the display effect failing to meet the user's demand, and improving the user experience.

[0006] In a possible implementation, the target state comprises a display state, and the display state comprises a size of a display window; and determining that the target state is switched from the first state to the second state comprises: determining that the size of the display window is switched from a first size to a second size. In this way, it is determined whether the target state changes. For example, if the size of the display window is 100 mm x 80 mm when the display window is displayed in full screen on the terminal, and the size of the display window is 50 mm x 80 mm when the display window is displayed in half screen, when the user switches the display window from full screen display to half screen display, the size of the display window is switched from 100 mm x 80 mm to 50 mm x 80 mm, and it can be determined that the size of the display window changes, that is, the target state changes at this time.

[0007] In a possible implementation, the target state comprises a display state, and the display state comprises target content expressed by a first image; and determining that the target state is switched from the first state to the second state comprises: determining that the target content is switched from a first content to a second content, where the type of the first content is different from the type of the second content. In this way, it is determined whether the target state changes. For example, when the first application is a game application, the user can play the game or watch others play the game on the display window of the application; when the user plays the game, the content expressed by the first image is game content, and the type of the content is game; when the user watches others play the game, the content expressed by the first image is video content, and the type of the content is video; at this time, if the content expressed by the first image is switched from game content to video content, it can be determined that the content expressed by the first image changes, that is, the target state changes at this time.

[0008] In a possible implementation, the target state comprises a user state, and the user state comprises target attention of a user to a first region on the display window, and the first region is used to display part or all of the first image; and determining that the target state is switched from the first state to the second state comprises: determining that the target attention is switched from a first attention to a second attention. In this way, it is determined whether the target state changes. For example, if the display screen of the terminal is divided into two regions, the first region is a region where the display window is located, and the second region is a region other than the display window, when the line of sight of the user is switched from the first region to the second region, it can be determined that the user no longer pays attention to the first region, that is, the user changes from paying attention to the image in the display window to no longer paying attention to the image in the display window, that is, the attention of the user to the image on the display window changes, that is, the target state changes at this time.

[0009] In a possible implementation, the method further includes: determining a gaze duration of the eye gaze of the user on the first region; and determining the target attention level according to a time duration interval to which the gaze duration belongs. In this way, the camera on the terminal can be used to track the motion state of the eye of the user, and when it is determined that the eye of the user gazes at the first region, the timing starts until the eye of the user no longer gazes at the first region, thereby counting the gaze duration of the eye of the user on the first region; then, the gaze duration is compared with the preconfigured time duration interval, and the time duration interval to which the current gaze duration belongs is determined; finally, the target attention level of the user on the first region on the display window is obtained according to the attention level corresponding to the time duration interval to which the current gaze duration belongs. For example, if the preconfigured relationship between the time duration interval and the attention level is that the gaze duration is 0-8 s, the attention level is level 1; the gaze duration is 8-16 s, the attention level is level 2; and the gaze duration is greater than 16 s, the attention level is level 3; when the counted gaze duration is 10 s, the attention level can be determined as level 2.

[0010] In a possible implementation, the target state includes a user state, and the user state includes a target operation frequency of the user operating the terminal; and the determining that the target state is switched from the first state to the second state includes: determining that the target operation frequency is switched from a first operation frequency to a second operation frequency. In this way, whether the target state changes is determined. For example, if the terminal is a mobile phone, when the operation frequency of the user operating the mobile phone is high, the user is usually in a game state; and when the operation frequency of the user operating the mobile phone is low, the user is usually in a video watching state, so when it is determined that the operation frequency of the user operating the mobile phone changes, it can be determined that the target state changes.

[0011] In a possible implementation, the adjusting the target parameter in the terminal includes: reducing at least one of a working frequency of a processor in the terminal or a working voltage of a power supply domain to which the processor belongs, the processor being configured to process the first image; or increasing at least one of the working frequency of the processor in the terminal or the working voltage of the power supply domain to which the processor belongs. In this way, the processor in the terminal can operate at a lower working frequency, or the power supply domain to which the processor belongs can be powered at a lower working voltage, so as to reduce the display effect of the first image, thereby avoiding the terminal from continuously operating at high performance, reducing the power consumption of the terminal; or the processor in the terminal can operate at a higher working frequency, or the power supply domain to which the processor belongs can be powered at a higher working voltage, so as to improve the display effect of the first image, thereby avoiding the terminal from continuously operating at low performance, improving the display effect of the terminal.

[0012] In a possible implementation, the method for reducing the working frequency of the processor in the terminal comprises: reducing the video post-processing performance of the decoder in the terminal; and reducing the working voltage of the power domain to which the processor belongs, comprising: reducing the matching voltage of the decoder in the terminal.

[0013] In a possible implementation, the method for adjusting the target parameter in the terminal comprises: increasing the number of first image processing algorithms, wherein the first image processing algorithms are used to process the first image; or reducing the number of first image processing algorithms. In this way, by increasing the number of first image processing algorithms, the terminal can process the first image with a smaller number of image processing algorithms to reduce the display effect of the first image, thereby avoiding the terminal from continuously running at high performance and reducing the power consumption of the terminal; or by reducing the number of first image processing algorithms, the terminal can process the first image with a larger number of image processing algorithms to improve the display effect of the first image, thereby avoiding the terminal from continuously running at low performance and improving the display effect of the terminal.

[0014] In a possible implementation, the first image processing algorithm comprises at least one of a de contour (DC) algorithm, a de mosquito (DM) algorithm, a de ring (DR) algorithm, a motion estimate and motion compensation (MEMC) algorithm, a noise reduction (NR) algorithm, and a super resolution (SR) algorithm.

[0015] In a possible implementation, the method further comprises: in the case of increasing the number of first image processing algorithms, the method further comprises: reducing the number of second image processing algorithms, the second image processing algorithms being used to process images in at least part of the display area of the terminal other than the area occupied by the display window; and in the case of reducing the number of first image processing algorithms, the method further comprises: increasing the number of second image processing algorithms. In this way, when improving the display effect of the first image, the number of image display algorithms for processing images in the area other than the display window of the terminal can be reduced to reduce the display effect of the images in the area other than the display window, thereby reducing the power consumption of the terminal; or when reducing the display effect of the first image, the number of image display algorithms for processing images in the area other than the display window of the terminal can be increased to improve the display effect of the images in the area other than the display window.

[0016] In a possible implementation, the second image processing algorithm includes at least one of a de contour (DC) algorithm, a de mosquito (DM) algorithm, a de ring (DR) algorithm, a motion estimate and motion compensation (MEMC) algorithm, a noise reduction (NR) algorithm, and an image super resolution (SR) algorithm.

[0017] In a possible implementation, the target parameter includes a frame rate; and adjusting the target parameter related to the first image in the terminal includes: performing frame dropping on a video stream corresponding to the first image, or performing frame filling on the video stream corresponding to the first image. In this way, when the target parameter is the frame rate, the target parameter is adjusted by performing frame dropping or frame filling on the video stream corresponding to the first image.

[0018] In a possible implementation, the target parameter includes a resolution; and adjusting the target parameter related to the first image in the terminal includes: adjusting a resolution of original image data related to the first image carried in a first request sent by the terminal to a server, the first request being used to request to acquire the original image data. In this way, when the target parameter is the resolution, the target parameter is adjusted by adjusting the resolution carried in the request sent by the terminal to the server.

[0019] In a possible implementation, the target parameter includes a first parameter corresponding to the first image in a first state; and adjusting the target parameter related to the first image in the terminal includes: determining a second parameter corresponding to the first image in a second state, the second parameter being of a same type as the first parameter; and adjusting the first parameter according to the first parameter and the second parameter. In this way, the parameter in the target state before a change is adjusted based on the parameters corresponding to the first image before and after the change of the target state, and the accuracy of the adjustment is improved.

[0020] In a possible implementation, the adjusting the first parameter according to the first parameter and the second parameter comprises: adjusting the first parameter to the second parameter when the first parameter and the second parameter have a deviation; or adjusting the first parameter based on a deviation value between the first parameter and the second parameter, so that the deviation value is less than or equal to a preset deviation value, when the deviation value is greater than the preset deviation value. Thus, the adjustment of the first parameter is realized. For example, if the resolution before the target state changes is 1080p and the resolution after the target state changes is 360p, it can be determined that there is a deviation between 1080p and 360p, and thus 1080p can be directly adjusted to 360p; or the deviation value between 1080p and 360p, such as a difference value, is greater than 500, and thus 1080p can be adjusted based on the deviation value between 1080p and 360p, so that the deviation value between 1080p and 360p is controlled to be less than or equal to 500, for example, 1080p is adjusted to 720p.

[0021] In a second aspect, the present application provides a terminal control apparatus, the apparatus comprising: a determining module configured to determine that a target state is switched from a first state to a second state, the target state comprising at least one of a display state of a display window of a first application on a terminal or a user state of a user currently using the terminal, and the display window of the first application displays a first image; the determining module is further configured to determine a first parameter required by the terminal to output the first image in the second state, the first parameter comprising at least one of an image quality, a frame rate or a resolution; and a processing module configured to adjust a target parameter in the terminal, the target parameter being related to a display effect of the first image.

[0022] In a possible implementation, the target state comprises the display state, and the display state comprises a size of the display window; and the determining module is specifically configured to determine that the size of the display window is switched from a first size to a second size.

[0023] In a possible implementation, the target state comprises the display state, and the display state comprises target content expressed by the first image; and the determining module is specifically configured to determine that the target content is switched from a first content to a second content, and a type of the first content is different from a type of the second content.

[0024] In a possible implementation, the target state comprises the user state, and the user state comprises a target attention degree of the user to a first area on the display window, and the first area is used to display part or all of the first image; and the determining module is specifically configured to determine that the target attention degree is switched from a first attention degree to a second attention degree.

[0025] In a possible implementation, the determining module is specifically configured to determine a gaze duration of an eyeball of the user to the first area, and determine the target attention degree according to a time interval to which the gaze duration belongs.

[0026] In a possible implementation, the target state includes a user state, and the user state includes a target operating frequency of the user operating the terminal; the determination module is specifically configured to determine whether the target operating frequency is switched from the first operating frequency to the second operating frequency.

[0027] In one possible implementation, the processing module is specifically used to: reduce at least one of the operating frequency of the processor in the terminal or the operating voltage of the power domain to which the processor belongs, and the processor is used to process the first image; or increase at least one of the operating frequency of the processor in the terminal or the operating voltage of the power domain to which the processor belongs.

[0028] In a possible implementation, the processing module is specifically configured to: increase the number of first image processing algorithms, wherein the first image processing algorithms are used to process the first image; or reduce the number of first image processing algorithms.

[0029] In one possible implementation, the processing module is further used to: reduce the number of second image processing algorithms while increasing the number of first image processing algorithms, where the second image processing algorithms are used to process images in at least part of the display area on the terminal except for the area occupied by the display window; the processing module is further used to: increase the number of second image processing algorithms while reducing the number of first image processing algorithms.

[0030] In a possible implementation, the target parameter includes a frame rate; and the processing module is specifically configured to: drop frames of the video stream corresponding to the first image, or add frames to the video stream corresponding to the first image.

[0031] In one possible implementation, the target parameter includes resolution; the processing module is specifically used to: when the terminal sends a first request to the server, adjust the resolution of the original image data related to the first image carried in the first request, and the first request is used to request to obtain the original image data.

[0032] In one possible implementation, the target parameter includes a first parameter corresponding to the first image in the first state; the processing module is further used to: determine a second parameter corresponding to the first image in the second state, the second parameter being of the same type as the first parameter; and adjust the first parameter based on the first parameter and the second parameter.

[0033] In one possible implementation, the processing module is further used to: adjust the first parameter to the second parameter when there is a deviation between the first parameter and the second parameter; or, when the deviation value between the first parameter and the second parameter is greater than a preset difference, adjust the first parameter based on the deviation value so that the deviation value is less than or equal to the preset difference.

[0034] In a third aspect, the present application provides an electronic device, comprising: at least one memory for storing a program; and at least one processor for invoking the program stored in the memory to execute the method provided in the first aspect.

[0035] In a fourth aspect, the present application provides an electronic device comprising the apparatus provided in the second aspect.

[0036] In a fifth aspect, the present application provides a computer storage medium, wherein the computer storage medium stores instructions, and when the instructions are run on a computer, the computer executes the method provided in the first aspect.

[0037] In a sixth aspect, the present application provides a computer program product comprising instructions, and when the instructions are run on a computer, the computer executes the method provided in the first aspect.

[0038] In a seventh aspect, the present application provides a terminal control apparatus, comprising: at least one processor and an interface; the at least one processor acquires program instructions or data through the interface; and the at least one processor executes the program instructions to implement the method provided in the first aspect. BRIEF DESCRIPTION OF DRAWINGS

[0039] The drawings required to be used in the following embodiments or prior art description are briefly introduced as follows.

[0040] Figure 1a is an exemplary application scenario provided by the embodiment of the present application;

[0041] Figure 1b is an exemplary application scenario provided by the embodiment of the present application;

[0042] Figure 2a is an exemplary application scenario provided by the embodiment of the present application;

[0043] Figure 2b is an exemplary application scenario provided by the embodiment of the present application;

[0044] Figure 3a is an exemplary application scenario provided by the embodiment of the present application;

[0045] Figure 3b is an exemplary application scenario provided by the embodiment of the present application;

[0046] Figure 4 is a hardware structure diagram of a terminal provided by the embodiment of the present application;

[0047] Figure 5 is a flow diagram of a terminal control method provided by the embodiment of the present application;

[0048] Figure 6 is a schematic diagram of a step of determining adjustment of a second parameter provided by an embodiment of the present application;

[0049] Figure 7 is a schematic diagram of a flow of another terminal control method provided by an embodiment of the present application;

[0050] Figure 8 is a schematic diagram of a structure of a terminal control apparatus provided by an embodiment of the present application;

[0051] Figure 9 is a schematic diagram of a structure of an electronic device provided by an embodiment of the present application;

[0052] Figure 10 is a schematic diagram of a structure of another terminal control apparatus provided by an embodiment of the present application. DETAILED DESCRIPTION

[0053] In order to make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described below with reference to the drawings.

[0054] In the description of the embodiments of the present application, the words “exemplary”, “for example”, or “e.g.” are used to mean serving as an example, instance, or illustration. Any embodiment or design solution described as “exemplary”, “for example”, or “e.g.” in the embodiments of the present application should not be construed as being more preferred or advantageous than other embodiments or design solutions. In fact, the words “exemplary”, “for example”, or “e.g.” are used to present related concepts in a specific manner.

[0055] In the description of the embodiments of the present application, the term “and / or” merely describes an association relationship of associated objects, and indicates that there can be three relationships, for example, A and / or B can represent three cases of existence of A alone, existence of B alone, and existence of A and B simultaneously. In addition, unless otherwise specified, the term “multiple” means two or more. For example, multiple systems mean two or more systems, and multiple terminals mean two or more terminals.

[0056] In addition, the terms “first” and “second” are used only for descriptive purposes, and should not be construed as indicating or implying relative importance or implicitly indicating the indicated technical features. Therefore, the features defined with “first” and “second” can explicitly or implicitly include one or more features. The terms “include”, “contain”, “have” and their variants mean “include but are not limited to”, unless otherwise specifically emphasized.

[0057] Figure 1a and 1bTogether, they constitute an application scenario provided by the embodiments of the present application. As shown in Figure 1a , the terminal 11 is installed with an a application, and the type of the a application can be video. The user opens the a application on the terminal 11 and watches the video, and at this time, the display window 12 of the a application will display the video content. As shown in Figure 1b , when the user watches the video content displayed on the display window 12, the user can scale the display window 12, i.e., adjust the size of the display window 12, and open a b application, and the type of the b application can be social. After the user opens the b application, the user can input chat content on the display window 13 of the b application. The display window 12 is changed from the state in Figure 1a to the state in Figure 1b , and the window size is changed, and at this time, the maximum resolution that can be displayed by the display window 12 is also changed. After the size of the display window 12 is changed, if the resolution of the video in the display window 12 is not adjusted, the terminal 11 continues to output the video at the original resolution, but this does not bring any value to the user. When the video of different resolutions is output, the code stream size, video decoding performance, image post-processing performance, etc. required by the terminal 11 are different, and thus the power consumption of the terminal is also different. Therefore, after the size of the display window 12 is changed, the parameters of the content displayed in the display window 12 can be adjusted to adjust the power consumption of the terminal. It can be understood that when the state of the display window 12 is switched from Figure 1b to Figure 1a , the parameters of the content displayed in the display window 12 can be adjusted to improve the display effect of the terminal 11.

[0058] For example, the maximum resolution that can be displayed by the display window 12 in Figure 1a is 1600x1200, and the maximum resolution that can be displayed by the display window in Figure 1b is 640x480, and at this time, the subjective feeling of the user when watching the video with the resolution of 640x480 in Figure 1b is the same as the subjective feeling of the user when watching the video with the resolution of 1600x1200 in Figure 1a . If the resolution of the video in the display window 12 is not adjusted at this time, the terminal 11 continues to output the video at the resolution of 1600x1200, but this does not bring any value to the user. In addition, the terminal 11 continues to output the video at the resolution of 1600x1200, which will also cause the terminal 11 to continue to run at high power consumption. Therefore, at this time, the resolution of the video displayed in the display window 12 can be reduced, i.e., from 1600x1200 to 640x480, so that the power consumption of the terminal 11 can be reduced without reducing the user experience.

[0059] Figure 2a and2b Together constitute another application scenario provided by the embodiment of the present application. As shown in Figure 2a , the terminal 11 is installed with a c application, and the type of the c application can be a game. The user opens the c application on the terminal 11 and plays the game, and at this time, the display window 14 of the c application will display the game content. As shown in Figure 2b , after playing the game for a period of time, the user can end the game and watch other users playing the game on the display window 14 of the c application. Obviously, the performance requirements of the terminal 11 are different when the user plays the game and when the user watches other people playing the game. If the terminal 11 continues to run at the performance when the user plays the game when the user watches other people playing the game, it will inevitably make the terminal 11 continue to run at high power consumption, but this will not bring any value to the user, on the contrary, it will increase the power consumption of the terminal 11. Therefore, at this time, the processing performance of the terminal 11 can be adjusted to avoid the terminal 11 from continuously running at high performance to reduce the power consumption of the terminal 11. It can be understood that when the state of the display window 14 is switched from Figure 2b to Figure 2a , the processing performance of the terminal 11 can be adjusted to avoid the terminal 11 from continuously running at low performance to improve the display effect of the terminal 11.

[0060] Figure 3a and 3b Together constitute another application scenario provided by the embodiment of the present application. As shown in Figure 3a , the terminal 11 of the user M has opened two application display windows, namely display windows 15 and 16. In the case shown in Figure 3a , the attention of the user M is on the display window 15; in the scenario shown in Figure 3b , the attention of the user M is transferred from the display window 15 to the display window 16. When the attention of the user M is transferred from the display window 15 to the display window 16, if the image quality, frame rate, resolution and other output parameters of the content displayed by the display window 15 are not adjusted, the terminal 11 will continue to output the corresponding content with the original image quality, frame rate, resolution and other output parameters, that is, the terminal 11 will continue to process the content displayed by the display window 15 with the original performance; but at this time, the user M no longer pays attention to the content in the display window 15, which will cause waste of part of the energy consumption on the terminal 11, therefore, at this time, the processing parameters related to the display content in the display window 15 on the terminal 11 (such as the working frequency of the processor, the working voltage of the power supply domain to which the processor belongs, etc.) can be adjusted to reduce the power consumption of the terminal 11. In addition, the processing parameters related to the display content in the display window 16 on the terminal 11 can also be adjusted to improve the display effect in the display window 16. Figure 3b

[0061] ​It should be noted that in the present scheme, after the state related to the display window of the application on the terminal changes, the processing parameters or output parameters related to the content displayed in the display window on the terminal are adjusted to avoid the terminal running at high or low performance continuously. Exemplarily, the state related to the display window of the application on the terminal can include the display state of the display window and / or the user state of the user currently using the terminal; wherein the display state can include the size of the display window, the display content, etc., and the user state can include the user's attention to part or all of the area on the display window, the operation frequency of the user operating the terminal, etc.

[0062] It can be understood that in the present scheme, the terminal can be a mobile phone, a tablet computer, a digital camera, a personal digital assistant (PDA), a wearable device, a smart television, a Huawei smart screen, etc. Exemplary embodiments of the terminal include but are not limited to electronic devices running iOS, android, Windows, Harmony OS or other operating systems. The terminal described above can also be other electronic devices, such as a laptop with a touch-sensitive surface (e.g., a touch panel), etc. The present scheme does not specifically limit the type of terminal.

[0063] Figure 4 is a hardware structure schematic diagram of a terminal provided by an embodiment of the present application. As shown in Figure 4 The terminal 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0064] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the terminal 100. In other embodiments of the present application, the terminal 100 can include more or fewer components than shown, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0065] The processor 110 can include one or more processors, for example, the processor 110 can include one or more of an application processor (AP), a modem, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processors can be independent devices, or can be integrated in one or more processors. For example, the processor 110 can process the content required to be displayed on the display window of the application program on the terminal 100.

[0066] The controller can generate operation control signals according to instruction operation codes and timing signals, complete the control of instructions and execution of instructions.

[0067] The processor 110 can also be provided with a memory for storing instructions and data. In some examples, the memory in the processor 110 is a cache memory. The memory can save instructions or data that the processor 110 has just used or repeatedly uses. If the processor 110 needs to use the instructions or data again, it can be directly called from the memory to avoid repeated access and reduce the waiting time of the processor 110, thereby improving the efficiency of the system.

[0068] In some examples, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a Pulse Code Modulation (PCM) interface, a Universal Asynchronous Receiver / Transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a General Purpose I / 0 Ports (GPIO), a subscriber identity module (SIM) interface, and / or a Universal Serial Bus (USB) interface, etc.

[0069] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a limitation on the structure of the terminal 100. In some other embodiments of the present application, the terminal 100 can also use different interface connection modes or a combination of multiple interface connection modes in the above embodiments.

[0070] The charging management module 140 is configured to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some examples of wired charging, the charging management module 140 can receive charging input from a wired charger through the USB interface 130. In some examples of wireless charging, the charging management module 140 can receive wireless charging input through a wireless charging coil of the terminal 100. The charging management module 140 can charge the battery 142 and also supply power to other terminals through the power management module 141.

[0071] The power management module 141 is configured to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to supply power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160, etc. The power management module 141 can also be configured to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), etc. In some other examples, the power management module 141 can also be arranged in the processor 110. In some other examples, the power management module 141 and the charging management module 140 can also be arranged in the same device.

[0072] The wireless communication function of the terminal 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem, and the baseband processor, etc.

[0073] The antenna 1 and the antenna 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the terminal 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In some other examples, the antennas can be used in combination with a tuning switch.

[0074] The mobile communication module 150 can provide a solution including 2G / 3G / 4G / 5G wireless communication applied to the terminal 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves by at least two antennas including the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem, and convert the signals into electromagnetic waves to be radiated through the antenna 1. In some examples, at least part of the functional modules of the mobile communication module 150 can be arranged in the processor 110. In some examples, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 can be arranged in the same device.

[0075] The modem can include a modulator and a demodulator. The modulator is used to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the loudspeaker 170A, the microphone 170B, etc.), or displays an image or a video through the display screen 194. In some examples, the modem can be an independent device. In some other examples, the modem can be independent of the processor 110, and arranged in the same device as the mobile communication module 150 or other functional modules. In some other examples, the mobile communication module 150 can be a module in the modem.

[0076] The wireless communication module 160 can provide a solution for wireless communication including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. applied to the terminal 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency-modulates and filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 can also receive signals to be transmitted from the processor 110, frequency-modulate them, amplify them, and radiate them as electromagnetic waves via the antenna 2.

[0077] In some examples, antenna 1 and mobile communication module 150 of terminal 100 are coupled, and antenna 2 and wireless communication module 160 are coupled, so that terminal 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), fifth generation, new radio (NR), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0078] Terminal 100 implements a display function through a GPU, display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, connected to display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 can include one or more GPUs that execute program instructions to generate or change display information.

[0079] The display screen 194 is configured to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diodes (QLED), or the like. In some examples, the terminal 100 can include one or more display screens 194. In one example, the display screen 194 can be configured to display an interface of an application, display a display window of an application, and the like.

[0080] The terminal 100 can implement a photographing function through the ISP, the camera 193, a video codec, a GPU, the display screen 194, and an application processor, and the like.

[0081] The ISP is configured to process data fed back by the camera 193. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing to convert it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize parameters such as exposure and color temperature of the photographed scene. In some examples, the ISP can be disposed in the camera 193.

[0082] The camera 193 is used to capture still images or videos, for example, to capture facial feature information, posture feature information, etc. of a person. An optical image of an object is projected onto a photosensitive element through a lens. The photosensitive element can be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to an ISP to convert it into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into a standard RGB, YUV, etc. format image signal. In some examples, the terminal 100 can include one or more cameras 193. For example, the camera 193 can capture facial features of a user and transmit the facial features to the processor 110, so that the processor 110 determines the user's attention to a partial region or the entire region of the display screen 4 according to the facial features.

[0083] The digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals. For example, when the terminal 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0084] The video codec is used to compress or decompress digital videos. The terminal 100 can support one or more video codecs. In this way, the terminal 100 can play or record videos in multiple encoding formats, such as moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0085] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize data storage functions. For example, music, video, etc. files are saved in the external memory card.

[0086] The internal memory 121 can be used to store computer executable program codes including instructions. The processor 110 performs various functional applications and data processing of the terminal 100 by running the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required for a function (such as a sound playing function, an image playing function, etc.), and the like. The data storage area can store data (such as audio data, a phone book, etc.) created during the use of the terminal 100, and the like. In addition, the internal memory 121 can include a high-speed random access memory, and can further include a non-volatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.

[0087] The terminal 100 can implement an audio function through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, an application processor, and the like. For example, music playing, recording, and the like.

[0088] The audio module 170 is used to convert digital audio information into an analog audio signal output, and is also used to convert an analog audio input into a digital audio signal. The audio module 170 can also be used to encode and decode an audio signal. In some examples, the audio module 170 can be disposed in the processor 110, or part of the functions of the audio module 170 can be disposed in the processor 110.

[0089] The speaker 170A, also referred to as a "loudspeaker", is used to convert an audio electrical signal into a sound signal. The terminal 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0090] The receiver 170B, also referred to as a "earpiece", is used to convert an audio electrical signal into a sound signal. When the terminal 100 answers a call or a voice message, the receiver 170B can be held close to a human ear to listen to the voice.

[0091] The microphone 170C, also referred to as a "microphone", "sound transducer", is used to convert a sound signal into an electrical signal. When making a call or sending a voice message, a user can speak into the microphone 170C close to the human mouth to input a sound signal into the microphone 170C. The terminal 100 can be provided with at least one microphone 170C. In other examples, the terminal 100 can be provided with two microphones 170C, in addition to collecting a sound signal, a noise reduction function can also be implemented. In other embodiments, the terminal 100 can also be provided with three, four or more microphones 170C, to collect sound signals, reduce noise, and also identify the source of the sound, implement directional recording functions, and the like.

[0092] The earphone interface 170D is configured to connect a wired earphone. The earphone interface 170D can be a USB interface 130, or a 3.5 mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0093] The sensor module 180 can include a pressure sensor 180A, a gyro sensor 180B, a barometric sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0094] The pressure sensor 180A is configured to sense a pressure signal and convert the pressure signal into an electrical signal. In some examples, the pressure sensor 180A can be disposed on the display screen 194. The pressure sensor 180A can be of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, etc. The capacitive pressure sensor can include at least two parallel plates of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The terminal 100 determines the intensity of the force according to the change in capacitance. When a touch operation is applied to the display screen 194, the terminal 100 detects the intensity of the touch operation according to the pressure sensor 180A. The terminal 100 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A. In some examples, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity less than a first pressure threshold is applied to a short message application icon, an instruction to view a short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the short message application icon, an instruction to create a new short message is executed.

[0095] The gyro sensor 180B can be configured to determine the motion posture of the terminal 100. In some examples, the angular velocity of the terminal 100 around three axes (i.e., the x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for shooting anti-shake. For example, when the terminal 100 is used to collect user feature information in an environment, the gyro sensor 180B detects the angle of shaking of the terminal 100, calculates the distance that needs to be compensated by the lens module according to the angle, and lets the lens offset the shaking of the terminal 100 by reverse movement to achieve anti-shake.

[0096] The barometric pressure sensor 180C is used to measure air pressure. In some examples, the terminal 100 calculates altitude based on the air pressure value measured by the barometric pressure sensor 180C, and assists in positioning and navigation.

[0097] The acceleration sensor 180E can detect the magnitude of acceleration of the terminal 100 in various directions (typically three axes). The magnitude and direction of gravity can be detected when the terminal 100 is stationary. It can also be used to identify the attitude of the terminal, applied to landscape / portrait switching, pedometer applications, etc.

[0098] The distance sensor 180F is used to measure distance. The terminal 100 can measure distance by infrared or laser. In some examples, when collecting user feature information of a user in an environment using the terminal, the terminal 100 can use the distance sensor 180F to measure distance to achieve fast focusing.

[0099] The ambient light sensor 180L is used to sense ambient light brightness. The terminal 100 can adaptively adjust the brightness of the display screen 194 according to the sensed ambient light brightness.

[0100] The fingerprint sensor 180H is used to collect fingerprints. The terminal 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locking, fingerprint photographing, fingerprint answering calls, etc.

[0101] The temperature sensor 180J is used to detect temperature. In some examples, the terminal 100 performs temperature handling strategies using the temperature detected by the temperature sensor 180J. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the terminal 100 reduces the performance of the processor located near the temperature sensor 180J in order to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the terminal 100 heats the battery 142 to avoid abnormal shutdown of the terminal 100 caused by low temperature. In other embodiments, when the temperature is lower than yet another threshold, the terminal 100 performs voltage boosting on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

[0102] The touch sensor 180K, also known as a "touch device". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also known as a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the terminal 100, which is different from the position where the display screen 194 is located.

[0103] The keys 190 include a power-on key, a volume key, an input keyboard, and the like. The keys 190 can be mechanical keys. Alternatively, the keys 190 can be touch keys. The terminal 100 can receive key input and generate key signal input related to user settings and function control of the terminal 100.

[0104] The motor 191 can generate a vibration prompt. The motor 191 can be used for incoming call vibration prompts and touch vibration feedback. For example, touch operations applied to different applications (e.g., video playback, audio playback, and the like) can correspond to different vibration feedback effects. Touch operations applied to different regions of the display screen 194 can also correspond to different vibration feedback effects. Different application scenarios (e.g., time reminders, received messages, alarms, games, and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effects can also support customization.

[0105] The indicator 192 can be an indicator light and can be used to indicate a charging state, a power change, and can also be used to indicate messages, missed calls, notifications, and the like.

[0106] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the terminal 100. The terminal 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. The same SIM card interface 195 can simultaneously insert multiple cards. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external storage cards. The terminal 100 interacts with a network through a SIM card to achieve functions such as calls and data communication. In some embodiments, the terminal 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the terminal 100 and cannot be separated from the terminal 100.

[0107] The following describes the technical solutions provided by the present application in detail with reference to the drawings, taking a mobile phone as an example.

[0108] (1) determining that a state related to an image displayed in a display window of an application on the mobile phone changes

[0109] It can be understood that various types of applications can be installed on the mobile phone, such as game applications, video applications, social applications, news applications, and the like. After a user starts an application on the mobile phone, a display window of the application will be displayed on the display screen of the mobile phone, such as the display window 12 in Figure 1a Figure 1a ​The content displayed in the display window 12; wherein in the present solution, the image can be understood as a video, a picture, and the like. In the present solution, the application can also be referred to as an application program, software, and the like.

[0110] It should be noted that in the present solution, the state related to the image displayed in the display window of the application on the mobile phone can be at least one of the display state of the display window of the application on the mobile phone or the user state of the user currently using the mobile phone. The state related to the image displayed in the display window of the application on the mobile phone is described below as the display state and the user state, respectively.

[0111] a. The state related to the image displayed in the display window of the application on the mobile phone is the display state

[0112] In the present solution, the display state can include the size of the display window of the application, the content expressed by the image displayed in the display window of the application, and the like.

[0113] If the display state is the size of the display window of the application, the mobile phone can determine whether the state related to the image displayed in the display window of the application on the mobile phone changes by determining whether the size of the display window changes.

[0114] For example, continuing to refer to Figure 1a and 1b When the size of the display window 12 is switched from the size in Figure 1a to the size in Figure 1b , it can be determined that the size of the display window changes, in other words, the display state changes at this time. Similarly, when the size of the display window 12 is switched from the size in Figure 1b to the size in Figure 1a , it can also be determined that the size of the display window changes, in other words, the display state changes at this time.

[0115] If the display state is the content expressed by the image displayed in the display window of the application, the mobile phone can determine whether the content expressed by the image changes by recognizing the image frame in the display window based on a neural-network processing unit (NPU) or the like, or based on data obtained from a server. It can be understood that in the present solution, when the content expressed by the image changes, the type of the content before the change and the type of the content after the change can be different, for example, the content before the change is a video type content, and the content after the change is a game type content, and the like.

[0116] For example, continuing to refer to Figure 2a, the mobile phone can determine that the content displayed on the current display window 14 is game content based on the data obtained from the server. Referring back to Figure 2b , the mobile phone can determine that the content displayed on the current display window 14 is video content based on the data obtained from the server. Referring back to Figure 2a , the mobile phone can determine that the content displayed on the current display window 14 is video content based on the data obtained from the server. Referring back to Figure 2b , the mobile phone can determine that the content displayed on the current display window 14 is video content based on the data obtained from the server. Referring back to Figure 2b , the mobile phone can determine that the content displayed on the current display window 14 is video content based on the data obtained from the server. Referring back to Figure 2a , the mobile phone can determine that the content displayed on the current display window 14 is video content based on the data obtained from the server. Referring back to

[0117] In addition, when determining whether the content expressed by the image displayed in the display window of the application changes, the running speed of the graphics processing unit (GPU) in the mobile phone can also be considered. For example, when the user plays a game, the running speed of the GPU is usually fast, while when the user watches a video, the running speed of the GPU is usually slow, so the running speed of the GPU can be used to determine whether the content expressed by the image displayed in the display window of the application changes.

[0118] b. The state related to the image displayed in the display window of the application on the mobile phone is the user state

[0119] In this scheme, the user state can include the user's attention to a certain area on the display window, the user's operation frequency of operating the mobile phone, etc.

[0120] If the user state is the user's attention to a certain area on the display window, the mobile phone can use the eye tracking technology to collect the user's eye movement state by using the image collection device such as the camera on the mobile phone, and estimate the position of the user's eye fixation point. After the mobile phone estimates the position of the user's eye fixation point, if the position of the user's eye fixation point is in the area where the display window is located, it can be determined that the user is paying attention to the image displayed on the display window; otherwise, it can be determined that the user is not paying attention to the image displayed on the display window. When it is determined that the user is paying attention to the content displayed on the display window, the user's fixation duration can be counted, and then the corresponding attention degree can be determined according to the time interval to which the user's fixation duration belongs. In this scheme, the user's fixation duration on the display window can be the fixation duration of the user's eyes on part or all of the areas on the display window; in addition, the user's fixation is the fixation of the user's eyes.

[0121] For example, referring back to Figure 3aAt this time, the mobile phone can determine that the user M is gazing at the displayed content in the display window 15. Then, the mobile phone can count the gazing duration of the user M gazing at the display window 15, for example, 10 seconds. If the pre-configured relationship between the gazing duration and the attention level is that the gazing duration is 0-8s, the attention level is level 1; the gazing duration is 8s-16s, the attention level is level 2; and the gazing duration is greater than 16s, the attention level is level 3, then when the gazing duration is 10s, the determined attention level is level 2. Continue to refer to Figure 3b At this time, the mobile phone can determine that the user M is gazing at the displayed content in the display window 16, that is, it can be determined that the user M has no longer paid attention to the display window 15, and at this time the attention level of the user to the display window 15 can be 0. When the eyeball of the user M switches from gazing at the display window 15 to gazing at the display window 16, it can be determined that the attention level of the user to a certain area on the display window 15 has changed. Similarly, when the eyeball of the user M switches from gazing at the display window 16 to gazing at the display window 15, it can be determined that the attention level of the user to a certain area on the display window 16 has changed.

[0122] If the user state is the operation frequency of the user operating the mobile phone, the mobile phone can count the frequency of the operation instructions issued by the user to determine the operation frequency of the user operating the mobile phone, and further determine whether the operation frequency has changed. For example, when the operation frequency of the user operating the mobile phone is high, the user is often in a game state; and when the operation frequency of the user operating the mobile phone is low, the user is often in a state of watching a video.

[0123] For example, continue to refer to Figure 2a and 2b In the Figure 2a , the user is in a game state, and the fingers of the user will frequently touch the display screen of the mobile phone 11. In the Figure 2b , the user is in a state of watching a game video, and the frequency of the fingers of the user touching the display screen of the mobile phone 11 is very low. When the operation frequency of the user operating the mobile phone switches from the operation frequency in the Figure 2a to the operation frequency in the Figure 2b , it can be determined that the operation frequency of the user operating the mobile phone has changed. Similarly, when the operation frequency of the user operating the mobile phone switches from the operation frequency in the Figure 2b to the operation frequency in the Figure 2a , it can also be determined that the operation frequency of the user operating the mobile phone has changed.

[0124] It should be noted that, for the convenience of description, the state related to the image displayed in the display window before the change will be referred to as the first state, and the state related to the image displayed in the display window after the change will be referred to as the second state.

[0125] (2) determining the parameters required by the mobile phone to output the image in the second state

[0126] After the state related to the image displayed in the display window of the application on the mobile phone changes, the mobile phone can determine the parameters required by the mobile phone to output the image in the display window in the second state, wherein the parameters required by the mobile phone to output the image can include at least one of image quality, frame rate or resolution.

[0127] For example, if the second state is the state after the size of the display window of the application changes, the mobile phone can determine the resolution that can be displayed by the changed display window according to the size of the changed display window and the mapping relationship between the size of the display window and the resolution that can be displayed by the display window.

[0128] If the second state is the state after the content expressed by the image displayed in the display window of the application changes, the mobile phone can determine the parameters required by the mobile phone to output the image in the second state according to the mapping relationship between the content and the parameters required by the mobile phone to output the image. For example, when the content expressed by the image displayed in the display window is game content, the image quality, frame rate and resolution can all be level 1; when the content expressed by the image displayed in the display window is video content, the image quality, frame rate and resolution can all be level 2; wherein the display effect of level 1 is stronger than that of level 2.

[0129] If the second state is the state after the attention of the user to a certain area on the display window changes, the mobile phone can determine the parameters required by the mobile phone to output the image in the second state according to the mapping relationship between the attention and the parameters required by the mobile phone to output the image. For example, when the attention is level 1, the image quality, frame rate and resolution can all be level 1; when the attention is level 2, the image quality, frame rate and resolution can all be level 2.

[0130] If the second state is the state after the operation frequency of the user operating the mobile phone changes, the mobile phone can determine the parameters required by the mobile phone to output the image in the second state according to the mapping relationship between the operation frequency and the parameters required by the mobile phone to output the image. For example, when the operation frequency is level 1, the image quality, frame rate and resolution can all be level 1; when the operation frequency is level 2, the image quality, frame rate and resolution can all be level 2.

[0131] The way to obtain the second parameter can refer to the way to obtain the first parameter, which will not be repeated here.

[0132] It should be noted that, for the sake of convenience, the parameters of the image output by the mobile phone in the first state in the display window of the application will be referred to as the second parameter, and the parameters of the image output by the mobile phone in the second state in the display window of the application will be referred to as the first parameter. The types of the first parameter and the second parameter are the same.

[0133] (3) determining whether the deviation value between the first parameter and the second parameter is greater than a preset difference value

[0134] The first parameter and the second parameter are mathematically calculated, and the deviation value between the two can be determined. The deviation value can be a difference value, a ratio value, etc. For example, when the first parameter and the second parameter are both resolutions, if the first parameter is 1080p and the second parameter is 720p, the difference between the two is 1080-720=360; when the first parameter and the second parameter are both frame rates, if the first parameter is 60Hz and the second parameter is 30Hz, the difference between the two is 60-30=30.

[0135] It can be understood that in order to facilitate the calculation of the deviation value, the parameter values of the first parameter and the second parameter can be scaled to different values, and then the deviation value is calculated. For example, when the first parameter and the second parameter are both resolutions, if the first parameter is 1080p and the second parameter is 720p, 1080p can be scaled to 10 and 720p can be scaled to 7, and the difference between the two is 10-7=3; when the first parameter and the second parameter are both frame rates, if the first parameter is 60Hz and the second parameter is 30Hz, 1080p can be scaled to 10 and 720p can be scaled to 7, and the difference between the two is 10-7=3.

[0136] In addition, when the first parameter and the second parameter are both image quality, the first parameter and the second parameter can be represented by numerical values. For example, the first parameter can be 100 and the second parameter can be 80, etc.

[0137] Further, after determining the deviation value between the first parameter and the second parameter, the deviation value is compared with the preset difference value, and the size relationship between the deviation value and the preset difference value can be determined.

[0138] If the deviation value is less than or equal to the preset difference value, it indicates that the deviation between the first parameter and the second parameter is small, and at this time, the performance of the terminal when outputting images with the first parameter and the second parameter is almost the same, so the terminal can continue to output images with the second parameter.

[0139] If the deviation value is greater than the preset difference value, it indicates that the deviation between the first parameter and the second parameter is large, and at this time, if the terminal continues to output images with the second parameter, the terminal is likely to run continuously with high performance or low performance, so the terminal can adjust the second parameter to the first parameter and then output images with the first parameter.

[0140] (4) adjusting the second parameter to the first parameter

[0141] After determining that the deviation value between the first parameter and the second parameter is large, the second parameter can be adjusted to the first parameter. The first parameter is a parameter of the mobile phone outputting an image displayed in the display window in the second state, and the second parameter is a parameter of the mobile phone outputting an image displayed in the display window in the first state. The first state is a state related to the image displayed in the display window before the change, and the second state is a state related to the image displayed in the display window after the change.

[0142] The following describes how to adjust the second parameter to the first parameter when the second parameter is greater than the first parameter and the second parameter is less than the first parameter.

[0143] The first parameter and the second parameter are greater than the first parameter

[0144] If the second parameter is greater than the first parameter, it indicates that the display effect of the image displayed in the display window is reduced after the state related to the image displayed in the display window is changed. At this time, the second parameter can be adjusted to the first parameter in the following manner.

[0145] a. At least one of the working frequency of a processor in the mobile phone processing the image displayed in the display window or the working voltage of a power domain to which the processor belongs is reduced. For example, the video post-processing performance of a decoder in the mobile phone can be reduced (such as reducing the working clock of the logic), the matching voltage of the decoder in the mobile phone is reduced, and the like.

[0146] b. The number of image processing algorithms processing the image displayed in the display window is reduced. In this scheme, the image processing algorithms can include de contour (DC), de mosquito (DM), dering (DR), motion estimate and motion compensation (MEMC), noise reduction (NR), super resolution (SR), and the like. For example, if four image processing algorithms are used when outputting the image in the display window in the second parameter, which are MEMC, DC, NR, and SR, respectively, when outputting the image in the display window in the first parameter, two image processing algorithms can be used, such as NR and SR.

[0147] c. If the first parameter and the second parameter are frame rates, the video stream corresponding to the image in the display window can be frame-dropped to adjust the second parameter to the first parameter. The frame-dropping manner can be a video processing subsystem (VPSS) frame-dropping manner.

[0148] d. If the first parameter and the second parameter are resolutions, the resolution of the data source requested by the mobile phone application from the server can be switched from the second parameter to the first parameter. In other words, the data source of the image in the display window of the mobile phone application is switched from the data source with the resolution of the second parameter to the data source with the resolution of the first parameter. For example, continue to refer to Figure 1a and Figure 1b ,like Figure 1a The resolution of the display window 12 is 1080p, Figure 1b If the resolution of display window 12 is 720p, then Figure 1b The mobile phone 11 can send the original image data with a resolution of 720p to the server, that is, switch the image source of the application to which the display window 12 belongs.

[0149] Second, the second parameter is less than the first parameter

[0150] If the second parameter is less than the first parameter, it indicates that after the state related to the image displayed in the display window changes, the display effect of the image displayed in the display window is improved. In this case, the second parameter can be adjusted to the first parameter in the following manner.

[0151] a. Increase at least one of the operating frequency of the image processor displayed in the mobile phone's processing display window or the operating voltage of the power domain to which the processor belongs. For example, this can improve the video post-processing performance of the mobile phone's decoder (such as increasing the logic operating clock) or increase the matching voltage of the mobile phone's decoder.

[0152] b. Increase the number of image processing algorithms for processing the image displayed in the display window. In this solution, the image processing algorithms may include decontour (DC), demosquito (DM), dehalo (DR), motion estimation and motion compensation (MEMC), noise reduction (NR), image super resolution (SR), and other algorithms. For example, if two image processing algorithms, NR and SR, are used when outputting the image in the display window with the second parameter, then four image processing algorithms, such as MEMC, DC, NR, and SR, may be used when outputting the image in the display window with the first parameter. For example, continue to refer to Figure 2a and Figure 2b ,like Figure 2b The image processing algorithm for processing the image in the display window 14 is NR or SR, and the display state of the display window 14 is changed from Figure 2b The video playback status in the switch is Figure 2a When in the game state, you canFigure 2a In the case where the number of image processing algorithms for the image in the display window 14 is increased, such as increasing the MEMC and DC algorithms, then Figure 2a In the case where the processing algorithm for the image in the display window 14 is MEMC, DC, NR, and SR.

[0153] c. If the first parameter and the second parameter are frame rates, then the video stream corresponding to the image in the display window can be interpolated to adjust the second parameter to the first parameter. The interpolation method can be a motion estimate and motion compensation (MEMC) interpolation method.

[0154] d. If the first parameter and the second parameter are resolutions, then the resolution of the data source requested by the application in the mobile phone from the server can be switched from the second parameter to the first parameter, in other words, the data source of the image in the display window of the application in the mobile phone is switched from the data source with the resolution of the second parameter to the data source with the resolution of the first parameter. For example, continuing to refer to Figure 1a and Figure 1b , if Figure 1b the resolution of the display window 12 is 720p, Figure 1a the resolution of the display window 12 is 1080p, then in Figure 1a the mobile phone 11 can send a request to the server to obtain the original image data with a resolution of 1080p, that is, switch the clip source of the application to which the display window 12 belongs.

[0155] It can be understood that when the second parameter is greater than the first parameter, it can indicate that the user's attention to the image displayed in the display window of the application has decreased, at this time, the user can be paying attention to other areas on the display screen of the mobile phone. Therefore, at this time, the number of image processing algorithms for the image in other areas on the display screen of the mobile phone can be increased to present the image in other areas to the user with better display effect and improve the user experience. For example, continuing to refer to Figure 3a and Figure 3b , after the user's line of sight is switched from Figure 3a to Figure 3b , the image processing algorithm for the image in the display window 16 can be increased; for example, in Figure 3a , the processing algorithm for the image in the display window 16 is 2, such as NR and SR, then in Figure 3b , the processing algorithm for the image in the display window 16 can be 4, such as MEMC, DC, NR, and SR.

[0156] Similarly, when the second parameter is less than the first parameter, it can indicate that the user's attention to the image displayed in the display window of the application has increased. Therefore, at this time, the number of image processing algorithms of the image in other areas of the display screen of the mobile phone can be reduced to reduce the power consumption of the mobile phone. For example, referring back to Figure 3a and Figure 3b , after the user's line of sight is switched from Figure 3a to Figure 3b , the image processing algorithm for processing the image in the display window 15 can be reduced; for example, in Figure 3a , the processing algorithm for processing the image in the display window 15 is 4, such as MEMC, DC, NR, and SR, and in Figure 3b , the processing algorithm for processing the image in the display window 15 can be 2, such as NR and SR.

[0157] It can be understood that when the second parameter is adjusted to the first parameter, the adjustment value of each parameter that needs to be adjusted in the mobile phone can be determined based on the deviation value between the two. For example, the deviation value and the adjustment value can have a mapping relationship, and when the deviation value is determined, the adjustment value can be determined. For example, Table 1 shows the mapping relationship between the deviation value and the adjustment value, and when the deviation value A1 is determined, the adjustment value B1 can be determined.

[0158] Table 1

[0159] Bias value Adjustment value A1 B1 A2 B2 A3 B3

[0160] For example, when the operating voltage of the power domain to which the processor for processing the image displayed in the display window belongs in the mobile phone needs to be adjusted, the adjustment value can be determined according to the deviation value between the second parameter and the first parameter, so as to determine the operating voltage of the power domain to which the processor belongs after adjustment. Then, the operating voltage of the power domain to which the processor belongs can be adjusted.

[0161] Next, a flow step of a terminal control method provided by an embodiment of the present application is introduced.

[0162] Please refer to Figure 5 , Figure 5 is a flowchart of a terminal control method provided by an embodiment of the present application. It can be understood that the method can be executed by any device, equipment, platform, device cluster with computing and processing capabilities. As shown in Figure 5 , the terminal control method comprises the following steps:

[0163] Step S101, determining that the target state is switched from the first state to the second state.

[0164] In the solution, the target state can include at least one of a display state of a display window of the first application on the terminal or a user state of a user currently using the terminal, wherein the first image is displayed on the display window of the first application.

[0165] When the target state is the display state, the terminal, a component on the terminal, or another device can monitor the display state of the display window of the first application on the terminal to determine whether the display state changes. For example, referring back to Figure 1a and Figure 1b When the state of the display window 12 changes from the state in Figure 1a to the state in Figure 1b , it can be determined that the display state of the display window 12 changes.

[0166] When the target state is the user state, the terminal, a component on the terminal, or another device can also monitor the user state to determine whether the user state changes. For example, referring back to Figure 3a and Figure 3b When the user state changes from the state in Figure 3a to the state in Figure 3b , it can be determined that the user state changes.

[0167] In one example, the display state can include at least one of a size of the display window and a target content expressed by the first image; and the user state can include at least one of a target attention of the user to a first region on the display window, the first region being used to display part or all of the first image, and a target operation frequency of the user operating the terminal.

[0168] If the display state is the size of the display window, when it is determined that the size of the display window changes from a first size to a second size, it can be determined that the target state changes from a first state to a second state. The first size is different from the second size.

[0169] If the display state is the target content expressed by the first image, when it is determined that the target content expressed by the first image changes from a first content to a second content, it can be determined that the target state changes from a first state to a second state. The first content is different from the second content in type.

[0170] If the user state is the target attention of the user to the first region on the display window, when it is determined that the target attention changes from a first attention to a second attention, it can be determined that the target state changes from a first state to a second state. The first attention is different from the second attention. For the manner of determining the attention, refer to the description above.

[0171] If the user state is the target operating frequency of the user operating the terminal, then when it is determined that the target operating frequency is switched from the first operating frequency to the second operating frequency, it can be determined that the target state is switched from the first state to the second state.

[0172] Step S102: Determine first parameters required for the terminal to output the first image in the second state.

[0173] Specifically, after the target state changes, the first parameter required for the terminal to output the first image in the second state can be determined. The first parameter may include at least one of image quality, frame rate, or resolution. Exemplarily, there is a mapping relationship between the second state and the first parameter. After determining that the target state has switched to the second state, the first parameter can be determined based on the second state. In addition, the first parameter can also be determined by the terminal system's perception, as described above.

[0174] Step S103: Adjust the second parameter to the first parameter, where the second parameter is a parameter corresponding to when the terminal outputs the first image in the first state, and the first parameter and the second parameter are of the same type.

[0175] Specifically, after determining the first parameter, the parameter (i.e., the second parameter) corresponding to when the terminal outputs the first image in the first state can be adjusted to the first parameter, so that the terminal outputs the first image with the first parameter, thereby making the terminal's operating state match at least one of the display state of the display window or the user state, avoiding the terminal from continuously running at high performance or low performance, helping to solve problems such as increased power consumption of the terminal or the display effect not meeting user needs, and improving user experience. In this solution, the types of the first parameter and the second parameter can be the same, that is, when the first parameter is image quality, the second parameter is also image quality; when the first parameter is frame rate, the second parameter is also frame rate; when the first parameter is resolution, the second parameter is also resolution. For the method of obtaining the second parameter, please refer to the method of obtaining the first parameter.

[0176] As a possible implementation manner, the second parameter may be adjusted to the first parameter in the following manner.

[0177] a. If the second parameter is greater than the first parameter, at least one of the operating frequency of the processor in the terminal or the operating voltage of the power domain to which the processor belongs can be reduced, and the processor is used to process the first image; if the second parameter is less than the first parameter, at least one of the operating frequency of the processor in the terminal or the operating voltage of the power domain to which the processor belongs can be increased.

[0178] b、if the second parameter is greater than the first parameter, the first image can be processed by a first number of first image processing algorithms, wherein the first image processing algorithms are in a second number when the first image is outputted at the second parameter, and the first number is less than the second number; if the second parameter is less than the first parameter, the first image can be processed by a third number of first image processing algorithms, and the third number is greater than the second number.

[0179] c、if the second parameter is greater than the first parameter, the image in the second region can be processed by a fourth number of second image processing algorithms, the second region being at least part of the display region on the terminal except the region occupied by the display window, wherein the second image processing algorithms are in a fifth number when the first image is outputted at the second parameter, and the fourth number is greater than the fifth number; if the second parameter is less than the first parameter, the image in the second region can be processed by a sixth number of second image processing algorithms, and the sixth number is less than the fifth number.

[0180] d、the first parameter can include a frame rate; wherein if the second parameter is greater than the first parameter, the frame rate of the terminal outputting the first image in the first state can be frame-dropped; if the second parameter is less than the first parameter, the frame rate of the terminal outputting the first image in the first state can be frame-added.

[0181] e、the first parameter can include a resolution; when the terminal sends a first request to the server, the resolution of the original image data carried in the first request can be switched from a first resolution to a second resolution, the first resolution being the resolution of the terminal outputting the first image in the first state, and the second resolution being the resolution required by the terminal outputting the first image in the second state, the first request being used to request to acquire the original image data related to the first image.

[0182] It should be noted that the above manner of adjusting the second parameter to the first parameter can be implemented alone or jointly, which is not limited herein.

[0183] It can be understood that part or all of the description in the method provided in the present solution can refer to the description above, which will not be repeated here.

[0184] Therefore, in the present solution, after determining that the state related to the image displayed in the display window of the terminal application changes, the parameter required by the terminal to output the image displayed in the display window in the changed state is determined, and the parameter of the terminal outputting the image displayed in the display window is adjusted based on the parameter, which avoids the terminal continuously running at high performance or low performance, and helps to solve the problems of increased power consumption of the terminal or unsatisfied display effect of the user, thereby improving the user experience.

[0185] In one example, before adjusting the second parameter to the first parameter, a deviation value between the two parameters can also be determined, and then based on the deviation value, it is determined whether to adjust the second parameter to the first parameter, so as to avoid unnecessary adjustment and improve the accuracy of parameter adjustment. Specifically, as shown in Figure 6 the following steps are included:

[0186] Step S201, determine a deviation value between the first parameter and the second parameter.

[0187] Wherein, the first parameter and the second parameter are mathematically calculated, i.e. the deviation value between the two can be determined. In this scheme, the deviation value can be a difference value, a ratio value, etc.

[0188] Step S202, determine whether the deviation value is less than or equal to a preset difference value.

[0189] Wherein, the deviation value is compared with the preset difference value, i.e. it can be determined whether the deviation value is greater than the preset difference value. In this scheme, if the deviation value is less than or equal to the preset difference value, step S203 is executed; otherwise, step S204 is executed.

[0190] Step S203, do not adjust the second parameter.

[0191] Specifically, if the deviation value is less than or equal to the preset difference value, it indicates that the deviation between the first parameter and the second parameter is small, at this time, the performance of the terminal when outputting images with the first parameter and the second parameter is almost the same, therefore, the terminal can continue to output images with the second parameter at this time, i.e. the second parameter is not adjusted at this time.

[0192] Step S204, adjust the second parameter to the first parameter.

[0193] Specifically, if the deviation value is greater than the preset difference value, it indicates that the deviation between the first parameter and the second parameter is large, at this time, if the terminal continues to output images with the second parameter, the terminal is prone to continuously running at high performance or low performance, therefore, the second parameter can be adjusted to the first parameter at this time, so that the terminal outputs images with the first parameter.

[0194] Next, the flow steps of another terminal control method provided by the embodiments of the present application are introduced.

[0195] Please refer to Figure 7 , Figure 7 is a flowchart of a terminal control method provided by the embodiments of the present application. It can be understood that the method can be executed by any device, equipment, platform, device cluster with computing and processing capability. As shown in Figure 7 the terminal control method includes:

[0196] Step S301, determine that the target state is switched from the first state to the second state, the target state includes at least one of the display state of the display window of the first application on the terminal or the user state of the user currently using the terminal, wherein the display window of the first application displays the first image. For the description of this step, please refer to the description in step S101 above, which will not be repeated here.

[0197] Step S302, adjust the target parameter in the terminal, the target parameter is related to the display effect of the first image.

[0198] In this scheme, after the target state changes, the target parameter in the terminal can be adjusted to adjust the display effect of the first image, thereby avoiding the terminal running continuously at high performance or low performance. Wherein, adjusting the target parameter in the terminal can include one or more of the following ways:

[0199] a. Reduce at least one of the working frequency of the processor in the terminal or the working voltage of the power domain to which the processor belongs, the processor being used to process the first image; or, increase at least one of the working frequency of the processor in the terminal or the working voltage of the power domain to which the processor belongs.

[0200] b. Increase the number of first image processing algorithms, wherein the first image processing algorithm is used to process the first image; or, reduce the number of first image processing algorithms.

[0201] c. In the case of increasing the number of first image processing algorithms, reduce the number of second image processing algorithms, the second image processing algorithm being used to process the image in at least part of the display area of the terminal except the area occupied by the display window; in the case of reducing the number of first image processing algorithms, increase the number of second image processing algorithms.

[0202] d. When the target parameter includes frame rate, the first image corresponding video stream can be frame dropped, or the first image corresponding video stream can be frame filled.

[0203] e. When the target parameter includes resolution, the resolution of the original image data related to the first image carried in the first request can be adjusted when the terminal sends the first request to the server, the first request being used to request to obtain the original image data.

[0204] f. When the target parameter includes the first parameter corresponding to the first image in the first state, the second parameter corresponding to the first image in the second state can be determined first, the second parameter being of the same type as the first parameter; then, the first parameter is adjusted according to the first parameter and the second parameter.

[0205] In an example, adjusting the first parameter according to the first parameter and the second parameter can include: adjusting the first parameter to the second parameter when the first parameter deviates from the second parameter; or adjusting the first parameter based on a deviation value between the first parameter and the second parameter to make the deviation value less than or equal to a preset deviation value when the deviation value is greater than the preset deviation value.

[0206] It can be understood that part or all of the descriptions in the method provided in the scheme can refer to the descriptions above, which will not be repeated here.

[0207] Based on the method in the above embodiments, the embodiments of the present application provide a terminal control device. Please refer to Figure 8 , Figure 8 is a structural schematic diagram of a terminal control device provided by the embodiments of the present application. As shown in Figure 8 , the terminal control device 800 includes a determination module 81 and a processing module 82; wherein the determination module 81 is configured to determine that a target state is switched from a first state to a second state, the target state includes at least one of a display state of a display window of a first application on a terminal or a user state of a user currently using the terminal, and the display window of the first application displays a first image; and the processing module 82 is configured to adjust a target parameter in the terminal, the target parameter being related to a display effect of the first image.

[0208] In an example, the target state includes the display state, and the display state includes a size of the display window; and the determination module 81 is specifically configured to determine that the size of the display window is switched from a first size to a second size.

[0209] In an example, the target state includes the display state, and the display state includes target content expressed by the first image; and the determination module 81 is specifically configured to determine that the target content is switched from a first content to a second content, and a type of the first content is different from a type of the second content.

[0210] In an example, the target state includes the user state, and the user state includes target attention of the user to a first area on the display window, and the first area is used to display part or all of the first image; and the determination module 81 is specifically configured to determine that the target attention is switched from a first attention to a second attention.

[0211] In an example, the determination module 81 is specifically configured to determine a gaze duration of an eyeball of the user to the first area, and determine the target attention according to a time interval to which the gaze duration belongs.

[0212] In an example, the target state includes the user state, and the user state includes target operation frequency of the user operating the terminal; and the determination module 81 is specifically configured to determine that the target operation frequency is switched from a first operation frequency to a second operation frequency.

[0213] In an example, the processing module 82 is specifically configured to: reduce at least one of a working frequency of a processor in the terminal or a working voltage of a power domain to which the processor belongs, the processor being configured to process the first image; or increase at least one of the working frequency of the processor in the terminal or the working voltage of the power domain to which the processor belongs.

[0214] In an example, the processing module 82 is specifically configured to: increase a number of the first image processing algorithms, the first image processing algorithms being configured to process the first image; or decrease the number of the first image processing algorithms.

[0215] In an example, in the case of increasing the number of the first image processing algorithms, the processing module 82 is further configured to: decrease a number of second image processing algorithms, the second image processing algorithms being configured to process images in at least part of the display area of the terminal other than the area occupied by the display window; or in the case of decreasing the number of the first image processing algorithms, the processing module 82 is further configured to: increase the number of the second image processing algorithms.

[0216] In an example, the target parameter includes a frame rate.

[0217] The processing module 82 is specifically configured to: drop frames of a video stream corresponding to the first image, or supplement frames of the video stream corresponding to the first image.

[0218] In an example, the target parameter includes a resolution.

[0219] The processing module 82 is specifically configured to: adjust a resolution of original image data related to the first image carried in a first request when the terminal sends the first request to the server, the first request being configured to request to obtain the original image data.

[0220] In an example, the target parameter includes a first parameter corresponding to the first image in the first state; the processing module 82 is further configured to: determine a second parameter corresponding to the first image in a second state, the second parameter being of a same type as the first parameter; and adjust the first parameter according to the first parameter and the second parameter.

[0221] In an example, the processing module 82 is further configured to: adjust the first parameter to the second parameter when the first parameter and the second parameter have a deviation; or when a deviation value between the first parameter and the second parameter is greater than a preset difference value, adjust the first parameter based on the deviation value so that the deviation value is less than or equal to the preset difference value.

[0222] It should be understood that the above apparatus is configured to execute the above method in the embodiments, the corresponding program modules in the apparatus have similar implementation principles and technical effects to those described in the above method, and the working process of the apparatus can refer to the corresponding process in the above method, which will not be described here in detail.

[0223] Based on the method in the above embodiment, the embodiment of the present application provides an electronic device. Figure 9 , Figure 9 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 9 As shown, an electronic device provided in an embodiment of the present application can be used to implement the method described in the above method embodiment.

[0224] The electronic device includes at least one processor 901, and the at least one processor 901 can support the electronic device to implement the method provided in the embodiment of the present application.

[0225] The processor 901 may be a general-purpose processor or a dedicated processor. For example, the processor 901 may include a central processing unit (CPU) and / or a baseband processor. The baseband processor may be used to process communication data (e.g., determine the target screen terminal), and the CPU may be used to implement corresponding control and processing functions, execute software programs, and process software program data.

[0226] Furthermore, the electronic device may further include a transceiver unit 905 for implementing signal input (reception) and output (transmission). For example, the transceiver unit 905 may include a transceiver or a radio frequency chip. The transceiver unit 905 may also include a communication interface.

[0227] Optionally, the electronic device may further include an antenna 906, which may be used to support the transceiver unit 905 to implement the transceiver function of the electronic device.

[0228] Optionally, the electronic device may include one or more memories 902 on which a program (or instruction or code) 904 is stored. The program 904 can be executed by the processor 901, so that the processor 901 performs the method described in the above method embodiment. Optionally, data may also be stored in the memory 902. Optionally, the processor 901 may also read data stored in the memory 902 (for example, pre-stored first feature information). The data may be stored at the same storage address as the program 904, or the data may be stored at a different storage address than the program 904.

[0229] The processor 901 and the memory 902 may be provided separately or integrated together, for example, integrated on a single board or a system on chip (SOC).

[0230] For a detailed description of the operations performed by the electronic device in the various possible designs described above, reference can be made to the description in the embodiments of the method provided in the embodiments of the present application, and will not be repeated here.

[0231] Based on the apparatus in the above embodiment, an embodiment of the present application further provides another electronic device, which includes the terminal control apparatus 800 provided in the above embodiment.

[0232] Based on the method in the above embodiment, the present application embodiment also provides a terminal control device. Figure 10 , Figure 10 This is a schematic diagram of the structure of another terminal control device provided in an embodiment of the present application. Figure 10 As shown, the terminal control device 1000 includes one or more processors 1001 and an interface circuit 1002. Optionally, the terminal control device 1000 may further include a bus 1003.

[0233] The processor 1001 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by an integrated logic circuit of hardware in the processor 1001 or instructions in the form of software. The above-mentioned processor 1001 can be a general-purpose processor, a digital communicator (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. The various methods and steps disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.

[0234] The interface circuit 1002 can be used to send or receive data, instructions or information. The processor 1001 can use the data, instructions or other information received by the interface circuit 1002 to process it, and can send the processing completion information through the interface circuit 1002.

[0235] Optionally, the terminal control device 1000 further includes a memory, which may include a read-only memory and a random access memory, and provides operation instructions and data to the processor. Part of the memory may also include a non-volatile random access memory (NVRAM).

[0236] Optionally, the memory stores an executable software module or a data structure, and the processor can perform corresponding operations by calling an operation instruction stored in the memory (the operation instruction may be stored in an operating system).

[0237] Optionally, the interface circuit 1002 may be configured to output the execution result of the processor 1001 .

[0238] It should be noted that the corresponding functions of the processor 1001 and the interface circuit 1002 can be implemented through hardware design, software design, or a combination of hardware and software, and there is no limitation here.

[0239] It should be understood that each step of the above method embodiments can be completed by logic circuit in the form of hardware in the processor or instructions in the form of software.

[0240] It can be understood that the processor in the embodiments of the present application can be a central processing unit (CPU), and can also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The general-purpose processor can be a microprocessor or any conventional processor.

[0241] The method steps in the embodiments of the present application can be implemented in the form of hardware or by the processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in a random access memory (RAM), a flash memory, a read-only memory (ROM), a programmable read-only memory (PROM), an erasable PROM (EPROM), an electrically EPROM (EEPROM), a register, a hard disk, a mobile hard disk, a CD-ROM or any other form of storage medium well known in the art. An exemplary storage medium is coupled to the processor, so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and the storage medium can be located in an ASIC.

[0242] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions can be stored in or transmitted by a computer readable storage medium. The computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center through a wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) manner. The computer readable storage medium can be any available medium accessible by a computer or a data storage device such as a server, data center, etc. integrated with one or more available media. The available media can be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk (SSD)) and the like.

[0243] It can be understood that various numerical numbers involved in the embodiments of the present application are only distinguished for convenience of description, and are not used to limit the scope of the embodiments of the present application.

Claims

1. A terminal control method, characterized in that: The method comprises: determining that a target state is switched from a first state to a second state, the target state comprising at least one of a display state of a display window of a first application on the terminal or a user state of a user currently using the terminal, wherein a first image is displayed on the display window of the first application; Adjusting a target parameter in the terminal, where the target parameter is related to a display effect of the first image.

2. The method according to claim 1, characterized in that The target state includes the display state, and the display state includes the size of the display window; The determining that the target state is switched from the first state to the second state includes: Determine that the size of the display window is switched from a first size to a second size.

3. The method according to claim 1 or 2, characterized in that The target state includes the display state, and the display state includes the target content expressed by the first image; The determining that the target state is switched from the first state to the second state includes: It is determined that the target content is switched from first content to second content, and a type of the first content is different from a type of the second content.

4. The method according to any one of claims 1 to 3, characterized in that: The target state includes the user state, and the user state includes the user's target attention to a first area on the display window, where the first area is used to display part or all of the first image; The determining that the target state is switched from the first state to the second state includes: It is determined that the target attention level is switched from the first attention level to the second attention level.

5. The method according to claim 4, characterized in that The method further comprises: determining a gaze duration of the user's eyes on the first area; The target attention degree is determined according to the duration interval to which the gaze duration belongs.

6. The method according to any one of claims 1 to 5, characterized in that: The target state includes the user state, and the user state includes a target operating frequency of the user operating the terminal; The determining that the target state is switched from the first state to the second state includes: Determine that the target operating frequency is switched from the first operating frequency to the second operating frequency.

7. The method according to any one of claims 1 to 6, characterized in that: The adjusting the target parameter in the terminal includes: reducing at least one of an operating frequency of a processor in the terminal or an operating voltage of a power domain to which the processor belongs, the processor being used to process the first image; or At least one of an operating frequency of the processor in the terminal or an operating voltage of a power domain to which the processor belongs is increased.

8. The method according to any one of claims 1 to 7, characterized in that: The adjusting the target parameter in the terminal includes: increasing the number of first image processing algorithms, wherein the first image processing algorithms are used to process the first image; or The number of the first image processing algorithms is reduced.

9. The method according to claim 8, characterized in that In the case of increasing the number of the first image processing algorithms, the method further includes: reducing the number of second image processing algorithms used to process images in at least a portion of a display area on the terminal excluding an area occupied by the display window; In the case of reducing the number of the first image processing algorithms, the method further comprises: Increase the number of the second image processing algorithms.

10. The method according to any one of claims 1 to 9, characterized in that: The target parameters include frame rate; The adjusting a target parameter related to the first image in the terminal includes: Drop frames of the video stream corresponding to the first image, or add frames to the video stream corresponding to the first image.

11. The method according to any one of claims 1 to 10, characterized in that: The target parameters include the resolution; The adjusting a target parameter related to the first image in the terminal includes: When the terminal sends a first request to the server, the resolution of the original image data related to the first image carried in the first request is adjusted, and the first request is used to request to obtain the original image data.

12. The method according to any one of claims 1 to 11, characterized in that: The target parameter includes a first parameter corresponding to the first image in the first state; The adjusting a target parameter related to the first image in the terminal includes: determining a second parameter corresponding to the first image in the second state, where the second parameter is of the same type as the first parameter; The first parameter is adjusted according to the first parameter and the second parameter.

13. The method according to claim 12, characterized in that The adjusting the first parameter according to the first parameter and the second parameter includes: When there is a deviation between the first parameter and the second parameter, adjusting the first parameter to the second parameter; or When a deviation value between the first parameter and the second parameter is greater than a preset difference value, the first parameter is adjusted based on the deviation value so that the deviation value is less than or equal to the preset difference value.

14. A terminal control device, characterized in that: The device comprises: a determining module, configured to determine whether a target state is switched from a first state to a second state, the target state comprising at least one of a display state of a display window of a first application on the terminal or a user state of a user currently using the terminal, wherein a first image is displayed on the display window of the first application; A processing module is used to adjust a target parameter in the terminal, where the target parameter is related to a display effect of the first image.

15. The device according to claim 14, characterized in that The target state includes the display state, and the display state includes the size of the display window; The determining module is further configured to: Determine that the size of the display window is switched from a first size to a second size.

16. The device according to claim 14 or 15, characterized in that The target state includes the display state, and the display state includes the target content expressed by the first image; The determining module is further configured to: It is determined that the target content is switched from first content to second content, and a type of the first content is different from a type of the second content.

17. The device according to any one of claims 14 to 16, characterized in that: The target state includes the user state, and the user state includes the user's target attention to a first area on the display window, where the first area is used to display part or all of the first image; The determining module is further configured to: It is determined that the target attention level is switched from the first attention level to the second attention level.

18. The device according to claim 17, characterized in that The determining module is further configured to: determining a gaze duration of the user's eyes on the first area; The target attention degree is determined according to the duration interval to which the gaze duration belongs.

19. The device according to any one of claims 14 to 18, characterized in that: The target state includes the user state, and the user state includes a target operating frequency of the user operating the terminal; The determining module is further configured to: Determine that the target operating frequency is switched from the first operating frequency to the second operating frequency.

20. The device according to any one of claims 14 to 19, characterized in that: The processing module is further configured to: reducing at least one of an operating frequency of a processor in the terminal or an operating voltage of a power domain to which the processor belongs, the processor being used to process the first image; or At least one of an operating frequency of the processor in the terminal or an operating voltage of a power domain to which the processor belongs is increased.

21. The device according to any one of claims 14 to 20, characterized in that: The processing module is further configured to: increasing the number of first image processing algorithms, wherein the first image processing algorithms are used to process the first image; or The number of the first image processing algorithms is reduced.

22. The device according to claim 21, characterized in that When the number of the first image processing algorithms is increased, the processing module is further configured to: reducing the number of second image processing algorithms used to process images in at least a portion of a display area on the terminal excluding an area occupied by the display window; When reducing the number of the first image processing algorithms, the processing module is further configured to: Increase the number of the second image processing algorithms.

23. The device according to any one of claims 14 to 22, characterized in that: The target parameters include frame rate; The processing module is further configured to: Drop frames of the video stream corresponding to the first image, or add frames to the video stream corresponding to the first image.

24. The device according to any one of claims 14 to 23, characterized in that The target parameters include the resolution; The processing module is further configured to: When the terminal sends a first request to the server, the resolution of the original image data related to the first image carried in the first request is adjusted, and the first request is used to request to obtain the original image data.

25. The device according to any one of claims 14 to 24, characterized in that: The target parameter includes a first parameter corresponding to the first image in the first state; The processing module is further configured to: determining a second parameter corresponding to the first image in the second state, where the second parameter is of the same type as the first parameter; The first parameter is adjusted according to the first parameter and the second parameter.

26. The device according to claim 25, characterized in that The processing module is further configured to: When there is a deviation between the first parameter and the second parameter, adjusting the first parameter to the second parameter; or When a deviation value between the first parameter and the second parameter is greater than a preset difference value, the first parameter is adjusted based on the deviation value so that the deviation value is less than or equal to the preset difference value.

27. An electronic device, characterized in that: include: at least one memory for storing a program; At least one processor, configured to call the program stored in the memory to execute the method according to any one of claims 1 to 13.

28. A computer storage medium storing instructions, wherein when the instructions are executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 13.

29. A computer program product comprising instructions, which, when executed on a computer, causes the computer to perform the method according to any one of claims 1 to 13.

30. A terminal control device, characterized in that: comprising at least one processor and an interface; The at least one processor obtains program instructions or data through the interface; The at least one processor is configured to execute the program line instructions to implement the method according to any one of claims 1-13.

Images