Method and terminal device for display control
By identifying and reducing the grayscale of non-critical areas of terminal devices, the problems of high power consumption and severe blue light radiation in terminal devices are solved, improving user experience and screen efficiency.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HONOR DEVICE CO LTD
- Filing Date
- 2022-10-28
- Publication Date
- 2026-04-17
AI Technical Summary
When terminal devices have consistent display parameters, high power consumption and poor user experience result, especially in areas where user attention is unevenly distributed in non-full-screen mode, leading to severe blue light radiation.
By identifying non-critical areas in the terminal device interface, the grayscale of their layers is reduced to adjust the display effect, making the content in the critical areas stand out, and reducing the grayscale of non-critical areas to save power consumption and reduce blue light radiation.
While ensuring a good user experience, it reduces screen power consumption, decreases blue light radiation, and improves the visibility of key content areas for users.
Smart Images

Figure CN117956215B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of electronic equipment technology, and in particular to a display control method and terminal device. Background Technology
[0002] To enhance the user experience for reading, gaming, and multimedia, terminal devices typically have large screen sizes. However, in practical applications, users have a limited field of view, and their focus is usually concentrated on a specific area of the screen rather than being evenly distributed across the entire screen. For example, when playing a video in non-full-screen mode, users primarily focus on the video playback area on the screen, paying less attention to areas outside the video playback area. In this case, the area corresponding to the video playback area is the key area of the screen that receives high user attention, while other areas are non-key areas that receive less user attention.
[0003] Currently, when setting certain display parameters for terminal devices, the settings are generally applied to the entire screen to ensure that all areas of the screen display the same effect. However, directly setting the same display parameters for the entire screen can easily lead to high power consumption and may also result in a poor user experience. Summary of the Invention
[0004] This application provides a display control method and terminal device. By reducing the grayscale of the layer corresponding to non-critical areas, the grayscale of areas on the screen with low user attention is also reduced, thereby reducing device power consumption while ensuring a good user experience.
[0005] Firstly, a display control method is provided, applied to a terminal device, including:
[0006] When entering the first interface of the terminal device, it is identified whether at least one first layer corresponding to the first interface supports grayscale adjustment function. The first interface includes non-critical areas pre-divided based on user attention.
[0007] When the first layer supports grayscale adjustment, the grayscale of the target layer corresponding to the first interface is adjusted so that the grayscale of the non-critical area in the first interface changes with the adjustment. The target layer is the first layer that matches the position and size of the non-critical area.
[0008] In one possible implementation, the first interface includes non-critical areas and critical areas pre-divided based on user attention, wherein the user attention in the critical areas is higher than the user attention in the non-critical areas.
[0009] According to the display control method provided in this implementation, by reducing the grayscale of the layer corresponding to non-critical areas, the terminal device can flexibly reduce the grayscale of non-critical areas when presenting content to the user through the screen. This satisfies the user's needs and experience in viewing critical areas, saves the screen power consumption of the terminal device, and also reduces the problem of severe blue light radiation caused by the high overall grayscale of the screen.
[0010] In conjunction with the first aspect, in some implementations of the first aspect, the first interface is an interface in the first application, and the method further includes:
[0011] Identify whether the first application supports the grayscale adjustment function;
[0012] If the first application supports the grayscale adjustment function, then when entering the first interface of the terminal device, it is identified whether the layer corresponding to the first interface supports the grayscale adjustment function.
[0013] In conjunction with the first aspect, in some implementations of the first aspect, identifying whether the first application supports the grayscale adjustment function specifically includes:
[0014] Set a first correspondence between the application type and the grayscale adjustment function, the first correspondence being used to indicate whether the application type supports the grayscale adjustment function;
[0015] Identify that the first application belongs to the first application type;
[0016] Based on the first correspondence between the first application type and the grayscale adjustment function, determine whether the first application supports the grayscale adjustment function.
[0017] In conjunction with the first aspect, in some implementations of the first aspect, identifying whether the layer corresponding to the first interface supports grayscale adjustment specifically includes:
[0018] A second correspondence is established between the layer and the grayscale adjustment function, the second correspondence being used to indicate whether the layer supports the grayscale adjustment function;
[0019] Based on the second correspondence, identify whether the layer corresponding to the first interface supports grayscale adjustment function.
[0020] In conjunction with the first aspect, in some implementations of the first aspect, when the layer corresponding to the first interface supports grayscale adjustment, adjusting the grayscale of the target layer so that the grayscale of the non-critical area in the first interface changes with the adjustment specifically includes:
[0021] When the layer corresponding to the first interface supports grayscale adjustment, obtain the preset target grayscale for the target layer in the first interface, and obtain the current grayscale of the target layer corresponding to the first interface.
[0022] Compare the current grayscale with the target grayscale;
[0023] When the current grayscale is higher than the target grayscale, the grayscale of the target layer is adjusted so that the grayscale of the non-critical area in the first interface changes with the adjustment.
[0024] In conjunction with the first aspect, in some implementations of the first aspect, the step of adjusting the grayscale of the target layer when the current grayscale is higher than the target grayscale, so that the grayscale of the non-critical area in the first interface changes with the adjustment, specifically includes:
[0025] Reduce the grayscale of the target layer in the next frame of the first interface by one unit grayscale to obtain the first adjusted grayscale of the target layer;
[0026] The first interface frame is refreshed and displayed according to the first grayscale adjustment, so that the grayscale of the non-critical area in the first interface changes with the adjustment.
[0027] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes:
[0028] Compare the first adjusted grayscale of the target layer with the target grayscale;
[0029] When the first adjusted grayscale is higher than the target grayscale, the grayscale of the target layer in the next frame of the first interface is reduced by one unit grayscale, and the second adjusted grayscale of the target layer is obtained.
[0030] The first interface frame is refreshed and displayed according to the second grayscale adjustment, so that the grayscale of the non-critical area in the first interface changes with the adjustment.
[0031] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes:
[0032] Repeatedly compare the second adjusted gray level of the target layer with the target gray level, and when the first adjusted gray level is higher than the target gray level, reduce the gray level of the target layer in the next frame of the first interface by one unit gray level until the gray level of the target layer reaches the target gray level;
[0033] The frames of the first interface are refreshed and displayed according to the target grayscale, so that the grayscale of the non-critical areas in the first interface changes with the adjustment.
[0034] In conjunction with the first aspect, in some implementations of the first aspect, adjusting the grayscale of the target layer corresponding to the first interface when the first layer supports grayscale adjustment specifically includes:
[0035] When the first layer supports grayscale adjustment, the target layer that matches the position and size of the non-critical area is determined based on the position and size of the at least one first layer.
[0036] In conjunction with the first aspect, in some implementations of the first aspect, adjusting the grayscale of the target layer corresponding to the first interface when the first layer supports grayscale adjustment specifically includes:
[0037] Based on the position and size of the at least one first layer, determine the target layer whose position and size match the non-critical area from the at least one first layer;
[0038] Identify whether the target layer supports the grayscale adjustment function;
[0039] When the target layer supports grayscale adjustment, the grayscale of the target layer corresponding to the first interface is adjusted.
[0040] In conjunction with the first aspect, in some implementations of the first aspect, adjusting the grayscale of the target layer corresponding to the first interface when the first layer supports grayscale adjustment specifically includes:
[0041] When the first layer supports grayscale adjustment, it detects whether the first interface and / or the pre-divided non-critical area in the first interface receives the first operation input by the user within a preset time period.
[0042] If the first interface does not receive the first operation within a preset time period, adjust the grayscale of the target layer corresponding to the first interface; or,
[0043] When the non-critical area pre-divided in the first interface does not receive the first operation within a preset time period, the grayscale of the target layer corresponding to the first interface is adjusted.
[0044] According to the display control method provided in the embodiments of this application, when a certain area is detected to have not received user input interaction for a long time, the gray level of the corresponding area is reduced. This enables the terminal device to flexibly reduce the gray level of non-critical areas when presenting display content to the user through the screen. This satisfies the user's needs and experience in viewing critical areas, saves the screen power consumption of the terminal device, and also reduces the problem of severe blue light radiation caused by high overall screen gray level.
[0045] In conjunction with the first aspect, in some implementations of the first aspect, when the terminal device is a foldable screen device, the non-critical area corresponds to the left or right area of the foldable screen device, and the left and right areas are areas divided according to the central axis of the foldable screen.
[0046] When the first layer supports grayscale adjustment, adjusting the grayscale of the target layer corresponding to the first interface specifically includes:
[0047] When the first layer supports grayscale adjustment, it detects whether the left and / or right regions of the foldable screen receive a second user input within a preset time period; wherein...
[0048] When it is detected that the left side of the foldable screen has not received a second user input within a preset time period, the grayscale of the target layer that matches the position and size of the left side area is adjusted; or,
[0049] When it is detected that the right side area of the foldable screen has not received a second operation from the user within a preset time period, the grayscale of the target layer that matches the position and size of the right side area is adjusted.
[0050] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes:
[0051] When it is detected that the left area of the foldable screen has not received a second user input within a preset time period, and the right area has received a second user input within a preset time period, the grayscale of the target layer that matches the position and size of the left area is adjusted; or,
[0052] When it is detected that the right side of the foldable screen has not received a second user input within a preset time period, and the left side has received a second user input within a preset time period, the grayscale of the target layer that matches the position and size of the right side area is adjusted.
[0053] In conjunction with the first aspect, in some implementations of the first aspect, the first interface includes a non-full-screen video playback interface or a video call interface.
[0054] In a second aspect, a terminal device is provided, comprising: one or more processors; one or more memories; the one or more memories storing one or more computer programs, the one or more computer programs including instructions that, when executed by the one or more processors, cause the terminal device to perform the method as described in any implementation of the first aspect above.
[0055] Thirdly, a computer-readable storage medium is provided that stores computer-executable program instructions, which, when executed on a computer, cause the computer to perform the method as described in any of the implementations of the first aspect above.
[0056] Fourthly, a computer program product is provided, the computer program product including computer program code, which, when run on a computer, causes the computer to perform the method as described in any of the implementations of the first aspect above. Attached Figure Description
[0057] Figure 1 These are schematic diagrams illustrating key and non-key areas in some scenarios provided for embodiments of this application.
[0058] Figure 2 This is a schematic diagram of the structure of a terminal device 100 provided in an embodiment of this application.
[0059] Figure 3 This is a software structure block diagram of a terminal device 100 provided in an embodiment of this application.
[0060] Figure 4 This is a schematic diagram of a GUI that may be involved in a display control method provided in an embodiment of this application.
[0061] Figure 5 This is a schematic diagram of a GUI that may be involved in another display control method provided in an embodiment of this application.
[0062] Figure 6 This is a schematic diagram of a GUI that may be involved in another display control method provided in an embodiment of this application.
[0063] Figure 7 This is a schematic diagram of a GUI that may be involved in another display control method provided in an embodiment of this application.
[0064] Figure 8 This is a schematic diagram of a GUI that may be involved in another display control method provided in an embodiment of this application.
[0065] Figure 9 This is a schematic flowchart illustrating a display control method provided in an embodiment of this application.
[0066] Figure 10 This is a schematic flowchart illustrating another display control method provided in an embodiment of this application.
[0067] Figure 11 This is a schematic flowchart illustrating another display control method provided in an embodiment of this application.
[0068] Figure 12 This is a schematic flowchart illustrating another display control method provided in an embodiment of this application. Detailed Implementation
[0069] It should be noted that the terminology used in the implementation section of the embodiments of this application is only used to explain the specific embodiments of this application and is not intended to limit this application. In the description of the embodiments of this application, unless otherwise stated, " / " means "or", for example, A / B can mean A or B; "and / or" in this document is merely a description of the association relationship of related obstacles, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. In addition, in the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more, "at least one" or "one or more" means one, two or more.
[0070] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.
[0071] References to "one embodiment" or "some embodiments" as used in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0072] To better understand the display control method and terminal device provided in the embodiments of this application, the following will introduce the terms or concepts that may be involved below.
[0073] 1. Key areas and non-key areas
[0074] The key area described in this application embodiment can also be described as a high-attention area, which refers to the area on the screen of the terminal device that receives high user attention, or the area that the user focuses on.
[0075] The non-critical areas described in this application embodiment can also be described as low-attention areas, which refer to areas on the screen of the terminal device that receive little user attention or areas that the user does not focus on.
[0076] Key and non-key areas can be pre-defined based on specific scenarios, such as through professional expertise or experience, and can be determined manually. For example, see [link to relevant documentation]. Figure 1 In example (a) of the video playback interface in non-full-screen mode, the video playback interface may include a video playback area 11 and a non-video playback area 12. It is understandable that when watching a video, the user's focus will be on the video playback area 11, while the non-video playback area 12 will receive less attention. Therefore, in the scenario of non-full-screen video playback, the video playback area 11 can be designated as the key area, and the non-video playback area 12 as the non-key area.
[0077] For example, see Figure 1 In (b) of the example, a video call interface in a social application includes a display area 13 for the other party's image and a display area 14 for the user's own image. Generally, during a video call, the user's focus is on the display area 13 for the other party's image, rather than on their own image. Therefore, in a video call scenario, the display area 13 for the other party's image can be designated as the key area, while the display area 14 for the user's own image can be designated as the non-key area.
[0078] For example, see Figure 1 In (c), taking the shopping interface in a foldable screen device as an example, the shopping interface can be divided into a left area 15 and a right area 16. When the user inputs an operation in the left area 15 (such as clicking the screen or swiping the screen), the user's focus will also be concentrated on the left area 15, while the attention to the right area 16 is lower. Therefore, in the shopping scenario of a foldable screen device, the left area 15, which receives the user's operation, can be classified as the key area, while the right area 16 can be classified as the non-key area.
[0079] 2. Gray level
[0080] A grayscale image is a monochrome image where each pixel contains only one brightness information. Based on this brightness information, a grayscale image can be divided into several levels between white and black, and the grayscale level is the number of levels from white to black.
[0081] As described in the background section, considering that terminal device screens are increasingly larger, and users typically focus on key areas when viewing content, paying less attention to non-critical areas, and given that current display parameter settings don't account for the varying levels of user attention across different screen areas, this easily leads to high power consumption and a poor user experience when certain parameters are set too high. Therefore, if non-critical areas of the display interface can be identified and their grayscale flexibly reduced when presenting content to the user, it would satisfy the user's needs and experience in viewing key content while saving power and reducing blue light radiation caused by high overall screen grayscale.
[0082] In view of this, the present application provides a display control method that identifies and reduces the grayscale of non-critical areas with low user attention on the screen of a terminal device, thereby reducing the grayscale of non-critical areas on the screen and reducing the power consumption of the terminal device. In addition, the content of critical areas on the screen is relatively highlighted, making the content of critical areas stand out, and the brightness of content in non-critical areas is reduced, which can also reduce the radiation generated by blue light and protect the user's eyesight.
[0083] For example, such as Figure 2 The diagram shown is a structural schematic of a terminal device 100 provided in an embodiment of this application. The terminal device 100 may be a terminal device with a display screen.
[0084] Terminal device 100 can be various types of electronic devices, such as mobile phones, tablets, wearable devices, laptops, desktop computers, netbooks, personal digital assistants (PDAs), etc. This application embodiment does not impose any restrictions on the type of terminal device.
[0085] Terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0086] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the terminal device 100. In other embodiments of this application, the terminal device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0087] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0088] The controller can serve as the central nervous system and command center of the terminal device 100. The controller can generate operation control signals based on the instruction opcode and timing signals to control the fetching and execution of instructions.
[0089] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0090] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0091] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the terminal device 100.
[0092] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.
[0093] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0094] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.
[0095] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the shooting function of the terminal device 100. The processor 110 and the display screen 194 communicate via the DSI interface to enable the display function of the terminal device 100.
[0096] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0097] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, or USB Type-C port. USB port 130 can be used to connect a charger to charge terminal device 100, and can also be used for data transfer between terminal device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other terminals, such as AR devices.
[0098] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the terminal device 100. In other embodiments of this application, the terminal device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.
[0099] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the terminal device 100. While charging the battery 142, the charging management module 140 can also supply power to the terminal via the power management module 141.
[0100] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, external memory, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.
[0101] The wireless communication function of the terminal device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0102] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.
[0103] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the terminal device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.
[0104] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.
[0105] The wireless communication module 160 can provide solutions for wireless communication applications on the terminal device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.
[0106] In some embodiments, antenna 1 of terminal device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling terminal device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).
[0107] The terminal device 100 implements display functions through a GPU, a display screen 194, and an application processor. The display screen 194 is used to display images, videos, etc.
[0108] Terminal device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.
[0109] A digital signal processor (DSP) is used to process digital signals, including digital image signals and other digital signals. For example, when terminal device 100 selects a frequency, the DSP performs Fourier transforms on the frequency energy. A video codec is used to compress or decompress digital video. An NPU (Neural Processing Unit) is a neural network (NN) computing processor that, by borrowing from the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, rapidly processes input information and can continuously learn on its own.
[0110] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card. The internal memory 121 can be used to store computer executable program code, which includes instructions.
[0111] Terminal device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0112] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. Gyroscope sensor 180B can be used to determine the motion posture of terminal device 100. Magnetic sensor 180D includes a Hall sensor. Terminal device 100 can use magnetic sensor 180D to detect the opening and closing of the flip cover. Accelerometer 180E can detect the magnitude of acceleration of terminal device 100 in various directions (generally three axes). When terminal device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the terminal's posture, applied to applications such as screen orientation switching and pedometers. Proximity sensor 180G can include, for example, a light-emitting diode (LED) and a photodetector, such as a photodiode. The LED can be an infrared LED. Terminal device 100 emits infrared light outward through the LED. Ambient light sensor 180L is used to sense ambient light brightness. Terminal device 100 can adaptively adjust the brightness of display screen 194 according to the sensed ambient light brightness. Fingerprint sensor 180H is used to collect fingerprints. Temperature sensor 180J is used to detect temperature. The touch sensor 180K, also known as the "touch panel," can be located on the display screen 194. The touch sensor 180K and the display screen 194 together form a touchscreen, also called a "touch screen." The touch sensor 180K detects touch operations applied to or near it. The bone conduction sensor 180M can acquire vibration signals.
[0113] In addition, the terminal device 100 also includes a barometric pressure sensor 180C and a distance sensor 180F. The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the terminal device 100 calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.
[0114] A distance sensor 180F is used to measure distance. The terminal device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, the terminal device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.
[0115] For example, the software system of terminal device 100 may adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This embodiment of the invention uses the layered architecture Android system as an example to illustrate the software structure of terminal device 100. Figure 3 This is a software structure block diagram of the terminal device 100 according to an embodiment of this application.
[0116] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.
[0117] The application layer can include a series of application packages. For example... Figure 3 As shown, the application package may include applications such as camera, calendar, map, WLAN, SMS, gallery, calling, navigation, Bluetooth, and video.
[0118] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions. For example... Figure 3 As shown, the application framework layer may include a window manager, content provider, phone manager, resource manager, notification manager, view system, etc.
[0119] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.
[0120] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.
[0121] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.
[0122] The phone manager is used to provide communication functions for terminal device 100. For example, it manages call status (including connection, hang-up, etc.).
[0123] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.
[0124] The notification manager allows applications to display notifications in the status bar. These can be used to convey informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of download completion or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating the device, or flashing indicator lights.
[0125] The Android Runtime consists of core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.
[0126] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.
[0127] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as obstacle lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0128] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.
[0129] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.
[0130] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.
[0131] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0132] A 2D graphics engine is a graphics engine for 2D drawing.
[0133] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
[0134] The display control method provided in this application can be applied to scenarios where users pay different attention to different areas of the screen, such as scenarios where videos are not viewed in full screen, video calls, or scenarios where users only pay attention to one side of the screen when using a foldable screen device. This application does not limit this.
[0135] To better understand the display control method provided in the embodiments of this application, the implementation process of the method will be described by way of example below with reference to some graphical user interface (GUI) diagrams shown in the accompanying drawings.
[0136] For example, such as Figures 4 to 6 The diagram shown is a GUI schematic that may be involved in a display control method provided in an embodiment of this application.
[0137] In some embodiments, different types of applications (Apps) can be pre-configured to support grayscale adjustment functionality. In this embodiment, grayscale adjustment functionality refers to the function of adjusting the grayscale of non-critical areas of the screen, specifically, the function of reducing the grayscale of non-critical areas of the screen. For example, the method of reducing the grayscale of non-critical areas of the screen may include: adjusting the grayscale by one unit per frame until the target grayscale is reached, thereby creating a gradient effect in the grayscale of the non-critical areas.
[0138] Understandably, when a user views different content within an app, the app may present different interfaces to the user on the screen. Since the content layout of different interfaces is different, the position and size of their corresponding non-critical areas may also be different. Therefore, in some embodiments, for different interfaces, their corresponding non-critical areas can be pre-defined.
[0139] As a possible implementation method, there are many ways to divide non-critical areas of different interfaces, such as: (1) traversing each interface (or each type of interface) and then manually dividing non-critical areas in these interfaces based on expertise or experience; (2) traversing each interface (or each type of interface) and dividing non-critical areas for interfaces that meet specific conditions.
[0140] Among them, the interfaces that meet the specific conditions mentioned in the above division method (2) refer to interfaces that meet the grayscale adjustment conditions for non-critical areas. In other words, interfaces that meet the specific conditions may have the following characteristics: when users view the content of these interfaces, their focus is usually concentrated on a certain part of the interface, while the attention to the rest is low, such as interfaces when playing videos in non-full-screen mode. For other interfaces, when users view these interfaces, if the range of attention moves dynamically across the entire screen, or the range of user operation moves dynamically across the entire screen, then these interfaces do not meet the specific conditions mentioned above. For this type of interface, there is no need to divide it into non-critical areas, and there is no need to perform grayscale adjustment on this type of interface subsequently.
[0141] In some embodiments, determining whether an interface meets specific conditions may include, for example, counting the top N (N being an integer greater than 1, such as 1000 or 2000) most frequently used apps based on app rankings (such as download rankings or usage rankings); then counting the application types of all apps included in the top N, where different application types may have a pre-defined correspondence with whether they support grayscale adjustment functionality; based on this correspondence, obtaining the apps in the top N that support grayscale adjustment functionality; then, iterating through the different interfaces (or interfaces of different types) of the apps that support grayscale adjustment functionality, and determining the interfaces that meet specific conditions based on the characteristics of different interfaces (or interfaces of different types). For example, interfaces with non-full-screen video playback windows, video call windows, etc., are determined to meet specific conditions.
[0142] In one possible implementation, based on the characteristics of different interfaces (or different types of interfaces), the operations of interfaces that meet specific conditions can be pre-executed manually, i.e., interfaces that meet specific conditions are pre-determined. For ease of understanding, the interfaces that meet specific conditions mentioned in the embodiments of this application can also be described as interfaces that support grayscale adjustment functions.
[0143] For example, taking video apps as an example, since the main purpose of users is to watch videos, and non-full-screen video playback is a common mode used by many users, this non-full-screen playback mode is suitable for grayscale adjustment functions. Therefore, video apps can be preset to support full-screen playback. Then, the interfaces in the video app can be traversed, and based on the characteristics of the interfaces, users can manually determine which interfaces meet specific conditions based on experience or expertise. For example, for... Figure 4 The non-full-screen video playback interface shown in (a) is considered to meet certain conditions, given that users' attention is focused on the area corresponding to the video playback window and not on other areas. For example, for... Figure 4 The TV series interface shown in (b) is considered not to meet the specific conditions, considering that users may be selecting a series to watch when viewing the interface, and their attention will dynamically move across the entire screen.
[0144] In some embodiments, when an interface that meets specific conditions is identified, its corresponding non-critical areas can be divided according to the content layout of the interface. Optionally, its corresponding critical areas can also be divided. For example, the method of dividing an interface into its corresponding non-critical areas may include: based on the content layout displayed on the interface, areas that are not of interest to users, or areas that receive low user attention, are classified as non-critical areas. For instance, when dividing non-critical areas, developers can iterate through all interfaces that meet specific conditions, and then, based on their expertise and experience, determine the areas on the interface that typically attract user attention, and then classify the other areas outside of those areas as non-critical areas. These non-critical areas are also the areas corresponding to subsequent grayscale adjustments.
[0145] In some embodiments, the grayscale adjustment function can be enabled before grayscale adjustment is performed on the interface that meets specific conditions. For example, there are several ways to enable the grayscale adjustment function, such as: (1) the terminal enables the grayscale adjustment function by default, such as the terminal device enabling the function by default in the factory settings; (2) the terminal device automatically enables the grayscale adjustment function when it detects that the triggering conditions are met; (3) the terminal device includes a switch control for the grayscale adjustment function, and the user enables the grayscale adjustment function manually.
[0146] Regarding the activation method (2) described above, the triggering condition can refer to a preset condition used to trigger the automatic activation of the grayscale adjustment function on the terminal device. For example, the triggering condition can be of various types, such as: the terminal device being powered on; or the user opening an App, etc. That is, when the terminal device is powered on, it can trigger the activation of the grayscale adjustment function. Subsequently, when the user uses an App that supports this function, the grayscale of the interface meeting specific conditions can be automatically adjusted. Alternatively, when the user opens an App, it can trigger the activation of the grayscale adjustment function on the terminal device. When the user views an interface in the App that meets specific conditions, the grayscale of that interface can be automatically adjusted.
[0147] Regarding the activation method (3) described above, in one possible implementation, the terminal device can be equipped with a switch control corresponding to the grayscale adjustment function. For example, the switch control corresponding to the grayscale adjustment function can be set in a settings application. Figure 5 As shown in (a), this is the display control settings interface in the application. This interface includes a switch control 501 corresponding to the grayscale adjustment function, and a function description (such as...). Figure 5 The grayscale adjustment function shown in (a) is used to adjust the grayscale of related interfaces that support this function, reducing the grayscale of areas with low user attention to save screen power consumption and reduce blue light radiation. Optionally, the interface may also include an application settings bar that supports the grayscale adjustment function. Through this application settings bar, users can add or delete applications that support the grayscale adjustment function. For example, when it is necessary to add an app to support this function, the user can click the application settings bar. In response to the user's click operation, the terminal device can display as shown in (a). Figure 5 The application settings interface shown in (b) may include an introductory statement of the application settings (such as...). Figure 5 (b) shows "Long press or swipe left on the app settings bar to delete apps that use grayscale adjustment function" and apps that have already been set to support grayscale adjustment function (such as...). Figure 5 (b) shows iQiyi Video, WeChat, Douyin, etc.), the new application settings bar, and the introduction statement of the new application (such as...). Figure 5 (b) shows "Click to add a control, add an application that uses the screen display control function".
[0148] The following describes an exemplary implementation process of a display control method provided in this application, with reference to the accompanying drawings. For example, as shown in the accompanying drawings... Figure 6 The diagram shown illustrates other GUI elements that may be involved in the display control method provided in this application embodiment. For ease of understanding, this embodiment uses a non-full-screen video playback scenario as an example.
[0149] like Figure 6As shown in (a), this is an exemplary main interface of a terminal device. A status bar can be displayed at the top of this main interface. This status bar may include one or more signal strength indicators for mobile communication signals (or cellular signals), one or more signal strength indicators for wireless fidelity (Wi-Fi) signals, a battery indicator, a time indicator, etc. The main screen interface may also include an application icon display area for displaying various types of application icons, such as clock icons, calendar icons, gallery icons, memo icons, file manager icons, email icons, music icons, calculator icons, voice recorder icons, fitness tracker icons, weather icons, browser icons, smart living icons, settings icons, video icons, etc. Below the multiple application icons may be a page indicator display area, which includes page indicators to show the positional relationship between the currently displayed page and other pages. Below the page indicator may be a tray application icon display area for displaying multiple tray application icons, such as camera application icons, contact application icons, dialer application icons, messaging application icons, etc. In other embodiments, the mobile phone home screen interface may include more or fewer application icons or tray application icons than illustrated, and this application is not limited thereto.
[0150] In some embodiments, when a user is watching a video, they can input an operation 601 (such as a click operation) on the video icon in the main interface. When the terminal device detects the operation 601, it can display a response such as... Figure 6 The video interface shown in (b) can specifically be a TV series selection interface, used to display TV series available for the user to select and watch. When the user selects to watch series 1, they can input operation 602 (such as a click operation) on the icon corresponding to series 1. In response to this operation 602, the terminal device can display as shown in (b). Figure 6 The video playback interface shown in (c) or (d) can specifically be a video playback screen in non-full-screen mode.
[0151] In some embodiments, in response to operation 602, the terminal device can directly display, as shown below. Figure 6 The interface shown in (d) is shown in the image.
[0152] Alternatively, in some other embodiments, in response to operation 602, the terminal device may first display as follows: Figure 6The interface shown in (c) is then used. The terminal device can detect whether it has received user input within a preset time period, i.e., whether the terminal device and user are in a weak interaction state. If the terminal device detects that the user has not input any action on the interface within the preset time period (e.g., 3 minutes), i.e., the terminal device and user are in a weak interaction state, the terminal device can reduce the grayscale of non-critical areas of the interface, i.e., display something like... Figure 6 The interface shown in (d) is shown in the image.
[0153] It should be noted that, because when users watch Figure 6 When selecting TV series as shown in (b), the focus range changes dynamically and does not concentrate on a certain area. Therefore, it can be considered that the interface does not meet the specific conditions introduced above, and grayscale adjustment of non-critical areas of the interface is not required.
[0154] According to the display control method provided in the embodiments of this application, by reducing the grayscale of non-critical areas with low user attention in the terminal device interface, the terminal device can flexibly reduce the grayscale of non-critical areas when presenting display content to the user through the screen. This satisfies the user's needs and experience in viewing critical areas, saves the screen power consumption of the terminal device, and also reduces the problem of severe blue light radiation caused by high overall screen grayscale.
[0155] It should be noted that the above Figures 4 to 6 The GUI diagram shown is only illustrated using a candybar phone as an example. However, the display control method provided in this application is not limited to candybar-type terminal devices, but can also be applied to foldable screen terminal devices. The following, in conjunction with... Figure 7 Taking a foldable screen phone as an example, this application provides another display control method.
[0156] For example, such as Figure 7 The diagram shown is another GUI schematic that may be involved in the display control method provided in the embodiments of this application.
[0157] Taking a shopping interface on a foldable phone as an example, the interface can be divided into a left and right area using the central axis of the screen or the central axis of the foldable screen as the dividing line. Before grayscale adjustment, the foldable phone interface can be as follows: Figure 7 As shown in (a) in the figure.
[0158] In some embodiments, the terminal device can listen to user input on the shopping interface and obtain the area corresponding to the input (left or right area). When the terminal device determines that no user input has been received in a certain area for a preset time period (e.g., 3 minutes), it can determine that the area is currently a non-critical area and reduce the grayscale of that area. For example, when the terminal device detects that the user inputs an operation 701 on the left side of the shopping interface and does not input any operation in the right area of the shopping interface for a preset time period, the terminal device can reduce the grayscale of the right area. The shopping interface after reducing the grayscale can be, for example, as shown below. Figure 7 As shown in (b) of the diagram.
[0159] According to the display control method provided in the embodiments of this application, when a certain area is detected to have not received user input interaction for a long time, the gray level of the corresponding area is reduced. This enables the terminal device to flexibly reduce the gray level of non-critical areas when presenting display content to the user through the screen. This satisfies the user's needs and experience in viewing critical areas, saves the screen power consumption of the terminal device, and also reduces the problem of severe blue light radiation caused by high overall screen gray level.
[0160] The foregoing, with reference to the GUI schematic diagrams in the accompanying drawings, describes the implementation process of the display control method provided in this application at the user's visual level. To more clearly understand the display control method provided in this application, the following, with reference to the accompanying drawings, describes the implementation principle of adjusting the grayscale of non-critical areas and the underlying implementation process of the display control method.
[0161] The following describes the implementation principle of reducing the grayscale of non-critical areas in the embodiments of this application:
[0162] Generally speaking, the content ultimately presented to the user by a terminal device through its display screen can be understood as being composed of multiple layers of objects (views), where different layers can include different views. Considering that different layers have different positions and sizes, there will be layers whose size and position are closest to the non-critical areas. Therefore, the display control method provided in this application embodiment can achieve the effect of changing the grayscale of the non-critical areas by adjusting the grayscale of the layer whose position and size are closest to the non-critical areas.
[0163] Specifically, different layers can be preset to support grayscale adjustment. For example, for interfaces that meet specific conditions, the layers included in that interface can be set to support grayscale adjustment; for interfaces that do not meet specific conditions, the layers included in that interface can be set to not support grayscale adjustment. When entering a certain interface, it can be determined whether the layers included in that interface support grayscale adjustment. If they do, the target layer matching the non-critical area can be determined based on the layer's position and size. Then, by adjusting the grayscale of the target layer, the grayscale of the non-critical area in the interface can be adjusted. Taking a non-full-screen video playback interface, a video call interface, and an e-book reading interface as examples, an exemplary correspondence between interfaces, layers, and whether grayscale adjustment is supported can be shown in Table 1 below:
[0164] Table 1
[0165]
[0166] Referring to Table 1, as an example, when entering a non-full-screen video playback interface, the terminal device checks whether the layers included in the interface support grayscale adjustment based on the correspondence shown in Table 1. If supported, the target layer matching the non-critical area can be selected from the layers (as shown in layer 4). Then, the grayscale of the non-critical area in the corresponding interface can be adjusted by adjusting the grayscale of the target layer.
[0167] The method for determining the target layer corresponding to non-critical areas in the interface can be found in [reference needed]. Figure 8 , Figure 8 (a) shows multiple layers corresponding to an exemplary interface, which may be, for example, a... Figure 8 The non-full-screen video playback interface is shown in (b). The multiple layers can specifically include layers 1 to 4, and each view in the non-full-screen video playback interface can include views from these multiple layers. Combining the positions and sizes of layers 1 to 4, layer 4 can be determined as the layer closest to the non-critical area in the non-full-screen video playback interface. Therefore, layer 4 can be used as the target layer representing the non-critical area of the interface.
[0168] Alternatively, one can first determine the target layer corresponding to the non-critical areas of the interface, and then, based on the characteristics of the interface, preset whether the target layer supports grayscale adjustment. When entering a certain interface later, it can be determined whether the target layer of that interface supports grayscale adjustment; if it does, the grayscale of the target layer can be adjusted to achieve grayscale adjustment of the non-critical areas of the interface. Taking a non-full-screen video playback interface, a video homepage interface, and a TV series selection interface as examples, an exemplary correspondence between the interface, the target layer, and whether grayscale adjustment is supported can be shown in Table 2 below:
[0169] Table 2
[0170] Interface Icons The interface includes the identification of multiple layers. Does it support grayscale adjustment function? Non-full-screen video playback interface Layer 4 yes Video Homepage Layer A no TV series selection interface Layer B no …… …… ……
[0171] Alternatively, considering that some layers in the interface may correspond to key areas while others may correspond to non-key areas, it is also possible to preset whether each of the multiple layers in the interface supports grayscale adjustment. Specifically, the target layer matching the non-key area can be set to support grayscale adjustment, while other layers can be set to not support grayscale adjustment. For layers that support grayscale adjustment, if a user enters the corresponding interface while using the terminal device, the grayscale of the non-key areas in the interface can be adjusted by adjusting the grayscale of that layer. Taking a non-full-screen video playback interface as an example, an exemplary correspondence between the interface, layers, and whether grayscale adjustment is supported can be shown in Table 3 below:
[0172] Table 3
[0173]
[0174] It should be noted that if none of the layers included in the interface support grayscale adjustment, it means that the interface may not meet specific conditions, and there is no need to use the display control method provided in the embodiments of this application to adjust the grayscale of the interface.
[0175] Alternatively, in one optional scenario, the target layer corresponding to the interface can be determined first. However, two pre-defined correspondences can exist between the target layer and the grayscale adjustment function: either the target layer supports grayscale adjustment or it does not. In other words, in this case, a target layer can be determined for each interface (or each type of interface); however, only interfaces that include a target layer that supports grayscale adjustment can have their non-critical areas adjusted. Taking a non-full-screen video playback interface, a video homepage, and a TV series selection interface as examples, the correspondence between an exemplary interface, the identifier of the target layer corresponding to the interface, and whether or not grayscale adjustment is supported can be shown in Table 4 below:
[0176] Table 4
[0177] Interface Icons The identifier of the target layer corresponding to the interface Does it support grayscale adjustment function? Non-full-screen video playback interface Layer 4 yes Video Homepage Layer A no TV series selection interface Layer B no …… …… ……
[0178] As an example, when entering a non-full-screen video playback interface, the terminal device queries the corresponding target layer (i.e., layer 4) of the interface from the correspondence shown in Table 4 above to see if it supports grayscale adjustment. If it does, the grayscale of non-critical areas can be reduced by adjusting the grayscale of the target layer.
[0179] As another example, when entering the video homepage interface, the terminal device queries the corresponding target layer (i.e., layer A) of the interface from the correspondence shown in Table 4 above to see if it supports grayscale adjustment function; if it does not support it, then there is no need to adjust the grayscale of non-critical areas in the video homepage.
[0180] As another example, when entering the TV series selection interface, the terminal device queries the corresponding target layer (i.e., layer B) of the interface from the correspondence shown in Table 4 above to see if it supports grayscale adjustment function; if it does not support it, then there is no need to adjust the grayscale of non-critical areas in the TV series selection interface.
[0181] Alternatively, in another optional scenario, there is only one correspondence between the target layer and the grayscale adjustment function, that is, the target layer supports the grayscale adjustment function. In this case, the target layer can be determined only for interfaces that meet specific conditions, and the database only stores the correspondence between interfaces that meet specific conditions and their corresponding target layers. For example, in this case, the terminal device can store the correspondence between the interface and the target layer corresponding to the interface in the database. Unlike Table 4 above, the interface stored here can refer to the interface that meets specific conditions, and its corresponding target layer is the layer that will definitely support the grayscale adjustment function. For example, this correspondence can be shown in Table 5 below, and this correspondence can include the interface identifier, the identifier of the target layer corresponding to the interface, and the identifier of whether the grayscale adjustment function is supported (such as "yes" or "no").
[0182] Table 5
[0183] Interface Icons The identifier of the target layer corresponding to the interface Non-full-screen video playback interface Layer 4 Video call interface Layer C Shopping interface Layer D …… ……
[0184] In other words, the target layers stored in Table 5 above (Layer 4, Layer C, and Layer D, etc.) all support grayscale adjustment functions.
[0185] As an example, when entering a certain interface, the terminal device checks whether the target layer corresponding to the interface identifier of the interface exists from the correspondence shown in Table 5 above; if it exists, the grayscale of non-critical areas in the interface can be reduced by adjusting the grayscale of the target layer; if it does not exist, there is no need to adjust the grayscale of the interface.
[0186] Optionally, the database can also store more detailed information, such as the App to which the interface belongs, whether the App supports grayscale adjustment, interface information, the target layer corresponding to the interface, and whether the target layer supports grayscale adjustment.
[0187] It should be noted that the methods for presetting the correspondence between the interface, layers and grayscale adjustment functions as described in the embodiments in Tables 1 to 5 above are only examples. The embodiments in Table 1 above will be used as the main methods for the following description of the embodiments in this application.
[0188] It should also be noted that the information types shown in Tables 1 to 5 above are merely examples. In practical applications, the correspondence between the interface, layers, and grayscale adjustment functions can also be represented by other types of information, and this correspondence can also include more or less information. This application embodiment does not limit this. In addition, the display control method provided in this application embodiment can also use other information identifiers to indicate the target layer corresponding to the interface. For example, for the non-full-screen video playback interface in the iQiyi App, the identifier used to indicate the target layer can be represented as: com.qiyi.video / org.iqiyi.video.activity.PlayerActivity#1, but this application embodiment does not limit this.
[0189] Optionally, in addition to determining the target layer for representing non-critical areas by size and position as described above, the target layer can also be determined by objects (views), for example, by pre-collecting and summarizing which views typically represent areas with low user attention, and then pre-setting the layer containing that view as the target layer representing the non-critical area. Furthermore, the target layer and grayscale adjustment function may have several correspondences (one or two), which can be set as needed; this application embodiment does not limit this.
[0190] For example, such as Figure 9 The diagram shown is a schematic flowchart of a display control method provided in an embodiment of this application. This method can be executed by a terminal device and specifically includes the following steps:
[0191] S901, scene recognition.
[0192] In some embodiments, the terminal device may pre-enable the grayscale adjustment function. The method for enabling the grayscale adjustment function can be found in the relevant description above, and will not be repeated here.
[0193] In some embodiments, when a user opens an app or enters a certain interface, the terminal device can perform scene recognition to identify whether the layers in the current app and / or the current interface support grayscale adjustment. Specifically, the scene recognition in this application embodiment can include the following scenarios:
[0194] In scenario (1), when the user opens the App, the terminal device can identify whether the App supports grayscale adjustment function. If the App supports grayscale adjustment function, the terminal device can further identify whether the layers in the current interface support grayscale adjustment function. If the layers in the interface support grayscale adjustment function, the subsequent step S902 is executed.
[0195] In scenario (2), the terminal device can directly identify whether the layer in the current interface supports grayscale adjustment function; if it is identified that the layer in the interface supports grayscale adjustment function, the terminal device can execute the subsequent step S902.
[0196] In some embodiments, there are multiple ways to identify whether an App supports grayscale adjustment, such as the following methods (1) and (2):
[0197] Method (1): First, iterate through the App rankings (such as download rankings or usage rankings) to count the most frequently used TOPN (N is an integer greater than 1) Apps by users; then iterate through all Apps to determine the Apps suitable for applying the grayscale adjustment function; then, store the correspondence between Apps and whether the App supports the grayscale adjustment function in the database (for example, the correspondence is shown in Table 6 below); when it is necessary to identify whether the App opened by the user supports the grayscale adjustment function, query whether it supports the grayscale adjustment function according to the identifier of the currently opened App and the correspondence in the database.
[0198] Table 6
[0199]
[0200]
[0201] Method (2): First, iterate through the app ranking lists (such as download ranking lists or usage ranking lists) to count the most frequently used TOPN (N is an integer greater than 1) apps by users; then, classify the apps into different application types according to their functions or characteristics, such as video type, social type, shopping type, and e-book reading type, etc., where different application types may support grayscale adjustment function or not support grayscale adjustment function; then, store the correspondence between the app and its corresponding application type and whether it supports grayscale adjustment function in the database (for example, the correspondence is shown in Table 7 below); when it is necessary to identify whether the app opened by the user supports grayscale adjustment function, it can be determined whether it supports grayscale adjustment function according to the type of the app. Specifically, after the terminal device determines the currently opened app, it can query the application type corresponding to the app from the database, and then query whether the app supports grayscale adjustment function according to the preset correspondence between application type and whether it supports grayscale adjustment function.
[0202] For example, taking the iQiyi video app as an example, the terminal device can pre-obtain the correspondence between different application types and whether they support grayscale adjustment functionality. Here, we assume that the video type corresponds to support for grayscale adjustment. In one possible implementation, when a user opens the iQiyi video app, the terminal device can determine the application type of the app in response to the app's opening process. If it is determined that the app is a video app, it can be determined that the app supports grayscale adjustment, and subsequently, grayscale adjustment can be applied to certain non-critical areas of the app's interface.
[0203] Table 7
[0204]
[0205] In some embodiments, identifying whether a layer in an app supports grayscale adjustment may include: determining whether a layer in the current interface supports grayscale adjustment based on the correspondence between layers and grayscale adjustment functions stored in a database. The correspondence between layers stored in the database and whether display control is supported can be found in Tables 1 to 5 above, for example.
[0206] Optionally, the display control method provided in this application embodiment may further include step S902, namely, determining non-critical areas.
[0207] In some embodiments, when entering a certain interface of an App that supports grayscale adjustment, if it is recognized that the layers in the interface support grayscale adjustment, the non-critical areas of the interface can be determined and obtained. If the interface has non-critical areas, step S903 can be executed subsequently; if the interface does not have non-critical areas, the process ends.
[0208] S903 reduces the grayscale of non-critical areas.
[0209] In some embodiments, when it is identified that the layers included in the current interface support grayscale adjustment, the terminal device may reduce the grayscale of the target layer in the current interface that matches the non-critical area. Alternatively, if the layers included in the current interface support grayscale adjustment and it is detected that no user input has been received on the current screen within a preset time period, the terminal device may reduce the grayscale of the target layer in the current interface that matches the non-critical area.
[0210] In some embodiments, reducing the grayscale of a target layer that matches a non-critical area may include: reducing the grayscale of a target layer that matches a non-critical area in the interface before displaying the current interface on the screen; or, reducing the grayscale of a target layer that matches a non-critical area in the interface before displaying the current interface on the screen.
[0211] It should be noted that by reducing the grayscale or gray level of the target layer that matches non-critical elements, the grayscale of non-critical areas that receive less user attention can be reduced. This avoids the problem of setting uniform grayscale parameters for the screen when user attention to the screen is uneven, which would lead to higher screen power consumption and stronger blue light radiation.
[0212] According to the display control method provided in the embodiments of this application, when a certain area is detected to have not received user input interaction for a long time, the gray level of the corresponding area is reduced. This enables the terminal device to flexibly reduce the gray level of non-critical areas when presenting display content to the user through the screen. This satisfies the user's needs and experience in viewing critical areas, saves the screen power consumption of the terminal device, and also reduces the problem of severe blue light radiation caused by high overall screen gray level.
[0213] For example, such as Figure 10 The diagram shown is a schematic flowchart of another display control method provided in an embodiment of this application. The execution subject of this process is a terminal device, and it may specifically include the following steps:
[0214] S1001, Level 1 scene recognition.
[0215] In some embodiments, primary scene recognition may specifically include identifying the application type of the App currently being used by the user. For example, the application type of the App may be preset, such as video, social, shopping, and e-book reading, etc., and this embodiment does not limit this.
[0216] In some embodiments, different application types may support grayscale adjustment functionality or not support it. For example, an exemplary correspondence between different application types and whether or not they support grayscale adjustment functionality is shown in Table 7 above.
[0217] S1002, determine whether the App supports grayscale adjustment function.
[0218] In some embodiments, after determining the application type of the App, the database can be used to query whether the application type supports grayscale adjustment functionality.
[0219] S1003, Level 2 scene recognition.
[0220] In some embodiments, secondary scene recognition may specifically include: recognizing the layers included in the current interface. Different layers may each have a pre-defined correspondence with a grayscale adjustment function, such as layers supporting grayscale adjustment or layers not supporting grayscale adjustment.
[0221] S1004, Determine whether the layers in the interface support grayscale adjustment.
[0222] In some embodiments, after determining the interface type of the current interface, a query can be performed from the database to determine whether the layers in that interface support grayscale adjustment. For example, a query can be performed based on Tables 1 to 5 above.
[0223] If the layers in the interface support grayscale adjustment, step S1005 can be executed; if the layers in the interface do not support grayscale adjustment, step S1008 can be executed, and then the process ends.
[0224] S1005: Obtain the target grayscale of the target layer and reduce the grayscale of the target layer according to the preset grayscale unit.
[0225] The target layer can refer to the layer corresponding to the non-critical area of the current interface, that is, the layer whose size and position are closest to the non-critical area of the current interface.
[0226] It should be noted that the display control method provided in this application mainly adjusts the grayscale of non-critical areas by adjusting the grayscale of the target layer that matches the non-critical area. Therefore, after determining that the layer in the current interface supports the grayscale adjustment function, the grayscale of the target layer in the current interface can be adjusted to reduce the grayscale of the non-critical area.
[0227] In some embodiments, obtaining the target grayscale of the target layer may include: presetting the target grayscale corresponding to the target layer (or non-critical area), which may refer to the grayscale after grayscale adjustment of the target layer, specifically the grayscale after grayscale reduction of the target layer. The target grayscale may be less than the current grayscale of the target layer. Here, the current grayscale of the target layer is also the grayscale of the target layer before grayscale adjustment. For ease of distinction, this grayscale may also be recorded as the initial grayscale.
[0228] In some embodiments, the initial grayscale of the target layer in the current interface can be calculated before adjusting the grayscale of the target layer.
[0229] Optionally, before adjusting the grayscale of the target layer, it can be determined whether a non-critical area in the current interface has received user input (such as a click, swipe, or long press) within a preset time period. If the non-critical area receives user input within the preset time period, grayscale adjustment is not performed on the non-critical area; if the non-critical area does not receive user input within the preset time period, grayscale adjustment is performed on the non-critical area. For example, the specific implementation process for grayscale adjustment of non-critical areas may include the following steps S1006 to S1008:
[0230] S1006 determines whether the current grayscale of the target layer is greater than the target grayscale.
[0231] The current gray level of the target layer is also the initial gray level of the target layer.
[0232] In some embodiments, the terminal device can compare the initial grayscale with the preset target grayscale. If the initial grayscale is greater than the target grayscale, it means that the grayscale of the non-critical areas in the current interface is high, that is, the current grayscale needs to be further reduced. Then, steps S1007 and S1008 can be executed. If the initial grayscale is greater than or equal to or less than the target grayscale, it means that the grayscale of the non-critical areas in the current interface is equal to or lower than the target grayscale, and the grayscale of the non-critical areas is low. Then, step S1008 can be executed directly, and the process ends.
[0233] S1007, the grayscale of the target layer corresponding to the next frame of data is reduced by one unit grayscale.
[0234] In some embodiments, the terminal device can reduce the gray level of the target layer based on an initial gray level and a preset gray level unit. The preset gray level unit can correspond to a gray scale, meaning the terminal device can reduce the gray level of the target layer based on the initial gray level and a preset gray scale.
[0235] It should be noted that the interface display is usually refreshed at a certain refresh rate. Therefore, reducing the gray level of the target layer according to the preset gray level unit can specifically include: reducing the gray level of the target layer in the next frame of data corresponding to the current interface by one gray level unit according to the preset gray level unit.
[0236] Specifically, the terminal device can reduce the grayscale of the target layer in the next frame of data corresponding to the current interface by one grayscale unit, thus obtaining the reduced grayscale of the target layer. Then, it can refresh the display and present the interface corresponding to the reduced grayscale of the target layer to the user through the terminal device's screen. For example, assuming the current interface has a grayscale of 150 and the preset grayscale unit is 5, the grayscale of the next frame of data corresponding to the current interface can be adjusted to 145 (that is, reducing the current grayscale of 150 by one grayscale unit of 5), and then the interface corresponding to the next frame of data can be displayed. In this interface, the grayscale of the target layer (i.e., the non-critical area) will also be 145.
[0237] In some embodiments, after adjusting the grayscale of the target layer in the next frame of data, steps S1006 and S1007 can be repeated, that is, determining the relationship between the current grayscale of the target layer (i.e., the adjusted grayscale) and the target grayscale. If the current grayscale of the target layer is greater than the target grayscale, it means that the grayscale of the adjusted target layer is still high, and the grayscale of the target layer in the next frame of data is further reduced by one unit grayscale; if the current grayscale of the target layer is equal to or less than the target grayscale, it means that the grayscale of the adjusted target layer has dropped to (or is lower than) the target grayscale, and step S1008 can be executed subsequently.
[0238] S1008 refreshes the display of the current frame data.
[0239] In some embodiments, the terminal device may refresh the frame data according to a preset frame rate.
[0240] In one possible implementation, when the adjusted grayscale of the target layer is equal to or less than the target grayscale, the terminal device refreshes the display of the current frame data, presenting the user with an interface of a non-critical area with lower grayscale (i.e., the target grayscale) on the screen. For example, this interface could correspond to... Figure 6 (d) or Figure 7 (b) in the middle.
[0241] According to the display control method provided in the embodiments of this application, when a certain area is detected to have not received user input interaction for a long time, the gray level of the corresponding area is reduced. This enables the terminal device to flexibly reduce the gray level of non-critical areas when presenting display content to the user through the screen. This satisfies the user's needs and experience in viewing critical areas, saves the screen power consumption of the terminal device, and also reduces the problem of severe blue light radiation caused by high overall screen gray level.
[0242] To better understand the display control method provided in the embodiments of this application, the timing flow of the method implementation is described below in conjunction with the specific structure of the terminal device. For example, as shown... Figure 11 The diagram shown is a schematic flowchart of another display control method provided in this application embodiment. The execution of this process is performed by a terminal device, specifically functional modules and hardware components within the terminal device, such as a touch panel (TP) module, an application module (which may correspond to the App mentioned above), a scene recognition module, a display composition module (SurfaceFlinger) (specifically including a grayscale adjustment module and a frame data refresh module), and a display screen, etc. The process may specifically include the following steps:
[0243] S1101, the TP module of the terminal device receives a first operation, which can be used to open the App.
[0244] For example, the first operation could be an operation to open an app, such as a click operation on an app icon displayed on a terminal device screen. This first operation could, for example, correspond to... Figure 6 Operation 601 is shown in (a) of the diagram.
[0245] In some embodiments, after the display screen of the terminal device receives the first operation, it can transmit the first operation to the TP module of the terminal device; the TP module responds to the first operation and can execute the App opening process.
[0246] S1102, the TP module sends the first operation to the application module.
[0247] The application module here can be compared to the App mentioned above.
[0248] S1103, the application module responds to the first operation and launches the App.
[0249] The process of launching the App can be any existing feasible process or any feasible process that may exist in the future; this application does not limit this.
[0250] S1104, the application module sends a first message to the scene recognition module, which is used to instruct the App to start.
[0251] S1105, the scene recognition module responds to the first message and identifies the application type of the current App.
[0252] The scene recognition module identifies the application type of the current app, which corresponds to the first-level scene recognition described above. Different application types have a corresponding relationship with whether or not they support grayscale adjustment functionality. Specifically, different application types can have their correspondence with grayscale adjustment functionality pre-set; for example, an application type may support grayscale adjustment (e.g., a video app) or an application type may not support grayscale adjustment (e.g., an e-book app). This correspondence can be stored in a database.
[0253] It should be noted that the grayscale adjustment function specifically refers to the grayscale gradient function, also known as local backlight. The local backlight gradient logic may include: in order to ensure that the brightness does not jump, a gradient effect needs to be applied to the brightness of the area. The gradient level is adjusted in frames (or data frames) as the adjustment unit, and the grayscale is adjusted in each frame until the target grayscale is reached.
[0254] In some embodiments, the application type can be preset. For example, applications can be categorized into video, social, shopping, and e-book reading types based on their functions and characteristics. The scene recognition module can identify the application type of the current app in various ways, including: pre-setting different application types for different apps, and determining the application type of the app based on the app identifier carried during the app's startup process (i.e., static judgment); or, determining the application type of the app in real time based on its characteristics and functions after the app is launched (i.e., dynamic judgment). This application embodiment does not limit the specific method for determining which application type an app belongs to.
[0255] S1106, the scene recognition module sends a second message to the grayscale adjustment module. The second message includes the application type, which is used to indicate the application type of the current APP.
[0256] S1107, the grayscale adjustment module queries the database to determine whether the application type of the App supports the grayscale adjustment function.
[0257] In some embodiments, the database stores a correspondence between different application types and whether or not grayscale adjustment functionality is supported.
[0258] In some embodiments, after the grayscale adjustment module determines the application type of the activated App, it can query the database to see if the App supports the grayscale adjustment function based on the application type. If the determination result in step S1107 is negative, meaning the application type of the App does not support the grayscale adjustment function, then steps S1108 to S1110 can be executed:
[0259] S1108, the grayscale adjustment module sends a refresh instruction message to the frame data refresh module. This refresh instruction message is used to instruct the corresponding current frame data to be refreshed and displayed.
[0260] It should be noted that the interface display is usually refreshed at a certain refresh rate. If it is determined that the current application type does not support grayscale adjustment, then you do not need to perform grayscale adjustment on the interface of the app. You can refresh the content displayed on the interface of the app according to the preset refresh rate later.
[0261] S1109, the frame data refresh module responds to the refresh instruction message and refreshes and displays the current frame data.
[0262] The method by which the frame data refresh module refreshes and displays the current frame data can refer to existing processes, and this application embodiment does not limit this.
[0263] S1110, the frame data refresh module sends a first notification message to the display screen, which is used to notify the target layer to be displayed according to the initial grayscale.
[0264] If the judgment result in step S1107 is yes, that is, the application type of the App supports grayscale adjustment function, then the following steps S1111 to S1112 can be executed:
[0265] S1111, the grayscale adjustment module sends a third message to the scene recognition module, which is used to indicate layer recognition.
[0266] S1112, the scene recognition module responds to the third message and identifies the layer corresponding to the current interface.
[0267] Here, the scene recognition module identifies the layer corresponding to the current interface, which corresponds to the secondary scene recognition mentioned above. That is, for apps that support grayscale adjustment, it further identifies the layer corresponding to the display interface. This layer can include the target layer whose position and size are closest to the non-critical areas of the interface.
[0268] In some embodiments, for interfaces whose characteristics are suitable for grayscale adjustment, the corresponding layer of the interface can be preset to support grayscale adjustment; or, for interfaces whose characteristics are suitable for grayscale adjustment, the corresponding target layer of the interface can be preset to support grayscale adjustment.
[0269] S1113, The scene recognition module sends the layer identifier to the grayscale adjustment module.
[0270] The layer identifier can be the layer identifier of multiple layers corresponding to the current interface; or, the layer identifier can be the layer identifier of the target layer corresponding to the current interface.
[0271] S1114 The grayscale adjustment module determines whether a layer supports grayscale adjustment by querying the corresponding relationship of layer identifiers in the database.
[0272] In some embodiments, a predefined correspondence between layers and whether grayscale adjustment is supported can be established, and this correspondence can be stored in a database. This correspondence may include the layer's identifier and whether it supports grayscale adjustment, or whether it does not support grayscale adjustment. Specifically, the method for predefinedly establishing the correspondence between layers and whether grayscale adjustment is supported can be found in the description in Table 1 of the embodiments above, and will not be repeated here.
[0273] In some embodiments, after the terminal device obtains the layer identifier, it can determine whether the layer supports grayscale adjustment function based on the layer identifier and the preset correspondence.
[0274] If the judgment result in step S1114 is negative, meaning the layer does not support grayscale adjustment, then steps S1115 to S1117 can be executed:
[0275] S1115, the grayscale adjustment module sends a refresh instruction message to the frame data refresh module. This refresh instruction message is used to instruct the current data frame to be refreshed for display.
[0276] It should be noted that the interface display is usually refreshed at a certain refresh rate. If it is determined that the current application type does not support grayscale adjustment, then you do not need to perform grayscale adjustment on the interface of the app. You can refresh the content displayed on the interface of the app according to the preset refresh rate later.
[0277] S1116, the frame data refresh module refreshes and displays the current frame data.
[0278] S1117, the frame data refresh module sends a second notification message to the display screen, which is used to notify the display screen to display the target layer according to the initial grayscale.
[0279] If the judgment result in step S1114 is yes, that is, if the layer supports grayscale adjustment function, then the following steps S1118 and S1119 can be executed:
[0280] S1118: Record the initial grayscale of the target layer and obtain the target grayscale of the target layer.
[0281] The initial grayscale of the target layer mentioned here refers to the current grayscale of the target layer before any grayscale adjustment is performed.
[0282] Optionally, before performing this step, the terminal device can also determine the target layer that matches the non-critical area based on information such as the layer's position and size.
[0283] In some embodiments, obtaining the target grayscale of the target layer may include: the target grayscale of the target layer (or non-critical area) may be preset, the target grayscale may refer to the grayscale after grayscale adjustment of the target layer, specifically the grayscale after grayscale reduction of the target layer, and the target grayscale may be less than the current corresponding grayscale of the target layer.
[0284] S1119: Determine if the grayscale of the target layer is greater than the target grayscale; if it is greater, adjust the grayscale of the target layer according to the preset strategy.
[0285] If the judgment result in step S1119 is negative, that is, if the current gray level of the target layer is not greater than the target gray level, then there is no need to adjust the gray level of the target layer, and the following steps S1120 to S1122 can be executed:
[0286] S1120, the grayscale adjustment module sends a refresh instruction message to the frame data refresh module. This refresh instruction message is used to instruct the current data frame to be refreshed for display.
[0287] S1121, the data refresh module responds to the refresh instruction message and refreshes the display of the current data frame.
[0288] S1122, the data refresh module sends a third notification message to the display screen, which is used to notify the target layer to be displayed according to the initial grayscale.
[0289] If the judgment result in S1119 is yes, that is, the gray level of the current layer is greater than the target gray level, then the gray level of the target layer needs to be adjusted, and the following steps S1123 to S1126 can be executed:
[0290] S1123, the grayscale adjustment module reduces the grayscale of the next frame of data by one unit grayscale.
[0291] Optionally, before performing this step, it can be determined whether a non-critical area of the current interface has received user input (such as a click, swipe, or long press) within a preset time period. If the non-critical area receives user input within the preset time period, then no grayscale adjustment is performed on the non-critical area; if the non-critical area does not receive user input within the preset time period, then grayscale adjustment is performed on the non-critical area.
[0292] The next frame data can refer to the data of the frame following the current frame. Since the current frame is the frame being presented to the user, there is no need to adjust its grayscale; the grayscale adjustment only needs to start from the next frame.
[0293] In some embodiments, adjusting the grayscale may include: reducing the grayscale by one unit (or gray level) for each frame; then, re-determining whether the current grayscale after reducing the grayscale by one unit is greater than the target grayscale, and then executing the above steps S1120 to S1122, or the process shown in the above steps S1123 to S1126 again.
[0294] S1124, the grayscale adjustment module sends a fourth notification message to the data refresh module, which indicates that the grayscale adjustment of the next data frame is complete.
[0295] S1125, the data refresh module responds to the fourth message and refreshes the display of the current data frame.
[0296] S1126, the data refresh module sends a fourth notification message to the display screen, which is used to notify the display screen to display the target layer according to the adjusted current grayscale.
[0297] According to the display control method provided in the embodiments of this application, when a certain area is detected to have not received user input interaction for a long time, the gray level of the corresponding area is reduced. This enables the terminal device to flexibly reduce the gray level of non-critical areas when presenting display content to the user through the screen. This satisfies the user's needs and experience in viewing critical areas, saves the screen power consumption of the terminal device, and also reduces the problem of severe blue light radiation caused by high overall screen gray level.
[0298] For example, such as Figure 12 The diagram shown is a schematic flowchart of another display control method provided in an embodiment of this application. This process can be applied to a terminal device and may specifically include the following steps:
[0299] S1201, when entering the first interface of the terminal device, identify whether at least one first layer corresponding to the first interface supports grayscale adjustment function, the first interface includes non-critical areas pre-divided based on user attention.
[0300] In some embodiments, the first interface includes non-critical regions and critical regions pre-divided based on user attention, wherein the user attention in the critical regions is higher than the user attention in the non-critical regions.
[0301] The first layer can be multiple layers included in the first interface, or it can be a target layer included in the first interface that matches the pre-divided key area. For example, the first interface can correspond to the interface that meets specific conditions as described above.
[0302] In some embodiments, the first interface is an interface in a first application, and the method further includes: identifying whether the first application supports the grayscale adjustment function; if the first application supports the grayscale adjustment function, then when entering the first interface of the terminal device, identifying whether the layer corresponding to the first interface supports the grayscale adjustment function.
[0303] In some embodiments, identifying whether the first application supports the grayscale adjustment function specifically includes: setting a first correspondence between application type and grayscale adjustment function, the first correspondence being used to indicate whether the application type supports the grayscale adjustment function; identifying that the first application belongs to a first application type; and determining whether the first application supports the grayscale adjustment function based on the first correspondence between the first application type and the grayscale adjustment function.
[0304] In some embodiments, identifying whether the layer corresponding to the first interface supports grayscale adjustment function specifically includes: setting a second correspondence between the layer and the grayscale adjustment function, the second correspondence being used to indicate whether the layer supports the grayscale adjustment function; and identifying whether the layer corresponding to the first interface supports grayscale adjustment function based on the second correspondence.
[0305] S1202, when the first layer supports grayscale adjustment function, adjust the grayscale of the target layer corresponding to the first interface so that the grayscale of the non-critical area in the first interface changes with the adjustment, wherein the target layer is the first layer that matches the position and size of the non-critical area.
[0306] In some embodiments, when the layer corresponding to the first interface supports grayscale adjustment, adjusting the grayscale of the target layer so that the grayscale of the non-critical area in the first interface changes with the adjustment specifically includes: when the layer corresponding to the first interface supports grayscale adjustment, obtaining a preset target grayscale for the target layer in the first interface, and obtaining the current grayscale of the target layer corresponding to the first interface; comparing the current grayscale with the target grayscale; when the current grayscale is higher than the target grayscale, adjusting the grayscale of the target layer so that the grayscale of the non-critical area in the first interface changes with the adjustment.
[0307] In some embodiments, adjusting the grayscale of the target layer when the current grayscale is higher than the target grayscale, so that the grayscale of the non-critical area in the first interface changes with the adjustment, specifically includes: reducing the grayscale of the target layer in the next frame of the first interface by one unit grayscale, obtaining the first adjusted grayscale of the target layer; and refreshing the display of the frame of the first interface according to the first adjusted grayscale, so that the grayscale of the non-critical area in the first interface changes with the adjustment.
[0308] In some embodiments, the method further includes: comparing a first adjusted grayscale of the target layer with a target grayscale; when the first adjusted grayscale is higher than the target grayscale, reducing the grayscale of the target layer in the next frame of the first interface by one unit grayscale to obtain a second adjusted grayscale of the target layer; and refreshing the display of the frame of the first interface according to the second adjusted grayscale, so that the grayscale of the non-critical area in the first interface changes with the adjustment.
[0309] In some embodiments, the method further includes: repeatedly comparing the second adjusted grayscale of the target layer with the target grayscale; and when the first adjusted grayscale is higher than the target grayscale, reducing the grayscale of the target layer in the next frame of the first interface by one unit grayscale until the grayscale of the target layer reaches the target grayscale; and refreshing the display of the frames of the first interface according to the target grayscale, so that the grayscale of the non-critical areas in the first interface changes with the adjustment.
[0310] In some embodiments, adjusting the grayscale of the target layer corresponding to the first interface when the first layer supports grayscale adjustment specifically includes: when the first layer supports grayscale adjustment, determining the target layer that matches the position and size of the non-critical area based on the position and size of the at least one first layer.
[0311] In some embodiments, adjusting the grayscale of the target layer corresponding to the first interface when the first layer supports grayscale adjustment specifically includes: determining the target layer whose position and size match the non-critical area from the at least one first layer based on the position and size of the at least one first layer; identifying whether the target layer supports the grayscale adjustment function; and adjusting the grayscale of the target layer corresponding to the first interface when the target layer supports the grayscale adjustment function.
[0312] In some embodiments, adjusting the grayscale of the target layer corresponding to the first interface when the first layer supports grayscale adjustment specifically includes: when the first layer supports grayscale adjustment, detecting whether the first interface and / or the pre-divided non-critical area in the first interface receives a first operation input by the user within a preset time period; when the first interface does not receive the first operation within the preset time period, adjusting the grayscale of the target layer corresponding to the first interface; or, when the pre-divided non-critical area in the first interface does not receive the first operation within the preset time period, adjusting the grayscale of the target layer corresponding to the first interface.
[0313] In some embodiments, when the terminal device is a foldable screen device, the non-critical area corresponds to the left or right area of the foldable screen device, and the left and right areas are areas divided according to the central axis of the foldable screen; when the first layer supports grayscale adjustment, adjusting the grayscale of the target layer corresponding to the first interface specifically includes: when the first layer supports grayscale adjustment, detecting whether the left and / or right areas of the foldable screen receive a second user input operation within a preset time period; wherein, when it is detected that the left area of the foldable screen does not receive a second user input operation within the preset time period, adjusting the grayscale of the target layer whose position and size match the left area; or, when it is detected that the right area of the foldable screen does not receive a second user input operation within the preset time period, adjusting the grayscale of the target layer whose position and size match the right area.
[0314] In some embodiments, the method further includes: when it is detected that the left area of the foldable screen has not received a second user input within a preset time period, and the right area has received a second user input within a preset time period, adjusting the grayscale of the target layer whose position and size match the left area; or, when it is detected that the right area of the foldable screen has not received a second user input within a preset time period, and the left area has received a second user input within a preset time period, adjusting the grayscale of the target layer whose position and size match the right area.
[0315] In some embodiments, the first interface includes a non-full-screen video playback interface or a video call interface.
[0316] According to the display control method provided in the embodiments of this application, when a certain area is detected to have not received user input interaction for a long time, the gray level of the corresponding area is reduced. This enables the terminal device to flexibly reduce the gray level of non-critical areas when presenting display content to the user through the screen. This satisfies the user's needs and experience in viewing critical areas, saves the screen power consumption of the terminal device, and also reduces the problem of severe blue light radiation caused by high overall screen gray level.
[0317] Based on the same technical concept, embodiments of this application also provide a terminal device, including one or more processors; one or more memories; the one or more memories storing one or more computer programs, the one or more computer programs including instructions, which, when executed by the one or more processors, cause the computer or processor to perform one or more steps of any of the above methods.
[0318] Based on the same technical concept, embodiments of this application also provide a computer-readable storage medium storing computer-executable program instructions, which, when executed on a computer, cause the computer or processor to perform one or more steps of any of the above methods.
[0319] Based on the same technical concept, embodiments of this application also provide a computer program product containing instructions, the computer program product including computer program code, which, when run on a computer, causes the computer or processor to perform one or more steps of any of the above methods.
[0320] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).
[0321] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.
[0322] The above description is merely a specific implementation of the embodiments of this application, but the protection scope of the embodiments of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the embodiments of this application should be covered within the protection scope of the embodiments of this application. Therefore, the protection scope of the embodiments of this application should be determined by the protection scope of the claims.
Claims
1. A method for display control, characterized in that, Applied to terminal devices, including: When entering the first interface of the terminal device, it is identified whether at least one first layer corresponding to the first interface supports grayscale adjustment function. The first interface includes non-critical areas that are not focused on by the user based on the user's attention. The non-critical areas are pre-divided by the user through traversing each interface. When the first layer supports grayscale adjustment, detect whether the first interface or the non-critical area in the first interface receives the first operation input by the user within a preset time period. When the first interface or the non-critical area in the first interface does not receive the first operation within a preset time period, obtain the preset target grayscale for the target layer in the first interface, and obtain the current grayscale of the target layer corresponding to the first interface; compare the current grayscale with the target grayscale. When the current grayscale is higher than the target grayscale, the grayscale of the target layer corresponding to the first interface is adjusted by one grayscale unit in each frame until the target grayscale is reached, so that the grayscale of the non-critical area presents a gradient effect; wherein, the target layer is the first layer that matches the position and size of the non-critical area.
2. The method according to claim 1, characterized in that, The first interface is the interface in the first application, and the method further includes: Identify whether the first application supports the grayscale adjustment function; If the first application supports the grayscale adjustment function, then when entering the first interface of the terminal device, it is identified whether the layer corresponding to the first interface supports the grayscale adjustment function.
3. The method according to claim 2, characterized in that, The step of identifying whether the first application supports the grayscale adjustment function specifically includes: Set a first correspondence between the application type and the grayscale adjustment function, the first correspondence being used to indicate whether the application type supports the grayscale adjustment function; Identify that the first application belongs to the first application type; Based on the first correspondence between the first application type and the grayscale adjustment function, determine whether the first application supports the grayscale adjustment function.
4. The method according to any one of claims 2-3, characterized in that, The step of identifying whether the layer corresponding to the first interface supports grayscale adjustment specifically includes: A second correspondence is established between the layer and the grayscale adjustment function, the second correspondence being used to indicate whether the layer supports the grayscale adjustment function; Based on the second correspondence, identify whether the layer corresponding to the first interface supports grayscale adjustment function.
5. The method according to claim 1, characterized in that, Using frames as the adjustment unit, each frame adjusts one grayscale unit of the target layer corresponding to the first interface until the target grayscale is reached. Specifically, this includes: Reduce the grayscale of the target layer in the next frame of the first interface by one unit grayscale to obtain the first adjusted grayscale of the target layer; The first interface frame is refreshed and displayed according to the first grayscale adjustment, so that the grayscale of the non-critical area in the first interface changes with the adjustment.
6. The method according to claim 5, characterized in that, The method further includes: Compare the first adjusted grayscale of the target layer with the target grayscale; When the first adjusted grayscale is higher than the target grayscale, the grayscale of the target layer in the next frame of the first interface is reduced by one unit grayscale, and the second adjusted grayscale of the target layer is obtained. The first interface frame is refreshed and displayed according to the second grayscale adjustment, so that the grayscale of the non-critical area in the first interface changes with the adjustment.
7. The method according to claim 6, characterized in that, The method further includes: Repeatedly compare the second adjusted gray level of the target layer with the target gray level, and when the first adjusted gray level is higher than the target gray level, reduce the gray level of the target layer in the next frame of the first interface by one unit gray level until the gray level of the target layer reaches the target gray level; The frames of the first interface are refreshed and displayed according to the target grayscale, so that the grayscale of the non-critical areas in the first interface changes with the adjustment.
8. The method according to any one of claims 1-7, characterized in that, Using frames as the adjustment unit, each frame adjusts one grayscale unit of the target layer corresponding to the first interface until the target grayscale is reached. Specifically, this includes: Based on the positional dimensions of the at least one first layer, a target layer matching the position and size of the non-critical region is determined.
9. The method according to any one of claims 1-7, characterized in that, Using frames as the adjustment unit, each frame adjusts one grayscale unit of the target layer corresponding to the first interface until the target grayscale is reached. Specifically, this includes: Based on the position and size of the at least one first layer, determine the target layer whose position and size match the non-critical area from the at least one first layer; Identify whether the target layer supports the grayscale adjustment function; When the target layer supports grayscale adjustment, the grayscale level of the target layer corresponding to the first interface is adjusted by one grayscale unit in each frame, until the target grayscale level is reached.
10. The method according to any one of claims 1-9, characterized in that, When the terminal device is a foldable screen device, the non-critical area corresponds to the left or right area of the foldable screen device, and the left and right areas are areas divided according to the central axis of the foldable screen. The adjustment is done frame by frame, adjusting one grayscale unit of the target layer corresponding to the first interface in each frame until the target grayscale is reached. Specifically, this includes: The system detects whether the left or right area of the foldable screen receives a second user input within a preset time period; wherein... When it is detected that the left side area of the foldable screen has not received a second user input within a preset time period, the grayscale level of the target layer corresponding to the first interface is adjusted by one grayscale unit per frame until the target grayscale level is reached; or... When it is detected that the right side area of the foldable screen has not received a second operation input by the user within a preset time period, the grayscale unit of the target layer corresponding to the first interface is adjusted in frames, until the target grayscale is reached.
11. The method according to claim 10, characterized in that, The method further includes: When it is detected that the left area of the foldable screen has not received a second user input within a preset time period, and the right area has received a second user input within a preset time period, the grayscale of the target layer that matches the position and size of the left area is adjusted; or, When it is detected that the right side of the foldable screen has not received a second user input within a preset time period, and the left side of the foldable screen has received a second user input within a preset time period, the grayscale of the target layer that matches the position and size of the right side of the foldable screen is adjusted.
12. The method according to any one of claims 1-11, characterized in that, The first interface includes a non-full-screen video playback interface or a video call interface.
13. A terminal device, characterized in that, include: One or more processors; One or more memory units; The one or more memories store one or more computer programs, the one or more computer programs including instructions that, when executed by the one or more processors, cause the terminal device to perform the method as described in any one of claims 1 to 12.
14. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable program instructions that, when executed on a computer, cause the computer to perform the method as described in any one of claims 1 to 12.
Citation Information
Patent Citations
Display apparatus and method for controlling the same
US20160314762A1
Brightness adjustment method and apparatus
WO2018000629A1
Method, device, storage medium, and electronic apparatus for changing background grayscale level to save power
WO2018161591A1