A display method and apparatus

Abstract

The application provides a display method and device, and relates to the technical field of display. The method can acquire a to-be-displayed image, and determine a target refresh rate according to pixel brightness information of the to-be-displayed image. The pixel brightness information of the to-be-displayed image is used to represent the richness of the content contained in the to-be-displayed image. Then, the to-be-displayed image is displayed according to the target refresh rate. In this way, the screen refresh rate can be dynamically adjusted while ensuring the image display quality, the flexibility and timeliness of adjusting the refresh frequency are improved, and the power consumption of the device is saved.

Description

Technical Field

[0001] This application relates to the field of display technology, and more particularly to a display method and device. Background Technology

[0002] With the continuous development of display technology, more and more displays capable of supporting various performance levels have emerged. For example, they support higher resolutions, better color reproduction, and higher refresh rates, providing users with a better visual experience.

[0003] Typically, displays refresh the content they show while displaying images. A higher refresh rate results in smoother image display. However, continuously using a high refresh rate leads to higher power consumption in electronic devices, resulting in a poor user experience. Summary of the Invention

[0004] This application provides a display method and device that determines a target refresh rate suitable for the image to be displayed based on the pixel brightness information of the image to be displayed, thereby realizing the process of dynamically adjusting the screen refresh rate and saving device power consumption while ensuring image display quality.

[0005] To achieve the above objectives, the embodiments of this application adopt the following technical solutions:

[0006] In a first aspect, embodiments of this application provide a display method applied to an electronic device. The method includes: acquiring a first image and determining a target refresh rate based on pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of content contained in the first image. Then, the first image is displayed according to the target refresh rate.

[0007] As can be seen, the embodiments of this application can determine the target refresh rate suitable for the image to be displayed based on the pixel brightness information of the image to be displayed, with different refresh rates corresponding to different images. That is, when the content content of the image to be displayed is rich, a higher screen refresh rate can be used for display. When the content content of the image to be displayed is low, a lower screen refresh rate can be used for display. Thus, the method provided by the embodiments of this application can dynamically adjust the screen refresh rate while ensuring image display quality, improving the flexibility and timeliness of refresh frequency adjustment, and saving device power consumption.

[0008] In one possible implementation of the first aspect, during the process of determining the target refresh rate based on the pixel brightness information of the first image, a target region corresponding to a pixel in the first image can be obtained based on the pixel brightness information of the first image. The target region is used to characterize the area occupied by pixels in the first image whose brightness value is greater than a preset threshold. Next, a target ratio between the area of ​​the target region and the area of ​​the first image is calculated. Then, the target refresh rate is determined based on the target ratio.

[0009] As can be seen, the embodiments of this application provide a method to obtain the target region corresponding to a pixel in the image to be displayed based on the pixel brightness information of the image to be displayed. Then, a target ratio is calculated between the area of ​​the target region and the area of ​​the image to be displayed. Subsequently, the target refresh rate is determined based on the target ratio. It is understood that the more pixels in the image to be displayed whose brightness value is greater than a preset threshold, the larger the area corresponding to the target region, and thus the larger the target ratio of the image to be displayed. Conversely, the fewer pixels in the image to be displayed whose brightness value is greater than the preset threshold, the smaller the area corresponding to the target region, and thus the smaller the target ratio of the image to be displayed. In this way, different target refresh rates can be determined based on different target ratios corresponding to different images to be displayed. This improves the flexibility and timeliness of refresh rate adjustment and saves device power consumption.

[0010] In one possible implementation of the first aspect, during the process of determining the target refresh rate based on the target ratio, when the target ratio is greater than or equal to a first preset value, the target refresh rate is determined to be the first refresh rate. When the target ratio is less than the first preset value, the target refresh rate is determined to be the second refresh rate; the first refresh rate is greater than the second refresh rate.

[0011] As can be seen, the pixel brightness information of the image to be displayed provided in this application embodiment is used to characterize the richness of the content contained in the image to be displayed. The more pixels in the image to be displayed whose brightness value is greater than a preset threshold, the richer the content contained in the image. Furthermore, the more pixels in the image to be displayed whose brightness value is greater than the preset threshold, the larger the area corresponding to the target region, and consequently, the larger the target ratio of the image to be displayed. When the target ratio of the image is larger, for example, if the target ratio is greater than or equal to a first preset value, a higher refresh rate is required to refresh the image to ensure its complete and smooth display.

[0012] Conversely, the fewer pixels in the image to be displayed whose brightness value exceeds a preset threshold, the lower the richness of the content contained in the image. Furthermore, the fewer pixels in the image to be displayed whose brightness value exceeds the preset threshold, the smaller the area corresponding to the target region, and consequently, the smaller the target ratio of the image to be displayed. When the target ratio of the image to be displayed is smaller, for example, if the target ratio is less than a first preset value, a high refresh rate is not required to refresh the image. This saves device power consumption while ensuring complete and smooth display. Thus, the method provided in this application embodiment can dynamically adjust the screen refresh rate while ensuring image display quality, improving the flexibility and timeliness of refresh frequency adjustment, and saving device power consumption.

[0013] In one possible implementation of the first aspect, during the process of determining the target refresh rate based on the pixel brightness information of the first image, a first trigger operation can be detected, and the target refresh rate can be determined based on the pixel brightness information of the first image.

[0014] As can be seen, this embodiment of the application can adaptively adjust the screen refresh rate based on the pixel brightness information of the image to be displayed after detecting the first trigger operation input by the user. That is, when the first trigger operation is not detected, the image can be displayed at the initial screen refresh rate. Once the first trigger operation is detected, the screen refresh rate can be adaptively adjusted according to the image to be displayed. Users can control the process of adaptively adjusting the screen refresh rate of the smartwatch to be turned on and off anytime, anywhere. This improves the interactivity between the user and the device, supports the user's setting of the screen refresh rate, and thus enhances the user experience.

[0015] In one possible implementation of the first aspect, the method further includes: acquiring a second image; wherein the second image includes a first image region and a second image region, and the first image region and the second image region do not overlap. Next, a third refresh rate is determined based on pixel brightness information of the first image region. And a fourth refresh rate is determined based on pixel brightness information of the second image region. Then, the first image region and the second image region are displayed according to the third refresh rate and the fourth refresh rate, respectively.

[0016] As can be seen, the embodiments of this application can display different image regions within the entire image at different refresh rates. This allows for more precise adjustment of the refresh rate of different regions within an image, improving the flexibility of screen refresh rate adjustment and reducing device power consumption.

[0017] In one possible implementation of the first aspect, the method further includes: acquiring a third image, the third image including a preset initial background image; then, generating a fourth image based on a first time point and the third image; the first time point being used to characterize the time of generating the fourth image; subsequently, determining a fifth refresh rate based on the pixel brightness information of the fourth image, and displaying the fourth image according to the fifth refresh rate.

[0018] As can be seen, the embodiments of this application can generate an image to be displayed based on an initial background image with a threshold value within the device and the current time, even in sleep mode, power-saving mode, or when displaying a lock screen image. By generating the image to be displayed using a preset initial background image, it is not necessary to repeatedly draw repetitive content in the image in real time. Similarly, a suitable screen refresh rate can be matched according to different images to be displayed, improving the flexibility of adjusting the refresh rate and saving device power consumption.

[0019] In one possible implementation of the first aspect, the method further includes: outputting a first prompt message, the first prompt message being used to indicate that the screen refresh rate adjustment has begun.

[0020] As can be seen, the embodiments of this application can output a first prompt message, which is used to indicate that the screen refresh rate adjustment has begun. This allows the user to perceive the start of the screen refresh rate adjustment process, improving the interactivity between the user and the device, and thus enhancing the user experience.

[0021] Secondly, embodiments of this application provide a display device, which includes a system-on-a-chip (SoC), a touch display driver chip, and a display panel. The SoC is used to acquire a first image. The SoC is also used to send the first image to the touch display driver chip. The touch display driver chip is used to determine a target refresh rate based on pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of the content contained in the first image. The touch display driver chip is also used to drive the display panel to display the first image according to the target refresh rate. The display panel is used to display the first image according to the target refresh rate.

[0022] As can be seen, the system-on-a-chip (SoC) can acquire the image to be displayed and send it to the touch display driver chip. The touch display driver chip determines the target refresh rate suitable for the image based on its pixel brightness information. Then, the touch display driver chip can drive the display panel to display the image according to the target refresh rate. Thus, the display device provided in this application embodiment can dynamically adjust the screen refresh rate while ensuring image display quality, improving the flexibility and timeliness of refresh frequency adjustment, and saving device power consumption.

[0023] Thirdly, embodiments of this application provide a display device, which includes a system-on-a-chip (SoC), a touch display driver chip, and a display panel. The SoC is used to acquire a first image. The SoC is also used to determine a target refresh rate based on pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of the content contained in the first image. The SoC is further used to send the target refresh rate and the first image to the touch display driver chip, which drives the display panel to display the first image according to the target refresh rate. The display panel is used to display the first image according to the target refresh rate.

[0024] As can be seen, the system-on-a-chip (SoC) can acquire the image to be displayed and determine the target refresh rate suitable for the image based on its pixel brightness information. Then, the SoC can send the target refresh rate and the image to be displayed to the touch display driver chip. The touch display driver chip can then drive the display panel to display the image according to the target refresh rate. Thus, the display device provided in this embodiment can dynamically adjust the screen refresh rate while ensuring image display quality, improving the flexibility and timeliness of refresh frequency adjustment and saving device power consumption.

[0025] Fourthly, embodiments of this application provide an electronic device, which includes a processor, a memory, and a display screen. The memory and the display screen are coupled to the processor. The display screen is used to display images, and the memory is used to store computer-readable instructions. When the processor reads computer-readable instructions from the memory, the electronic device performs the display method as described in the first aspect.

[0026] Fifthly, embodiments of this application provide a chip system including at least one processor and at least one interface circuit. The at least one interface circuit is used to perform transceiver functions and send instructions to the at least one processor. The at least one processor executes the instructions and performs the display method as described in the first aspect.

[0027] In a sixth aspect, embodiments of this application provide a computer-readable storage medium including a computer program that, when run on an electronic device, causes the electronic device to perform the display method as described in the first aspect. Attached Figure Description

[0028] Figure 1 This is a schematic diagram of the structure of an electronic device screen provided in an embodiment of this application;

[0029] Figure 2 This is a schematic diagram of the structure of a smartwatch provided in an embodiment of this application;

[0030] Figure 3A schematic diagram of the hardware structure of a smartwatch provided in an embodiment of this application;

[0031] Figure 4 A schematic diagram of the software structure of a smartwatch provided in an embodiment of this application;

[0032] Figure 5 A schematic diagram illustrating the process of displaying images on a smartwatch screen, provided as an embodiment of this application;

[0033] Figure 6 A schematic diagram illustrating a process for displaying the i-th frame image and the j-th frame image, provided as an embodiment of this application;

[0034] Figure 7 A schematic diagram of a process for determining a target refresh rate provided in an embodiment of this application;

[0035] Figure 8 A flowchart illustrating an overwrite process provided in an embodiment of this application;

[0036] Figure 9 A schematic diagram of an interface for adaptively adjusting refresh rate provided in an embodiment of this application;

[0037] Figure 10 A schematic diagram of a prompt window provided in an embodiment of this application;

[0038] Figure 11 A schematic diagram of the interface of a range control provided in an embodiment of this application;

[0039] Figure 12 This application provides a schematic diagram of a host-side system-on-chip (SOC) process for determining a target refresh rate in an embodiment of the present application. Figure 1 ;

[0040] Figure 13 This application provides a schematic diagram of a host-side SOC process for determining a target refresh rate. Figure 2 ;

[0041] Figure 14 A schematic diagram illustrating a process for generating an image to be displayed, provided in an embodiment of this application;

[0042] Figure 15 This is a schematic diagram of the structure of a wearable device provided in an embodiment of this application. Detailed Implementation

[0043] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of this application, unless otherwise stated, " / " indicates that the objects before and after are in an "or" relationship. For example, A / B can represent A or B. "And / or" in this application is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone, where A and B can be singular or plural. Furthermore, in the description of this application, unless otherwise stated, "multiple" refers to two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple. Furthermore, to facilitate a clear description of the technical solutions in the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish identical or similar items with substantially the same function and effect. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and that "first" and "second" are not necessarily different. Meanwhile, in some embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is being used as an example, illustration, or description. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of terms such as "exemplary" or "for example" is intended to present related concepts in a concrete manner for ease of understanding.

[0044] Furthermore, the network architecture and business scenarios described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided in the embodiments of this application. As those skilled in the art will know, with the evolution of network architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0045] First, some of the terms and related technologies used in the embodiments of this application will be explained to facilitate understanding by those skilled in the art.

[0046] Touch and display driver integrated circuit (TDDIC): TDDIC is one of the main control components of the display panel. Its main function is to send drive signals and image data to the display panel in the form of electrical signals, so that the display panel can display images.

[0047] Figure 1 This is a schematic diagram of the structure of an electronic device screen. Figure 1 An example is an electronic device comprising two touch display driver chips 11 (such as touch display driver chip 1 and touch display driver chip 2). The display panel 10 is the display area of ​​the electronic device's screen. The two touch display driver chips 11 (such as touch display driver chip 1 and touch display driver chip 2) are packaged beneath the screen, for example, by directly bonding the two touch display driver chips to a glass substrate using on-glass chip packaging technology.

[0048] Screen refresh rate: This refers to the refresh rate of an electronic device's display screen, also known as the screen's frame rate. It's a hardware performance parameter that indicates how many times the image on the screen is updated per second. A higher refresh rate means the screen refreshes the displayed image more times per second. Consequently, the refresh time interval between each image is smaller, resulting in smoother visuals.

[0049] Screen refresh rate is generally expressed in the physical unit Hz. A display panel is filled with physical pixels. For example, if a display has a resolution of 1080*1920 progressive scanning (P), the display has 1080*1920 pixels. Each row of the display consists of 1080 pixels, and each column consists of 1920 pixels. Displaying a row of 1080 pixels is called a line scan, and displaying 1920 rows of pixels is called a field scan. After one field scan, the display can show one frame of image data.

[0050] The refresh rate of a display screen is how many frames of image data it can display per second. For example, if the refresh rate of a display screen is 60 Hz, then the display screen can refresh and display 60 frames of image data per second.

[0051] Frame rate: This is the rate at which the graphics processing unit (GPU) in a system-on-chip (SoC) renders images per second. A higher frame rate means the GPU renders more images, resulting in a smoother and more realistic display. In simpler terms, the frame rate is the number of images the SoC generates per second. The refresh rate is the number of times the screen refreshes per second, determining the number of images displayed on the screen per second.

[0052] The display panel is filled with physical pixels. For example, if the display resolution is 466*466 progressive scanning (P), the display has 466*466 pixels. Each row of the display consists of 466 pixels, and each column consists of 466 pixels. Displaying a row of 466 pixels is called a row scan, and displaying 466 rows of pixels is called a field scan. The physical signal that starts scanning a row is called the horizontal synchronization pulse (Hsync), and the physical signal that starts scanning a field is called the vertical synchronization pulse (Vsync). After scanning one field, the display can display one frame of image; that is, the display can display one frame of image within one Vsync signal cycle.

[0053] The refresh rate of a display depends on how many frames it can show per second. Therefore, a smartwatch needs to generate a certain number of Vsync signals per second. In other words, the number of Vsync signals generated per second by the smartwatch is the display's refresh rate. For example, if the display's refresh rate is 60Hz, the smartwatch needs to generate 60 Vsync signals per second. These Vsync signals can be generated by the hardware compiler (HWC) within the smartwatch. After the HWC generates the Vsync signal, the SoC (System-on-a-Chip) can send the image to be displayed to the TDDIC (Tencent Digital Display) within the cycle of that Vsync signal.

[0054] The tearing effect signal (also described as the TE signal) is a signal generated by TDDIC to prevent screen tearing during image refresh. The TE signal is periodic. Electronic devices configured with MIPI command mode typically use the TE signal to synchronize and control the SOC frame rate and screen refresh rate. The TE signal synchronizes the processes of image drawing, rendering, compositing, and screen refresh display. In each cycle corresponding to the same TE signal, the SOC draws, renders, and composites one or more layers to obtain a frame of image, and transmits the image data packet to TDDIC via the MIPI interface. TDDIC decapsulates the image data packet and refreshes the display of the image.

[0055] With the continuous development of display technology in mobile phones and other electronic devices, more and more electronic devices are able to support multiple refresh rates, such as 30Hz, 60Hz, and 90Hz. In other words, electronic devices can support multiple levels of screen refresh rates.

[0056] Typically, displays show images at a fixed frame rate. Therefore, in applications where high refresh rates are not critical, using a high refresh rate can lead to higher power consumption in electronic devices.

[0057] For example, the display supports a 60Hz refresh rate. When the electronic device's processor is operating in sleep or power-saving mode, the display still uses a 60Hz refresh rate to display images. As another example, when displaying static images, the display still uses a 60Hz refresh rate. This increases the power consumption of the electronic device and reduces the user experience.

[0058] Based on the above, this application provides a display method and device. The method acquires an image to be displayed and determines a corresponding target refresh rate based on the pixel brightness information of the image. The pixel brightness information of the image is used to characterize the richness of the content contained in the image. Then, the image is displayed according to the target refresh rate. It is understood that generally, the richer the content in the image to be displayed, the brighter the corresponding pixels, and the higher the screen refresh rate is required for subsequent display. Similarly, the simpler the content in the image to be displayed, the lower the brightness of the corresponding pixels, and the lower the screen refresh rate is required for subsequent display.

[0059] As can be seen, the embodiments of this application can determine the target refresh rate suitable for the image to be displayed based on the pixel brightness information of the image to be displayed, with different refresh rates corresponding to different images. That is, when the content displayed in the image to be displayed is relatively complex, a higher screen refresh rate can be used for display. When the content displayed in the image to be displayed is relatively simple, a lower screen refresh rate can be used for display. In this way, the method provided by the embodiments of this application can dynamically adjust the screen refresh rate while ensuring image display quality, improving the flexibility and timeliness of adjusting the refresh frequency, and saving device power consumption.

[0060] The display method provided in this application can be applied to electronic devices. In some embodiments, the electronic device may include, for example, a mobile phone, tablet computer, personal computer (PC), personal digital assistant (PDA), smartwatch, netbook, wearable device, augmented reality (AR) device, virtual reality (VR) device, in-vehicle device, smart screen, smart car, smart speaker, and robot, etc. This application does not impose any special limitations on the specific form of the electronic device.

[0061] For example, taking a smartwatch as an electronic device, Figure 2 A schematic diagram of the structure of a smartwatch provided in an embodiment of this application is shown. The smartwatch can be worn on a user's wrist. The smartwatch may include a display screen 103 and a fixing strap 104. The display screen 103 is used to display the time and allow the user to touch and click to display other relevant content. The fixing strap 104 is used to secure the smartwatch to the user's wrist.

[0062] For example, Figure 3 Taking a smartwatch as an example, the diagram shows a hardware structure schematic of an electronic device provided in an embodiment of this application. See also... Figure 3 A smartwatch may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a microphone 170B, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, and a display screen 194, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer 180E, a proximity sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, and a bone conduction sensor 180M, etc.

[0063] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the smartwatch. In other embodiments of this application, the smartwatch may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0064] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0065] In some examples, the processor 110 can be a system-on-a-chip (SoC) for a smartwatch. In some embodiments, the SoC can draw, render, and composite the images to be displayed. Specifically, the SoC can control the GPU to draw, render, and composite the layers, and send (write) the image data corresponding to the composited image to be displayed to the TDDIC via the MIPI interface, so that the TDDIC can subsequently control the display screen 194 to display the image based on the screen refresh rate.

[0066] The controller can serve as the central nervous system and command center of a smartwatch. It generates operational control signals based on instruction opcodes and timing signals to control the fetching and execution of instructions.

[0067] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0068] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0069] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the smartwatch's shooting function. The processor 110 and the display screen 194 communicate via the DSI interface to enable the smartwatch's display function.

[0070] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the smartwatch. In other embodiments of this application, the smartwatch may also employ different interface connection methods or combinations of multiple interface connection methods as described above.

[0071] The wireless communication function of a smartwatch can be achieved through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor.

[0072] The wireless communication module 160 can provide solutions for wireless communication applications in smartwatches, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0073] The smartwatch utilizes a GPU, display 194, and application processor to achieve its display function. The GPU is a microprocessor for image processing, connecting the display 194 and the application processor. The GPU performs mathematical and geometric calculations and is used for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0074] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc.

[0075] In some embodiments, the display screen 194 can receive image data of the image to be displayed and the target refresh rate corresponding to the image to be displayed sent by TDDIC. Then, the display screen 194 displays and refreshes the image to be displayed according to the target refresh rate corresponding to the image to be displayed.

[0076] In some embodiments, a smartwatch may include one or N displays 194, where N is a positive integer greater than 1.

[0077] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of the smartwatch by running the instructions stored in internal memory 121.

[0078] The internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a given function (such as sound playback, image playback, etc.). The data storage area may store data created during the use of the smartwatch (such as audio data, phonebook entries, etc.). Furthermore, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory, universal flash storage (UFS), etc.

[0079] Understandably, the implementation of smartwatch functions generally requires not only hardware support but also software cooperation.

[0080] The software system of a smartwatch can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application's embodiment uses a layered architecture. Taking the system as an example, the software structure of a smartwatch is illustrated.

[0081] Figure 4 This is a software structure block diagram of a smartwatch according to an embodiment of this application.

[0082] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, [the following is omitted as the text is incomplete and likely refers to a specific implementation or feature]. The system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime layer, and the application application layer. runtime) and system libraries as well as the kernel layer.

[0083] The application layer can include a series of application packages.

[0084] like Figure 4 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0085] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0086] like Figure 4 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0087] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0088] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.

[0089] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0090] The phone manager is used to provide communication functions for smartwatches. For example, it manages call status (including connection, hang-up, etc.).

[0091] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0092] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of download completion or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting alert sounds, vibrating smartwatches, and flashing indicator lights.

[0093] Runtime includes core libraries and a virtual machine. Runtime is responsible for Android System scheduling and management.

[0094] The core library consists of two parts: one part contains the functionalities that the Java language needs to call, and the other part is... The core library.

[0095] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0096] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.

[0097] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0098] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0099] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0100] A 2D graphics engine is a graphics engine for 2D drawing.

[0101] The kernel layer is the layer between hardware and software. The kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver. In some embodiments, the kernel layer's display driver can send (write) image data corresponding to the image to be displayed to the TDDIC via the MIPI interface, so that the TDDIC can subsequently control the display screen to display the image based on the screen refresh rate.

[0102] For example, the technical solutions involved in the following embodiments can all be implemented in electronic devices with the above-described hardware architecture.

[0103] The display method provided in this application embodiment can be applied to electronic devices equipped with a display screen. Taking a smartwatch as an example, the display method provided in this application embodiment will be described in detail below with reference to the accompanying drawings.

[0104] To facilitate understanding of the technical content of this application, the specific process of displaying images on a smartwatch screen will be described below.

[0105] In the embodiments of this application, see Figure 5In a smartwatch, the microcontroller unit (MCU) in the SoC (System-on-a-Chip) controls the GPU to draw, render, and composite layers, and then sends the composited image data to the TDDIC (Tunnel Digitized Display) via the MIPI interface. The MCU in the TDDIC stores the image data in static random-access memory (SRAM) via the memory controller. Then, the MCU in the TDDIC scans the image data in the SRAM and reconstructs the digital image data into continuous voltage signals to drive the panel, thereby achieving the purpose of displaying and refreshing the image. In other words, the image displayed on the panel originates from the MCU in the TDDIC, which is controlled by the SoC to send the image via MIPI each frame.

[0106] In some embodiments of this application, the smartwatch can acquire the i-th frame image to be displayed, where i is an integer not less than 1. The image to be displayed is the image currently to be displayed.

[0107] Typically, smartwatches feature electronic displays on their watch faces, allowing users to interact with the watch through the interactive interface displayed on the watch face. It's understandable that a smartwatch's interactive interface can display multiple frames of images during the display process. A frame is the smallest unit of visual animation, a single image. A single frame is a still image, and consecutive frames form an animation, such as moving images. In this way, a smartwatch can quickly and continuously display multiple frames to create its interactive interface.

[0108] For example, let's take the user launching the first application as an example. After the user launches the first application, the smartwatch's display will show the corresponding interactive interface of the first application.

[0109] When a smartwatch displays the interactive interface corresponding to the first application, it draws and displays multiple frames of images. The SoC (System-on-a-Chip) can control the first application to call the MCU and GPU to draw and render the images. Then, the SurfaceFlinger layer integrator composites the drawn images to obtain the image corresponding to the interactive interface. For example, if the SoC's frame rate is 60, then the SoC can draw and generate 60 frames of images per second for subsequent display on the screen.

[0110] Understandably, the SOC can initiate the drawing and rendering of the i-th frame image by calling the MCU and GPU. Then, the layer integrator begins the compositing of the i-th frame image. Consequently, the SOC can obtain the i-th frame image to be displayed.

[0111] In some embodiments of this application, see Figure 6In (A), after the SOC in the smartwatch generates the i-th frame image to be displayed, it can send the image data corresponding to the i-th frame image to the TDDIC via the MIPI interface. The MCU in the TDDIC stores the image data corresponding to the i-th frame image in SRAM via the memory controller.

[0112] For example, when the refresh rate of a smartwatch is 60Hz, the period of the corresponding tearing effect signal (such as the TE1 signal) is 16.66ms. The SOC can draw, render, and synthesize the image based on the TE1 signal within 16.66ms to obtain the i-th frame image, and then transmit the image data corresponding to the i-th frame image to the TDDIC. When the SOC receives the next TE1 signal, it draws the image again to obtain the image data corresponding to the next frame image, and then sends the image data corresponding to the next frame image to the TDDIC.

[0113] In some embodiments of this application, after the smartwatch acquires the i-th frame image to be displayed, it can display the i-th frame image according to the initial refresh rate.

[0114] Specifically, after the SOC sends the image data corresponding to the i-th frame to the TDDIC, the TDDIC can refresh and display the i-th frame. Correspondingly, the TDDIC's MCU can scan the image data corresponding to the i-th frame from the SRAM within 16.66ms based on the TE1 signal, and convert the digital image data into a continuous voltage signal. Then, the MCU sends this voltage signal and the initial refresh rate to the Panel to drive the Panel. The Panel then displays and refreshes the i-th frame according to the initial refresh rate, thus realizing the screen display and image refresh process. When the TDDIC's MCU receives the next TE1 signal, it can refresh and display the next frame (i.e., the next frame sent by the SOC). It can be understood that, taking a smartwatch's screen refresh rate of 60Hz as an example, the initial refresh rate is 60Hz.

[0115] In some embodiments of this application, the image data of the image to be displayed may include the resolution of the image to be displayed, the three-channel values ​​of each pixel, etc. Here, an image channel refers to the individual red, green, and blue portions in RGB color mode. That is, a complete image is composed of three channels: red, green, and blue, which work together to produce the complete image. All three channels are indispensable for a complete image. It is understood that even if an image appears to lack blue, it only means that the brightness of blue light is all 0 or that the red and green channel values ​​of each pixel are not all 0, but it does not mean that a blue channel is absent.

[0116] In some embodiments of this application, the smartwatch can acquire a first image and determine a target refresh rate based on the pixel brightness information of the first image. The pixel brightness information of the first image is used to characterize the richness of the content contained in the first image. Then, the smartwatch displays the first image according to the target refresh rate.

[0117] For example, see [link to example]. Figure 6 In step (B), the smartwatch can continue to acquire the j-th frame image to be displayed, where j is an integer not less than 1. Then, the smartwatch can determine the target refresh rate based on the pixel brightness information of the j-th frame image. It should be noted that the j-th frame image can be an adjacent frame image to the i-th frame image, and other frame images can exist between the j-th frame image and the i-th frame image. This application does not specifically limit this aspect.

[0118] Continuing with the example of a smartwatch with a refresh rate of 60Hz and the j-th frame being the next frame after the i-th frame, the period of the tearing effect signal (such as the TE1 signal) remains 16.66ms. The SOC can continue to draw, render, and synthesize the image within 16.66ms based on the TE2 signal to obtain the j-th frame image to be displayed, and transmit the image data corresponding to the j-th frame image to the TDDIC. Then, after receiving the image data corresponding to the j-th frame image, the TDDIC can analyze the image data to obtain the pixel brightness information of the j-th frame image to be displayed. Furthermore, the TDDIC determines the target refresh rate based on the pixel brightness information of the j-th frame image to be displayed.

[0119] Specifically, the MCU in the TDDIC can read the image data corresponding to the j-th frame from the SRAM, and based on the image data, obtain the target region corresponding to the pixels in the j-th frame. The target region is used to characterize the area occupied by pixels with brightness values ​​greater than a preset threshold in the j-th frame. Next, the MCU in the TDDIC calculates the target ratio between the area of ​​the target region and the area of ​​the j-th frame. Then, the MCU in the TDDIC determines the target refresh rate based on the target ratio.

[0120] Among them, see Figure 7 When the target ratio is greater than or equal to a first preset value, the target refresh rate is determined to be the first refresh rate. Alternatively, when the target ratio is less than the first preset value, the target refresh rate is determined to be the second refresh rate. The first refresh rate is greater than the second refresh rate.

[0121] In one possible implementation, the preset threshold can be 0. TDDIC can calculate the brightness value of each pixel based on the image data corresponding to the j-th frame image to obtain the target region corresponding to the j-th frame image.

[0122] For example, TDDIC can convert the three-channel values ​​of each pixel in the j-th frame image into the brightness value of each pixel. Then, TDDIC compares the brightness value of each pixel with a preset threshold, identifying pixels with brightness values ​​greater than 0 as luminous pixels. It is understood that the target area can include the area corresponding to at least one luminous pixel.

[0123] Next, TDDIC calculates the ratio of the target region's area to the area of ​​the j-th frame. For example, if the j-th frame has a length of 8 pixels and a width of 8 pixels, then the area of ​​the j-th frame is 64. If the number of luminous pixels is 32, the target region's area is 32. Thus, the target region's area to the area of ​​the j-th frame is 0.5.

[0124] Then, TDDIC determines the target refresh rate based on the target ratio of 0.5. For example, the first preset value is 0.25. The first refresh rate is 30Hz, and the second refresh rate is 1Hz.

[0125] If the target ratio of the j-th frame is 0.5, the target ratio is greater than the first preset value, and the target refresh rate is determined to be 30Hz. If the target ratio of the j-th frame is 0.1, the target ratio is less than the first preset value, and the target refresh rate is determined to be 1Hz.

[0126] Importantly, the first refresh rate proposed in this application embodiment needs to be greater than the second refresh rate. It is understood that pixel brightness information of an image is used to characterize the richness of the content contained in the image. The more pixels in an image with brightness values ​​greater than a preset threshold, the richer the content contained in the image. Furthermore, the more pixels in an image with brightness values ​​greater than the preset threshold, the larger the area corresponding to the target region, and consequently, the larger the target ratio of the image. When the target ratio of the image is larger, a higher refresh rate is required to refresh the image to ensure its complete and smooth display.

[0127] Conversely, the fewer pixels in an image whose brightness value exceeds a preset threshold, the lower the richness of the content contained in the image. Furthermore, the fewer pixels in an image whose brightness value exceeds the preset threshold, the smaller the area corresponding to the target region, and consequently, the smaller the target ratio of the image. When the target ratio of the image is smaller, a high refresh rate is not needed to refresh the image. This saves device power consumption while ensuring complete and smooth display.

[0128] Thus, this embodiment of the application can use a high refresh rate to display images containing complex content and a low refresh rate to display images containing simple content, thereby achieving adaptive adjustment of the screen refresh rate. This saves device power consumption while ensuring image display quality.

[0129] It should be noted that this application embodiment does not specifically limit the values ​​corresponding to the preset threshold, the first preset value, the first refresh rate, and the second refresh rate. Furthermore, the number of preset values ​​can be one or more, and the target refresh rate can be determined from several refresh rates. This application embodiment does not specifically limit the number of preset values, the number of first refresh rates, and the number of second refresh rates.

[0130] In some other embodiments of this application, the target refresh rate may be the optimal refresh frequency corresponding to the image. Optionally, the optimal refresh rate may be a fixed refresh frequency. Alternatively, it may be a dynamically changing refresh frequency. The optimal refresh frequency may be preset in TDDIC and supports dynamic updates. It is understood that TDDIC can determine the target refresh rate suitable for the currently displayed image from several refresh frequencies.

[0131] For example, the first refresh rate may include a value between 10 and 30 Hz. If the target ratio of the j-th frame is 0.5, the target ratio of the j-th frame is greater than a first preset value, and the target refresh rate applicable to the j-th frame is determined to be 20 Hz from the first refresh rate. If the target ratio of the j-th frame is 0.8, the target ratio of the j-th frame is greater than the first preset value, and the target refresh rate applicable to the j-th frame is determined to be 30 Hz from the first refresh rate.

[0132] For another example, the second refresh rate may include a value between 0 and 10 Hz. If the target ratio of the j-th frame image is 0.1, the target ratio corresponding to the pixel brightness information of the j-th frame image is less than the first preset value, and a target refresh rate of 1 Hz is determined from the second refresh rate for the j-th frame image. If the target ratio of the j-th frame image is 0.2, the target ratio corresponding to the pixel brightness information of the j-th frame image is less than the first preset value, and a target refresh rate of 8 Hz is determined from the second refresh rate for the j-th frame image.

[0133] As can be seen, this embodiment of the application can determine the target refresh rate applicable to the current image based on the pixel brightness information of the image, with different refresh rates corresponding to different images. The image can then be displayed based on this target refresh rate. Specifically, in this solution, the process of determining the target refresh rate is executed by the TDDIC, without relying on the SOC for control and adjustment. The TDDIC can determine the corresponding target refresh rate frame by frame and adjust the refresh rate frame by frame. This improves the flexibility and timeliness of refresh rate adjustment and saves device power consumption.

[0134] In practical applications, besides needing to achieve high refresh rates in high frame rate games, high refresh rates can also be primarily used in a few fast-scrolling scenarios such as desktop scrolling and photo browsing. This improves the smoothness of the screen when users perform fast swiping operations. It's conceivable that fast swiping accounts for a relatively small proportion of the time spent in practical applications; most usage scenarios are still static displays, slow scrolling, and low frame rate video playback. In these scenarios, using low refresh rates and low frame rates can ensure smooth visuals, reduce power consumption, and improve battery life. Therefore, the display method provided in this application can be applied to different scenarios.

[0135] In other embodiments of this application, the smartwatch can also determine the current display scene based on the pixel brightness information of the j-th frame image. Then, the smartwatch can determine the target refresh rate based on the current display scene, with different refresh rates corresponding to different display scenes.

[0136] The display scenarios include static display scenarios and dynamic display scenarios. Static display scenarios can include image display scenarios, text display scenarios, always-on display scenarios, and low-speed scrolling scenarios, etc. Dynamic display scenarios include video playback scenarios, game scenarios, and high-speed scrolling scenarios, etc.

[0137] In one possible implementation, when the current display scenario is static, the sixth refresh rate is determined as the target refresh rate, which is the highest refresh rate in a static display scenario. When the current display scenario is dynamic, the seventh refresh rate is determined as the target refresh rate, which is the highest refresh rate in a dynamic display scenario; the seventh refresh rate is greater than the sixth refresh rate.

[0138] As can be seen, the embodiments of this application can also determine the corresponding display scene based on the pixel brightness information of the image. This allows for the determination of the target refresh rate suitable for the current image, with different refresh rates corresponding to different display scenes. The refresh frequency subsequently used is determined based on the display scene determination result, enabling dynamic adjustment of the refresh rate according to the image content. This facilitates maintaining display quality in different display scenes while helping to reduce the power consumption of the smartwatch.

[0139] In some embodiments of this application, see also [link to previous document]. Figure 6 In (B), the smartwatch can display the j-th frame image based on the target refresh rate.

[0140] Specifically, after the MCU in TDDIC determines the target refresh rate suitable for the j-th frame image, it can send the target refresh rate and the image data of the j-th frame image to the Panel. Then, the Panel refreshes and displays the j-th frame image according to the target refresh rate and the image data of the j-th frame image.

[0141] For example, after the MCU in TDDIC determines that the target refresh rate for the j-th frame image is 30Hz, it can send the 30Hz refresh rate and the image data of the j-th frame image to the Panel. Then, the Panel refreshes and displays the j-th frame image at 30Hz.

[0142] In one possible implementation, after the MCU in the TDDIC determines the target refresh rate suitable for the j-th frame image, it can also send a refresh rate switching command and the image data of the j-th frame image to the Panel. The refresh rate switching command instructs the Panel to switch its refresh rate from the initial refresh rate to the target refresh rate. Subsequently, upon receiving the refresh rate switching command, the Panel refreshes and displays the j-th frame image according to the target refresh rate and the image data of the j-th frame image.

[0143] For example, after the MCU in the TDDIC determines that the target refresh rate for the j-th frame image is 30Hz, it can send a refresh rate switching command and the image data of the j-th frame image to the Panel. The refresh rate switching command instructs the Panel to switch the refresh rate from 60Hz to 30Hz. Then, the Panel refreshes and displays the j-th frame image at 30Hz.

[0144] In some embodiments of this application, during the process of refreshing and displaying the j-th frame image, the Panel will write the next frame image in real time to overwrite it, so as to facilitate the subsequent display of the next frame image. Typically, the Panel overwrites from the bottom edge to the top edge.

[0145] For example, see Figure 8 For example, the j-th frame image includes the letter A. Thus, during the refresh display of the j-th frame image, the Panel will display the letter A from the bottom edge to the top edge, as shown below. Figure 8 As shown in (B) in the diagram.

[0146] It's conceivable that a higher screen refresh rate means a shorter image rendering and transmission cycle, resulting in a shorter panel overwrite cycle and faster speed. Conversely, a lower screen refresh rate means a longer image data rendering and transmission cycle, resulting in a longer panel overwrite cycle and slower speed.

[0147] As can be seen, in this embodiment, the entire screen refresh rate adjustment process is actively executed by the TDDIC. The TDDIC can dynamically adjust the screen refresh rate based on the pixel brightness information corresponding to the displayed image. This allows for adaptive adjustment of the screen refresh rate for different image modulations, without relying on the SOC side for data processing and control. This improves the flexibility of the screen refresh rate when displaying images and saves device power consumption.

[0148] In some embodiments of this application, the smartwatch can detect the first trigger operation and determine the target refresh rate based on the pixel brightness information of the j-th frame image to be displayed.

[0149] It is understood that the TDDIC in this embodiment can automatically determine the target refresh rate based on the pixel brightness information of each frame of image. Of course, the TDDIC can also determine the target refresh rate based on the pixel brightness information of each frame of image after detecting a user input trigger operation. That is, the smartwatch can refresh and display the i-th frame of image at an initial refresh rate, and then refresh and display the j-th frame of image at the target refresh rate after detecting a user input trigger operation.

[0150] The first trigger operation can be a pre-set operation that causes the smartwatch to switch refresh rates. The first trigger operation can include certain user shortcuts, such as those via gestures, touch, or key combinations. The first trigger operation can also include user voice commands.

[0151] In one possible implementation, see Figure 9 In (A), the smartwatch is currently displaying its interface. Users can interact with the smartwatch by touching it to update the watch face. See also... Figure 9 In (B), after detecting a touch operation, the smartwatch responds by displaying an updated watch face. For example, the user might tap a control on the screen, or swipe along the edge of the screen. The updated watch face could be the smartwatch's main screen, which displays a settings app icon that the user can tap.

[0152] As shown in Figure 9(C), the smartwatch responds to the user's tap on the Settings app icon by displaying the Settings app's user interface. The Settings app displays a list of all functions installed on the smartwatch, such as Bluetooth, display and brightness, and Wi-Fi. The user can tap on the display and brightness function in the list to access its corresponding properties page.

[0153] As shown in Figure 9(D), the smartwatch displays a property page corresponding to the brightness function, which includes a refresh rate adjustment control. Users can click the refresh rate adjustment control to control whether the phone performs the screen refresh rate adjustment function. Figure 9 As shown in (E), the smartwatch responds to the user's click on the refresh rate adjustment control, triggering an adaptive adjustment of the screen refresh rate.

[0154] In some embodiments of this application, the smartwatch can detect a second trigger operation and switch the screen refresh rate from the target refresh rate to the initial refresh rate.

[0155] The second triggering operation can be the same as or different from the first triggering operation. This application does not limit the specific implementation of the first and second triggering operations.

[0156] For example, see [link to example]. Figure 9 In step (F), the smartwatch responds to the user's tap on the refresh rate adjustment control, triggering a halt to the adaptive screen refresh rate adjustment process. In other words, the smartwatch can stop the process of adaptively adjusting the screen refresh rate based on the frame image to be displayed after detecting a second user input trigger.

[0157] In some embodiments of this application, after detecting the first trigger operation, the smartwatch can also output a first prompt message. The first prompt message indicates that adaptive screen refresh rate adjustment has been enabled. The first prompt message also corresponds to a first prompt control, which can be implemented as the text "Adaptive screen refresh rate adjustment is enabled".

[0158] For example, when a user clicks the refresh rate adjustment control, the smartwatch responds to the click by triggering an adaptive screen refresh rate adjustment process and displaying a first prompt window as shown. Figure 10 As shown in (A) above, the first prompt window includes the aforementioned first prompt control.

[0159] Similarly, in some embodiments of this application, see [link to relevant documentation]. Figure 10 In section (B), the user can perform a second trigger operation on the refresh rate adjustment control. After detecting the second trigger operation, the smartwatch can also output a second prompt message. This second prompt message indicates that adaptive screen refresh rate adjustment has stopped. The second prompt message also corresponds to a second prompt control, which can display the text "Adaptive screen refresh rate adjustment has stopped."

[0160] For example, if the user clicks the refresh rate adjustment control again, the smartwatch responds to the click by stopping the adaptive screen refresh rate adjustment process and displays a second prompt window as shown. Figure 10 As shown in (C), the second prompt window includes the aforementioned second prompt control.

[0161] As can be seen, the smartwatch provided in this application can adaptively adjust the screen refresh rate according to the image to be displayed after detecting the first trigger operation input by the user. In other words, the smartwatch can display an image at the initial screen refresh rate even when the user has not input the first trigger operation. Once the smartwatch detects the first trigger operation input by the user, it can adaptively adjust the screen refresh rate according to the image to be displayed. Users can control the process of adaptively adjusting the screen refresh rate of the smartwatch to be turned on and off anytime, anywhere. This improves the interactivity between the user and the smartwatch, supports the user's screen refresh rate setting process, and reduces the power consumption of the smartwatch. This, in turn, enhances the user experience.

[0162] In another possible implementation, the property page corresponding to the brightness function can include a refresh rate control for switching refresh rates, wherein multiple range controls corresponding to different refresh rates can be configured on the property page corresponding to the brightness function. For example, Figure 11 (A) in the diagram shows a first range control corresponding to 0-10Hz and a second range control corresponding to 0-60Hz, respectively. It should be understood that smartwatches can achieve multiple refresh rates, and this application embodiment does not specifically limit the number or value of refresh rate ranges.

[0163] For example, the smartwatch's current screen refresh rate is 30Hz. The smartwatch receives a user tap on a first-range control and, in response, determines the target refresh rate based on the pixel brightness information of the j-th frame of the image to be displayed.

[0164] In one feasible manner, see [link to relevant documentation]. Figure 11 In (B), the smartwatch detects the user's operation on the first range of controls and adaptively determines the target refresh rate based on the pixel brightness information of the j-th frame image to be displayed. The target refresh rate can be any refresh rate between 0-10Hz.

[0165] Understandably, users can pre-set a range for the screen refresh rate. For example, if a user is about to view static images using a photo album app, they can tap the first range control to set a relatively low screen refresh rate. That is, in scenarios involving static display and slow scrolling, the smartwatch can control the screen refresh rate within the range of 0-10Hz based on the pixel brightness information of the j-th frame. The higher the ratio corresponding to the pixel brightness information of the j-th frame, the higher the target refresh rate can be, such as 10Hz. Conversely, the lower the ratio corresponding to the pixel brightness information of the j-th frame, the lower the target refresh rate can be, such as 1Hz.

[0166] For another example, the smartwatch's current screen refresh rate is 30Hz. The smartwatch receives a user's tap on a second-range control and, in response to this tap, determines the target refresh rate based on the pixel brightness information of the j-th frame image.

[0167] In another possible implementation, the smartwatch can detect the user's actions on the second range of controls and adaptively determine the target refresh rate based on the pixel brightness information of the j-th frame of the image to be displayed. The target refresh rate can be any refresh rate between 0 and 60Hz.

[0168] For example, when a user is about to view a video file using a video application, they can click the second range control to set a relatively high screen refresh rate. That is, in scenarios involving dynamic displays and high-speed scrolling, the smartwatch can control the screen refresh rate within the range of 0-60Hz based on the pixel brightness information of the j-th frame. The higher the target ratio corresponding to the pixel brightness information of the j-th frame, the higher the determined target refresh rate, such as 60Hz. Conversely, the lower the target ratio corresponding to the pixel brightness information of the j-th frame, the lower the determined target refresh rate, such as 10Hz.

[0169] As can be seen, the smartwatch provided in this application embodiment can support users in setting different ranges of screen refresh rates and displaying images using different ranges of screen refresh rates. Users can preset the screen refresh rate according to their needs and scenarios, setting a low refresh rate in scenarios where a high refresh rate is not required and a high refresh rate in scenarios where a high refresh rate is required. Therefore, while improving the interactivity between the user and the smartwatch, it can also reduce the power consumption of the smartwatch and enhance the user experience.

[0170] In some embodiments of this application, the host-side SOC can also determine the target refresh rate based on the pixel brightness information of the j-th frame image to be displayed.

[0171] In one possible implementation, see [link to implementation details]. Figure 12 If the host-side SOC does not write the image data into the SRAM of the TDDIC, the MCU in the SOC can read the image data of the j-th frame from the buffer and calculate the pixel brightness information of the j-th frame based on the image data. Then, the MCU in the SOC determines the target refresh rate based on the pixel brightness information of the j-th frame to be displayed.

[0172] Then, the MCU in the SOC sends the target refresh rate and the image data of the j-th frame to the MCU in the TDDIC. The MCU in the TDDIC then directly sends the target refresh rate and the image data of the j-th frame to the Panel. The Panel refreshes and displays the j-th frame based on the target refresh rate and the image data of the j-th frame.

[0173] In another possible implementation, see Figure 13 If the host-side SOC has already written the image data into the SRAM of the TDDIC, the MCU in the SOC can read the image data of the j-th frame from the SRAM in the TDDIC and calculate the pixel brightness information of the j-th frame based on the image data. Then, the MCU in the SOC determines the target refresh rate based on the pixel brightness information of the j-th frame to be displayed.

[0174] Then, the MCU in the SOC sends the target refresh rate and the image data of the j-th frame to the MCU in the TDDIC. The MCU in the TDDIC then directly sends the target refresh rate and the image data of the j-th frame to the Panel. The Panel refreshes and displays the j-th frame based on the target refresh rate and the image data of the j-th frame.

[0175] As can be seen, in the adaptive screen refresh rate adjustment process of this application embodiment, TDDIC control is not required; only macroscopic control by the host-side SOC is needed. The SOC can dynamically adjust the screen refresh rate based on the pixel brightness information corresponding to the displayed image. Since the host-side SOC has a more powerful control capability than TDDIC, its processing efficiency is higher in the adaptive screen refresh rate adjustment process. This improves the efficiency of screen refresh rate adjustment while reducing device power consumption.

[0176] In some embodiments of this application, the smartwatch can further divide the image to be displayed into M image regions in advance, where M is an integer not less than 1. Then, the smartwatch can refresh the display of the M image regions according to corresponding screen refresh rates, wherein different image regions correspond to different screen refresh rates.

[0177] Specifically, the MCU in TDDIC can determine the corresponding screen refresh rate based on the pixel brightness information corresponding to M image regions.

[0178] For example, the MCU in the TDDIC acquires the second image and divides it into regions. The second image includes a first image region and a second image region, which do not overlap. Next, the MCU in the TDDIC determines a third refresh rate based on the pixel brightness information of the first image region, and a fourth refresh rate based on the pixel brightness information of the second image region. Then, the MCU in the TDDIC sends the third refresh rate, the fourth refresh rate, and the image data of the first and second image regions to the Panel, causing the Panel to refresh and display the first and second image regions.

[0179] It should be noted that during the pre-region division of the image to be displayed in the TDDIC, the MCU can divide the image into M image regions of equal area or M image regions of different areas. These M image regions can be arranged horizontally and vertically, or they can be arranged in an enclosing manner. This application does not specifically limit the implementation method of region division in its embodiments.

[0180] It is evident that the higher the target ratio corresponding to the pixel brightness information of a certain image region, the higher the screen refresh rate of that image region. Conversely, the lower the target ratio corresponding to the pixel brightness information of a certain image region, the lower the screen refresh rate of that image region. The embodiments of this application enable the display of the entire image at different refresh rates in different image regions. This allows for more precise adjustment of the refresh rate in different regions of an image, improving the flexibility of screen refresh rate adjustment and reducing device power consumption.

[0181] In some embodiments of this application, when the smartwatch displays an image corresponding to a customized watch face, the image content of each frame does not change significantly. For example, when the smartwatch is in sleep mode, power-saving mode, or displaying a lock screen image, the image content of each frame mostly only changes in terms of time. Thus, the smartwatch can store an initial background image and generate the image to be displayed based on the initial background image. The initial background image may include pointer images and preset images (wallpaper images, watch face images, and user-defined customized images), etc.

[0182] Specifically, the smartwatch can acquire a third image, which includes a preset initial background image. Then, based on a first moment and the third image, the smartwatch can generate a fourth image; the first moment represents the time when the fourth image is generated. Similarly, the smartwatch determines a fifth refresh rate based on the pixel brightness information of the fourth image, and displays the fourth image according to the fifth refresh rate.

[0183] For example, see Figure 14 The initial background image can be pre-stored in the SRAM of TDDIC. TDDIC does not need to receive the image from the SOC in real time. The MCU in TDDIC can obtain the first moment from the built-in clock (CLK) and generate the image to be displayed based on the first moment and the initial background image.

[0184] For example, the MCU in the TDDIC retrieves the dial image from SRAM, which includes an initial pointer image. It's understood that the initial pointer image in the dial image is a template image, and the corresponding time content in the dial image is continuously changing. The MCU in the TDDIC needs to update the initial pointer image. Thus, after retrieving the dial image from SRAM, the MCU in the TDDIC can obtain the first moment from CLK and update the initial pointer image based on this first moment to generate the image to be displayed. Here, the first moment represents the time when the image to be displayed is generated.

[0185] Next, after the MCU in TDDIC generates the image to be displayed, it can determine the target refresh rate based on the pixel brightness information of the image to be displayed, and control the Panel to refresh and display the image to be displayed according to the target refresh rate.

[0186] It should be noted that the SRAM of TDDIC can pre-store the initial background image or the first frame image obtained by TDDIC from SOC.

[0187] In some embodiments of this application, during the process of the MCU in the TDDIC generating and refreshing an image, the clock frequency of the CLK in the TDDIC may be inconsistent with the clock frequency of the CLK in the SOC, resulting in time asynchrony between the CLK in the TDDIC and the CLK in the SOC. Therefore, the CLK in the TDDIC needs to be synchronized with the CLK in the SOC.

[0188] Specifically, the MCU in TDDIC can obtain the second time from the CLK in the SOC within a certain preset period and send a synchronization time command to the CLK. The synchronization time command is used to instruct the CLK in TDDIC to synchronize its time to the second time, thereby achieving time synchronization between the CLK in TDDIC and the CLK in the SOC.

[0189] As can be seen, the embodiments of this application can send images to the TDDIC in real time without relying on the host-side SOC. The TDDIC can generate the image to be displayed and dynamically refresh the image. It only needs to periodically synchronize with the SOC, saving the SOC's power consumption.

[0190] This application also provides a wearable device, such as the aforementioned smartwatch. Figure 15 As shown, the wearable device may include one or more processors 1510, memory 1520 and communication interface 1530.

[0191] The memory 1520, communication interface 1530, and processor 1510 are coupled together. For example, the memory 1520, communication interface 1530, and processor 1510 can be coupled together via bus 1540.

[0192] The communication interface 1530 is used for data transmission with other devices. The memory 1520 stores computer program code. The computer program code includes computer instructions, which, when executed by the processor 1510, cause the wearable device to perform the dial interface display method described in this embodiment.

[0193] The processor 1510 may be a processor or controller, such as a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with this disclosure. The processor may also be a combination that implements computational functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0194] The bus 1540 can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus 1540 can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 15 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0195] This application also provides an electronic device, which includes a memory and one or more processors; the memory is coupled to the processors; wherein the memory stores computer program code, which includes computer instructions, and when the computer instructions are executed by the processor, the electronic device performs the relevant method steps in the above method embodiments.

[0196] This application also provides a computer-readable storage medium storing computer program code. When the processor executes the computer program code, the electronic device executes the relevant method steps in the above method embodiments.

[0197] This application also provides a computer program product that, when run on a computer, causes the computer to execute the relevant method steps described in the above method embodiments.

[0198] This application embodiment also provides a display device, which includes a system-on-a-chip (SoC), a touch display driver chip, and a display panel. The SoC is used to acquire a first image. The SoC is also used to determine a target refresh rate based on pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of the content contained in the first image. The SoC is further used to send the target refresh rate and the first image to the touch display driver chip, which drives the display panel to display the first image according to the target refresh rate. The display panel is used to display the first image according to the target refresh rate.

[0199] This application embodiment also provides a display device, which includes a system-on-a-chip (SoC), a touch display driver chip, and a display panel. The SoC is used to acquire a first image. The SoC is also used to send the first image to the touch display driver chip. The touch display driver chip is used to determine a target refresh rate based on pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of the content contained in the first image. The touch display driver chip is also used to drive the display panel to display the first image according to the target refresh rate. The display panel is used to display the first image according to the target refresh rate.

[0200] The wearable device, computer storage medium, display device, or computer program product provided in this application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0201] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0202] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another apparatus, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0203] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0204] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0205] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, essentially, or the contributing parts, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0206] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A display method characterized by comprising: The method includes: Get the first image; The target refresh rate is determined based on the pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of the content contained in the first image; the target refresh rate is associated with the current display scene, which includes static display scene and dynamic display scene, and the target refresh rate of the static display scene is less than the target refresh rate of the dynamic display scene. Display the first image according to the target refresh rate; Determining the target refresh rate based on the pixel brightness information of the first image includes: Based on the pixel brightness information of the first image, the target region corresponding to the pixel in the first image is obtained. The target region is used to characterize the area occupied by pixels in the first image whose brightness value is greater than a preset threshold. Calculate the target ratio between the area of ​​the target region and the image area of ​​the first image; The target refresh rate is determined based on the target ratio.

2. The method of claim 1, wherein, Determining the target refresh rate based on the target ratio and the pixel brightness information of the first image includes: When the target ratio is greater than or equal to a first preset value, the target refresh rate is determined to be the first refresh rate; When the target ratio is less than the first preset value, the target refresh rate is determined to be the second refresh rate; the first refresh rate is greater than the second refresh rate.

3. The method according to claim 1 or 2, characterized in that, Determining the target refresh rate based on the pixel brightness information of the first image includes: Upon detecting the first trigger operation, the target refresh rate is determined based on the pixel brightness information of the first image.

4. The method of claim 1, wherein, The method further includes: Acquire a second image; wherein the second image includes a first image region and a second image region, and the first image region and the second image region do not overlap; The third refresh rate is determined based on the pixel brightness information of the first image region; The fourth refresh rate is determined based on the pixel brightness information of the second image region; The first image region and the second image region are displayed according to the third refresh rate and the fourth refresh rate, respectively.

5. The method according to claim 1, characterized in that, The method further includes: Acquire a third image, which includes a preset initial background image; A fourth image is generated based on the first moment and the third image; the first moment is used to characterize the time when the fourth image is generated. The fifth refresh rate is determined based on the pixel brightness information of the fourth image; The fourth image is displayed according to the fifth refresh rate.

6. The method according to claim 1, characterized in that, The method further includes: Output a first prompt message, which indicates that the screen refresh rate adjustment has begun.

7. A display device, characterized in that, The display device includes a system-on-a-chip, a touch display driver chip, and a display panel; The system-on-a-chip is used to acquire the first image; The system-on-a-chip is also used to send the first image to the touch display driver chip; The touch display driver chip is used to determine the target refresh rate based on the pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of the content contained in the first image. The target refresh rate is associated with the current display scene, which includes static display scenes and dynamic display scenes. The target refresh rate of the static display scene is less than the target refresh rate of the dynamic display scene. The touch display driver chip is also used to drive the display panel to display the first image according to the target refresh rate; The display panel is used to display the first image according to the target refresh rate; The touch display driver chip is specifically used to obtain the target area corresponding to the pixel in the first image based on the pixel brightness information of the first image. The target area is used to characterize the area occupied by the pixel in the first image whose brightness value is greater than a preset threshold. Calculate the target ratio between the area of ​​the target region and the area of ​​the first image; determine the target refresh rate based on the target ratio.

8. A display device, characterized in that, The display device includes a system-on-a-chip, a touch display driver chip, and a display panel; The system-on-a-chip is used to acquire the first image; The system-on-a-chip is also used to determine a target refresh rate based on the pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of the content contained in the first image. The target refresh rate is associated with the current display scene, which includes static display scenes and dynamic display scenes. The target refresh rate of the static display scene is less than the target refresh rate of the dynamic display scene. The system-on-a-chip is also used to send the target refresh rate and the first image to the touch display driver chip; The touch display driver chip is used to drive the display panel to display the first image according to the target refresh rate; The display panel is used to display the first image according to the target refresh rate; The system-on-a-chip is specifically used to obtain the target region corresponding to the pixel in the first image based on the pixel brightness information of the first image. The target region is used to characterize the region occupied by pixels in the first image whose brightness value is greater than a preset threshold. Calculate the target ratio between the area of ​​the target region and the area of ​​the first image; determine the target refresh rate based on the target ratio.

9. An electronic device, characterized in that, The electronic device includes a processor, a memory, and a display screen, wherein the memory and the display screen are coupled to the processor, the display screen is used to display images, and the memory is used to store computer-readable instructions. When the processor reads the computer-readable instructions from the memory, the electronic device performs the display method as described in any one of claims 1-6.

10. A chip system, characterized in that, The chip system includes at least one processor and at least one interface circuit, the at least one interface circuit being used to perform transceiver functions and send instructions to the at least one processor, the at least one processor executing the instructions, and the at least one processor performing the display method as described in any one of claims 1-6.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a computer program that, when run on an electronic device, causes the electronic device to perform the display method as described in any one of claims 1-6.

Images