Display method and device

Abstract

The present application provides a display method and a device, and relates to the technical field of display. The method comprises: acquiring an image to be displayed, and, according to pixel brightness information of said image, determining a corresponding target refresh rate, wherein the pixel brightness information of said image is used for representing the richness of content contained in said image; and then displaying said image according to the target refresh rate. Thus, the screen refresh rate can be dynamically adjusted while the image display quality is ensured, thus improving the flexibility and timeliness of adjusting the refresh rate, and reducing the device power consumption.

Description

Display method and device

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on June 26, 2023, with application number 202310766412.5 and application name “A Display Method and Device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of display technology, and in particular to a display method and device. Background Art

[0003] With the continuous development of display technology, more and more displays that can support various display performances have emerged, such as higher resolution, better color vision, and higher refresh rate, etc., to provide users with a better visual experience.

[0004] Typically, displays refresh content while displaying an image. The higher the display's refresh rate, the smoother the image display. However, continuously displaying at a high refresh rate can lead to higher power consumption in electronic devices, resulting in a poor user experience.

[0005] Summary of the Invention

[0006] The present application provides a display method and device, which determines a target refresh rate suitable for an image to be displayed based on pixel brightness information of the image to be displayed, thereby realizing a process of dynamically adjusting the screen refresh rate, thereby saving device power consumption while ensuring image display quality.

[0007] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0008] In a first aspect, embodiments of the present application provide a display method for an electronic device, comprising: acquiring a first image and determining a target refresh rate based on pixel brightness information of the first image; the pixel brightness information of the first image is used to represent the richness of content contained in the first image; and then displaying the first image based on the target refresh rate.

[0009] It can be seen that the embodiment of the present application can determine the target refresh rate applicable to the image to be displayed based on the pixel brightness information of the image to be displayed, and different images to be displayed correspond to different refresh rates. In other words, when the content contained in the image to be displayed is rich, a higher screen refresh rate can be used for display. When the content contained in the image to be displayed is less rich, a lower screen refresh rate can be used for display. In this way, the method provided by the embodiment of the present application can dynamically adjust the screen refresh rate while ensuring the image display quality, improve the flexibility and timeliness of adjusting the refresh frequency, and save device power consumption.

[0010] In one implementation of the first aspect, when determining a target refresh rate based on pixel brightness information of a first image, a target area corresponding to pixels in the first image can be obtained based on the pixel brightness information of the first image. The target area represents the area occupied by pixels in the first image having brightness values ​​greater than a preset threshold. Subsequently, a target ratio of the area of ​​the target area to the image area of ​​the first image is calculated. The target refresh rate is then determined based on the target ratio.

[0011] It can be seen that the embodiment of the present application provides a method for obtaining the target area corresponding to the pixels in the image to be displayed based on the pixel brightness information of the image to be displayed. And calculate the target ratio of the area of ​​the target area to the image area of ​​the image to be displayed. Then, based on the target ratio, determine the target refresh rate. It can be understood that when the more pixels in the image to be displayed whose brightness values ​​are greater than the preset threshold, the larger the area corresponding to the target area, and thus the larger the target ratio of the image to be displayed. On the contrary, when the fewer pixels in the image to be displayed whose brightness values ​​are greater than the preset threshold, the smaller the area corresponding to the target area, and thus the smaller the target ratio of the image to be displayed. In this way, different target refresh rates can be determined according to different target ratios corresponding to different images to be displayed. Thereby improving the flexibility and timeliness of adjusting the refresh rate and saving device power consumption.

[0012] In one implementation of the first aspect, in determining the target refresh rate based on the target ratio, when the target ratio is greater than or equal to a first preset value, the target refresh rate is determined to be a first refresh rate. When the target ratio is less than the first preset value, the target refresh rate is determined to be a second refresh rate; and the first refresh rate is greater than the second refresh rate.

[0013] It can be seen that the pixel brightness information of the image to be displayed provided by the embodiment of the present application is used to characterize the richness of the content contained in the image to be displayed. The more pixels in the image to be displayed whose brightness values ​​are greater than the preset threshold, the richer the content contained in the image to be displayed. Then, when the more pixels in the image to be displayed whose brightness values ​​are greater than the preset threshold, the larger the area corresponding to the target area, and thus the larger the target ratio of the image to be displayed. When the target ratio of the image is larger, for example, the target ratio is greater than or equal to the first preset value, a higher refresh rate is required to refresh the image to ensure that it is displayed completely and smoothly.

[0014] On the contrary, when there are fewer pixels in the image to be displayed whose brightness values ​​are greater than the preset threshold, it indicates that the richness of the content contained in the image to be displayed is lower. Then, when there are fewer pixels in the image to be displayed whose brightness values ​​are greater than the preset threshold, the area corresponding to the target area is smaller, and thus the target ratio of the image to be displayed is smaller. When the target ratio of the image to be displayed is smaller, for example, the target ratio is less than the first preset value, a high refresh rate is not required to refresh the image to be displayed. It is possible to save device power consumption while ensuring its complete and smooth display. In this way, the method provided in the embodiment of the present application can dynamically adjust the screen refresh rate while ensuring the image display quality, improve the flexibility and timeliness of adjusting the refresh frequency, and save device power consumption.

[0015] In one implementation of the first aspect, in the process of determining the target refresh rate based on pixel brightness information of the first image, a first trigger operation can be detected, and the target refresh rate can be determined based on the pixel brightness information of the first image.

[0016] It can be seen that the embodiment of the present application can adaptively adjust the screen refresh rate according to the pixel brightness information of the image to be displayed after detecting the first trigger operation input by the user. That is to say, when the first trigger operation is not detected, the image can be displayed at the initial screen refresh rate. As long as the first trigger operation is detected, the screen refresh rate can be adaptively adjusted according to the image to be displayed. The user can control the process of turning on and off the smart watch's adaptive adjustment of the screen refresh rate anytime and anywhere. The interactivity between the user and the device is improved, and the user's setting process of the screen refresh rate can be supported, thereby improving the user's usage experience.

[0017] In one implementation of the first aspect, the method further includes: acquiring a second image; wherein the second image includes a first image area and a second image area, and the first image area and the second image area do not overlap. Next, determining a third refresh rate based on pixel brightness information of the first image area. And determining a fourth refresh rate based on the pixel brightness information of the second image area. Then, displaying the first image area and the second image area according to the third refresh rate and the fourth refresh rate, respectively.

[0018] As can be seen, the embodiments of the present application can realize the display of different image areas in the entire image at different refresh rates. The refresh rate of different areas in an image can be adjusted more accurately, which improves the flexibility of adjusting the screen refresh rate and reduces the power consumption of the device.

[0019] In one possible implementation of the first aspect, the method further includes: acquiring a third image, the third image including a preset initial background image. Next, generating a fourth image based on the first moment and the third image, wherein the first moment represents the time when the fourth image was generated. Then, determining a fifth refresh rate based on pixel brightness information of the fourth image, and displaying the fourth image at the fifth refresh rate.

[0020] As can be seen, the embodiments of the present application can generate an image to be displayed based on an initial background image at a threshold within the device and the current time, even in sleep mode, power-saving mode, or when displaying a lock screen image. By using a preset initial background image to generate an image to be displayed, there is no need to repeatedly draw repeated content in the image in real time. Similarly, the screen refresh rate can be matched to different images to be displayed, improving the flexibility of adjusting the refresh rate and saving device power consumption.

[0021] In an implementation manner of the first aspect, the method further includes: outputting first prompt information, where the first prompt information is used to prompt that the adjustment of the screen refresh rate has started.

[0022] As can be seen, the embodiment of the present application can output a first prompt message, which is used to indicate that the screen refresh rate adjustment has begun. This allows the user to perceive the start of the screen refresh rate adjustment process, improves the interactivity between the user and the device, and thus improves the user's user experience.

[0023] In a second aspect, an embodiment of the present application provides a display device, which includes a system-level chip, a touch display driver chip, and a display panel. The system-level chip is used to acquire a first image. The system-level chip is also used to send the first image to the touch display driver chip. The touch display driver chip is used to determine a target refresh rate based on the pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of the content contained in the first image. The touch display driver chip is also used to drive the display panel to display the first image according to the target refresh rate. The display panel is used to display the first image according to the target refresh rate.

[0024] As can be seen, the system-level chip can obtain the image to be displayed and send it to the touch display driver chip. The touch display driver chip determines the target refresh rate for the image to be displayed based on the pixel brightness information of the image to be displayed. The touch display driver chip can then drive the display panel to display the image to be displayed according to the target refresh rate. In this way, the display device provided in the embodiment of the present application can dynamically adjust the screen refresh rate while ensuring image display quality, improve the flexibility and timeliness of adjusting the refresh frequency, and save device power consumption.

[0025] In a third aspect, an embodiment of the present application provides a display device, which includes a system-level chip, a touch display driver chip, and a display panel. The system-level chip is used to obtain a first image. The system-level chip is also used to determine a target refresh rate based on the pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of the content contained in the first image. The system-level chip is also used to send the target refresh rate and the first image to the touch display driver chip and the touch display driver chip, and is used to drive the display panel to display the first image according to the target refresh rate. The display panel is used to display the first image according to the target refresh rate.

[0026] It can be seen that the system-level chip can obtain the image to be displayed and determine the target refresh rate applicable to the image to be displayed based on the pixel brightness information of the image to be displayed. Then, the system-level chip can also send the target refresh rate and the image to be displayed to the touch display driver chip. The touch display driver chip can drive the display panel to display the image to be displayed according to the target refresh rate. In this way, the display device provided by the embodiment of the present application can dynamically adjust the screen refresh rate while ensuring the image display quality, improve the flexibility and timeliness of adjusting the refresh frequency, and save device power consumption.

[0027] In a fourth aspect, an embodiment of the present application provides an electronic device, which includes: a processor, a memory, and a display screen. The memory and the display screen are coupled to the processor. The display screen is used to display images, and the memory is used to store computer-readable instructions. When the processor reads the computer-readable instructions from the memory, the electronic device executes the display method described in the first aspect.

[0028] In the fifth aspect, an embodiment of the present application provides a chip system, which includes at least one processor and at least one interface circuit, the at least one interface circuit is used to perform transceiver functions and send instructions to at least one processor, the at least one processor executes instructions, and the at least one processor executes the display method described in the first aspect.

[0029] In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium, which includes a computer program. When the computer program runs on an electronic device, the electronic device executes the display method described in the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] FIG1 is a schematic structural diagram of a screen of an electronic device provided in an embodiment of the present application;

[0031] FIG2 is a schematic structural diagram of a smart watch provided in an embodiment of the present application;

[0032] FIG3 is a schematic diagram of the hardware structure of a smart watch provided in an embodiment of the present application;

[0033] FIG4 is a schematic diagram of the software structure of a smart watch provided in an embodiment of the present application;

[0034] FIG5 is a schematic diagram of a process of displaying an image on a smartwatch screen according to an embodiment of the present application;

[0035] FIG6 is a schematic diagram of a process of displaying an i-th frame image and a j-th frame image provided by an embodiment of the present application;

[0036] FIG7 is a schematic diagram of a process for determining a target refresh rate according to an embodiment of the present application;

[0037] FIG8 is a flow chart of an overwriting process according to an embodiment of the present application;

[0038] FIG9 is a schematic diagram of an interface for adaptively adjusting a refresh rate provided in an embodiment of the present application;

[0039] FIG10 is a schematic diagram of an interface of a prompt window provided in an embodiment of the present application;

[0040] FIG11 is a schematic diagram of an interface of a range control provided in an embodiment of the present application;

[0041] FIG12 is a first schematic diagram of a process for determining a target refresh rate by a host-side system on chip (SOC) according to an embodiment of the present application;

[0042] FIG13 is a second schematic diagram of a process for determining a target refresh rate by a host-side SOC according to an embodiment of the present application;

[0043] FIG14 is a schematic diagram of a process for generating an image to be displayed provided by an embodiment of the present application;

[0044] FIG15 is a schematic structural diagram of a wearable device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0045] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the present application, unless otherwise specified, " / " indicates that the objects associated before and after are in an "or" relationship. For example, A / B can represent A or B; "and / or" in the present application is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. In addition, in the description of the present application, unless otherwise specified, "multiple" refers to two or more than two. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple. In addition, in order to facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, words such as "first" and "second" are used to distinguish between identical or similar items with substantially the same functions and effects. Those skilled in the art will understand that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily limit differences. At the same time, in some embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete way for easy understanding.

[0046] In addition, the network architecture and business scenarios described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Ordinary technicians in this field can know that with the evolution of network architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0047] First, some of the terms and related technologies involved in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.

[0048] Touch and display driver integrated circuit (TDDIC): TDDIC is one of the main control components of the display panel. Its main function is to send driving signals and image data to the display panel in the form of electrical signals, so that the display panel can display images.

[0049] Figure 1 is a schematic diagram of the structure of an electronic device screen. Figure 1 uses an electronic device including two touch display driver chips 11 (e.g., touch display driver chip 1 and touch display driver chip 2) as an example. A display panel 10 is the display area of ​​the electronic device screen. The two touch display driver chips 11 (e.g., touch display driver chip 1 and touch display driver chip 2) are packaged beneath the screen. For example, the two touch display driver chips are directly bonded to a glass substrate using chip-on-glass packaging technology.

[0050] Screen refresh rate: This refers to the refresh rate of an electronic device's display, also known as the display's frame rate. It's a hardware performance parameter of an electronic device's display, representing the number of times the screen updates per second. The higher the refresh rate, the more times the screen refreshes the displayed image per second. Consequently, the interval between image refreshes decreases, resulting in smoother display.

[0051] Screen refresh rates are generally expressed in physical units of Hz. A display panel is composed of physical pixels. For example, if the resolution of a display is 1080 x 1920 progressive scanning (P), the display has 1080 x 1920 pixels. Each row of the display contains 1080 pixels, and each column of the display contains 1920 pixels. Displaying a row of 1080 pixels is called a row scan, while displaying 1920 rows of pixels is called a field scan. After the display scans a field, it can display a frame of image data.

[0052] The number of frames a display can refresh per second is how many frames it can display per second. For example, if the refresh rate of a display is 60 hertz (Hz), the screen refresh rate is 60 Hz, which means the display can refresh the image 60 times per second, or 60 frames per second.

[0053] Frame rate: This is the rate at which the graphics processing unit (GPU) in a system-on-chip (SOC) draws images per second. The higher the frame rate, the more images the GPU can draw, resulting in a smoother and more realistic display. Generally speaking, the frame rate is the number of frames the SOC generates per second. The refresh rate is the number of times the screen refreshes per second, which determines how many times the screen displays images per second.

[0054] The display panel is filled with physical pixels. For example, if the display resolution is 466*466 progressive scanning (P), the display has 466*466 pixels. Each row of the display contains 466 pixels, and each column of the display contains 466 pixels. Displaying 466 pixels in a row is called a row scan, and displaying 466 rows of pixels is called a field scan. The physical signal that starts the display scanning a row is called the horizontal synchronization signal (Hsync), and the physical signal that starts the display scanning a field is called the vertical synchronization signal (Vsync). After the display scans a field, it can display one frame of image. That is, the display can display one frame of image within one Vsync signal cycle.

[0055] The number of frames the display can refresh per second, that is, the number of frames the display can display per second, is the number of Vsync signals the smartwatch needs to generate per second. In other words, the number of Vsync signals generated per second by the smartwatch is the refresh rate of the display. For example, if the refresh rate of the display is 60Hz, the smartwatch needs to generate 60 Vsync signals per second. The Vsync signal can be generated by the hardware composer (HWC) in the smartwatch. After the HWC generates the Vsync signal, the SOC can send the image to be displayed to the TDDIC within the period of the Vsync signal.

[0056] Tearing effect signal (also described as TE signal): a signal generated by TDDIC, used to prevent tearing problems when the screen is refreshed during image display. The TE signal is a periodic signal. Electronic devices configured with MIPI's command control mode (command mode) generally synchronize and control the SOC frame rate and screen refresh rate based on the TE signal. The image drawing, rendering, synthesis and screen refresh display processes are synchronized based on the TE signal. In each cycle corresponding to the same TE signal, the SOC draws, renders and synthesizes one or more layers to obtain a frame of image, and transmits the image data packet to TDDIC through the MIPI interface. TDDIC unpacks the image data packet and refreshes the image.

[0057] With the continuous development of display technology for electronic devices such as mobile phones, more and more electronic devices' displays are able to support multiple refresh rates, such as 30Hz, 60Hz, and 90Hz. In other words, electronic devices' displays are able to support multiple levels of screen refresh rates.

[0058] Typically, a display screen displays images at a fixed frame rate. Therefore, in scenarios where the refresh rate requirement is not high, using a high refresh rate display screen can lead to high power consumption in electronic devices.

[0059] For example, the display supports a 60Hz refresh rate. When the processor of the electronic device is operating in sleep mode or power saving mode, the display of the electronic device still uses a 60Hz refresh rate to display images. For another example, when a static image needs to be displayed, the display of the electronic device still uses a 60Hz refresh rate to display images. This will increase the power consumption of the electronic device and reduce the user experience.

[0060] Based on the above content, an embodiment of the present application provides a display method and device, which can obtain an image to be displayed and determine a corresponding target refresh rate based on the pixel brightness information of the image to be displayed. The pixel brightness information of the image to be displayed is used to characterize the richness of the content contained in the image to be displayed. Then, the image to be displayed is displayed according to the target refresh rate. It can be understood that, generally, the richer the content in the image to be displayed, the greater the brightness of the corresponding pixel points, and the image to be displayed requires a higher screen refresh rate for subsequent display. Similarly, the simpler the content in the image to be displayed, the smaller the brightness of the corresponding pixel points, and the image to be displayed requires a lower screen refresh rate for subsequent display.

[0061] It can be seen that the embodiment of the present application can determine the target refresh rate applicable to the image to be displayed based on the pixel brightness information of the image to be displayed, and different images to be displayed correspond to different refresh rates. In other words, when the display content of the image to be displayed is relatively complex, a higher screen refresh rate can be used for display. When the display content of the image to be displayed is relatively simple, a lower screen refresh rate can be used for display. In this way, the method provided by the embodiment of the present application can dynamically adjust the screen refresh rate while ensuring the image display quality, improve the flexibility and timeliness of adjusting the refresh frequency, and save device power consumption.

[0062] The display method provided in the embodiments of the present application can be applied to electronic devices. In some embodiments, the electronic devices may include, for example, mobile phones, tablet computers, personal computers (PCs), personal digital assistants (PDAs), smart watches, netbooks, wearable devices, augmented reality (AR) devices, virtual reality (VR) devices, in-vehicle devices, smart screens, smart cars, smart speakers, and robots, etc. The specific form of the electronic devices is not particularly limited in this application.

[0063] For example, taking a smartwatch as an example, FIG2 shows a schematic diagram of the structure of a smartwatch provided by an embodiment of the present application. The smartwatch can be worn on a user's wrist. The smartwatch may include a display 103 and a fixing strap 104. The display 103 is used to display the time and display other related content when the user touches and clicks. The fixing strap 104 is used to secure the smartwatch to the user's wrist.

[0064] For example, FIG3 takes a smartwatch as an example, showing a hardware structure diagram of an electronic device provided by an embodiment of the present application. Referring to FIG3 , the smartwatch may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a microphone 170B, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, and a display 194, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L and a bone conduction sensor 180M, etc.

[0065] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on smart watches. In other embodiments of this application, the smart watch may include more or fewer components than shown in the figure, or some components may be combined, some components may be separated, or the components may be arranged differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0066] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0067] In some examples, the processor 110 may be a system-on-chip (SOC) for a smartwatch. In some embodiments, the SOC may perform layer drawing, rendering, and synthesis of images to be displayed. Specifically, the SOC may control the GPU to perform layer drawing, rendering, and synthesis, and transmit (write) the image data corresponding to the synthesized image to be displayed to the TDDIC via the MIPI interface, so that the TDDIC can subsequently control the display screen 194 to display the image to be displayed based on the screen refresh rate.

[0068] The controller can be the nerve center and command center of the smartwatch. It can generate operation control signals based on instruction opcodes and timing signals to complete the control of instruction fetching and execution.

[0069] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0070] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0071] Among them, the MIPI interface can be used to connect the processor 110 with peripheral devices such as the display 194 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the smart watch's camera function. The processor 110 and the display 194 communicate via the DSI interface to implement the smart watch's display function.

[0072] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely illustrative and does not constitute a structural limitation on the smart watch. In other embodiments of the present application, the smart watch may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0073] The wireless communication function of the smart watch can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0074] The wireless communication module 160 can provide wireless communication solutions for smart watches, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0075] The smartwatch implements its display functionality through a GPU, display 194, and an application processor. The GPU is a microprocessor for image processing that connects the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and render graphics. The processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0076] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED).

[0077] In some embodiments, the display screen 194 may receive the image data of the image to be displayed and the target refresh rate corresponding to the image to be displayed sent by the TDDIC, and then the display screen 194 may display and refresh the image to be displayed according to the target refresh rate corresponding to the image to be displayed.

[0078] In some embodiments, the smart watch may include 1 or N display screens 194 , where N is a positive integer greater than 1.

[0079] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes the instructions stored in the internal memory 121 to execute various functional applications and data processing of the smart watch.

[0080] The internal memory 121 may include a program storage area and a data storage area. The program storage area may store an operating system, at least one application required for a function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the smartwatch (such as audio data, a phone book, etc.). In addition, the internal memory 121 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0081] It is understandable that, generally speaking, the realization of smart watch functions requires not only hardware support but also software cooperation.

[0082] The software system of the smartwatch can adopt a layered architecture, event-driven architecture, micro-kernel architecture, micro-service architecture, or cloud architecture. Taking the system as an example, the software structure of the smart watch is illustrated.

[0083] FIG4 is a software structure block diagram of the smart watch according to an embodiment of the present application.

[0084] The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, The system is divided into four layers, from top to bottom: application layer, application framework layer, Android runtime layer ( runtime) and system libraries and kernel layer.

[0085] The application layer can include a series of application packages.

[0086] As shown in FIG4 , the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.

[0087] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0088] As shown in FIG4 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0089] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0090] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0091] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0092] The phone manager is used to provide communication functions for the smartwatch, such as managing call status (including answering, hanging up, etc.).

[0093] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0094] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically, without requiring user interaction. For example, the Notification Manager can be used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeping sounds, vibrating smartwatches, and flashing indicator lights.

[0095] Runtime includes core libraries and virtual machines. Runtime is responsible System scheduling and management.

[0096] The core library consists of two parts: one is the function that the Java language needs to call, and the other is The core library.

[0097] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0098] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0099] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0100] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0101] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0102] A 2D graphics engine is a drawing engine for 2D drawings.

[0103] The kernel layer is the layer between hardware and software. It includes at least a display driver, a camera driver, an audio driver, and a sensor driver. In some embodiments, the kernel layer's display driver can send (write) image data corresponding to the image to be displayed to the TDDIC via the MIPI interface, allowing the TDDIC to subsequently control the display to display the image based on the screen refresh rate.

[0104] Illustratively, the technical solutions involved in the following embodiments can all be implemented in an electronic device having the above hardware architecture.

[0105] A display method provided in an embodiment of the present application can be applied to an electronic device with a display screen. Taking a smartwatch as an example, the display method provided in an embodiment of the present application is described in detail below with reference to the accompanying drawings.

[0106] In order to facilitate understanding of the technical content of this application, the specific process of displaying images on the smart watch screen is first introduced below.

[0107] In an embodiment of the present application, referring to FIG5 , the microcontroller unit (MCU) in the SOC in the smartwatch can control the GPU to draw, render, and synthesize layers, and send the synthesized image data to (write to) the TDDIC via the MIPI interface. The MCU in the TDDIC stores the image data in the static random-access memory (SRAM) via the memory controller. Then, the MCU of the TDDIC scans the image data in the SRAM and restores the digital image data into a continuous voltage signal to drive the Panel, thereby achieving the purpose of displaying and refreshing the image. In other words, the image displayed by the Panel comes from the MCU in the TDDIC that controls the MIPI to send the image to each frame of the SOC.

[0108] In some embodiments of the present application, the smartwatch may obtain an i-th frame of image to be displayed, where i is an integer not less than 1. The image to be displayed is an image that currently needs to be displayed.

[0109] Typically, the dial of a smartwatch is an electronic display, allowing users to interact with the smartwatch through the interactive interface displayed on the dial. It is understood that the smartwatch's interactive interface can display multiple frames during the display process. A frame is a single image, the smallest unit in an image animation. A frame is a still image, while consecutive frames form an animation, such as a dynamic image. In this way, a smartwatch can display multiple frames in rapid succession to form an interactive interface.

[0110] For example, taking the user launching the first application as an example, after the user launches the first application, the display screen of the smartwatch will display the corresponding interactive interface of the first application.

[0111] When displaying the interactive interface corresponding to the first application, the smartwatch draws and displays multiple frames of images. The SOC can control the first application to call the MCU and GPU to draw and render the image, and then synthesize the drawn images through the layer integrator (Surface Flinger) to obtain the image corresponding to the interactive interface. For example, if the SOC frame rate is 60, then the SOC can draw and generate 60 frames of images per second, which is convenient for subsequent display on the display screen.

[0112] It is understood that the SOC can start drawing and rendering the i-th frame image by calling the MCU and GPU. Then the layer integrator starts synthesizing the i-th frame image. Then, the SOC can obtain the i-th frame image to be displayed.

[0113] In some embodiments of the present application, referring to FIG6 (A), after the SOC in the smartwatch generates the i-th frame of image to be displayed, the image data corresponding to the i-th frame of image can be sent to the TDDIC via the MIPI interface. The MCU in the TDDIC stores the image data corresponding to the i-th frame of image in the SRAM via the memory controller.

[0114] For example, when the refresh rate of a smartwatch is 60Hz, the corresponding tearing effect signal (such as the TE1 signal) has a period of 16.66ms. The SOC can draw, render, and synthesize the image based on the TE1 signal in 16.66ms, obtain the i-th frame image, and transmit the image data corresponding to the i-th frame image to the TDDIC. When the SOC receives the next TE1 signal, it draws the image again to obtain the image data corresponding to the next frame image, and sends the image data corresponding to the next frame image to the TDDIC.

[0115] In some embodiments of the present application, after the smart watch obtains the i-th frame image to be displayed, it can display the i-th frame image according to the initial refresh rate.

[0116] Specifically, after the SOC sends the image data corresponding to the i-th frame image to the TDDIC, the TDDIC can refresh and display the i-th frame image. Correspondingly, the MCU of the TDDIC can scan the image data corresponding to the i-th frame image from the SRAM within 16.66ms according to the TE1 signal, and convert the image data corresponding to the i-th frame image in the form of a digital signal into a continuous voltage signal. Then, the MCU sends the voltage signal and the initial refresh rate to the Panel to drive the Panel. The Panel then displays and refreshes the i-th frame image according to the initial refresh rate to realize the process of screen display and image refresh. When the TDDIC MCU receives the next TE1 signal, it can refresh and display the next frame image (that is, the next frame image sent by the SOC). It can be understood that, taking the screen refresh rate of a smart watch as an example of 60Hz, the initial refresh rate is 60Hz.

[0117] In some embodiments of the present application, the image data of the image to be displayed may include the resolution of the image to be displayed, the three-channel value of each pixel, and the like. The image channel refers to the separate red, green, and blue parts in the RGB color mode. In other words, a complete image is composed of the three channels of red, green, and blue, which work together to produce a complete image. For a complete image, the three channels of red, green, and blue are indispensable. It is understandable that even if there seems to be no blue in the image, it can only be said that the brightness of the blue light is 0 or the red and green channels of each pixel value are not all 0, but it cannot be said that there is no blue channel.

[0118] In some embodiments of the present application, a smartwatch may acquire a first image and determine a target refresh rate based on pixel brightness information of the first image. The pixel brightness information of the first image is used to represent the richness of the content contained in the first image. The smartwatch may then display the first image based on the target refresh rate.

[0119] For example, referring to (B) in FIG6 , the smartwatch may continue to acquire the j-th frame image to be displayed, where j is an integer not less than 1. The smartwatch may then determine the target refresh rate based on the pixel brightness information of the j-th frame image to be displayed. It should be noted that the j-th frame image may be an adjacent frame image of the i-th frame image, and there may also be other frame images between the j-th frame image and the i-th frame image. This embodiment of the present application does not specifically limit this.

[0120] Continuing with the example of a smartwatch with a refresh rate of 60Hz and the j-th frame image being the next frame image of the i-th frame image, the period of the tearing effect signal (such as the TE1 signal) is still 16.66ms. The SOC can continue to draw, render, and synthesize the image at 16.66ms according to the TE2 signal to obtain the j-th frame image to be displayed, and transmit the image data corresponding to the j-th frame image to the TDDIC. Then, after receiving the image data corresponding to the j-th frame image, the TDDIC can analyze the image data corresponding to the j-th frame image to obtain the pixel brightness information of the j-th frame image to be displayed. And the TDDIC determines the target refresh rate based on the pixel brightness information of the j-th frame image to be displayed.

[0121] Specifically, the MCU in the TDDIC can read the image data corresponding to the j-th frame image from the SRAM and, based on the image data corresponding to the j-th frame image, obtain the target area corresponding to the pixels in the j-th frame image. The target area is used to represent the area occupied by pixels in the j-th frame image whose brightness values ​​are greater than a preset threshold. Next, the MCU in the TDDIC calculates the target ratio of the area of ​​the target area to the image area of ​​the j-th frame image. Then, the MCU in the TDDIC determines the target refresh rate based on the target ratio.

[0122] 7 , when the target ratio is greater than or equal to the first preset value, the target refresh rate is determined to be the first refresh rate. Alternatively, when the target ratio is less than the first preset value, the target refresh rate is determined to be the second refresh rate. The first refresh rate is greater than the second refresh rate.

[0123] In one implementable manner, the preset threshold may be 0. TDDIC may calculate the brightness value corresponding to each pixel point based on the image data corresponding to the j-th frame image, and obtain the target area corresponding to the j-th frame image.

[0124] For example, TDDIC can convert the three-channel image values ​​of each pixel in the jth frame into the brightness value of each pixel. TDDIC then compares the brightness value of each pixel with a preset threshold and identifies pixels with a brightness value greater than 0 as luminous pixels. It is understood that the target area can include an area corresponding to at least one luminous pixel.

[0125] Next, TDDIC calculates the ratio of the target area to the image area of ​​the jth frame. For example, if the jth frame has a length of 8 pixels and a width of 8 pixels, then the image area of ​​the jth frame is 64. If the number of luminous pixels is 32, the target area is also 32. Therefore, the target ratio of the target area to the image area of ​​the jth frame is 0.5.

[0126] Then, TDDIC determines the target refresh rate based on the target ratio of 0.5. For example, the first preset value is 0.25. The first refresh rate is 30 Hz, and the second refresh rate is 1 Hz.

[0127] When the target ratio of the j-th frame image is 0.5, the target ratio is greater than the first preset value, and the target refresh rate is determined to be 30 Hz. When the target ratio of the j-th frame image is 0.1, the target ratio of the j-th frame image is less than the first preset value, and the target refresh rate is determined to be 1 Hz.

[0128] It is important that the first refresh rate proposed in the embodiment of the present application needs to be greater than the second refresh rate. It is understandable that the pixel brightness information of the image is used to characterize the richness of the content contained in the image. The more pixels in the image whose brightness values ​​are greater than the preset threshold, the richer the content contained in the image. Then, when the more pixels in the image whose brightness values ​​are greater than the preset threshold, the larger the area corresponding to the target area, and thus the larger the target ratio of the image. When the target ratio of the image is larger, a higher refresh rate is required to refresh the image to ensure that it is displayed completely and smoothly.

[0129] Conversely, when fewer pixels in an image have brightness values ​​greater than a preset threshold, the image's content is less rich. Consequently, when fewer pixels in an image have brightness values ​​greater than the preset threshold, the target region's corresponding area becomes smaller, and the image's target ratio decreases. When the image's target ratio decreases, a high refresh rate is not required to refresh the image. This ensures a complete and smooth display while saving device power consumption.

[0130] In this way, the embodiment of the present application can display images containing complex content at a high refresh rate and images containing simple content at a low refresh rate, thereby adaptively adjusting the screen refresh rate. This can save device power consumption while ensuring image display quality.

[0131] It should be noted that the embodiments of the present application do not specifically limit the numerical values ​​corresponding to the preset threshold, the first preset value, the first refresh rate, and the second refresh rate. Furthermore, the number of preset values ​​may be one or more, and the target refresh rate may be determined from a plurality of refresh rates. The embodiments of the present application do not specifically limit the number of preset values, the first refresh rate, and the second refresh rate.

[0132] In other embodiments of the present application, the target refresh rate may be an optimal refresh rate corresponding to the image. Optionally, the optimal refresh rate may be a fixed refresh rate. Alternatively, it may be a dynamically changing refresh rate. The optimal refresh rate may be pre-set in the TDDIC and support dynamic updating. It is understood that the TDDIC may determine a target refresh rate suitable for the current image to be displayed from a number of refresh rates.

[0133] Exemplarily, the first refresh rate may include a value between 10-30 Hz. When the target ratio value of the j-th frame image is 0.5, the target ratio value of the j-th frame image is greater than the first preset value, and the target refresh rate for the j-th frame image is determined to be 20 Hz from the first refresh rate. When the target ratio value of the j-th frame image is 0.8, the target ratio value of the j-th frame image is greater than the first preset value, and the target refresh rate for the j-th frame image is determined to be 30 Hz from the first refresh rate.

[0134] As another example, the second refresh rate may include a value between 0 and 10 Hz. When the target ratio of the j-th frame image is 0.1, the target ratio corresponding to the pixel brightness information of the j-th frame image is less than the first preset value, and the target refresh rate for the j-th frame image is determined to be 1 Hz from the second refresh rate. When the target ratio of the j-th frame image is 0.2, the target ratio corresponding to the pixel brightness information of the j-th frame image is less than the first preset value, and the target refresh rate for the j-th frame image is determined to be 8 Hz from the second refresh rate.

[0135] It can be seen that the embodiment of the present application can determine the target refresh rate applicable to the current image based on the pixel brightness information of the image, and different images correspond to different refresh rates. The image can also be displayed based on the target refresh rate later. Specifically, the process of determining the target refresh rate in this solution is executed by the TDDIC, without relying on the SOC to participate in control and regulation. The TDDIC can determine the corresponding target refresh rate for each frame of the image and adjust the refresh rate frame by frame. This improves the flexibility and timeliness of adjusting the refresh rate and saves device power consumption.

[0136] In actual application, in addition to the need to achieve high refresh rate in high frame rate games, high refresh rate can also be mainly used in a small number of fast sliding scenarios such as desktop sliding and album browsing. This can improve the smoothness of the picture when the user performs a fast sliding operation. It can be imagined that the proportion of time occupied by fast sliding in actual applications is relatively small, and most usage scenarios are still static display, low-speed sliding and low-frame rate video playback scenarios. These scenarios use low refresh rate and low frame rate to ensure the smoothness of the picture, reduce power consumption and improve battery life. It can be seen that the display method provided in the embodiment of the present application can be applied in different scenarios.

[0137] In other embodiments of the present application, the smartwatch can also determine the current display scene based on the pixel brightness information of the jth frame image. Then, the smartwatch can determine the target refresh rate based on the current display scene, and different display scenes correspond to different refresh rates.

[0138] Display scenes include static display scenes and dynamic display scenes. Static display scenes can include image display scenes, text display scenes, always-on display scenes, and low-speed sliding scenes, etc. Dynamic display scenes include video playback scenes, game scenes, high-speed sliding scenes, etc.

[0139] In one implementation, when the current display scene is a static display scene, the sixth refresh rate is determined as the target refresh rate, which is the highest refresh rate in static display scenes. When the current display scene is a dynamic display scene, the seventh refresh rate is determined as the target refresh rate, which is the highest refresh rate in dynamic display scenes; the seventh refresh rate is greater than the sixth refresh rate.

[0140] As can be seen, the embodiments of the present application can also determine the corresponding display scene based on the pixel brightness information of the image. This can then determine the target refresh rate for the current image, with different refresh rates corresponding to different display scenes. The subsequent refresh frequency is determined based on the display scene determination result, and the refresh rate can be dynamically adjusted according to the image content. This facilitates the subsequent reduction of power consumption of the smartwatch while ensuring display quality in different display scenes.

[0141] In some embodiments of the present application, referring to (B) in FIG. 6 , the smartwatch may display the j-th frame image according to the target refresh rate.

[0142] Specifically, after the MCU in the TDDIC determines the target refresh rate for the jth frame image, it can send the target refresh rate and the image data of the jth frame image to the panel. The panel then refreshes and displays the jth frame image based on the target refresh rate and the image data of the jth frame image.

[0143] For example, after the MCU in the TDDIC determines that the target refresh rate for the j-th frame image is 30 Hz, it can send the 30 Hz and image data of the j-th frame image to the panel. The panel then refreshes and displays the j-th frame image at 30 Hz.

[0144] In one implementation, after the MCU in the TDDIC determines the target refresh rate for the jth image frame, it can also send a refresh rate switching instruction and the image data of the jth image frame to the panel. The refresh rate switching instruction instructs the panel to switch the refresh rate from the initial refresh rate to the target refresh rate. The panel then receives the refresh rate switching instruction and refreshes and displays the jth image frame based on the target refresh rate and the image data of the jth image frame.

[0145] For example, after the MCU in the TDDIC determines that the target refresh rate for the jth image frame is 30Hz, it can send a refresh rate switching instruction and the image data for the jth image frame to the panel. The refresh rate switching instruction instructs the panel to switch the refresh rate from 60Hz to 30Hz. The panel then refreshes and displays the jth image frame at 30Hz.

[0146] In some embodiments of the present application, when the panel is refreshing the jth frame image, it will overwrite the next frame image in real time to facilitate the subsequent display of the next frame image. Usually, the panel overwrites from the bottom end face to the top end face.

[0147] For example, referring to FIG8 (A), for example, the j-th frame image includes the letter A. Thus, when the panel refreshes and displays the j-th frame image, the letter A will be displayed from the bottom end surface to the top end surface, as shown in FIG8 (B).

[0148] It can be expected that when the target refresh rate of the screen is higher, the image drawing and transmission cycle is shorter, and thus the panel overwriting cycle is shorter, and the speed can be faster. Similarly, when the target refresh rate of the screen is lower, the image data drawing and transmission cycle is longer, and thus the panel overwriting cycle is longer, and the speed can be slower.

[0149] As can be seen, the entire screen refresh rate adjustment process in this embodiment is actively performed by the TDDIC. The TDDIC can dynamically adjust the screen refresh rate based on the pixel brightness information corresponding to the displayed image. This allows for adaptive adjustment of the screen refresh rate to different image modulations without relying on the SOC for data processing and control. This improves the flexibility of the screen refresh rate when displaying images and saves device power.

[0150] In some embodiments of the present application, the smart watch can detect the first trigger operation and determine the target refresh rate based on the pixel brightness information of the j-th frame image to be displayed.

[0151] It is understood that the TDDIC in the embodiments of the present application can automatically determine the target refresh rate based on the pixel brightness information of each frame of the image. Of course, the TDDIC can also determine the target refresh rate based on the pixel brightness information of each frame of the image after detecting a trigger operation input by the user. In other words, the smartwatch can refresh and display the i-th frame of the image at the initial refresh rate, and then refresh and display the j-th frame of the image at the target refresh rate after detecting a trigger operation input by the user.

[0152] The first triggering operation may be a pre-set operation that can trigger the smartwatch to switch the refresh rate. The first triggering operation may include certain user shortcut operations, such as shortcut operations through gestures, touch, or key combination shortcut keys. The first triggering operation may also include a user's voice command.

[0153] In one possible implementation, referring to (A) in FIG9 , the smartwatch currently displays an interface, and the user can perform a touch operation when wanting to interact with the smartwatch to update the dial interface currently displayed on the smartwatch. Referring to (B) in FIG9 , after the smartwatch detects the touch operation, it displays the updated dial interface in response to the touch operation. For example, the user clicks on the content control displayed on the display screen, or the user slides along the end surface of the display screen. The updated dial interface can be the home screen interface of the smartwatch, and a settings application icon is displayed on the home screen interface of the smartwatch, and the user can click on the settings application icon.

[0154] As shown in FIG9 (C), in response to a user clicking the settings app icon, the smartwatch displays the user interface of the settings app. The settings app displays a list of all functions installed on the smartwatch, such as Bluetooth, display and brightness, and wireless LAN. The user can click the display and brightness function in the list to access the corresponding property page for the display and brightness function.

[0155] As shown in FIG9 (D), the smartwatch displays a property page corresponding to the brightness function, which includes a refresh rate adjustment control. The user can click the refresh rate adjustment control to control whether the phone performs the screen refresh rate adjustment function. As shown in FIG9 (E), the smartwatch triggers the process of adaptively adjusting the screen refresh rate in response to the user clicking the refresh rate adjustment control.

[0156] In some embodiments of the present application, the smart watch can detect the second trigger operation and switch the screen refresh rate from the target refresh rate to the initial refresh rate.

[0157] The second trigger operation and the first trigger operation may be the same operation or different operations. The embodiment of the present application does not limit the specific implementation of the first trigger operation and the second trigger operation.

[0158] For example, referring to (F) in FIG9 , the smartwatch triggers the cessation of the process of adaptively adjusting the screen refresh rate in response to the user clicking the control for adjusting the refresh rate. In other words, the smartwatch may stop the process of adaptively adjusting the screen refresh rate according to the frame image to be displayed after detecting the second triggering operation input by the user.

[0159] In some embodiments of the present application, after detecting the first triggering operation, the smartwatch may further output a first prompt message. The first prompt message is used to indicate that adaptive adjustment of the screen refresh rate has been enabled. The first prompt message also corresponds to a first prompt control, which may be implemented as the text "Adaptive adjustment of the screen refresh rate has been enabled."

[0160] Exemplarily, the user clicks on the refresh rate adjustment control, and the smart watch responds to the click operation, triggers the process of adaptively adjusting the screen refresh rate, and displays the first prompt window as shown in (A) in Figure 10, where the first prompt window includes the above-mentioned first prompt control.

[0161] Similarly, in some embodiments of the present application, referring to (B) in FIG10 , the user can perform a second trigger operation on the refresh rate adjustment control, and the smartwatch can further output a second prompt message after detecting the second trigger operation. The second prompt message is used to prompt that the adaptive adjustment of the screen refresh rate has stopped. The second prompt message also corresponds to a second prompt control, which can be implemented as the text "Adaptive adjustment of the screen refresh rate has stopped."

[0162] Exemplarily, the user clicks on the refresh rate adjustment control again, and the smart watch responds to the click operation, triggers the stop of the process of adaptively adjusting the screen refresh rate, and displays a second prompt window as shown in (C) in Figure 10, where the second prompt window includes the above-mentioned second prompt control.

[0163] It can be seen that the smart watch provided in the embodiment of the present application can adaptively adjust the screen refresh rate according to the image to be displayed after detecting the first trigger operation input by the user. In other words, the smart watch can display the image at the initial screen refresh rate when the user has not input the first trigger operation. As long as the smart watch detects the first trigger operation input by the user, it can adaptively adjust the screen refresh rate according to the image to be displayed. The user can control the process of turning on and off the smart watch's adaptive adjustment of the screen refresh rate anytime and anywhere. The interactivity between the user and the smart watch is improved, and the user can support the process of setting the screen refresh rate, thereby reducing the power consumption of the smart watch. This improves the user's experience.

[0164] In another possible implementation, the property page corresponding to the brightness function may include a refresh rate control for switching the refresh rate, wherein the property page corresponding to the brightness function may be configured with multiple range controls corresponding to different refresh rates. For example, as shown in (A) in Figure 11, a first range control corresponding to 0-10Hz and a second range control corresponding to 0-60Hz are shown. It should be understood that the smartwatch can achieve multiple refresh rates, and the embodiment of the present application does not specifically limit the number and value of refresh rate ranges.

[0165] For example, the current screen refresh rate of the smartwatch is 30 Hz. The smartwatch receives an operation of a user clicking the first range control, and in response to the operation, determines a target refresh rate based on pixel brightness information of the jth frame image to be displayed.

[0166] In one achievable embodiment, referring to FIG11 (B), the smartwatch detects a user's operation on a first range control and adaptively determines a target refresh rate based on pixel brightness information of the jth frame of image to be displayed. The target refresh rate can be any refresh rate between 0 and 10 Hz.

[0167] It is understandable that the user can set the range of the screen refresh rate in advance. For example, when a user is about to use the album application to view a static picture, he can click the first range control to set a relatively low screen refresh rate. That is, in static display and low-speed sliding scenarios, the smart watch can control the screen refresh rate within the range of 0-10Hz based on the pixel brightness information of the j-th frame image. When the ratio corresponding to the pixel brightness information of the j-th frame image is larger, the determined target refresh rate can be higher, such as 10Hz. When the ratio corresponding to the pixel brightness information of the j-th frame image is smaller, the determined target refresh rate can be lower, such as 1Hz.

[0168] For another example, the current screen refresh rate of the smartwatch is 30 Hz. The smartwatch receives a user click operation on the second range control, and in response to the operation, determines a target refresh rate based on pixel brightness information of the j-th frame image.

[0169] In another possible implementation, the smartwatch can detect the user's operation on the second range control and adaptively determine the target refresh rate based on the pixel brightness information of the jth frame image to be displayed. The target refresh rate can be any refresh rate between 0-60 Hz.

[0170] For example, when a user is about to use a video application to view a video file, he or she can click the second range control to set a relatively high screen refresh rate. That is, in dynamic display and high-speed sliding scenarios, the smartwatch can control the screen refresh rate within the range of 0-60Hz based on the pixel brightness information of the j-th frame image. When the target ratio corresponding to the pixel brightness information of the j-th frame image is larger, the determined target refresh rate is higher, such as 60Hz. When the target ratio corresponding to the pixel brightness information of the j-th frame image is smaller, the determined target refresh rate is lower, such as 10Hz.

[0171] It can be seen that the smartwatch provided in the embodiment of the present application can support users to set screen refresh rates in different ranges and display images using screen refresh rates in different ranges. Users can pre-set the screen refresh rate that suits the scene according to their needs, setting a low refresh rate in scenes that do not require a high refresh rate, and setting a high refresh rate in scenes that require a high refresh rate. Furthermore, while improving the interactivity between the user and the smartwatch, it can also reduce the power consumption of the smartwatch and enhance the user experience.

[0172] In some embodiments of the present application, the host-side SOC may also determine the target refresh rate based on pixel brightness information of the j-th frame image to be displayed.

[0173] In one implementation, referring to FIG12 , if the host-side SOC does not write image data to the SRAM in the TDDIC, the MCU in the SOC can read the image data of the j-th frame from the buffer and calculate the pixel brightness information of the j-th frame based on the image data of the j-th frame. The MCU in the SOC then determines the target refresh rate based on the pixel brightness information of the j-th frame to be displayed.

[0174] The MCU in the SOC then sends the target refresh rate and the image data for the jth frame to the MCU in the TDDIC. The MCU in the TDDIC then directly sends the target refresh rate and the image data for the jth frame to the panel. The panel refreshes and displays the jth frame based on the target refresh rate and the image data for the jth frame.

[0175] In another possible implementation, referring to FIG13 , after the host-side SOC has written image data to the SRAM in the TDDIC, the MCU in the SOC can read the image data for the jth frame from the SRAM in the TDDIC and calculate the pixel brightness information for the jth frame based on the image data. The MCU in the SOC then determines the target refresh rate based on the pixel brightness information for the jth frame to be displayed.

[0176] The MCU in the SOC then sends the target refresh rate and the image data for the jth frame to the MCU in the TDDIC. The MCU in the TDDIC then directly sends the target refresh rate and the image data for the jth frame to the panel. The panel refreshes and displays the jth frame based on the target refresh rate and the image data for the jth frame.

[0177] It can be seen that in the process of adaptively adjusting the screen refresh rate in the embodiment of the present application, there is no need for TDDIC control, and only the host-side SOC macro-control is required. The SOC can dynamically adjust the refresh rate of the screen based on the pixel brightness information corresponding to the displayed image. Because the host-side SOC has a more powerful control capability than the TDDIC, the SOC's processing efficiency is higher during the process of adaptively adjusting the screen refresh rate. This improves the efficiency of adjusting the screen refresh rate while reducing device power consumption.

[0178] In some embodiments of the present application, the smartwatch may further pre-divide the image to be displayed into M image regions, where M is an integer not less than 1. The smartwatch may then refresh and display the M image regions at corresponding screen refresh rates, where different image regions correspond to different screen refresh rates.

[0179] Specifically, the MCU in the TDDIC can determine the corresponding screen refresh rate according to the pixel brightness information corresponding to the M image areas.

[0180] Exemplarily, the MCU in the TDDIC acquires a second image and divides the second image into regions. The second image includes a first image region and a second image region, and the first image region and the second image region do not overlap. Next, the MCU in the TDDIC determines a third refresh rate based on the pixel brightness information of the first image region, and determines a fourth refresh rate based on the pixel brightness information of the second image region. The MCU in the TDDIC then transmits the third refresh rate, the fourth refresh rate, and the image data of the first image region and the image data of the second image region to the panel, causing the panel to refresh and display the first image region and the second image region.

[0181] It should be noted that, in the process of pre-dividing the image to be displayed, the MCU in the TDDIC can obtain M image regions of equal area or M image regions of different areas. The M image regions can be arranged and combined horizontally and vertically, or arranged and combined in an enclosed manner. The embodiments of the present application do not specifically limit the specific implementation method of the region division.

[0182] It can be seen that when the target ratio corresponding to the pixel brightness information of a certain image area is larger, the screen refresh rate of that image area is higher. Conversely, when the target ratio corresponding to the pixel brightness information of a certain image area is smaller, the screen refresh rate of that image area is lower. The embodiments of the present application can display the entire image at different refresh rates in different image areas. The refresh rate of different areas in an image can be adjusted more accurately, which increases the flexibility of adjusting the screen refresh rate and reduces the power consumption of the device.

[0183] In some embodiments of the present application, when a smartwatch displays an image corresponding to a customized dial, the image content of each frame of the image will not change much. For example, when the smartwatch is in sleep mode, power saving mode, or displaying a lock screen image, the image content of each frame of the image mostly only needs to change the time content. In this way, the smartwatch can store an initial background image and generate an image to be displayed based on the initial background image. The initial background image may include a pointer image and preset images (wallpaper images, dial images, and customized images set by the user).

[0184] Specifically, the smartwatch may acquire a third image, which includes a preset initial background image. The smartwatch may then generate a fourth image based on the first moment and the third image; the first moment represents the time when the fourth image was generated. Similarly, the smartwatch may determine a fifth refresh rate based on pixel brightness information of the fourth image, and display the fourth image at the fifth refresh rate.

[0185] For example, referring to FIG14 , an initial background image can be pre-stored in the SRAM of the TDDIC. The TDDIC does not need to receive the image sent by the SOC in real time. The MCU in the TDDIC can obtain the first moment from the built-in clock (CLK) and generate the image to be displayed based on the first moment and the initial background image.

[0186] For example, the MCU in the TDDIC retrieves the dial image from the SRAM, which includes the initial pointer image. It is understandable that the initial pointer image in the dial image is a template image, and the corresponding time content in the dial image is continuously changing. The MCU in the TDDIC needs to update the initial pointer image. In this way, after the MCU in the TDDIC retrieves the dial image from the SRAM, it can obtain the first moment from the CLK and update the initial pointer image based on the first moment to generate the image to be displayed. The first moment is used to represent the time when the image to be displayed is generated.

[0187] Then, after the MCU in the TDDIC generates the image to be displayed, it can determine the target refresh rate based on the pixel brightness information of the image to be displayed, and control the panel to refresh the image to be displayed according to the target refresh rate.

[0188] It should be noted that the SRAM of the TDDIC may pre-store an initial background image or the first frame image obtained by the TDDIC from the SOC.

[0189] In some embodiments of the present application, when the MCU in the TDDIC generates and refreshes images, the clock frequency of the CLK in the TDDIC may be inconsistent with the clock frequency of the CLK in the SOC, resulting in a time desynchronization between the CLK in the TDDIC and the CLK in the SOC. Therefore, the CLK in the TDDIC needs to be synchronized with the CLK in the SOC.

[0190] Specifically, the TDDIC's MCU can obtain the second time from the CLK in the SOC within a certain preset period and send a synchronization time instruction to the CLK. The synchronization time instruction is used to instruct the CLK in the TDDIC to synchronize the time to the second time, thereby achieving the synchronization of the CLK in the TDDIC and the CLK in the SOC.

[0191] It can be seen that the embodiment of the present application does not rely on the host-side SOC to send images to the TDDIC in real time. The TDDIC can generate the image to be displayed and dynamically refresh the image. It only needs to periodically synchronize with the SOC, saving the power consumption of the SOC.

[0192] An embodiment of the present application further provides a wearable device, such as the above-mentioned smart watch. As shown in FIG15 , the wearable device may include one or more processors 1510 , a memory 1520 and a communication interface 1530 .

[0193] The memory 1520 and the communication interface 1530 are coupled to the processor 1510. For example, the memory 1520, the communication interface 1530 and the processor 1510 may be coupled together via a bus 1540.

[0194] The communication interface 1530 is used to transmit data with other devices. The memory 1520 stores computer program code. The computer program code includes computer instructions. When the computer instructions are executed by the processor 1510, the wearable device executes the dial interface display method of the embodiment of the present application.

[0195] The processor 1510 may be a processor or a controller, such as a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the present disclosure. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0196] Bus 1540 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. Bus 1540 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, FIG15 shows only one thick line, but this does not necessarily mean that there is only one bus or only one type of bus.

[0197] An embodiment of the present application also provides an electronic device, which includes a memory and one or more processors; the memory is coupled to the processor; wherein computer program code is stored in the memory, and the computer program code includes computer instructions, and when the computer instructions are executed by the processor, the electronic device executes the relevant method steps in the above method embodiment.

[0198] An embodiment of the present application further provides a computer-readable storage medium, in which computer program code is stored. When the processor executes the computer program code, the electronic device executes the relevant method steps in the above method embodiment.

[0199] An embodiment of the present application further provides a computer program product, which, when executed on a computer, enables the computer to execute the relevant method steps in the above method embodiment.

[0200] An embodiment of the present application also provides a display device, which includes a system-level chip, a touch display driver chip and a display panel. The system-level chip is used to obtain a first image. The system-level chip is also used to determine a target refresh rate based on the pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of the content contained in the first image. The system-level chip is also used to send the target refresh rate and the first image to the touch display driver chip and the touch display driver chip, which is used to drive the display panel to display the first image according to the target refresh rate. The display panel is used to display the first image according to the target refresh rate.

[0201] An embodiment of the present application also provides a display device, which includes a system-level chip, a touch display driver chip and a display panel. The system-level chip is used to obtain a first image. The system-level chip is also used to send the first image to the touch display driver chip. The touch display driver chip is used to determine the target refresh rate based on the pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of the content contained in the first image. The touch display driver chip is also used to drive the display panel to display the first image according to the target refresh rate. The display panel is used to display the first image according to the target refresh rate.

[0202] Among them, the wearable device, computer storage medium, display device or computer program product provided in this application is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0203] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0204] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0205] Units described as separate components may or may not be physically separate, and components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0206] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0207] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the contributing part or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0208] The above content is only a specific embodiment of this application, but the scope of protection of this application is not limited to this. Any changes or replacements within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A display method, characterized in that: The method comprises: acquiring a first image; Determining a target refresh rate according to pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of content contained in the first image; The first image is displayed according to the target refresh rate.

2. The method according to claim 1, characterized in that The step of determining the target refresh rate according to the pixel brightness information of the first image includes: Obtaining a target area corresponding to pixels in the first image according to pixel brightness information of the first image, wherein the target area is used to represent an area occupied by pixels in the first image whose brightness values ​​are greater than a preset threshold; Calculating a target ratio of the area of ​​the target area to the image area of ​​the first image; The target refresh rate is determined according to the target ratio.

3. The method according to claim 2, characterized in that The step of determining the target refresh rate according to the target ratio and the pixel brightness information of the first image includes: When the target ratio is greater than or equal to a first preset value, determining the target refresh rate to be a first refresh rate; When the target ratio is less than the first preset value, the target refresh rate is determined to be a second refresh rate; and the first refresh rate is greater than the second refresh rate.

4. The method according to any one of claims 1 to 3, characterized in that: The step of determining the target refresh rate according to the pixel brightness information of the first image includes: A first trigger operation is detected, and the target refresh rate is determined according to pixel brightness information of the first image.

5. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: Acquire a second image; wherein the second image includes a first image area and a second image area, and the first image area and the second image area do not overlap; determining a third refresh rate according to pixel brightness information of the first image area; determining a fourth refresh rate according to pixel brightness information of the second image area; The first image area and the second image area are displayed according to the third refresh rate and the fourth refresh rate, respectively.

6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: Acquire a third image, wherein the third image includes a preset initial background image; Based on the first moment and the third image, a fourth image is generated; the first moment is used to represent the time when the fourth image is generated; determining a fifth refresh rate according to pixel brightness information of the fourth image; The fourth image is displayed according to the fifth refresh rate.

7. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: A first prompt message is output, where the first prompt message is used to prompt that the screen refresh rate has started to be adjusted.

8. A display device, characterized in that: The display device includes a system-level chip, a touch display driver chip and a display panel; The system-on-chip is used to acquire a first image; The system-level chip is further used to send the first image to the touch display driver chip; The touch display driver chip is used to determine a target refresh rate according to pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of the content contained in the first image; The touch display driver chip is further used to drive the display panel to display the first image according to the target refresh rate; The display panel is used to display the first image according to the target refresh rate.

9. A display device, characterized in that: The display device includes a system-level chip, a touch display driver chip and a display panel; The system-on-chip is used to acquire a first image; The system-level chip is further used to determine a target refresh rate according to pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of content contained in the first image; The system-level chip is further used to send the target refresh rate and the first image to the touch display driver chip; The touch display driver chip is used to drive the display panel to display the first image according to the target refresh rate; The display panel is used to display the first image according to the target refresh rate.

10. An electronic device, characterized in that: The electronic device includes: a processor, a memory and a display screen, wherein the memory and the display screen are coupled to the processor, the display screen is used to display images, and the memory is used to store computer-readable instructions. When the processor reads the computer-readable instructions from the memory, the electronic device executes the display method as described in any one of claims 1 to 7.

11. A chip system, characterized in that: The chip system includes at least one processor and at least one interface circuit, wherein the at least one interface circuit is used to perform transceiver functions and send instructions to the at least one processor, and the at least one processor executes the instructions, and the at least one processor executes the display method as described in any one of claims 1-7.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a computer program, and when the computer program is executed on an electronic device, the electronic device executes the display method according to any one of claims 1 to 7.

Images