Display method and device

Abstract

The invention provides a display method and device, and relates to the technical field of display. According to the method, a to-be-displayed image can be acquired, and a corresponding target refresh rate is determined according to pixel brightness information of the to-be-displayed image. Wherein the pixel brightness information of the to-be-displayed image is used for representing the richness degree of the content contained in the to-be-displayed image. And then, displaying the to-be-displayed image according to the target refresh rate. Therefore, the screen refresh rate can be dynamically adjusted while the image display quality is ensured, the flexibility and timeliness of adjusting the refresh rate are improved, and the power consumption of equipment is saved.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to a display method and device. Background Art

[0002] With the continuous development of display technology, more and more display screens that can support various performance displays have emerged, such as supporting higher resolution, better color vision, higher refresh rate, etc., to give users a better visual experience.

[0003] Usually, the display screen refreshes the displayed content during the process of displaying an image. The higher the refresh rate of the display screen, the smoother the image display. Then, when the display screen continues to display at a high refresh rate, the electronic device will consume high power, resulting in a poor user experience. Summary of the invention

[0004] The present application provides a display method and device, which determines a target refresh rate suitable for an image to be displayed based on pixel brightness information of the image to be displayed, thereby realizing a process of dynamically adjusting the screen refresh rate, thereby saving device power consumption while ensuring image display quality.

[0005] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0006] In a first aspect, an embodiment of the present application provides a display method, which is applied to an electronic device, and the method includes: acquiring a first image, and determining a target refresh rate according to pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of the content contained in the first image. Then, the first image is displayed according to the target refresh rate.

[0007] It can be seen that the embodiment of the present application can determine the target refresh rate applicable to the image to be displayed based on the pixel brightness information of the image to be displayed, and different images to be displayed correspond to different refresh rates. In other words, when the richness of the content contained in the image to be displayed is high, a higher screen refresh rate can be used for display. When the richness of the content contained in the image to be displayed is low, a lower screen refresh rate can be used for display. In this way, the method provided in the embodiment of the present application can dynamically adjust the screen refresh rate while ensuring the image display quality, improve the flexibility and timeliness of adjusting the refresh frequency, and save device power consumption.

[0008] In an implementation of the first aspect, in the process of determining the target refresh rate according to the pixel brightness information of the first image, a target area corresponding to the pixels in the first image can be obtained according to the pixel brightness information of the first image, and the target area is used to characterize the area occupied by the pixels in the first image whose brightness values ​​are greater than a preset threshold. Then, a target ratio of the area of ​​the target area to the image area of ​​the first image is calculated. Then, the target refresh rate is determined according to the target ratio.

[0009] It can be seen that the embodiment of the present application provides a method for obtaining a target area corresponding to a pixel in an image to be displayed based on the pixel brightness information of the image to be displayed. And calculate the target ratio of the area of ​​the target area to the image area of ​​the image to be displayed. Then, according to the target ratio, determine the target refresh rate. It can be understood that when the number of pixels with brightness values ​​greater than a preset threshold in the image to be displayed is greater, the area corresponding to the target area is larger, and thus the target ratio of the image to be displayed is larger. On the contrary, when the number of pixels with brightness values ​​greater than a preset threshold in the image to be displayed is smaller, the area corresponding to the target area is smaller, and thus the target ratio of the image to be displayed is smaller. In this way, different target refresh rates can be determined according to different target ratios corresponding to different images to be displayed. Thereby improving the flexibility and timeliness of adjusting the refresh rate and saving device power consumption.

[0010] In an implementation of the first aspect, in the process of determining the target refresh rate according to the target ratio, when the target ratio is greater than or equal to a first preset value, the target refresh rate is determined to be a first refresh rate. When the target ratio is less than the first preset value, the target refresh rate is determined to be a second refresh rate; and the first refresh rate is greater than the second refresh rate.

[0011] It can be seen that the pixel brightness information of the image to be displayed provided by the embodiment of the present application is used to characterize the richness of the content contained in the image to be displayed. The more pixels in the image to be displayed whose brightness values ​​are greater than the preset threshold, the richer the content contained in the image to be displayed. Then, when the more pixels in the image to be displayed whose brightness values ​​are greater than the preset threshold, the larger the area corresponding to the target area, and thus the larger the target ratio of the image to be displayed. When the target ratio of the image is larger, for example, the target ratio is greater than or equal to the first preset value, a higher refresh rate is required to refresh the image to ensure that it is displayed completely and smoothly.

[0012] On the contrary, when there are fewer pixels in the image to be displayed whose brightness values ​​are greater than the preset threshold, it indicates that the richness of the content contained in the image to be displayed is lower. Then, when there are fewer pixels in the image to be displayed whose brightness values ​​are greater than the preset threshold, the area corresponding to the target area is smaller, and thus the target ratio of the image to be displayed is smaller. When the target ratio of the image to be displayed is smaller, for example, the target ratio is less than the first preset value, a high refresh rate is not required to refresh the image to be displayed. It is possible to save device power consumption while ensuring its complete and smooth display. In this way, the method provided in the embodiment of the present application can dynamically adjust the screen refresh rate while ensuring the image display quality, improve the flexibility and timeliness of adjusting the refresh frequency, and save device power consumption.

[0013] In an implementation manner of the first aspect, in the process of determining the target refresh rate based on pixel brightness information of the first image, a first trigger operation can be detected, and the target refresh rate can be determined based on the pixel brightness information of the first image.

[0014] It can be seen that the embodiment of the present application can adaptively adjust the screen refresh rate according to the pixel brightness information of the image to be displayed after detecting the first trigger operation input by the user. That is to say, when the first trigger operation is not detected, the image can be displayed at the initial screen refresh rate. As long as the first trigger operation is detected, the screen refresh rate can be adaptively adjusted according to the image to be displayed. The user can control the process of turning on and off the smart watch to adaptively adjust the screen refresh rate anytime and anywhere. The interactivity between the user and the device is improved, and the user's setting process of the screen refresh rate can be supported, thereby improving the user's user experience.

[0015] In an implementation manner of the first aspect, the method further includes: obtaining a second image; wherein the second image includes a first image area and a second image area, and the first image area and the second image area do not overlap. Then, determining a third refresh rate based on pixel brightness information of the first image area. And determining a fourth refresh rate based on pixel brightness information of the second image area. Then, displaying the first image area and the second image area according to the third refresh rate and the fourth refresh rate, respectively.

[0016] It can be seen that the embodiment of the present application can realize displaying different image areas in the entire image at different refresh rates. The refresh rates of different areas in an image can be adjusted more accurately, which improves the flexibility of adjusting the screen refresh rate and reduces the power consumption of the device.

[0017] In an implementation manner of the first aspect, the method further includes: obtaining a third image, the third image including a preset initial background image. Then, based on the first moment and the third image, generating a fourth image; the first moment is used to represent the time when the fourth image is generated. Then, according to the pixel brightness information of the fourth image, determining a fifth refresh rate, and displaying the fourth image according to the fifth refresh rate.

[0018] It can be seen that the embodiment of the present application can generate an image to be displayed based on the initial background image of the threshold in the device and the current time when in sleep mode, power saving mode or displaying a lock screen image. By using the preset initial background image to generate the image to be displayed, there is no need to repeatedly draw the repeated content in the image in real time. Similarly, the screen refresh rate can be matched according to different images to be displayed, which improves the flexibility of adjusting the refresh rate and saves device power consumption.

[0019] In an implementation manner of the first aspect, the method further includes: outputting first prompt information, where the first prompt information is used to prompt that the adjustment of the screen refresh rate has begun.

[0020] It can be seen that the embodiment of the present application can output the first prompt information, and the first prompt information is used to prompt that the screen refresh rate has started to be adjusted. It can allow the user to perceive the start process of adjusting the screen refresh rate, improve the interactivity between the user and the device, and thus improve the user's usage experience.

[0021] In a second aspect, an embodiment of the present application provides a display device, which includes a system-level chip, a touch display driver chip and a display panel. Among them, the system-level chip is used to obtain a first image. The system-level chip is also used to send the first image to the touch display driver chip. The touch display driver chip is used to determine the target refresh rate based on the pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of the content contained in the first image. The touch display driver chip is also used to drive the display panel to display the first image according to the target refresh rate. The display panel is used to display the first image according to the target refresh rate.

[0022] It can be seen that the system-level chip can obtain the image to be displayed and send the image to be displayed to the touch display driver chip. The touch display driver chip determines the target refresh rate applicable to the image to be displayed based on the pixel brightness information of the image to be displayed. Then, the touch display driver chip can drive the display panel to display the image to be displayed according to the target refresh rate. In this way, the display device provided in the embodiment of the present application can dynamically adjust the screen refresh rate while ensuring the image display quality, improve the flexibility and timeliness of adjusting the refresh frequency, and save the power consumption of the device.

[0023] In a third aspect, an embodiment of the present application provides a display device, which includes a system-level chip, a touch display driver chip and a display panel. Among them, the system-level chip is used to obtain a first image. The system-level chip is also used to determine the target refresh rate based on the pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of the content contained in the first image. The system-level chip is also used to send the target refresh rate and the first image to the touch display driver chip and the touch display driver chip, which are used to drive the display panel to display the first image according to the target refresh rate. The display panel is used to display the first image according to the target refresh rate.

[0024] It can be seen that the system-level chip can obtain the image to be displayed, and determine the target refresh rate applicable to the image to be displayed based on the pixel brightness information of the image to be displayed. Then, the system-level chip can also send the target refresh rate and the image to be displayed to the touch display driver chip. The touch display driver chip can drive the display panel to display the image to be displayed according to the target refresh rate. In this way, the display device provided in the embodiment of the present application can dynamically adjust the screen refresh rate while ensuring the image display quality, improve the flexibility and timeliness of adjusting the refresh frequency, and save device power consumption.

[0025] In a fourth aspect, an embodiment of the present application provides an electronic device, comprising: a processor, a memory and a display screen, wherein the memory and the display screen are coupled to the processor, the display screen is used to display images, and the memory is used to store computer-readable instructions. When the processor reads the computer-readable instructions from the memory, the electronic device executes the display method described in the first aspect.

[0026] In the fifth aspect, an embodiment of the present application provides a chip system, the chip system includes at least one processor and at least one interface circuit, the at least one interface circuit is used to perform transceiver functions and send instructions to at least one processor, the at least one processor executes instructions, and the at least one processor executes the display method as described in the first aspect.

[0027] In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium, the computer-readable storage medium including a computer program, and when the computer program runs on an electronic device, the electronic device executes the display method as described in the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 A schematic diagram of the structure of an electronic device screen provided in an embodiment of the present application;

[0029] Figure 2 A schematic diagram of the structure of a smart watch provided in an embodiment of the present application;

[0030] Figure 3A schematic diagram of the hardware structure of a smart watch provided in an embodiment of the present application;

[0031] Figure 4 A schematic diagram of the software structure of a smart watch provided in an embodiment of the present application;

[0032] Figure 5 A schematic diagram of a process of displaying an image on a smart watch screen provided in an embodiment of the present application;

[0033] Figure 6 A schematic diagram of a process of displaying an i-th frame image and a j-th frame image provided in an embodiment of the present application;

[0034] Figure 7 A schematic diagram of a process for determining a target refresh rate provided in an embodiment of the present application;

[0035] Figure 8 A flowchart of an overwriting process provided in an embodiment of the present application;

[0036] Fig. 9 A schematic diagram of an interface for adaptively adjusting refresh rate provided in an embodiment of the present application;

[0037] Fig.10 A schematic diagram of an interface of a prompt window provided in an embodiment of the present application;

[0038] Fig.11 A schematic diagram of an interface of a range control provided in an embodiment of the present application;

[0039] Fig.12 A schematic diagram of a process for determining a target refresh rate by a host-side system on chip (SOC) according to an embodiment of the present application Figure 1 ;

[0040] Fig.13 A schematic diagram of a process for determining a target refresh rate by a host-side SOC according to an embodiment of the present application Figure 2 ;

[0041] Fig.14 A schematic diagram of a process for generating an image to be displayed provided in an embodiment of the present application;

[0042] Fig.15 A schematic diagram of the structure of a wearable device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0043] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the present application, unless otherwise specified, " / " indicates that the objects associated before and after are in an "or" relationship, for example, A / B can represent A or B; "and / or" in the present application is only a kind of association relationship describing the associated objects, indicating that there can be three relationships, for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. And, in the description of the present application, unless otherwise specified, "multiple" refers to two or more than two. "At least one of the following" or its similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple. In addition, in order to facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first", "second" and the like are used to distinguish the same items or similar items with substantially the same functions and effects. Those skilled in the art will understand that the words "first", "second" and the like do not limit the quantity and execution order, and the words "first", "second" and the like do not necessarily limit the difference. At the same time, in some embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or design solutions. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete manner for easy understanding.

[0044] In addition, the network architecture and business scenarios described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. A person of ordinary skill in the art can appreciate that with the evolution of the network architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are equally applicable to similar technical problems.

[0045] First, some of the terms and related technologies involved in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.

[0046] Touch and display driver integrated circuit (TDDIC): TDDIC is one of the main control components of the display panel. Its main function is to send driving signals and image data to the display panel in the form of electrical signals, so that the display panel presents images.

[0047] Figure 1 The present invention is a structural schematic diagram of a screen of an electronic device. Figure 1 Take an electronic device including two touch display driver chips 11 (such as touch display driver chip 1 and touch display driver chip 2) as an example. The display panel (Panel) 10 is the display area of ​​the electronic device screen. The two touch display driver chips 11 (such as touch display driver chip 1 and touch display driver chip 2) are packaged under the screen, for example, the two touch display driver chips are directly bonded to the glass substrate through the chip packaging technology on glass.

[0048] Screen refresh rate: the refresh rate of the display screen of an electronic device, which can also be called the frame rate of the display screen. The screen refresh rate is a hardware performance parameter of the display screen of an electronic device, that is, the number of times the screen is updated per second. The higher the screen refresh rate, the more times the screen refreshes the displayed image per second. Correspondingly, the refresh time interval between each image is smaller, and the smoother the picture is.

[0049] The screen refresh rate can generally be expressed in physical units of Hz. The panel of the display screen is filled with physical pixels. For example, if the resolution of the display screen is 1080*1920 progressive scanning (P), the display screen has 1080*1920 pixels. Each row of the display screen includes 1080 pixels, and each column of the display screen includes 1920 pixels. The display screen displays 1080 pixels in a row, which is called row scanning. The display screen displays 1920 rows of pixels, which is called field scanning. After the display screen scans a field, the display screen can display a frame of image data.

[0050] How many frames of image data can the display screen refresh per second, that is, how many frames of image data can the display screen display per second. For example, if the refresh rate of the display screen is 60 hertz (Hz), that is, the screen refresh rate is 60Hz, then the display screen can refresh the screen 60 times per second, that is, the display screen can display 60 frames of image data per second.

[0051] Frame rate: It is the rate at which the graphics processing unit (GPU) in the system on chip (SOC) draws images per second. The higher the frame rate, the more images the graphics processor draws, and the display looks smoother and more realistic. It can be understood that the frame rate is the number of frames generated by the SOC per second. The refresh rate is the number of times the screen is refreshed per second, which determines the number of times the screen presents images per second.

[0052] The panel of the display screen is covered with physical pixels. For example, if the resolution of the display screen is 466*466 progressive scanning (P), the display screen has 466*466 pixels, each row of the display screen includes 466 pixels, and each column of the display screen includes 466 pixels. The display screen displays 466 pixels in a row, which is called row scanning, and the display screen displays 466 rows of pixels, which is called field scanning. The physical signal when the display screen starts scanning a row is called the horizontal synchronization signal (horizontal synchronization pulse, Hsync), and the physical signal when the display screen starts scanning a field is called the vertical synchronization signal (vertical synchronization, Vsync). After the display screen scans a field, the display screen can display one frame of image, that is, the display screen can display one frame of image within the cycle of a Vsync signal.

[0053] How many fields can the display screen refresh per second, that is, how many frames of images can the display screen display per second, the smart watch needs to generate how many Vsync signals per second. In other words, the number of Vsync signals generated by the smart watch per second is the refresh rate of the display screen. For example, if the refresh rate of the display screen is 60Hz, the smart watch needs to generate 60 Vsync signals per second. The Vsync signal can be generated by the hardware composer (HWC) in the smart watch. After the HWC generates the Vsync signal, the SOC can send the image to be displayed to the TDDIC within the period of the Vsync signal.

[0054] Tearing effect signal (also described as TE signal): a signal generated by TDDIC, which is used to prevent tearing problems when the screen is refreshed during image display. TE signal is a periodic signal. Electronic devices configured with MIPI's command control mode generally synchronize and control the SOC frame rate and screen refresh rate based on TE signals. The image drawing, rendering, synthesis and screen refresh display processes are synchronized based on TE signals. In each cycle corresponding to the same TE signal, the SOC draws, renders and synthesizes one or more layers to obtain a frame of image, and transmits the image data packet to TDDIC through the MIPI interface. TDDIC unpacks the image data packet and refreshes the image.

[0055] With the continuous development of display technology of electronic devices such as mobile phones, more and more electronic devices can support multiple refresh rates, such as 30Hz, 60Hz, 90Hz, etc. That is, the display of electronic devices can support multiple levels of screen refresh rates.

[0056] Usually, the display screen displays images at a fixed frame rate. In this way, in a usage scenario where the refresh rate requirement is not high, if the display screen uses a high refresh rate for display, it will lead to the problem of high power consumption of the electronic device.

[0057] Exemplarily, the display screen supports a 60Hz refresh rate. When the processor of the electronic device is operating in sleep mode or power saving mode, the display screen of the electronic device still uses a 60Hz refresh rate to display images. In another exemplary embodiment, when a static image needs to be displayed, the display screen of the electronic device still uses a 60Hz refresh rate to display images. In this way, the power consumption of the electronic device will be increased and the user experience will be reduced.

[0058] Based on the above content, an embodiment of the present application provides a display method and device, which can obtain an image to be displayed and determine the corresponding target refresh rate according to the pixel brightness information of the image to be displayed. Among them, the pixel brightness information of the image to be displayed is used to characterize the richness of the content contained in the image to be displayed. Then, the image to be displayed is displayed according to the target refresh rate. It can be understood that, generally, the richer the content in the image to be displayed, the greater the brightness of the corresponding pixel point, and the image to be displayed requires a higher screen refresh rate for subsequent display. Similarly, the simpler the content in the image to be displayed, the smaller the brightness of the corresponding pixel point, and the image to be displayed requires a lower screen refresh rate for subsequent display.

[0059] It can be seen that the embodiment of the present application can determine the target refresh rate applicable to the image to be displayed based on the pixel brightness information of the image to be displayed, and different images to be displayed correspond to different refresh rates. In other words, when the displayed content in the image to be displayed is relatively complex, a higher screen refresh rate can be used for display. When the displayed content in the image to be displayed is relatively simple, a lower screen refresh rate can be used for display. In this way, the method provided in the embodiment of the present application can dynamically adjust the screen refresh rate while ensuring the image display quality, improve the flexibility and timeliness of adjusting the refresh frequency, and save device power consumption.

[0060] The display method provided in the embodiments of the present application can be applied to electronic devices. In some embodiments, the electronic device may include, for example, a mobile phone, a tablet computer, a personal computer (PC), a personal digital assistant (PDA), a smart watch, a netbook, a wearable device, an augmented reality (AR) device, a virtual reality (VR) device, an in-vehicle device, a smart screen, a smart car, a smart speaker, and a robot, etc. The present application does not impose any special restrictions on the specific form of the electronic device.

[0061] For example, taking the electronic device as a smart watch, Figure 2 The structure diagram of the smart watch provided by the embodiment of the present application is shown. The smart watch can be worn on the wrist of the user. The smart watch may include a display screen 103 and a fixing band 104, the display screen 103 is used to display time and the user touches and clicks to display other related content, and the fixing band 104 is used to fix the smart watch on the user's wrist.

[0062] For example, Figure 3 Taking a smart watch as an example, a hardware structure diagram of an electronic device provided by an embodiment of the present application is shown. Figure 3 The smart watch may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a microphone 170B, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, and a display screen 194. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, and a bone conduction sensor 180M.

[0063] It is understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the smart watch. In other embodiments of the present application, the smart watch may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0064] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0065] In some examples, the processor 110 may be a system-on-chip (SOC) of a smartwatch. In some embodiments, the SOC may draw, render, and synthesize layers of images to be displayed. Specifically, the SOC may control the GPU to draw, render, and synthesize layers, and send (write) the image data corresponding to the synthesized image to be displayed to the TDDIC via the MIPI interface, so that the TDDIC may subsequently control the display screen 194 to display the image to be displayed based on the screen refresh rate.

[0066] The controller can be the nerve center and command center of the smart watch. The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching and executing instructions.

[0067] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0068] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0069] Among them, the MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to realize the shooting function of the smart watch. The processor 110 and the display screen 194 communicate through the DSI interface to realize the display function of the smart watch.

[0070] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the smart watch. In other embodiments of the present application, the smart watch may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0071] The wireless communication function of the smart watch can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0072] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to smart watches. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0073] The smartwatch implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0074] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc.

[0075] In some embodiments, the display screen 194 may receive the image data of the image to be displayed and the target refresh rate corresponding to the image to be displayed sent by the TDDIC, and then the display screen 194 implements the process of displaying and refreshing the image to be displayed according to the target refresh rate corresponding to the image to be displayed.

[0076] In some embodiments, the smart watch may include 1 or N display screens 194 , where N is a positive integer greater than 1.

[0077] The internal memory 121 may be used to store computer executable program codes, which include instructions. The processor 110 executes the instructions stored in the internal memory 121 to execute various functional applications and data processing of the smart watch.

[0078] The internal memory 121 may include a program storage area and a data storage area. The program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the smart watch (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0079] It is understandable that, generally speaking, the realization of smart watch functions requires not only hardware support but also software cooperation.

[0080] The software system of the smart watch can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. Taking the system as an example, the software structure of the smart watch is illustrated.

[0081] Figure 4 It is a software structure block diagram of the smart watch of the embodiment of the present application.

[0082] The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. The system is divided into four layers, from top to bottom: application layer, application framework layer, Android runtime ( runtime) and system libraries and kernel layer.

[0083] The application layer can include a series of application packages.

[0084] like Figure 4 As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0085] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0086] like Figure 4 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0087] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0088] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0089] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0090] The phone manager is used to provide communication functions for smart watches, such as the management of call status (including answering, hanging up, etc.).

[0091] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0092] The notification manager allows applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a reminder sound is emitted, a smart watch vibrates, and an indicator light flashes.

[0093] Runtime includes core libraries and virtual machines. Runtime is responsible for Android Scheduling and management of the system.

[0094] The core library consists of two parts: one is the function that the Java language needs to call, and the other is The core library.

[0095] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0096] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0097] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0098] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0099] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0100] A 2D graphics engine is a drawing engine for 2D drawings.

[0101] The kernel layer is a layer between hardware and software. The kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver. In some embodiments, the display driver of the kernel layer can send (write) the image data corresponding to the image to be displayed to TDDIC through the MIPI interface, so that the subsequent TDDIC controls the display screen to display the image to be displayed based on the screen refresh rate.

[0102] Illustratively, the technical solutions involved in the following embodiments can all be implemented in an electronic device having the above hardware architecture.

[0103] A display method provided in an embodiment of the present application can be applied to an electronic device with a display screen. Taking the electronic device as a smart watch as an example, the display method provided in an embodiment of the present application is described in detail below in conjunction with the accompanying drawings.

[0104] In order to facilitate understanding of the technical content of this application, the specific process of displaying images on the smart watch screen is first introduced below.

[0105] In the examples of this application, see Figure 5The microcontroller unit (MCU) in the SOC in the smart watch can control the GPU to draw, render and synthesize layers, and send the synthesized image data to (write to) TDDIC through the MIPI interface. The MCU in TDDIC stores the image data in the static random-access memory (SRAM) via the memory controller. Then, the MCU of TDDIC scans the image data in the SRAM, and restores the digital image data into a continuous voltage signal to drive the Panel, thereby achieving the purpose of displaying and refreshing the image. In other words, the image displayed by the Panel comes from the MCU in TDDIC that controls MIPI to send the image to each frame of the SOC.

[0106] In some embodiments of the present application, the smart watch may obtain the i-th frame image to be displayed, where i is an integer not less than 1. The image to be displayed is an image that currently needs to be displayed.

[0107] Usually, the dial of a smart watch is electronically displayed, and the user can interact with the smart watch through the interactive interface displayed on the dial. It is understandable that the interactive interface of the smart watch can display multiple frames of images during the display process. A frame is a single image screen that is the smallest unit in an image animation. A frame is a still image, and continuous frames form an animation, such as a dynamic image. In this way, the smart watch can quickly and continuously display multiple frames to form an interactive interface.

[0108] For example, taking the user starting the first application as an example, after the user starts the first application, the display screen of the smart watch will display the corresponding interactive interface of the first application.

[0109] When the smartwatch displays the interactive interface corresponding to the first application, it will draw and display multiple frames of images. The SOC can control the first application to call the MCU and GPU to draw and render the image, and then synthesize the drawn image through the layer integrator (SurfaceFlinger) to obtain the image corresponding to the interactive interface. For example, the frame rate of the SOC is 60. Then the SOC can draw and generate 60 frames of images per second, which is convenient for the subsequent display of the display screen.

[0110] It is understandable that the SOC can start drawing and rendering the i-th frame image by calling the MCU and the GPU. Then the layer integrator starts synthesizing the i-th frame image. Then, the SOC can obtain the i-th frame image to be displayed.

[0111] In some embodiments of the present application, see Figure 6In (A), after the SOC in the smart watch generates the i-th frame image to be displayed, the image data corresponding to the i-th frame image can be sent to the TDDIC via the MIPI interface. The MCU in the TDDIC stores the image data corresponding to the i-th frame image in the SRAM via the memory controller.

[0112] For example, when the refresh rate of the smart watch is 60Hz, the period of the corresponding tearing effect signal (such as TE1 signal) is 16.66ms. The SOC can draw, render and synthesize the image at 16.66ms according to the TE1 signal to obtain the i-th frame image, and transmit the image data corresponding to the i-th frame image to the TDDIC. When the SOC receives the next TE1 signal, it draws the image again to obtain the image data corresponding to the next frame image, and sends the image data corresponding to the next frame image to the TDDIC.

[0113] In some embodiments of the present application, after acquiring the i-th frame image to be displayed, the smart watch can display the i-th frame image according to the initial refresh rate.

[0114] Specifically, after the SOC sends the image data corresponding to the i-th frame image to the TDDIC, the TDDIC can refresh and display the i-th frame image. Correspondingly, the MCU of the TDDIC can scan the image data corresponding to the i-th frame image from the SRAM within 16.66ms according to the TE1 signal, and convert the image data corresponding to the i-th frame image in the form of a digital signal into a continuous voltage signal. Then, the MCU sends the voltage signal and the initial refresh rate to the Panel to drive the Panel. Then, the Panel displays and refreshes the i-th frame image according to the initial refresh rate to realize the process of screen display and image refresh. When the MCU of the TDDIC receives the next TE1 signal, it can refresh and display the next frame image (that is, the next frame image sent by the SOC). It can be understood that, taking the screen refresh rate of a smart watch as 60Hz, the initial refresh rate is 60Hz.

[0115] In some embodiments of the present application, the image data of the image to be displayed may include the resolution of the image to be displayed, the three-channel value of each pixel, and the like. The image channel refers to the separate red, green, and blue parts in the RGB color mode. In other words, a complete image is composed of three channels of red, green, and blue, which work together to produce a complete image. For a complete image, the three channels of red, green, and blue are indispensable. It is understandable that even if there seems to be no blue in the image, it can only be said that the brightness of the blue light is 0 or the red and green channels of each pixel value are not all 0, but it cannot be said that there is no blue channel.

[0116] In some embodiments of the present application, the smart watch can obtain a first image and determine a target refresh rate based on pixel brightness information of the first image. The pixel brightness information of the first image is used to characterize the richness of the content contained in the first image. Then, the smart watch displays the first image according to the target refresh rate.

[0117] For example, see Figure 6 In (B), the smart watch can continue to obtain the j-th frame image to be displayed, where j is an integer not less than 1. Then, the smart watch can determine the target refresh rate based on the pixel brightness information of the j-th frame image to be displayed. It should be noted that the j-th frame image can be an adjacent frame image of the i-th frame image, and there can also be other frame images between the j-th frame image and the i-th frame image. The embodiments of the present application do not specifically limit this.

[0118] Continuing with the example that the refresh rate of the smart watch is 60Hz, and the j-th frame image is the next frame image of the i-th frame image, the period of the tearing effect signal (such as the TE1 signal) is still 16.66ms. The SOC can continue to draw, render and synthesize the image at 16.66ms according to the TE2 signal, obtain the j-th frame image to be displayed, and transmit the image data corresponding to the j-th frame image to TDDIC. Then, after receiving the image data corresponding to the j-th frame image, TDDIC can analyze the image data corresponding to the j-th frame image to obtain the pixel brightness information of the j-th frame image to be displayed. And TDDIC determines the target refresh rate based on the pixel brightness information of the j-th frame image to be displayed.

[0119] Specifically, the MCU in the TDDIC can read the image data corresponding to the j-th frame image from the SRAM, and obtain the target area corresponding to the pixel in the j-th frame image based on the image data corresponding to the j-th frame image. The target area is used to characterize the area occupied by the pixels in the j-th frame image whose brightness value is greater than the preset threshold. Then, the MCU in the TDDIC calculates the target ratio of the area of ​​the target area to the image area of ​​the j-th frame image. Then, the MCU in the TDDIC determines the target refresh rate based on the target ratio.

[0120] Among them, see Figure 7 When the target ratio is greater than or equal to the first preset value, the target refresh rate is determined to be the first refresh rate. Alternatively, when the target ratio is less than the first preset value, the target refresh rate is determined to be the second refresh rate. The first refresh rate is greater than the second refresh rate.

[0121] In an implementable manner, the preset threshold may be 0. TDDIC may calculate the brightness value corresponding to each pixel point according to the image data corresponding to the j-th frame image, and obtain the target area corresponding to the j-th frame image.

[0122] For example, TDDIC can convert the image three-channel value of each pixel in the j-th frame image into the brightness value of each pixel. Then, TDDIC compares the brightness value of each pixel with a preset threshold value and determines the pixel with a brightness value greater than 0 as a luminous pixel. It can be understood that the target area can include an area corresponding to at least one luminous pixel.

[0123] Next, TDDIC calculates the ratio of the area of ​​the target region to the image area of ​​the j-th frame image. For example, if the length pixel number of the j-th frame image is 8 and the width pixel number is 8. Then, the image area of ​​the j-th frame image is 64. If the number of luminous pixels is 32, the area of ​​the target region is 32. In this way, the target ratio of the area of ​​the target region to the image area of ​​the j-th frame image is 0.5.

[0124] Then, TDDIC determines the target refresh rate according to the target ratio 0.5. For example, the first preset value is 0.25. The first refresh rate is 30 Hz, and the second refresh rate is 1 Hz.

[0125] When the target ratio of the j-th frame image is 0.5, the target ratio is greater than the first preset value, and the target refresh rate is determined to be 30 Hz. When the target ratio of the j-th frame image is 0.1, the target ratio of the j-th frame image is less than the first preset value, and the target refresh rate is determined to be 1 Hz.

[0126] Importantly, the first refresh rate proposed in the embodiment of the present application needs to be greater than the second refresh rate. It is understandable that the pixel brightness information of the image is used to characterize the richness of the content contained in the image. The more pixels in the image whose brightness values ​​are greater than the preset threshold, the richer the content contained in the image. Then, when the more pixels in the image whose brightness values ​​are greater than the preset threshold, the larger the area corresponding to the target area, and thus the larger the target ratio of the image. When the target ratio of the image is larger, a higher refresh rate is required to refresh the image to ensure that it is displayed completely and smoothly.

[0127] On the contrary, when there are fewer pixels in the image with brightness values ​​greater than the preset threshold, it means that the richness of the content contained in the image is lower. Then, when there are fewer pixels in the image with brightness values ​​greater than the preset threshold, the area corresponding to the target area is smaller, and thus the target ratio of the image is smaller. When the target ratio of the image is smaller, a high refresh rate is not required to refresh the image. It can save device power consumption while ensuring its complete and smooth display.

[0128] In this way, the embodiment of the present application can display images containing complex content at a high refresh rate and display images containing simple content at a low refresh rate, so as to achieve adaptive adjustment of the screen refresh rate, thereby saving device power consumption while ensuring image display quality.

[0129] It should be noted that the embodiments of the present application do not specifically limit the values ​​corresponding to the preset threshold, the first preset value, the first refresh rate, and the second refresh rate. In addition, the number of preset values ​​may be one or more, and the target refresh rate may be determined from a number of refresh rates. The embodiments of the present application do not specifically limit the number of preset values, the first refresh rate, and the second refresh rate.

[0130] In other embodiments of the present application, the target refresh rate may be an optimal refresh rate corresponding to the image. Optionally, the optimal refresh rate may be a fixed refresh rate. Alternatively, it may be a dynamically changing refresh rate. The optimal refresh rate may be pre-set in the TDDIC and support dynamic updates. It is understood that the TDDIC may determine a target refresh rate suitable for the current image to be displayed from a number of refresh rates.

[0131] Exemplarily, the first refresh rate may include a value between 10-30 Hz. When the target ratio of the j-th frame image is 0.5, the target ratio of the j-th frame image is greater than the first preset value, and the target refresh rate for the j-th frame image is determined to be 20 Hz from the first refresh rate. When the target ratio of the j-th frame image is 0.8, the target ratio of the j-th frame image is greater than the first preset value, and the target refresh rate for the j-th frame image is determined to be 30 Hz from the first refresh rate.

[0132] As another example, the second refresh rate may include a value between 0 and 10 Hz. When the target ratio of the j-th frame image is 0.1, the target ratio corresponding to the pixel brightness information of the j-th frame image is less than the first preset value, and the target refresh rate for the j-th frame image is determined to be 1 Hz from the second refresh rate. When the target ratio of the j-th frame image is 0.2, the target ratio corresponding to the pixel brightness information of the j-th frame image is less than the first preset value, and the target refresh rate for the j-th frame image is determined to be 8 Hz from the second refresh rate.

[0133] It can be seen that the embodiment of the present application can determine the target refresh rate applicable to the current image based on the pixel brightness information of the image, and different images correspond to different refresh rates. The image can also be displayed based on the target refresh rate later. Specifically, the process of determining the target refresh rate in this solution is executed by TDDIC, without relying on SOC to participate in control and regulation. TDDIC can determine the corresponding target refresh rate frame by frame and adjust the refresh rate frame by frame. Thereby improving the flexibility and timeliness of adjusting the refresh rate and saving equipment power consumption.

[0134] In actual application, in addition to the need to achieve high refresh rate in high frame rate games, high refresh rate can also be mainly used in a small number of fast sliding scenarios such as desktop sliding and album browsing. This can improve the smoothness of the picture when the user performs a fast sliding operation. It can be imagined that the proportion of time occupied by fast sliding in actual applications is relatively small, and most usage scenarios are still static display, low-speed sliding, and low-frame rate video playback scenarios. These scenarios use low refresh rate and low frame rate to ensure the smoothness of the picture, reduce power consumption, and improve battery life. It can be seen that the display method provided in the embodiment of the present application can be applied in different scenarios.

[0135] In some other embodiments of the present application, the smart watch can also determine the current display scene according to the pixel brightness information of the jth frame image. Then, the smart watch can determine the target refresh rate according to the current display scene, and different display scenes correspond to different refresh rates.

[0136] Among them, the display scenes include static display scenes and dynamic display scenes. Static display scenes can include picture display scenes, text display scenes, always-on display scenes, and low-speed sliding scenes, etc. Dynamic display scenes include video playback scenes, game scenes, high-speed sliding scenes, etc.

[0137] In one achievable manner, when the current display scene is a static display scene, the sixth refresh rate is determined as the target refresh rate, and the sixth refresh rate is the highest refresh rate in the static display scene. When the current display scene is a dynamic display scene, the seventh refresh rate is determined as the target refresh rate, and the seventh refresh rate is the highest refresh rate in the dynamic display scene; the seventh refresh rate is greater than the sixth refresh rate.

[0138] It can be seen that the embodiment of the present application can also determine the corresponding display scene based on the pixel brightness information of the image. Then determine the target refresh rate applicable to the current image, and different display scenes correspond to different refresh rates. Determine the refresh frequency to be used subsequently based on the display scene determination result, and dynamically adjust the refresh rate according to the image content. This facilitates the subsequent display quality in different display scenes while helping to reduce the power consumption of the smart watch.

[0139] In some embodiments of the present application, see Figure 6 In (B), the smart watch can display the j-th frame image according to the target refresh rate.

[0140] Specifically, after the MCU in the TDDIC determines the target refresh rate for the j-th frame image, it can send the target refresh rate and the image data of the j-th frame image to the Panel. Then, the Panel refreshes and displays the j-th frame image according to the target refresh rate and the image data of the j-th frame image.

[0141] For example, after the MCU in the TDDIC determines that the target refresh rate for the j-th frame image is 30 Hz, 30 Hz and the image data of the j-th frame image can be sent to the Panel. Then, the Panel refreshes and displays the j-th frame image at 30 Hz.

[0142] In one possible implementation, after the MCU in the TDDIC determines the target refresh rate for the j-th frame image, it can also send a refresh rate switching instruction and the image data of the j-th frame image to the Panel. The refresh rate switching instruction is used to instruct the Panel to switch the refresh rate from the initial refresh rate to the target refresh rate. Then, the Panel receives the refresh rate switching instruction and refreshes and displays the j-th frame image according to the target refresh rate and the image data of the j-th frame image.

[0143] For example, after the MCU in the TDDIC determines that the target refresh rate for the j-th frame image is 30 Hz, the refresh rate switching instruction and the image data of the j-th frame image can be sent to the Panel. The refresh rate switching instruction is used to instruct the Panel to switch the refresh rate from 60 Hz to 30 Hz. Then, the Panel refreshes and displays the j-th frame image at 30 Hz.

[0144] In some embodiments of the present application, when the Panel is refreshing and displaying the jth frame image, the Panel will overwrite the next frame image in real time to facilitate the subsequent display of the next frame image. Usually, the Panel overwrites from the bottom end surface to the top end surface.

[0145] For example, see Figure 8 In (A), for example, the j-th frame image includes the letter A. Thus, when the Panel refreshes and displays the j-th frame image, the letter A will be displayed from the bottom end surface to the top end surface, such as Figure 8 As shown in (B) in .

[0146] It can be imagined that when the target refresh rate corresponding to the screen is higher, it means that the image drawing and transmission cycle is shorter, and thus the panel overwriting cycle is shorter, and the speed can be faster. Similarly, when the target refresh rate corresponding to the screen is lower, it means that the image data drawing and transmission cycle is longer, and thus the panel overwriting cycle is longer, and the speed can be slower.

[0147] It can be seen that the entire screen refresh rate adjustment process in the embodiment of the present application is actively executed by TDDIC, and TDDIC can dynamically adjust the refresh rate of the screen according to the pixel brightness information corresponding to the image being displayed. The screen refresh rate can be adaptively adjusted for different image modulations, and does not rely on the SOC side for data processing and control. The flexibility of the screen refresh rate when displaying images is improved, saving device power consumption.

[0148] In some embodiments of the present application, the smart watch can detect the first trigger operation and determine the target refresh rate according to the pixel brightness information of the j-th frame image to be displayed.

[0149] It is understandable that the TDDIC in the embodiment of the present application can automatically determine the target refresh rate for the pixel brightness information of each frame of the image. Of course, the TDDIC can also determine the target refresh rate for the pixel brightness information of each frame of the image after detecting the trigger operation input by the user. In other words, the smart watch can refresh and display the i-th frame of the image at the initial refresh rate, and then refresh and display the j-th frame of the image at the target refresh rate after detecting the trigger operation input by the user.

[0150] The first trigger operation may be a pre-set operation that can trigger the smartwatch to switch the refresh rate. The first trigger operation may include some quick operations of the user, such as quick operations through gestures, touch, or key combination shortcut keys. The first trigger operation may also include a voice command of the user.

[0151] In one possible implementation, see Fig. 9 In (A), the smartwatch currently displays the interface. When the user wants to interact with the smartwatch, he can perform a touch operation to update the watch face interface currently displayed on the smartwatch. Fig. 9 In (B), after the smart watch detects a touch operation, it displays an updated dial interface in response to the touch operation. For example, the user clicks on a content control displayed on the display screen, or the user slides along the end surface of the display screen. The updated dial interface may be the home screen interface of the smart watch, and a settings application icon is displayed on the home screen interface of the smart watch, and the user may click on the settings application icon.

[0152] As shown in (C) of FIG9 , in response to the user clicking the setting application icon, the smart watch displays the user interface of the setting application. In the setting application, a list of all functions installed in the smart watch is displayed. For example, the Bluetooth function, the display and brightness function, and the wireless LAN function, etc. The user can click the display and brightness function in the list to trigger the property page corresponding to the display and brightness function.

[0153] As shown in (D) of FIG9 , the smart watch displays a property page corresponding to the brightness function, and the property page corresponding to the brightness function includes a refresh rate adjustment control. The user can click the refresh rate adjustment control to control whether the mobile phone executes the screen refresh rate adjustment function. Fig. 9 As shown in (E) in the figure, the smart watch triggers the process of adaptively adjusting the screen refresh rate in response to the user's click operation on the refresh rate adjustment control.

[0154] In some embodiments of the present application, the smart watch can detect the second trigger operation and switch the screen refresh rate from the target refresh rate to the initial refresh rate.

[0155] The second trigger operation and the first trigger operation may be the same operation or different operations. The embodiment of the present application does not limit the specific implementation form of the first trigger operation and the second trigger operation.

[0156] For example, see Fig. 9 In (F), the smart watch triggers the stopping of the process of adaptively adjusting the screen refresh rate in response to the user's click operation on the refresh rate adjustment control. That is, the smart watch can stop the process of adaptively adjusting the screen refresh rate according to the frame image to be displayed after detecting the second trigger operation input by the user.

[0157] In some embodiments of the present application, after detecting the first trigger operation, the smartwatch may further output a first prompt message. The first prompt message is used to prompt that the adaptive adjustment of the screen refresh rate has been turned on. The first prompt message also corresponds to a first prompt control, which may be implemented as the text "Adaptive adjustment of the screen refresh rate has been turned on".

[0158] Exemplarily, the user clicks on the refresh rate adjustment control, and the smart watch responds to the click operation, triggers the process of adaptively adjusting the screen refresh rate, and displays a first prompt window such as Fig.10 As shown in (A), the first prompt window includes the above-mentioned first prompt control.

[0159] Likewise, in some embodiments of the present application, see Fig.10 In (B), the user can perform a second trigger operation on the refresh rate adjustment control, and the smart watch can also output a second prompt message after detecting the second trigger operation. The second prompt message is used to prompt that the adaptive adjustment of the screen refresh rate has stopped. The second prompt message also corresponds to a second prompt control, and the second prompt control can be implemented as the text "Adaptive adjustment of the screen refresh rate has stopped".

[0160] For example, the user clicks the refresh rate adjustment control again, and the smart watch responds to the click operation, triggers the stop of the process of adaptively adjusting the screen refresh rate, and displays a second prompt window such as Fig.10 As shown in (C), the second prompt window includes the above-mentioned second prompt control.

[0161] It can be seen that the smart watch provided in the embodiment of the present application can adaptively adjust the screen refresh rate according to the image to be displayed after detecting the first trigger operation input by the user. In other words, the smart watch can display the image at the initial screen refresh rate when the user has not input the first trigger operation. As long as the smart watch detects the first trigger operation input by the user, it can adaptively adjust the screen refresh rate according to the image to be displayed. The user can control the process of turning on and off the smart watch to adaptively adjust the screen refresh rate anytime and anywhere. The interactivity between the user and the smart watch is improved, and the user can support the setting process of the screen refresh rate and reduce the power consumption of the smart watch. Thereby improving the user's sense of use.

[0162] In another possible implementation, the property page corresponding to the display and brightness function may include a refresh rate control for switching the refresh rate, wherein the property page corresponding to the display and brightness function may be configured with multiple range controls corresponding to different refresh rates. Fig.11 The first range control corresponding to 0-10 Hz and the second range control corresponding to 0-60 Hz are shown in (A) in FIG. It should be understood that a smartwatch can achieve a variety of refresh rates, and the embodiment of the present application does not specifically limit the number and value of the refresh rate ranges.

[0163] For example, the current screen refresh rate of the smart watch is 30 Hz. The smart watch receives an operation of the user clicking the first range control, and in response to the operation, determines a target refresh rate according to pixel brightness information of the jth frame image to be displayed.

[0164] In one achievable way, continue to see Fig.11 In (B), the smartwatch detects the user's operation on the first range control, and adaptively determines the target refresh rate according to the pixel brightness information of the jth frame image to be displayed. The target refresh rate can be any refresh rate between 0 and 10 Hz.

[0165] It is understandable that the user can set the range of the screen refresh rate in advance. For example, when a user is about to use the photo album application to view a static picture, he can click the first range control to set a relatively low screen refresh rate. That is, in the scene of static display and low-speed sliding, the smart watch can control the screen refresh rate within the range of 0-10Hz according to the pixel brightness information of the j-th frame image. When the ratio corresponding to the pixel brightness information of the j-th frame image is larger, the determined target refresh rate can be higher, such as 10Hz. When the ratio corresponding to the pixel brightness information of the j-th frame image is smaller, the determined target refresh rate can be lower, such as 1Hz.

[0166] In another exemplary embodiment, the current screen refresh rate of the smart watch is 30 Hz. The smart watch receives a click operation of the user on the second range control, and in response to the operation, determines the target refresh rate according to the pixel brightness information of the j-th frame image.

[0167] In another achievable manner, the smartwatch can detect the user's operation on the second range control, and adaptively determine the target refresh rate according to the pixel brightness information of the jth frame image to be displayed. The target refresh rate can be any refresh rate between 0 and 60 Hz.

[0168] For example, when a user is about to use a video application to view a video file, he can click the second range control to set a relatively high screen refresh rate. That is, in the scenario of dynamic display and high-speed sliding, the smart watch can control the screen refresh rate within the range of 0-60Hz according to the pixel brightness information of the j-th frame image. When the target ratio corresponding to the pixel brightness information of the j-th frame image is larger, the determined target refresh rate is higher, such as 60Hz. When the target ratio corresponding to the pixel brightness information of the j-th frame image is smaller, the determined target refresh rate is lower, such as 10Hz.

[0169] It can be seen that the smart watch provided in the embodiment of the present application can support users to set screen refresh rates in different ranges, and use screen refresh rates in different ranges to display images. Users can pre-set the screen refresh rate that meets the scene according to their needs, set a low refresh rate in scenes where a high refresh rate is not required, and set a high refresh rate in scenes where a high refresh rate is required. Furthermore, while improving the interactivity between the user and the smart watch, the power consumption of the smart watch can also be reduced, thereby improving the user's experience.

[0170] In some embodiments of the present application, the host-side SOC may also determine the target refresh rate according to the pixel brightness information of the j-th frame image to be displayed.

[0171] In one possible implementation, see Fig.12 , when the host-side SOC does not write the image data into the SRAM in the TDDIC, the MCU in the SOC can read the image data of the j-th frame image from the buffer, and calculate the pixel brightness information of the j-th frame image based on the image data of the j-th frame image. Then, the MCU in the SOC determines the target refresh rate based on the pixel brightness information of the j-th frame image to be displayed.

[0172] Then, the MCU in the SOC sends the target refresh rate and the image data of the j-th frame image to the MCU in the TDDIC. Then, the MCU in the TDDIC directly sends the target refresh rate and the image data of the j-th frame image to the Panel. The Panel refreshes and displays the j-th frame image according to the target refresh rate and the image data of the j-th frame image.

[0173] In another possible implementation, see Fig.13 , when the host-side SOC has written the image data into the SRAM in the TDDIC, the MCU in the SOC can read the image data of the j-th frame image from the SRAM in the TDDIC, and calculate the pixel brightness information of the j-th frame image based on the image data of the j-th frame image. Then, the MCU in the SOC determines the target refresh rate based on the pixel brightness information of the j-th frame image to be displayed.

[0174] Then, the MCU in the SOC sends the target refresh rate and the image data of the j-th frame image to the MCU in the TDDIC. Then, the MCU in the TDDIC directly sends the target refresh rate and the image data of the j-th frame image to the Panel. The Panel refreshes and displays the j-th frame image according to the target refresh rate and the image data of the j-th frame image.

[0175] It can be seen that in the process of adaptively adjusting the screen refresh rate, the embodiment of the present application does not need TDDIC for control, and only requires macro-control by the host-side SOC. The SOC can dynamically adjust the refresh rate corresponding to the screen according to the pixel brightness information corresponding to the displayed image. Since the control capability of the host-side SOC is more powerful than that of the TDDIC, the processing efficiency of the SOC is higher in the process of adaptively adjusting the screen refresh rate. The efficiency of adjusting the screen refresh rate is improved, while reducing the power consumption of the device.

[0176] In some embodiments of the present application, the smart watch may further pre-divide the image to be displayed into regions to obtain M image regions, where M is an integer not less than 1. Then, the smart watch may match the M image regions with corresponding screen refresh rates for refresh display, where different image regions correspond to different screen refresh rates.

[0177] Specifically, the MCU in the TDDIC can determine the corresponding screen refresh rate according to the pixel brightness information corresponding to the M image areas.

[0178] Exemplarily, the MCU in the TDDIC acquires the second image and divides the second image into regions. The second image includes a first image region and a second image region, and the first image region and the second image region do not overlap. Next, the MCU in the TDDIC determines a third refresh rate based on the pixel brightness information of the first image region, and determines a fourth refresh rate based on the pixel brightness information of the second image region. Then, the MCU in the TDDIC sends the third refresh rate, the fourth refresh rate, the image data of the first image region, and the image data of the second image region to the Panel, so that the Panel refreshes and displays the first image region and the second image region.

[0179] It should be noted that, in the process of pre-dividing the image to be displayed, the MCU in the TDDIC can obtain M image regions of the same area, or M image regions of different areas. The M image regions can be arranged and combined in the horizontal and vertical directions, or in the form of encirclement. The embodiment of the present application does not specifically limit the specific implementation method of the region division.

[0180] It can be seen that when the target ratio corresponding to the pixel brightness information of a certain image area is larger, the screen refresh rate of the image area is higher. On the contrary, when the target ratio corresponding to the pixel brightness information of a certain image area is smaller, the screen refresh rate of the image area is lower. The embodiment of the present application can realize the display of the entire image at different refresh rates in different image areas. The refresh rate of different areas in an image can be adjusted more accurately, which improves the flexibility of adjusting the screen refresh rate and reduces the power consumption of the device.

[0181] In some embodiments of the present application, when the smart watch displays the image corresponding to the customized dial, the image content of each frame of the image will not change too much. For example, when the smart watch is in sleep mode, power saving mode or displaying a lock screen image, the image content of each frame of the image mostly only needs to change the time content. In this way, the smart watch can store an initial background image and generate an image to be displayed based on the initial background image. Among them, the initial background image may include a pointer image and a preset image (wallpaper image, dial image, and customized image set by the user), etc.

[0182] Specifically, the smart watch can obtain a third image, which includes a preset initial background image. Then, the smart watch can generate a fourth image based on the first moment and the third image; the first moment is used to represent the time when the fourth image is generated. Similarly, the smart watch determines a fifth refresh rate based on the pixel brightness information of the fourth image, and displays the fourth image based on the fifth refresh rate.

[0183] For example, see Fig.14 The initial background image can be pre-stored in the SRAM of TDDIC. TDDIC does not need to receive the image sent by SOC in real time. The MCU in TDDIC can obtain the first moment from the built-in clock (CLK) and generate the image to be displayed based on the first moment and the initial background image.

[0184] Exemplarily, the MCU in the TDDIC retrieves the dial image from the SRAM, and the dial image includes an initial pointer image. It can be understood that the initial pointer image in the dial image is a template image, and the corresponding time content in the dial image is continuously changing. The MCU in the TDDIC needs to update the initial pointer image. In this way, after the MCU in the TDDIC retrieves the dial image from the SRAM, it can obtain the first moment from the CLK, and update the initial pointer image based on the first moment to generate an image to be displayed. Among them, the first moment is used to represent the time for generating the image to be displayed.

[0185] Next, after the MCU in the TDDIC generates the image to be displayed by itself, it can determine the target refresh rate based on the pixel brightness information of the image to be displayed, and control the Panel to refresh and display the image to be displayed according to the target refresh rate.

[0186] It should be noted that the SRAM of the TDDIC may pre-store an initial background image or may be the first frame image obtained by the TDDIC from the SOC.

[0187] In some embodiments of the present application, when the MCU in the TDDIC generates an image and refreshes it, the clock frequency of the CLK in the TDDIC will be inconsistent with the clock frequency of the CLK in the SOC, which will cause the CLK in the TDDIC to be out of sync with the CLK in the SOC. In this way, the CLK in the TDDIC needs to be synchronized with the CLK in the SOC.

[0188] Specifically, the MCU of the TDDIC can obtain the second moment from the CLK in the SOC within a certain preset period, and send a synchronization time instruction to the CLK, which is used to instruct the CLK in the TDDIC to synchronize the time to the second moment, so as to achieve the time synchronization of the CLK in the TDDIC and the CLK in the SOC.

[0189] It can be seen that the embodiment of the present application does not rely on the host side SOC to send images to TDDIC in real time. TDDIC can generate images to be displayed by itself and dynamically refresh the images. It only needs to periodically synchronize time with SOC, saving the power consumption of SOC.

[0190] The present application also provides a wearable device, such as the smart watch described above. Fig.15 As shown, the wearable device may include one or more processors 1510 , a memory 1520 , and a communication interface 1530 .

[0191] The memory 1520 , the communication interface 1530 , and the processor 1510 are coupled together. For example, the memory 1520 , the communication interface 1530 , and the processor 1510 may be coupled together via a bus 1540 .

[0192] The communication interface 1530 is used to transmit data with other devices. The memory 1520 stores computer program code. The computer program code includes computer instructions. When the computer instructions are executed by the processor 1510, the wearable device executes the dial interface display method in the embodiment of the present application.

[0193] Among them, the processor 1510 can be a processor or a controller, for example, a central processing unit (CPU), a general processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It can implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the present disclosure. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0194] The bus 1540 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus 1540 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.15 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0195] An embodiment of the present application also provides an electronic device, which includes a memory and one or more processors; the memory is coupled to the processor; wherein computer program code is stored in the memory, and the computer program code includes computer instructions, and when the computer instructions are executed by the processor, the electronic device executes the relevant method steps in the above method embodiment.

[0196] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program code is stored. When the processor executes the computer program code, the electronic device executes the relevant method steps in the method embodiment.

[0197] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, it enables the computer to execute the relevant method steps in the above method embodiment.

[0198] The embodiment of the present application also provides a display device, which includes a system-level chip, a touch display driver chip and a display panel. The system-level chip is used to obtain a first image. The system-level chip is also used to determine a target refresh rate based on the pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of the content contained in the first image. The system-level chip is also used to send the target refresh rate and the first image to the touch display driver chip and the touch display driver chip, which are used to drive the display panel to display the first image according to the target refresh rate. The display panel is used to display the first image according to the target refresh rate.

[0199] The embodiment of the present application also provides a display device, which includes a system-level chip, a touch display driver chip and a display panel. The system-level chip is used to obtain a first image. The system-level chip is also used to send the first image to the touch display driver chip. The touch display driver chip is used to determine the target refresh rate based on the pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of the content contained in the first image. The touch display driver chip is also used to drive the display panel to display the first image according to the target refresh rate. The display panel is used to display the first image according to the target refresh rate.

[0200] Among them, the wearable device, computer storage medium, display device or computer program product provided in this application is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0201] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0202] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of modules or units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0203] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0204] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0205] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including a number of instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0206] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A display method, characterized in that: The method comprises: acquiring a first image; Determining a target refresh rate according to pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of content contained in the first image; The first image is displayed according to the target refresh rate.

2. The method according to claim 1, characterized in that: The step of determining the target refresh rate according to the pixel brightness information of the first image includes: Obtaining a target area corresponding to pixels in the first image according to pixel brightness information of the first image, wherein the target area is used to represent an area occupied by pixels in the first image whose brightness values ​​are greater than a preset threshold; Calculating a target ratio of the area of ​​the target area to the image area of ​​the first image; The target refresh rate is determined according to the target ratio.

3. The method according to claim 2, characterized in that The step of determining the target refresh rate according to the target ratio and the pixel brightness information of the first image includes: When the target ratio is greater than or equal to a first preset value, determining the target refresh rate to be a first refresh rate; When the target ratio is less than the first preset value, the target refresh rate is determined to be a second refresh rate; and the first refresh rate is greater than the second refresh rate.

4. The method according to any one of claims 1 to 3, characterized in that: The step of determining the target refresh rate according to the pixel brightness information of the first image includes: A first trigger operation is detected, and the target refresh rate is determined according to pixel brightness information of the first image.

5. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: Acquire a second image; wherein the second image includes a first image area and a second image area, and the first image area and the second image area do not overlap; determining a third refresh rate according to pixel brightness information of the first image area; determining a fourth refresh rate according to pixel brightness information of the second image area; The first image area and the second image area are displayed according to the third refresh rate and the fourth refresh rate, respectively.

6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: Acquire a third image, wherein the third image includes a preset initial background image; Based on the first moment and the third image, a fourth image is generated; the first moment is used to represent the time when the fourth image is generated; determining a fifth refresh rate according to pixel brightness information of the fourth image; The fourth image is displayed according to the fifth refresh rate.

7. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: A first prompt message is output, where the first prompt message is used to prompt that the screen refresh rate has started to be adjusted.

8. A display device, characterized in that: The display device includes a system-level chip, a touch display driver chip and a display panel; The system-on-chip is used to acquire a first image; The system-level chip is further used to send the first image to the touch display driver chip; The touch display driver chip is used to determine a target refresh rate according to pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of the content contained in the first image; The touch display driver chip is further used to drive the display panel to display the first image according to the target refresh rate; The display panel is used to display the first image according to the target refresh rate.

9. A display device, characterized in that: The display device includes a system-level chip, a touch display driver chip and a display panel; The system-on-chip is used to acquire a first image; The system-level chip is further used to determine a target refresh rate according to pixel brightness information of the first image; the pixel brightness information of the first image is used to characterize the richness of content contained in the first image; The system-level chip is further used to send the target refresh rate and the first image to the touch display driver chip; The touch display driver chip is used to drive the display panel to display the first image according to the target refresh rate; The display panel is used to display the first image according to the target refresh rate.

10. An electronic device, characterized in that: The electronic device includes: a processor, a memory and a display screen, wherein the memory and the display screen are coupled to the processor, the display screen is used to display images, and the memory is used to store computer-readable instructions. When the processor reads the computer-readable instructions from the memory, the electronic device executes the display method as described in any one of claims 1 to 7.

11. A chip system, characterized in that: The chip system includes at least one processor and at least one interface circuit, wherein the at least one interface circuit is used to perform transceiver functions and send instructions to the at least one processor, and the at least one processor executes the instructions, and the at least one processor executes the display method as described in any one of claims 1-7.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a computer program, and when the computer program is executed on an electronic device, the electronic device executes the display method according to any one of claims 1 to 7.

Images