Image display method and electronic equipment

By increasing the frequency of vertical synchronization signal and outputting VSync signals in advance, the problem of the waiting time for electronic devices to prepare for image display data during user interaction is solved, improving chirality and response speed, and saving device power consumption.

CN119091780AActive Publication Date: 2024-12-06HONOR DEVICE CO LTD

Patent Information

Application Number
CN202411198779.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2024-01-09
Filing Date
2024-08-28
Publication Date
2024-12-06
Estimated Expiration
2044-08-28

AI Technical Summary

Technical Problem

When the electronic device interacts with the user touching the display screen, the image display driver waits for a long time to write image data to the display screen, resulting in poor chiral performance in response to the user's touch operation, especially when the high refresh rate is still felt. Poor chirality.

Method used

By increasing the frequency of the vertical synchronization signal, outputting the VSync signal in advance, shortening the duration of waiting for the next VSync signal after the image display data is ready, and improving the speed of image display and responding to user interaction.

Benefits of technology

It effectively shortens the response time of electronic devices in response to user touch operations, improves the chirality of the display screen changing with user interaction, and reduces device power consumption and waste.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119091780A_ABST
    Figure CN119091780A_ABST
Patent Text Reader

Abstract

The invention provides an image display method, which is applied to electronic equipment comprising a display screen, and comprises the following steps: at a first moment, generating a first Vsync signal, responding to the first Vsync signal, and starting to display a first image, the first Vsync signal corresponding to a first Vsync signal period, and the first display duration of displaying the first image being the same as the duration of the first Vsync signal period; at a second moment, a second Vsync signal is generated, a second image is started to be displayed in response to the second Vsync signal, the second Vsync signal corresponds to a second Vsync signal period, the second moment is after the first moment, and the second image is the next frame of image of the first image; after the second image starts to be displayed, whether display data of a third image is synthesized or not is detected, and the third image is the next frame of image of the second image; and if the display data of the third image is synthesized, issuing a control instruction for controlling the frequency of generating the Vsync signal to the display screen. According to the scheme, the image display speed of the electronic equipment can be increased, and the chirality is improved.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application claims the priority of the Chinese patent application filed with the State Intellectual Property Office on January 9, 2024, with application number 202410035569.5 and application name “Image Display Method and Electronic Device”, all contents of which are incorporated by reference in this application. Technical Field

[0002] The present application relates to the field of display technology, and in particular to an image display method and an electronic device. Background Art

[0003] The refresh rate of the display screen of the electronic device can be 60 Hz, 70 Hz, 75 Hz, 80 Hz, 90 Hz or 120 Hz, etc. When the display screen uses different refresh rates for image display, the time length that the image display driver of the electronic device waits for sending the image to the display screen to drive the display screen to display the screen change is also different. Take the display screen using refresh rates of 60 Hz and 120 Hz for image refresh display as an example. When the display screen uses a refresh rate of 60 Hz, the waiting time for the image display driver to write the display data of the image to the display screen can reach up to 1 / 60 seconds (s) = 0.01667 (s) = 16.667 milliseconds (ms). When the display screen uses a refresh rate of 120 Hz, the waiting time for the image display driver to write the display data of the image to the display screen also needs to reach up to 1 / 120 (s) = 0.00833 (s) = 8.33 (ms).

[0004] However, when users use electronic devices, it is common for them to touch the display screen to interact. If the image display driver waits for the display data of the image to be written to the display screen to drive the display screen to display the image, the longer the electronic device's overall response to the user's touch operation to display the screen changes will be worse. Even when the electronic device's display screen uses a 120Hz refresh rate to respond to the user's touch operation to display the screen changes, the user will still feel that the screen changes are poorly followed. Therefore, how to effectively shorten the response time of the electronic device to the user's touch operation, thereby improving the display screen's follow-up performance with the user's touch operation, is a technical problem that needs to be solved in the current field. Summary of the invention

[0005] The embodiments of the present application provide an image display method and an electronic device, which are used to shorten the response time of the electronic device in response to a user touch operation, speed up the image display speed, and thus improve the tracking performance of the display screen as the user touch operation changes.

[0006] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0007] In a first aspect, an image display method is provided, which is applied to an electronic device, the electronic device including a display screen, the method comprising: at a first moment, the electronic device generates a first Vsync signal, and in response to the first Vsync signal, the display screen displays a first image; wherein the first Vsync signal corresponds to a first Vsync signal cycle, the first Vsync signal cycle corresponds to a first display duration, and the first display duration is the display duration of the first image. At a second moment, the electronic device generates a second Vsync signal, and in response to the second Vsync signal, the display screen displays a second image; wherein the second Vsync signal corresponds to a second Vsync signal cycle, the second Vsync signal cycle is equal to the first Vsync signal cycle, and the second moment is after the first moment; at a third moment, in response to the display data of the third image being ready, the electronic device generates a third Vsync signal; wherein the third Vsync signal corresponds to a third Vsync signal cycle, the third moment is after the second moment, and the third Vsync signal cycle is less than the first Vsync signal cycle.

[0008] In the embodiment of the present application, after the display data of the image is prepared, the frequency of the vertical synchronization signal is increased by the image display driver of the electronic device, and the display data of the target image obtained by the electronic device in response to the user's interactive operation is written to the display screen of the electronic device by the image display driver in response to the vertical synchronization signal after the frequency is increased, so as to realize the rapid driving of the display screen to display the target image. In this way, the present solution can effectively shorten the time that the image waits for display after the display data is prepared, thereby speeding up the image display. For the scenario where the user touches the display screen to interact, the present solution can shorten the response time of the electronic device to the user's touch operation, thereby improving the chirality of the device's display screen changing with the user's interactive operation.

[0009] In the present application, since the image display driver increases the frequency of the vertical synchronization signal, after receiving the display data of the image corresponding to the user interaction operation, the image display driver can respond to the vertical synchronization signal with the increased frequency, and write the display data of the image to the display screen with only a very short waiting time, thereby realizing fast driving of the display screen to refresh the image display.

[0010] In a possible implementation, the second Vsync signal period corresponds to a second display duration, the second display duration is shorter than the first display duration, and the second display duration is the display duration of the second image.

[0011] In a possible implementation, the first display duration is 16.6 ms, and the second display duration is 13.8 ms.

[0012] In a possible implementation manner, the second display duration is a difference between the first Vsync signal period and the third Vsync signal period.

[0013] In the present application, there may be a situation where the time between the image waiting for the next VSync signal to be generated after the display data is prepared exceeds two 360Hz cycles, that is, exceeds 5.6ms. In this case, the present application can increase the frequency of the output Vsync signal to 360Hz, and output the next VSync signal 2.8ms in advance, that is, the second display time is the difference between the first Vsync signal cycle and the third Vsync signal cycle. In another example, the present application can also increase the frequency of the output VSync signal to 360Hz, and output the next VSync signal 5.6ms in advance.

[0014] It is understandable that the time values ​​mentioned in this application are approximate values ​​and can be adjusted within a smaller range. For example, 2.8ms can also be 2.7ms, and 5.5ms can also be 5.4ms, and this application does not limit this.

[0015] In a possible implementation, the second Vsync signal period corresponds to a second display duration, the second display duration is greater than the first display duration, and the second display duration is the display duration of the second image.

[0016] In a possible implementation, in response to the third Vsync signal, the display screen displays a third image, where the third image is a next frame image of the second image.

[0017] In a possible implementation, at a fourth moment, the electronic device generates a fourth Vsync signal, and in response to the fourth Vsync signal, the display screen displays a fourth image; wherein the fourth moment is after the third moment, the fourth Vsync signal corresponds to a fourth Vsync signal cycle, the fourth Vsync signal cycle corresponds to a fourth display duration, the fourth display duration is the display duration of the fourth image; the fourth display duration is equal to the first display duration. Thus, after the application outputs the third Vsync signal in advance, the electronic device will maintain the display duration of the fourth image.

[0018] In the present application, after determining that the display screen has stabilized the display of the third image, the frequency of the output Vsync signal can be reduced, so as to avoid the display screen outputting the Vsync signal with an increased frequency for a long time, causing a waste of device power consumption, thereby achieving the purpose of saving device power consumption.

[0019] In a possible implementation, at the fifth moment, the electronic device generates a fifth Vsync signal; wherein the fifth Vsync signal corresponds to the fifth Vsync signal period, and the fifth Vsync signal period is equal to the first Vsync signal period. In the present application, after the electronic device maintains the display duration of the fourth image, during the display process of the fifth image which is the next frame of the fourth image, it can continue to detect the duration between the time when the next frame of the fifth image is waiting for the next moment when the Vsync signal will be generated after the display data preparation is completed.

[0020] In a possible implementation manner, the first image is a previous frame image of the second image.

[0021] In a possible implementation, when the display screen displays the first image, the time length that the display data of the second image waits for the second Vsync signal is greater than 2.8ms. In the present application, the time length that the display data of the previous frame of the image waits for the next Vsync signal after preparation is completed can also be detected. If it is greater than the set time length (2.8ms), the Vsync signal with the frequency increased can be output in advance.

[0022] In a possible implementation, the first Vsync signal period is 16.6 ms, and the third Vsync signal period is 2.8 ms. It is understandable that the maximum refresh rate of 360 Hz of the electronic device corresponds to a period of 2.8 ms, so the frequency of the third Vsync signal is increased to 360 Hz at most.

[0023] In one possible implementation, the electronic device also includes an image display driver; the method also includes: in response to the display screen displaying the second image, the image display driver detects whether the display data of the third image is ready; in response to the display data of the third image being ready, the image display driver sends a control instruction to the display screen, and the display screen generates a third Vsync signal.

[0024] In one possible implementation, the electronic device adds a frame tracking detection module in the system kernel layer, and detects whether the image display data is ready through the frame tracking detection module. When the frame tracking detection module detects that the image display data is ready, the frequency of the Vsync signal output by the display screen is increased to shorten the waiting time for display after the image display data is ready, thereby achieving the purpose of improving the tracking performance.

[0025] In a second aspect, the present application provides an electronic device having the function of implementing the method described in the first aspect. The function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0026] In a third aspect, the present application provides an electronic device comprising: a processor and a memory; the memory is used to store computer program code, the computer program code includes computer execution instructions, and when the electronic device is running, the processor executes the computer execution instructions to enable the electronic device to perform the method described in the first aspect above.

[0027] In a fourth aspect, the present application provides an electronic device, comprising: a processor; the processor is used to couple with a memory, and after reading instructions in the memory, execute the method described in the first aspect according to the instructions.

[0028] In a fifth aspect, the present application provides a computer-readable storage medium, which stores computer instructions. When the computer-readable storage medium is run on an electronic device, the electronic device can execute the method described in the first aspect above.

[0029] In a sixth aspect, the present application provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the method described in the first aspect above.

[0030] In a seventh aspect, a device (for example, the device may be a display system) is provided, the device including a processor for supporting an electronic device to implement the functions involved in the first aspect. In a possible design, the device also includes a memory for storing program instructions and data necessary for the electronic device.

[0031] Among them, the technical effects brought about by any design method in the second to seventh aspects can refer to the technical effects brought about by different implementation methods in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0033] Figure 2 A schematic diagram of a system architecture of an electronic device in conventional technology;

[0034] Figure 3 A schematic diagram of the principle of layer drawing, rendering, synthesis and image frame display of an electronic device in conventional technology;

[0035] Figure 4 A schematic diagram of a system architecture of an electronic device in an embodiment of the present application;

[0036] Figure 5 A schematic diagram of the principles of layer drawing, rendering, synthesis and image frame display by an electronic device in an embodiment of the present application;

[0037] Figure 6 A schematic diagram of the principles of another electronic device performing layer drawing, rendering, synthesis and image frame display in an embodiment of the present application;

[0038] Figure 7 A schematic diagram of the principles of another electronic device performing layer drawing, rendering, synthesis and image frame display in an embodiment of the present application;

[0039] Figure 8 A schematic diagram of a method for displaying an image provided in an embodiment of the present application Figure 1 ;

[0040] Fig. 9 A schematic diagram of the principles of another electronic device performing layer drawing, rendering, synthesis and image frame display in an embodiment of the present application;

[0041] Fig.10 A schematic diagram of the principles of another electronic device performing layer drawing, rendering, synthesis and image frame display in an embodiment of the present application;

[0042] Fig.11 A schematic diagram of the principles of another electronic device performing layer drawing, rendering, synthesis and image frame display in an embodiment of the present application;

[0043] Fig.12 A schematic diagram of the duration of displaying an image on a display screen in a case involved in an embodiment of the present application;

[0044] Fig.13 A schematic diagram of the principle of an electronic device sending and displaying an image in response to a Vsync signal with an increased frequency in a case involved in an embodiment of the present application;

[0045] Fig.14 A schematic diagram of the system architecture and data signal flow of an electronic device involved in an embodiment of the present application;

[0046] Fig.15 A control logic diagram for image display of an electronic device involved in an embodiment of the present application;

[0047] Fig.16 A schematic diagram of a method for displaying an image provided in an embodiment of the present application Figure 2 ;

[0048] Fig.17 Another control logic schematic diagram of an electronic device for displaying an image according to an embodiment of the present application;

[0049] Fig.18 A control logic diagram for obtaining the time length for a second image to wait for the next Vsync signal after display data preparation is completed provided in an embodiment of the present application;

[0050] Fig.19 A schematic diagram of a flow chart of configuring a frame tracking solution provided in an embodiment of the present application;

[0051] Fig. 20 A schematic diagram of the structure of a chip system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0052] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. The following terms "first", "second", etc. are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, features defined as "first", "second", etc. may explicitly or implicitly include one or more of the features.

[0053] An embodiment of the present application provides an image display method, which can be applied to an electronic device including a display screen. In response to the completion of the preparation of image display data, the frequency of the vertical synchronization signal output by the display screen is increased, so that the image display driver of the electronic device responds to the vertical synchronization signal with a higher frequency to send and display the image, thereby realizing rapid driving of the display screen to display the image.

[0054] It should be noted that the above-mentioned electronic device can be a mobile phone, a tablet computer, a desktop / laptop / handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), an augmented reality (AR) / virtual reality (VR) device, and other electronic devices with a display screen. The embodiments of the present application do not impose any special restrictions on the specific form of the electronic device.

[0055] The implementation of the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0056] Please refer to Figure 1 , Figure 1 FIG. 1 is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application. Figure 1As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 111, a power management module 112, a battery 113, an antenna 1, an antenna 2, a mobile communication module 140, a wireless communication module 150, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0057] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0058] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural-network processing unit (neural-network processing unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. Among them, the controller can be the nerve center and command center of the electronic device 100. The controller can generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions.

[0059] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0060] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0061] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0062] The charging management module 111 is used to receive charging input from a charger. While the charging management module 111 charges the battery 113, it can also power the electronic device through the power management module 112. The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 140, the wireless communication module 150, the modem processor and the baseband processor.

[0063] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0064] The mobile communication module 140 can provide solutions for wireless communications including 2G / 3G / 4G / 5G / 6G applied to the electronic device 100. The modulation and demodulation processor may include a modulator and a demodulator. The wireless communication module 150 can provide solutions for wireless communications including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc. applied to the electronic device 100.

[0065] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0066] The display screen (or screen) 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel may include, but is not limited to, a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode or an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini organic light-emitting diode (MINILED), a micro organic light-emitting diode (MicroLed), a quantum dot light emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0067] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0068] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 200 .

[0069] The internal memory 121 may be used to store computer executable program codes, wherein the executable program codes include instructions.

[0070] The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0071] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0072] The buttons 190 include a power button, a volume button, etc. The indicator 192 may be an indicator light.

[0073] The sensor module 180 may include a folding angle detection sensor, a pressure sensor, a gyro sensor, an air pressure sensor,

[0074] Magnetic sensor, acceleration sensor, distance sensor, proximity light sensor, fingerprint sensor, temperature sensor, touch sensor, ambient light sensor, bone conduction sensor, etc.

[0075] It should be noted that, in the embodiment of the present application, the display screen of the electronic device to which the image display method provided by the embodiment of the present application is applied belongs to the type of screen that supports source chip (Source IC) refresh interruption. Among them, the Source IC refresh interruption means that the Source IC of the display screen can be interrupted by the driver at any time when it is not in the refresh state (referred to as Source refresh interruption), so as to re-enter the refresh state and start working. The work performed by the Source IC in the refresh state can be: refreshing the display data of the image so that the display screen starts to display the image, or, responding to the frame cutting instruction to switch the refresh rate of the display screen.

[0076] Exemplarily, the display screen of the electronic device may be a display screen that uses low temperature polysilicon oxide (LTPO) transistors, thereby supporting Source refresh interrupts based on the low leakage characteristics of LTPO. However, the display screen of the electronic device is usually not a display screen that uses low temperature polysilicon (LTPS) transistors. Because as the leakage of the transistor increases, even if the Source refresh interrupt can still be supported, the overall display effect of the display screen will be seriously affected. Therefore, due to the serious leakage characteristics of LTPS, the display screen using LTPS usually does not support the function of Source refresh interrupts. Therefore, it can be understood that as long as the display screen of the electronic device uses transistors with low leakage characteristics, it can support Source refresh interrupts.

[0077] Based on different design requirements of actual applications, the transistor types that can be used for the display of electronic devices can of course be other types besides LTPO. However, no matter what type of transistors are used in the display screen, and whether the transistors have the characteristic of low leakage current and can support source refresh interrupts, as long as the display screen of the electronic device is a screen type that supports source refresh interrupts, it should be included in the protection scope of the image display method provided in the embodiments of the present application.

[0078] In an embodiment of the present application, the basic frequency supported by the display screen of the electronic device may be 60 Hz, 70 Hz, 75 Hz, 80 Hz, 90 Hz, 120 Hz or 360 Hz, etc. The refresh rate of the display screen for displaying images (abbreviated as image refresh rate or display frame rate) is less than or equal to the basic frequency supported by the display screen. Moreover, the image refresh rate supported by the display screen is generally less than or equal to 120 Hz. For example, the image refresh rate of the display screen can generally be configured as 60 Hz, 70 Hz, 75 Hz, 80 Hz, 90 Hz or 120 Hz.

[0079] When the display screen supports a 120Hz image refresh rate, the display screen can increase the image refresh rate from 60Hz, 70Hz, 75Hz, 80Hz, 90Hz to 120Hz, or reduce it from 120Hz to 90Hz, 80Hz, 75Hz, 70Hz or 60Hz. The image refresh rate of the electronic device in the embodiment of the present application is the image refresh rate currently used by the display screen of the electronic device. Therefore, in some feasible embodiments of the present application, the image refresh rate of the electronic device or the image refresh rate of the display screen of the electronic device may also be referred to as the current refresh rate.

[0080] It should be noted that in the embodiment of the present application, the vertical synchronization (VSync) signal is a periodic discrete signal involved in the process of applying the VSync technology to the electronic device. That is, there will be a VSync signal triggered by the hardware driver every VSync period (also known as a refresh period or refresh duration, etc.).

[0081] It should be noted that, in the embodiment of the present application, the VSync signal is used to trigger the hardware to refresh the displayed image frame. The VSync signal can be generated by the display screen and fed back to the APP, the modem processor, the GPU, the ISP, and the controller. Therefore, the VSync signal can also be considered as a type of tearing effect (TE) signal fed back from the display screen 194 to the processor 110.

[0082] In an embodiment of the present application, when the display screen supports a basic frequency of 360 Hz, the display screen can adaptively switch the frequency of the output VSync signal to 60 Hz, 90 Hz, 120 Hz or 360 Hz based on the control of the image display driver in the electronic device, thereby triggering and outputting VSync signals with different VSync cycles at different times.

[0083] In different systems or architectures, the name of the VSync signal may be different. For example, in some systems or architectures, the VSync signal may specifically be VSYNC_APP, or it may be VSYNC_SF or VSYNC_HW. However, no matter what the name of the VSync signal is, as long as it is a synchronization signal with similar functions and conforms to the technical ideas of the method provided in the embodiments of the present application, it should be covered within the scope of protection of the present application. Moreover, in different systems or architectures, the definition of the VSync signal may also be different, but no matter what definition is made for the VSync signal, as long as it is a synchronization signal with similar functions and conforms to the technical ideas of the method provided in the embodiments of the present application, it should also be covered within the scope of protection of the present application.

[0084] It should be noted that the software system of the electronic device can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture or a cloud architecture. For ease of understanding, the present application embodiment takes the Android system with a layered architecture as an example to describe in detail the image display method provided by the present application embodiment when the electronic device is applied.

[0085] The following will be combined Figure 2 Taking the example of an electronic device responding to a VSync signal to send (or write) an image to a display screen for display, the software and hardware processing flow of the electronic device of the Android system in this process is introduced.

[0086] like Figure 2 As shown, the software and hardware architecture of the electronic device adopts a layered design. Among them, the software layer includes the application layer (Application Layer, APP Layer), the application framework layer (Application Framework Layer, FWKLayer), the hardware abstraction layer (HAL) and the kernel layer (Kernel Layer), and the hardware layer includes the display screen (panel). Among them, the application layer can include various applications running in the electronic device, such as: gallery, browser, theme application and wallpaper application. The application framework layer mainly involves graphics processing services, such as: image rendering service (surface flinger, SF) for rendering the image to be displayed given by the application, and image synthesis service (GPU) for synthesizing multiple layers of the image to be displayed. The kernel layer mainly includes the image display driver, which is mainly used to send the image to be displayed processed and issued by the upper layer of the system (other system layers above the kernel layer where the image display driver is located, such as the application layer, the application framework layer and the hardware abstraction layer) to the display screen. The hardware layer mainly includes the display screen (panel) that refreshes the image to be displayed based on the call of the image display driver.

[0087] Among them, in the image display processing flow of the electronic device, VSync alignment can be performed between APP and SF, and between SF and the driver, or VSync alignment can be performed without VSync alignment. If VSync alignment is not performed between APP and SF, and between SF and the driver, the hand tracking performance of the electronic device can be further improved. The following description will be made by taking the case where VSync alignment is not performed between APP and SF, and between SF and the driver as an example.

[0088] In such Figure 2In the system framework of the electronic device shown, the application APPs such as the gallery, browser, theme application or wallpaper application of the application layer perform image drawing, and then the APP sends the drawn image to the application framework layer, so that the SF and GPU in the application framework layer respectively perform image rendering and layer synthesis processing on the drawn image to obtain the display data of the image to be displayed, and pass the display data of the image to be displayed to the image display driver of the kernel layer through the hardware abstraction layer. Furthermore, the image display driver responds to the new VSync signal to call the display module serial interface (display serial interface, DSI) through the smart display engine (smart display engine, SDE), and writes the display data of the image to be displayed into the display driver chip (display driver integrated circuit, DDIC) of the display screen, and the DDIC of the display screen can store the image data sent by the software side in the buffer, so as to control the display panel to complete the refresh display of the image by scanning (or reading) the display data in the buffer.

[0089] For scenarios that pursue extreme tracking, VSync alignment is not required between APP and SF, as well as between SF and driver. The goal at this time is to display a frame of image on the display as quickly as possible after the APP draws it.

[0090] In a game scenario with a frame rate of 60Hz, Figure 3 As shown, the DDIC of the display screen of the electronic device supports a 60Hz image refresh rate. When the DDIC refreshes and outputs the vertical synchronization signal at a frequency of 60Hz, the VSync period of the output vertical synchronization signal is approximately 16.6ms, and thus, the display time of the display screen to display the image is also approximately 16.6ms.

[0091] At time t1, the display screen responds to VSync signal 1 and starts to display image-1 for 16.6ms. During the display of image-1, the APP of the electronic device application layer starts to draw image 0. After image 0 is drawn, the SF of the electronic device application framework layer renders the image 0 drawn by the APP through the rendering service render server (also called render thread), and after SF completes the rendering of image 0, it will further send image 0 downward to the GPU, so that after receiving image 0, the GPU immediately starts to process the layer synthesis of image 0. Then, after synthesis, image 0 is sent to the image display driver. Wait until time t2, the image display driver responds to the VSync signal 2 output by the display screen to write the display data of image 0 to the display screen, so that the display screen refreshes and displays image 0 at time t2 until time t3.

[0092] After time t2, the APP of the electronic device application layer starts to draw image 1. After image 1 is drawn, SF renders image 1 sent by APP, and after SF completes rendering of image 1, it further sends image 1 to GPU, so that after receiving image 1, GPU starts to process layer synthesis of image 1. At this time, after GPU completes synthesis of image 1, it will synchronously send the display data of image 1 to the image display driver of the electronic device system kernel layer (that is, the moment when GPU completes image synthesis also means that the image display driver has received the display data of synthesized image 1). Therefore, after GPU completes synthesis of image 1 before time t3 and sends image 1 to the image display driver, the image display driver writes the display data of image 1 to the display screen in response to VSync signal 3 at time t3, so that the display screen refreshes and displays image 1 at time t3.

[0093] After time t3, while the display screen is displaying image 1, the APP starts drawing image 2. After image 2 is drawn, the SF renders image 2 sent by the APP. After SF finishes rendering image 2, it further sends image 2 to the GPU. After receiving image 2, the GPU starts to perform layer synthesis on image 2. Figure 3 It can be seen that image 2 has been synthesized at time t0, and the GPU synchronously sends the display data of image 1 to the image display driver of the electronic device system kernel layer. At this time, the image display driver waits from time t0 to time t4, the display screen generates VSync signal 4, and the image display driver writes the display data of image 2 to the display screen in response to VSync signal 4 at time t4, so that the display screen refreshes and displays image 2 at time t4.

[0094] At time t5, since the APP has completed the original image display demand of the electronic device before time t5 and does not draw a new image, and the electronic device has not generated a new image display demand from time t4 to time t5, the display screen will no longer continue to refresh the image after it finishes displaying image 2 at time t5. At this time, the display screen enters a dormant or off-screen state.

[0095] In combination with the above, after the display data of Image 2 is prepared, that is, after Image 2 completes the drawing of the APP, the rendering of the SF and the synthesis processing of the GPU, the time waiting for the next VSync signal (VSync signal 4) to arrive in the image display driver is long, and Image 2 cannot be displayed on the display screen faster.

[0096] Therefore, in a game scene that pursues high chirality, if a frame of image needs to wait for a long time before it can be displayed on the display screen after the display data is prepared, it will result in failure to respond to the user's interactive operations on the interface in a timely manner, resulting in poor chirality and affecting the user's gaming experience.

[0097] In order to improve the hand tracking performance of an electronic device, the present application proposes an image display method, which improves the hand tracking performance of the electronic device by reducing the waiting time for the next VSync signal after the display data of the image is prepared.

[0098] It should be noted that the method proposed in the embodiment of the present application can be considered as a separate improvement relative to the above-mentioned solution of adjusting the software control logic of the upper layer of the electronic device system (such as the application layer, the application framework layer or the hardware abstraction layer), and can also be considered as a further optimization and supplement to the solution of adjusting the software control logic. That is, the image display method proposed in the embodiment of the present application is improved separately at the software control level of the electronic device system, and the method proposed in the embodiment of the present application is also creatively improved at the system hardware level, thereby combining the improvements at both the system software and hardware levels to further reduce the time the image waits for display after the display data is prepared, and greatly improve the hand tracking performance.

[0099] In a feasible implementation of the embodiment of the present application, as Figure 4 As shown, the method proposed in the embodiment of the present application can be used to detect whether the display data of the image is ready by adding a frame-chasing detection module in the kernel layer of the electronic device system. Based on this, when the display data of the image is detected to be ready by the frame-chasing detection module, the image display driver of the electronic device immediately increases the frequency of the VSync signal output by the display screen, advances the time of generating the VSync signal, and responds to the VSync signal with the increased frequency at the advanced time to drive the display screen to display the frame image. That is, the method proposed in the embodiment of the present application can enable the display screen to quickly display the next frame of the image when the display data of the image is ready, instead of requiring the display screen to display the next frame of the image after the display of the previous frame of the image corresponding to the corresponding VSync cycle is completed as in the traditional solution. In this way, it can effectively shorten the time for the image display driver to send the image to the display screen, speed up the speed at which the electronic device responds to the interactive operations performed by the user on the display screen, and thus improve the hand tracking of the electronic device. Among them, the frame-chasing here can be understood as setting the time in advance when the image display driver of the electronic device generates the VSync signal.

[0100] The method proposed in the embodiment of the present application improves the comprehensiveness of detecting whether the image display data is ready by configuring the frame tracking detection module in the image display driver of the kernel layer of the electronic device system, and improves the accuracy of the image display driver in instantly displaying the next frame of the image by increasing the frequency of the output VSync signal and outputting the frequency of the next VSync signal in advance.

[0101] Next, combine Figure 5 , a feasible specific implementation method of the image display method provided in an embodiment of the present application is described.

[0102] like Figure 5 As shown, if in a game scene with a frame rate of 60Hz, when the display screen of an electronic device (supporting a 360Hz base frequency) performs image refresh display at the current refresh rate of 120Hz, if image 2 is displayed after data preparation is completed (synthesis is completed), it will take a while to reach the moment of generating the next VSync signal. The image display method provided by the embodiment of the present application detects and identifies that when image 2 is displayed after data preparation is completed (synthesis is completed) through a newly added hardware module in the core layer of the electronic device system, namely, a frame tracking detection module, the image display driver responds to the completion of the display data preparation of image 2, and at time t4, the image display driver of the electronic device increases the frequency of the VSync signal output by the display screen to 360Hz, and outputs VSync signal 4 at time t4.

[0103] It is understandable that, since the maximum frequency of the VSync signal output by the display screen of the electronic device is 360 Hz, the corresponding Vsync period is 2.8 ms. Figure 5 In the figure, the time (t4) corresponding to the completion of the display data preparation of image 2 differs by 2.8ms from the time when the display screen is originally going to output the next VSync signal. Therefore, the image display driver of the electronic device can advance the time when the display screen outputs the next VSync signal by 2.8ms, that is, the display screen outputs the VSync signal 4 with the frequency increased at time t4 (the corresponding Vsync period is 2.8ms). The image display driver used to drive the display screen in the system kernel layer can write the received display data of image 2 to the display screen at time t4 in response to the VSync signal 4 after receiving the VSync signal 4. In this way, the display screen can start to display image 2 after the display data of image 2 is prepared, thereby reducing the time that image 2 waits for the next VSync signal after the display data preparation is completed.

[0104] In some feasible embodiments, the time corresponding to the completion of preparation of the display data of the image 2 may be earlier, that is, the duration between this time and the time when the display screen is originally going to output the next VSync signal is greater than 2.8 ms.

[0105] like Figure 6 As shown, if in a game scene with a frame rate of 60Hz, in the process of refreshing and displaying the image at the current refresh rate of 120Hz, if the image 2 waits for the next VSync signal for more than 2.8ms after the display data is prepared (synthesized), the image display method provided in the embodiment of the present application detects that the image 2 waits for the next VSync signal for more than 2.8ms after the display data is prepared (synthesized), by adding a new hardware module-frame tracking detection module in the kernel layer of the electronic device system. The image display driver of the electronic device increases the frequency of the VSync signal output by the display screen to 360Hz, and advances the time when the display screen outputs the next VSync signal by 2.8ms. Thus, the display screen outputs the VSync signal 4 with the frequency increased at time t4 (the corresponding Vsync period is 2.8ms), and the image display driver used to drive the display screen in the kernel layer of the system can write the received display data of the image 2 to the display screen in response to the VSync signal 4 at time t4 after receiving the VSync signal 4. In this way, the display screen can start displaying the image 2 at time t4, thereby shortening the time for the image 2 to wait for the next VSync signal after the display data is prepared.

[0106] like Figure 7As shown, if in a game scene with a frame rate of 60Hz, in the process of refreshing and displaying the image at the current refresh rate of 120Hz, the GPU of the system application framework layer performs the synthesis processing of image 2 for more than 16.6ms, that is, it exceeds the time t7, and the time when the GPU completes the synthesis processing of image 2 is t8. Then, the GPU will send the display data of image 2 to the image display driver of the kernel layer after the time t8, and thus cause the image display driver to miss the VSync signal generated at the time t7 and fail to send the image to the display screen at the time t7, resulting in the phenomenon that the display screen displays image 1 overtime. In view of this phenomenon, the image display method provided in the embodiment of the present application, when the electronic device detects through the frame tracking detection module that the time length of image 2 waiting for the next VSync signal after the display data preparation is completed exceeds 2.8ms, the frequency of the VSync signal output by the display screen is increased to 360Hz, and the time when the display screen outputs the next VSync signal is advanced by 2.8ms. Thus, the display screen can output the VSync signal 4 with the increased frequency at the time t4 (the corresponding Vsync period is 2.8ms). At time t4, the image display driver responds to VSync signal 4 and writes the display data of image 2 that has been synthesized by the GPU and sent to the image display driver before time t4 to the display screen, so that the display screen can start displaying image 2 at time t4, shortening the time that image 2 waits for the next VSync signal after the display data is prepared. In addition, the display timeout of image 1 is shortened.

[0107] Compared with the traditional solution, the image display method provided in the embodiment of the present application uses a newly added frame tracking detection module. When it is found that the image of the electronic device is ready for display data, the display screen increases the frequency of the VSync signal output by the display screen, and sets the time of outputting the VSync signal in advance, so that the image display driver can send and display the image instantly based on the VSync signal with the increased frequency at the advanced time. In this way, the display screen does not need to use a frame rate of 120hz (corresponding to 1 VSync cycle of 8.3ms) at the driver layer, as in the traditional solution, when a frame of image waits for the next VSync signal for longer than the set time (such as 2.8ms) after the display data is prepared, and the image display driver writes the image to the display screen for display, resulting in the problem that the image cannot be displayed quickly and the chirality is low. The embodiment of the present application can increase the frequency of the VSync signal output by the display screen, and advance the time when the display screen outputs the VSync signal, so as to write the image to the display screen in advance based on the VSync signal with the increased frequency, so as to realize the fast display of the next frame of the image by the display screen and improve the chirality. Therefore, the present application can advance the time of generating the next VSync signal after the display data of the image is prepared, and display the frame image in time, thereby improving the hand tracking performance of the electronic device.

[0108] Based on the overall overview of the image display method provided by the above-mentioned embodiment of the present application, the specific embodiments of the image display method provided by the embodiment of the present application are described in turn below.

[0109] Please refer to Figure 8 , Figure 8 The following is a flowchart of an image display method provided in an embodiment of the present application in a specific implementation. It should be understood that although Figure 8 The execution order of some method steps is shown in the figure, but the image display method provided in the embodiment of the present application can adopt an execution order different from the method steps shown in the figure based on different design requirements of actual applications. That is, Figure 8 The order of the steps in the method shown does not constitute a limitation on the execution logic order of the image display method provided in the embodiment of the present application. Figure 8 Reasonable changes in the sequence of steps of the method shown should be included in the protection scope of the image display method provided in the embodiments of the present application.

[0110] In a feasible embodiment of the image display method provided in the embodiment of the present application, when the image display method is executed by an electronic device, at a first moment, the electronic device generates a first Vsync signal, and in response to the first Vsync signal, the display screen of the electronic device starts to display the first image. At a second moment after the first moment, the electronic device generates a second Vsync signal. In response to the second Vsync signal, the display screen starts to display the second image. At a third moment after the second moment, in response to the display data of the second image being ready, the electronic device generates a third Vsync signal.

[0111] It should be noted that, in the embodiment of the present application, the first Vsync signal generated by the electronic device at the first moment corresponds to the first Vsync cycle, and the first Vsync cycle corresponds to the first display duration of the first image, that is, the first VSync cycle is equal to the first display duration. The second Vsync signal generated by the electronic device at the second moment corresponds to the second Vsync cycle, and the second Vsync cycle is equal to the first Vsync cycle. The third Vsync signal generated by the electronic device at the third moment corresponds to the third Vsync cycle, and the third Vsync cycle is less than the first Vsync cycle.

[0112] In the embodiment of the present application, the smaller the Vsync period, the higher the frequency of the output Vsync signal. The electronic device generates the third Vsync signal at the third moment in response to the display data of the third image being ready, which can be: the electronic device controls the display screen to increase the frequency of the trigger Vsync signal through its own image display driver when the display data of the third image is ready, so that the display screen outputs the third Vsync signal with the increased frequency at the third moment according to the increased frequency.

[0113] In the embodiment of the present application, by generating a third Vsync signal at a third moment, the display screen can start displaying the third image after the display data of the third image is prepared and the time the third image waits for the Vsync signal is extremely short.

[0114] In a feasible embodiment, the electronic device controls the display screen to advance the time of generating the Vsync signal through the image display driver, and increases the frequency of triggering the Vsync signal. The specific process of the electronic device generating the third Vsync signal at the third time can be referred to. Figure 8 S1 to S3 shown.

[0115] S1: Detect whether display data of the third image is ready.

[0116] In the embodiment of the present application, the image display driver of the electronic device detects in real time whether display data of the third image is ready after the display screen displays the second image in response to the second Vsync signal at the second moment.

[0117] It should be noted that, in the embodiment of the present application, the second image displayed on the display screen is the next frame image of the first image displayed on the display screen.

[0118] Exemplarily, the display screen uses 60 Hz as the current refresh rate to refresh the image, and uses the 60 Hz frequency as the frequency to trigger the Vsync signal. When the first Vsync signal is triggered at the first moment, the first Vsync period corresponding to the first Vsync signal is approximately 1 / 60≈16.6ms, that is, the display screen triggers a first Vsync signal every 16.6ms. At this time, the first display duration corresponding to the first Vsync period is also approximately 16.6ms, that is, the display screen refreshes and displays a frame of image every approximately 16.6ms. The display screen displays the second image in response to the second Vsync signal at the second moment, and detects whether the display data of the third image is ready when the display screen displays the second image.

[0119] Among them, since the second Vsync cycle is equal to the first Vsync cycle, after the display screen responds to the second Vsync signal to display the second image at the second moment, normally, the second display time for the display screen to continuously display the second image is also about 16.6ms, and the moment when the display of the second image ends can be recorded as moment 1, that is, the moment when the next Vsync signal will be generated. Then, before moment 1, the image display driver of the electronic device detects whether the display data of the third image is ready.

[0120] S2: When the display data of the third image is ready, the frequency of outputting the third Vsync signal is increased.

[0121] In the embodiment of the present application, the image display driver of the electronic device controls the display screen to increase the frequency of the output Vsync signal and generate a third Vsync signal when detecting that display data of the third image is ready during the process of the display screen displaying the second image.

[0122] Exemplarily, in the image display driver of an electronic device, when the display screen uses the current refresh rate of 60 Hz as the frequency of the output Vsync signal to display the second image, the image display driver detects that the display data of the third image is ready, and records the moment when the display data of the third image is ready as moment 2. Among them, moment 2 is before moment 1. If the duration between moment 2 and moment 1 is greater than or equal to the set duration, the set duration can be a period corresponding to the maximum refresh rate of 360 Hz of the electronic device, which is approximately 1 / 360≈2.8ms. That is to say, if the duration between moment 2 and moment 1 is greater than or equal to 2.8ms, the image display driver of the electronic device sends a control instruction to the display screen to increase the frequency of the currently used output Vsync signal of 60Hz, so that the display screen can be controlled to generate a third Vsync signal at a moment 2.8ms before moment 1.

[0123] If the duration between moment 2 and moment 1 is less than 2.8 ms, the image display driver of the electronic device sends a control instruction to the display screen to control the display screen to generate a third Vsync signal at moment 1. In addition, the image display driver can also control the display screen to increase the frequency of the currently used output Vsync signal of 60 Hz.

[0124] In other examples, if the duration between moment 2 and moment 1 is less than 2.8 ms, the image display driver of the electronic device may not send a control instruction to the display screen, and wait until moment 1 for the display screen to generate a third Vsync signal.

[0125] S3: Generate a third Vsync signal.

[0126] In the embodiment of the present application, if the duration between moment 2 and moment 1 is greater than or equal to 2.8 ms, then the third moment is the moment 2.8 ms before moment 1. If the duration between moment 2 and moment 1 is less than 2.8 ms, then the third moment is moment 1. At the third moment, the image display driver of the electronic device outputs a third Vsync signal with a frequency boost to the image display driver and other software and hardware modules.

[0127] It should be noted that in the embodiment of the present application, since the higher the frequency of the output Vsync signal, the smaller the Vsync period, therefore, after the display screen increases the frequency of the output Vsync signal, the third Vsync period corresponding to the third Vsync signal triggered at the third moment is smaller than the above-mentioned first Vsync period, and also smaller than the above-mentioned second Vsync period (when the display screen outputs the first Vsync signal at the first moment and outputs the second Vsync signal at the second moment, the frequency of the output Vsync signal has not yet been increased).

[0128] For example, after the electronic device controls the display screen to increase the frequency of the currently used output Vsync signal from 60 Hz to 360 Hz, the display screen outputs the third Vsync signal with the first output frequency increased after increasing the frequency of the output Vsync signal by about 2.8 ms according to the Vsync period 1 / 360≈2.8 ms corresponding to the increased frequency 360 Hz. At this time, the third Vsync period corresponding to the third Vsync signal is about 2.8 ms, which is less than the first Vsync period of about 16.6 ms.

[0129] In a feasible embodiment, the specific process of the display screen displaying the next frame image of the second image in response to the third Vsync signal can be further referred to. Figure 8 S4 shown.

[0130] S4: Writing display data of the third image.

[0131] It should be noted that, in the embodiment of the present application, the third image is the next frame image of the above-mentioned second image.

[0132] In the embodiment of the present application, in response to the electronic device generating a third Vsync signal at a third moment, the display screen displays a third image. That is, after the image display driver of the electronic device has received the display data of the third image sent by the upper layer of the system, in response to the third Vsync signal with a frequency boost output by the display screen at the third moment, the display screen writes the display data of the third image to the display screen, so that the display screen displays the third image at the third moment.

[0133] Exemplarily, assuming that the display screen of the electronic device supports a 360Hz base frequency, when the display screen uses the current refresh rate of 60Hz corresponding to the image display time of 16.6ms, in the process of displaying the image, the display screen uses the 60Hz frequency as the frequency of the output Vsync signal. After the display screen responds to the second Vsync signal at the second moment and starts to display the second image, the image display driver of the electronic device detects whether the display data of the third image is ready. Therefore, when the image display driver detects that the display data of the third image is ready, it controls the display screen to start the pre-set 360Hz-TE high-frequency synchronization scheme to control the display screen to increase the frequency of the output Vsync signal to 360Hz. In this way, the display screen outputs the third Vsync signal with the frequency increased according to the Vsync period 1 / 360≈2.8ms corresponding to the 360Hz frequency at the third moment. After receiving the third Vsync signal, the image display driver responds to the third Vsync signal and writes the display data of the third image sent by the upper layer of the system before the third moment to the display screen. In this way, the display screen starts to refresh and display the third image at the third moment. At this time, after the display data of the third image is ready, the time for waiting for the next Vsync signal is extremely short and will not exceed 2.8 ms.

[0134] In other feasible embodiments, if the time between the moment when the display data of the third image is ready and the moment 1 is exactly equal to 2.8 ms, then the moment when the display data of the third image is ready is the third moment. In this case, the display screen starts to refresh and display the third image at the moment when the display data of the third image is ready, and there is no process of waiting for the third image to be displayed.

[0135] It should be noted that in the embodiment of the present application, the 360Hz-TE high frequency synchronization scheme can be pre-added in the display screen, and the display screen can switch the frequency of the output Vsync signal based on the need of the Vsync signal output control scheme. It should be understood that based on the different design requirements of actual applications, other Vsync signal output control schemes of the same type but with different frequencies can also be pre-added in the display screen, for example, a 60Hz-TE low frequency synchronization scheme and a 120Hz-TE standard frequency synchronization scheme.

[0136] When the display screen responds to the synchronization scheme of a certain frequency, it outputs a Vsync signal according to the Vsync period corresponding to the frequency. For example, when the display screen responds to the 360Hz-TE high-frequency synchronization scheme, the Vsync period corresponding to the 360Hz frequency is 2.8ms, and a Vsync signal is output every 2.8ms. When the display screen responds to the 120Hz-TE standard frequency synchronization scheme, the Vsync period corresponding to the 120Hz frequency is 8.3ms, and a Vsync signal is output every 8.3ms. When the display screen responds to the 60Hz-TE low-frequency synchronization scheme, the Vsync period corresponding to the 60Hz frequency is 16.6ms, and a Vsync signal is output every 16.6ms.

[0137] In an embodiment of the present application, when the display screen of the electronic device uses 60 Hz as the current refresh rate for image refresh display, a 60 Hz-TE low-frequency synchronization scheme can be used by default to output a Vsync signal with 60 Hz as the original frequency.

[0138] Compared with the traditional solution, which always uses a 120Hz image refresh rate, the embodiment of the present application uses a 60Hz image refresh rate when the 360Hz-TE high-frequency synchronization solution is not enabled, and the number of times the 360Hz-TE is actually enabled is about one-third less than the number of times the 120Hz-TE is always enabled in the traditional solution. Therefore, the present solution can minimize the time the image waits for the Vsync signal after the display data is prepared, thereby achieving the performance requirements of high chirality while reducing the waste of power consumption.

[0139] In other feasible embodiments, the electronic device can also detect through the image display driver the duration that the previous frame image waits for the next Vsync signal after the display data preparation is completed. If the duration exceeds the first set duration, and the duration that waits for the next Vsync signal after the display data of the current frame image is completed exceeds the second set duration, then the image display driver can control the display screen to increase the frequency of the output Vsync signal, and in response to the Vsync signal with the frequency increased output by the display screen at this moment, write the display data of the current frame image to the display screen, so that the display screen starts to display the current frame image at this moment.

[0140] In some examples, the first set duration and the second set duration may be equal, both being 2.8 ms. In other examples, the first set duration and the second set duration may be unequal, the first set duration being 5.5 ms and the second set duration being 2.8 ms. In this application, the first set duration and the second set duration may be adjusted according to actual conditions, and there is no limitation on this.

[0141] like Fig. 9As shown, during the process of the display screen displaying image-1, the image display driver detects that the display data of image 0 is ready, and the waiting time for Vsync signal 2 exceeds 2.8ms. Then, during the process of the display screen responding to Vsync signal 2 and starting to refresh and display image 0 at time t2, if the image display driver detects that the waiting time for the next Vsync signal after the display data preparation of image 1 is also more than 2.8ms, at this time, the image display driver increases the frequency of the next Vsync signal and controls the display screen to output Vsync signal 3 2.8ms in advance. After receiving Vsync signal 3, the image display driver responds to Vsync signal 3 and writes the display data of image 1 sent by the upper layer of the system before time t3 to the display screen. In this way, the display screen starts to refresh and display image 1 at time t3.

[0142] Therefore, the electronic device shortens the time for the image to wait for the next Vsync signal after the display data is prepared, thereby speeding up the display speed of the image.

[0143] In other feasible embodiments, such as Fig.10 As shown, after reducing the display time of image 0, the electronic device will ensure that the display time of image 1 is normal, that is, the display time is kept at 16.6ms. At this time, at time t4, the electronic device can turn off the 360Hz high-frequency synchronization signal. Then, in the subsequent display process, the time for waiting for the next Vsync signal after the display data of image 3 is prepared is continued to be detected.

[0144] In other feasible embodiments, if the time between when image 2 waits for the next VSync signal to be generated after display data preparation is completed exceeds two 360Hz cycles, that is, exceeds 5.6ms, the present application can increase the frequency of the output VSync signal to 360Hz and output the next VSync signal 2.8ms in advance. Fig.10 As shown, the moment when the display data of image 2 is ready is before the moment t41, then the image display driver can control the display screen to output the VSync signal 4 with the frequency increased at the moment t42. Then, the image display driver responds to the VSync signal 4 output at the moment t42 and writes the received display data of image 2 to the display screen. In this way, the display screen can start to display image 2 at the moment t42, saving the time for image 2 to wait for the next VSync signal after the display data is ready.

[0145] In other feasible embodiments, if the time between when image 2 waits for the next VSync signal to be generated after display data preparation is completed exceeds two 360Hz cycles, that is, exceeds 5.6ms, the present application can increase the frequency of the output VSync signal to 360Hz and output the next VSync signal 5.6ms in advance. Fig.11 As shown, the moment when the display data of image 2 is ready is before the moment t41, then the image display driver can control the display screen to output the VSync signal 4 with the frequency increased at the moment t41. Then, the image display driver responds to the VSync signal 4 output at the moment t41 and writes the received display data of image 2 to the display screen. In this way, the display screen can start to display image 2 at the moment t41, saving the time for image 2 to wait for the next VSync signal after the display data is ready.

[0146] It is understandable that the advance time corresponding to the display screen generating the next VSync signal may be related to the number of 360Hz cycles that the time between the image waiting for the next VSync signal to be generated after the display data preparation is completed exceeds two 360Hz cycles. For example, if the time between the image 2 waiting for the next VSync signal to be generated after the display data preparation is completed exceeds two 360Hz cycles, then the image display driver may control the display screen to output the VSync signal 4 with the frequency increased 5.6ms in advance. If the time between the image 2 waiting for the next VSync signal to be generated after the display data preparation is completed exceeds one 360Hz cycle, then the image display driver may control the display screen to output the VSync signal 4 with the frequency increased 2.8ms in advance. In order to ensure that the refresh rate of the electronic device fluctuates less, generally speaking, even if the number of 360Hz cycles that the time between the image waiting for the next VSync signal to be generated after the display data preparation is completed exceeds two or more, the image display driver may control the display screen to output the VSync signal with the frequency increased only 2.8ms in advance.

[0147] In an embodiment of the present application, an electronic device detects the time that the previous frame image waits for the next Vsync signal after the display data is prepared through an image display driver to determine whether to increase the frequency of the next VSync signal of the current frame image after the display data is prepared. The time that the previous frame image waits for the next Vsync signal after the display data is prepared is related to the advance time corresponding to the next VSync signal generated by the display screen. The shorter the time that the previous frame image waits for the next Vsync signal after the display data is prepared, the greater the jitter of the displayed image; the longer the time that the previous frame image waits for the next Vsync signal after the display data is prepared, the smaller the jitter of the displayed image. For example, when the time that the previous frame image waits for the next Vsync signal after the display data is prepared is about 2.7ms, the frequency of triggering frame chasing is 100 / 600, and the greater the jitter of the displayed image, the average time that the image waits for the next Vsync signal after the display data is prepared is 4ms. When the previous frame image waits for the next Vsync signal for about 5.4ms after the display data is ready, the frequency of triggering frame chasing is 90 / 600, where the average time the image waits for the next Vsync signal after the display data is ready is 6ms. When the previous frame image waits for the next Vsync signal for about 8.1ms after the display data is ready, the frequency of triggering frame chasing is 80 / 600, where the average time the image waits for the next Vsync signal after the display data is ready is 9ms.

[0148] In traditional solutions, the driver layer uses a 120 Hz frame rate. However, in a game scenario with a frame rate of 60 Hz, the actual frame rate of the game engine is drawn at 60 Hz+ over a long period of time, but the time interval between two or more frames is uncontrollable. As a result, the following problems may occur: Fig.12 situations such as Fig.12 As shown, the DDIC of the display screen of the electronic device supports a 120Hz image refresh rate. When the DDIC refreshes and outputs the vertical synchronization signal at a frequency of 120Hz, the VSync period of the output vertical synchronization signal is about 8.3ms. Thus, in a 60Hz game scenario, each image usually needs to display two VSync periods of about 16.6ms.

[0149] The display screen starts to display image-1 for 16.6ms at time t1. During the display of image-1, if the APP of the electronic device application layer starts to draw image 0, and the SF of the electronic device application framework layer renders the image 0 previously sent by the APP through the rendering service renderserver (also called render thread), and after SF completes the rendering of image 0, it will further send image 0 downward to the GPU, so that after receiving image 0, the GPU immediately starts to process the layer synthesis of image 0. Since the time when image 0 is synthesized is more than t2, image 0 waits until t3 after synthesis, and writes the display data of image 0 to the display screen in response to the VSync signal output by the display screen, so that the display screen refreshes and displays image 0 at time t3 until time t5.

[0150] The APP of the electronic device application layer starts to draw image 1, and SF renders image 1 sent by APP, and after SF completes rendering of image 1, it further sends image 1 to GPU, so that after receiving image 1, GPU starts to process the layer synthesis of image 1. At this time, after GPU completes synthesis of image 1, it will synchronously send the display data of image 1 to the image display driver of the electronic device system kernel layer (that is, the moment when GPU completes image synthesis also means that the image display driver has received the display data of synthesized image 1). Therefore, after GPU completes synthesis of image 1 before time t5 and sends image 1 to the image display driver, the image display driver writes the display data of image 1 to the display screen in response to the VSync signal at time t5, so that the display screen refreshes and displays image 1 at time t5.

[0151] After image 1 is displayed for 16.6ms, that is, at time t7, since the synthesis completion time of image 2 is later than time t7, the image display driver fails to receive the display data of image 2 at time t7 and does not perform any image processing until the next VSync signal arrives. At this time, the display screen continues to display image 1 until a new VSync signal is generated at time t8. Then, the display length of image 1 is 25ms. At this time, image 2 has been synthesized, so the display screen refreshes and displays image 2 at time t8.

[0152] At time t9, a new VSync signal output by the display screen arrives. At this time, since the GPU has completed the synthesis of image 3 before time t9 and sent the display data of image 3 to the image display driver, the image display driver responds to the VSync signal at time t9 and writes the display data of image 3 to the display screen. The display screen starts to refresh and display image 3 at time t9 until time t11. Then, the display time of image 2 is 8.3ms, and the display time of image 3 is 16.6ms.

[0153] At time t11, since the APP has completed the original image display demand of the electronic device before time t11 and does not draw a new image, and the electronic device has not generated a new image display demand from time t9 to time t11, the display screen will no longer continue to refresh the image after it finishes displaying image 3 at time t11. At this time, the display screen enters a dormant or off-screen state.

[0154] In combination with the above, the electronic device may have an application layer APP drawing image timeout (not shown in the attached figure), which leads to the SF rendering image of the application framework layer and the GPU synthesis image of the application framework layer timeout, the SF rendering image of the application framework layer timeout leads to the GPU synthesis image of the application framework layer timeout, or the GPU synthesis image of the application framework layer timeout, thereby causing the image display driver of the kernel layer to miss the VSync signal to send the image to the display screen. Therefore, even if the electronic device uses a refresh rate of 120Hz at the driver layer, the display screen needs to timeout the image being displayed for a period (8.3ms) corresponding to the refresh rate of 120Hz.

[0155] Therefore, in the above game scenario, the electronic device may encounter a situation where the display data of a certain frame of image is generated slowly and the display data of the next frame of image is generated quickly, resulting in the display time of the previous frame of image exceeding the time limit, and the display time of the current frame of image is too short, and the display time of the next frame of image of the current frame of image returns to normal. Fig.12 In the case where the display data of image 1 is generated slowly and the display data of image 2 is generated quickly, the display time of image 1 is 25ms, the display time of image 2 is 8.3ms, and the display time of image 3 is 16.6ms. That is, at this time, the display screen shows that the current refresh rate increases from 40Hz to 120Hz, and then drops directly from 120Hz to 60Hz. For users, because the human eye is more sensitive to the fluctuation of refresh rate, the current refresh rate of the display screen increases from 40Hz to 120Hz, and then drops directly from 120Hz to 60Hz, which will be visually felt to be jittery.

[0156] In order to improve the hand tracking performance of electronic devices and reduce the actual jitter caused by frame rate fluctuations when actual freezes occur, the present application proposes an image display method, which reduces the time to wait for the next VSync signal after the image display data is prepared, and turns off the high-frequency TE signal for the duration of the next frame to ensure the continuation of the current refresh rate. This improves the hand tracking performance of electronic devices while making it difficult for users to notice jitter in the device display screen.

[0157] like Fig.13As shown, when the display screen of the electronic device (supporting 360Hz basic frequency) is refreshing and displaying the image at the current refresh rate of 60Hz, if the synthesis processing of the GPU of the system application framework layer on the image 2 exceeds the time (t7) when the VSync signal 4 is generated, then, when the electronic device detects that the time for the image 2 to wait for the next VSync signal after the display data is prepared exceeds 2.8ms, the frequency of the VSync signal output by the display screen is increased to 360Hz, and the time when the display screen outputs the next VSync signal is advanced by 2.8ms. Fig.13 As shown, the display screen can output the VSync signal 5 with the frequency increased at time t8 (the corresponding Vsync period is 2.8ms), and the image display driver responds to the VSync signal 5 at time t8, and writes the display data of image 2 that has been synthesized by the GPU and sent to the image display driver before time t8 to the display screen, so that the display screen can start to display image 2 at time t8, which greatly shortens the time for image 2 to wait for the next VSync signal after the display data is prepared. In addition, the display timeout of image 1 is shortened, and the display time of image 2 can be restored to normal.

[0158] Then, when the display screen starts to display image 2 at time t8, the display duration of image 2 will be maintained at 16.6ms, that is, the display will continue until time t10. In other words, if the display data of image 3 is ready before time t10, even if the time between the time when the display data of image 3 is ready and time t10 exceeds 2.8ms, the image display driver will not advance the time when the display screen outputs the next VSync signal. Instead, at time t10, the image display driver writes the display data of image 3 to the display screen in response to VSync signal 6, so that the display screen can start to display image 3 at time t10. And, the electronic device will maintain the display duration of image 3 at 16.6ms, that is, the display will continue until time t12.

[0159] Therefore, this solution can shorten the time that the image waits for display after the display data is prepared, reduce the timeout display time of the image, and stabilize the display time of subsequent images, so that the display time difference between adjacent images is small, which makes it difficult for users to notice the jitter of the device display screen.

[0160] In other feasible embodiments, each frame may be caught up. Since each frame is displayed in advance for a short time, generally only 2.8ms, although there may be a situation where the display time of several consecutive frames is different, the user's eyes cannot perceive the fluctuation of the frame rate because the difference in display time is short.

[0161] In the embodiment of the present application, the electronic device can determine whether to increase the frequency of the output Vsync signal by combining improvements at the software level and the hardware level. That is, the electronic device adds a new hardware module to the system kernel layer, and uses the hardware module to detect whether the image display data is ready. When the hardware module detects that the image display data is ready, the display screen increases the frequency of the Vsync signal output to shorten the waiting time for display after the image display data is ready, thereby achieving the purpose of improving the chirality. Fig.14 As shown, the electronic device newly configures a frame-chasing detection module in the image display driver of the kernel layer. Based on this, in response to the display screen starting to display the second image, the electronic device continuously detects whether the display data of the third image is ready through the frame-chasing detection module, and detects whether the time for the third image to wait for the next Vsync signal is greater than or equal to the set time (2.8ms). Afterwards, when the frame-chasing detection module detects that the display data of the third image is ready, and the time for waiting for the next Vsync signal is greater than or equal to 2.8ms, the image display driver sends a control instruction to the display screen to control the display screen to increase the frequency of the output Vsync signal.

[0162] In an embodiment of the present application, when the image display driver of the electronic device detects whether the time length of the third image waiting for the next Vsync signal is greater than or equal to the set time length, it can detect whether the time length of the third image waiting for the next Vsync signal is greater than or equal to the set time length during the process of the display screen displaying the second image through its newly added frame chasing detection module. When the frame chasing detection module detects that the time length of the third image waiting for the next Vsync signal is greater than or equal to the set time length, the image display driver determines that the third image meets the condition of outputting the next Vsync signal in advance.

[0163] When the image display driver determines that the time length of the third image waiting for the next Vsync signal is greater than or equal to the set time length, thereby outputting the Vsync signal in advance and increasing the frequency of the Vsync signal output by the display screen, the image display driver can send a control instruction to the display screen through the display module serial interface that establishes a communication connection between itself and the display screen. The display screen responds immediately after receiving the control instruction, thereby increasing the frequency of the output Vsync signal from the original frequency to the frequency indicated by the control instruction.

[0164] In an embodiment of the present application, when the frame tracking detection module detects that the time the third image waits for the next Vsync signal after the display data is prepared is greater than or equal to the set time, the image display driver of the electronic device immediately increases the frequency of the Vsync signal output by the display screen, sets the time in advance to output the Vsync signal with the increased frequency, and responds to the Vsync signal with the increased frequency to write the display data of the third image to the display screen to drive the display screen to display the third image. In this way, it can effectively reduce the time the third image waits for the next Vsync signal after the display data is prepared, thereby speeding up the display speed of the third image. In addition, it can also improve the comprehensiveness of detecting whether the time the third image waits for the next Vsync signal after the display data is prepared is greater than or equal to the set time, and increase the frequency of the output Vsync signal to enable the image display driver to instantly display the third image.

[0165] In other feasible embodiments, the frame chasing detection module can also be used to detect whether the time the second image waits for the next Vsync signal after the display data is prepared is greater than or equal to the set time. The electronic device detects through the frame chasing detection module that the time the second image waits for the next Vsync signal after the display data is prepared is greater than or equal to the set time, and the display data of the third image is prepared and the time waiting for the next Vsync signal is greater than or equal to 2.8ms, so that the image display driver sends a control instruction to the display screen to control the display screen to increase the frequency of the output Vsync signal.

[0166] For example, in combination Fig.14 The system framework of the electronic equipment shown and Fig.15 The electronic device shown applies the method provided in the embodiment of the present application to perform control logic for image display. Assuming that the display screen of the electronic device supports a basic frequency of 360 Hz, when the display screen displays an image according to the first Vsync period of 16.6 ms corresponding to a 60 Hz refresh rate, when the display screen displays an image, the browser application APP of the electronic device system application layer also draws a third image of the next frame of the second image, and sends the display data of the third image that has been drawn but needs to be rendered to the image rendering service (SF) in the application framework layer. After SF completes rendering the display data, if the display data needs to be further synthesized, the rendered display data is further sent to the image synthesis service (GPU). After the GPU synthesizes the display data, it is sent to the hardware abstraction layer as the display data of the third image to be displayed, so that the hardware abstraction layer performs hardware matching to send the display data of the third image to the image display driver of the kernel layer. The image display driver performs pre-image sending preparations after receiving the display data of the third image.

[0167] Then, the image display driver determines whether to start the frame chasing scheme. If the frame chasing scheme is not started, the image display driver directly waits for the next Vsync signal to execute the image sending. If the frame chasing scheme is turned on, at this time, the image display driver obtains the result detected by the frame chasing detection module, and the result is that the time length of the third image waiting for the next Vsync signal after the display data preparation is completed is greater than 2.8ms (360Hz cycle). That is, the third image has the conditions to turn on the high-frequency TE 2.8ms in advance. At this time, the image display driver can immediately send an instruction 1 to control the start of the high-frequency TE to the display screen through the display module serial interface (DSI) that establishes a communication connection with the display screen, thereby controlling the display screen to respond to the instruction 1 to start the pre-set 360Hz-TE high-frequency synchronization scheme 2.8ms in advance, thereby increasing the frequency of the Vsync signal output by the display screen to 360Hz.

[0168] Among them, Fig.15 As shown, after the image display driver determines that the third image has the conditions to turn on the high-frequency TE 2.8ms in advance according to the results detected by the frame-chasing detection module, it is determined again by the results detected by the frame-chasing detection module whether the current high-frequency TE will only be turned on 2.8ms in advance. In other words, if the time for the third image to wait for the next Vsync signal after the display data is prepared is greater than 2 times or more of 2.8ms, then the image display driver sends an instruction 1 for controlling the turning on of the high-frequency TE to the display screen through the display module serial interface (DSI) that establishes a communication connection with the display screen. Instruction 1 includes that the moment of turning on the high-frequency TE is only 2.8ms earlier than the original moment of generating the next Vsync signal. Thereby, the display screen is controlled to respond to the instruction 1 to turn on the pre-set 360Hz-TE high-frequency synchronization scheme 2.8ms in advance to increase the frequency of the Vsync signal output by the display screen to 360Hz. Therefore, when the time it takes for the third image to wait for the next Vsync signal after the display data is prepared is greater than 2 times or more of 2.8ms, the image display driver will not control the display screen to generate the Vsync signal with a higher frequency in advance by 2 or more cycles of 360hz, but will delay it to a moment only 2.8ms in advance to control the display screen to generate the Vsync signal with a higher frequency.

[0169] Among them, if the result detected by the frame tracking detection module determines that the current high-frequency TE is turned on only 2.8ms in advance, then the image display driver immediately sends an instruction 1 for controlling the turning on of the high-frequency TE to the display screen through the display module serial interface (DSI) that establishes a communication connection with the display screen, thereby controlling the display screen to respond to the instruction 1 and turn on the preset 360Hz-TE high-frequency synchronization scheme 2.8ms in advance, thereby increasing the frequency of the Vsync signal output by the display screen to 360Hz.

[0170] In some feasible embodiments, after the image display driver of the electronic device increases the frequency of the output Vsync signal, thereby driving the display screen to display an image in response to the Vsync signal with the increased frequency, in order to avoid the image display driver sending the next frame of the image for display in advance, causing the display screen to only briefly display the image and then quickly display the next frame of the image, the electronic device can use the image display driver to not respond to the Vsync signal with the increased frequency output by the display screen within the display time of the display screen displaying the image, thereby forcing the display screen to display the image for a longer time.

[0171] In the embodiment of the present application, the electronic device can Fig.16 The steps S5 and S10 shown in the figure forcibly extend the duration of the display screen displaying the third image. Among them, after the display screen displays the third image, the step S5 is executed: the Vsync signal with the frequency increased is fed back. When the image display driver receives the Vsync signal with the frequency increased fed back by the display screen, if the third display duration of the third image displayed by the display screen is not equal to the first display duration, the step S6 is executed: stop responding to the Vsync signal with the frequency increased. After that, the display screen continues to execute step S7: feedback the Vsync signal with the frequency increased. After the image display driver receives the Vsync signal with the frequency increased fed back by the display screen, if the third display duration is equal to the first display duration at this time, the image display driver executes S8: resumes responding to the Vsync signal with the frequency increased. After that, the display screen executes step S9: feedback the Vsync signal with the frequency increased. After receiving the Vsync signal, the image display driver executes step S10: responds to the Vsync signal with the frequency increased and writes the display data of the next frame of the image to the display screen. In this way, the display screen starts to display the next frame of the image.

[0172] In an embodiment of the present application, after the image display driver of the electronic device writes the display data of the third image to the display screen to drive the display screen to display the third image, the image display driver stops responding to the frequency-increased Vsync signal output by the display screen within the third display time duration when the display screen displays the third image, so as to refuse to write the display data of the next frame image of the third image to the display screen within the third display time duration.

[0173] Afterwards, when the third display time is equal to the first display time, the image display driver resumes responding to the Vsync signal with increased frequency output by the display screen, thereby writing the display data of the next frame of the third image to the display screen after the third display time reaches the first display time.

[0174] In the embodiment of the present application, the image display driver does not respond to the Vsync signal with a frequency increase triggered by the display screen during the third display duration of the display screen displaying the third image, so as to avoid the phenomenon that the display screen briefly displays the third image due to the image display driver sending the next frame of the third image to display in advance during the display screen displaying the third image. In this way, the stability of the electronic device displaying the third image and subsequent images is further improved.

[0175] See also Fig.17 , Fig.17 Another control logic for an electronic device to display an image using the method provided in an embodiment of the present application is shown. Assuming that the display screen of the electronic device supports a 360 Hz basic frequency, when the display screen displays an image according to the first Vsync period of 16.6 ms corresponding to a 60 Hz refresh rate, when the display screen displays an image, the browser application APP of the electronic device system application layer also draws a third image of the next frame of the second image while the display screen displays the second image, and sends the display data of the third image that has been drawn but needs to be rendered to the image rendering service (SF) in the application framework layer. After the SF completes rendering the display data, if the display data needs to be further synthesized, the rendered display data is further sent to the image synthesis service (GPU). After the GPU synthesizes the display data, it is sent to the hardware abstraction layer as the display data of the third image to be displayed, so that the hardware abstraction layer performs hardware matching to send the display data of the third image to the image display driver of the kernel layer. The image display driver performs preparation before sending the image after receiving the display data of the third image.

[0176] Then, the image display driver determines whether to start the frame chasing scheme. If not, the image display driver directly waits for the next Vsync signal to send the image. If the frame chasing scheme is started, at this time, the image display driver obtains the result detected by the frame chasing detection module, and the result is that the time for the second image to wait for the next Vsync signal after the display data is prepared exceeds the set time, which is 2.8ms (360Hz cycle).

[0177] At this time, the image display driver determines whether the time for the third image to wait for the next Vsync signal after the display data is prepared is greater than or equal to 2.8ms. If so, the third image has the condition to turn on the high-frequency TE 2.8ms in advance. At this time, the image display driver can immediately send a command 1 for controlling the turning on of the high-frequency TE to the display screen through the display module serial interface (DSI) that establishes a communication connection with the display screen, thereby controlling the display screen to respond to the command 1 and turn on the preset 360Hz-TE high-frequency synchronization scheme 2.8ms in advance, thereby increasing the frequency of the Vsync signal output by the display screen to 360Hz.

[0178] If the image display driver obtains the result detected by the frame tracking detection module that the time for the second image to wait for the next Vsync signal after the display data preparation is completed does not exceed 2.8ms, then the image display driver directly waits for the next Vsync signal to send the image.

[0179] Among them, Fig.17 As shown, after the image display driver determines that the third image has the conditions to turn on the high-frequency TE 2.8ms in advance according to the results detected by the frame-chasing detection module, it is determined again by the results detected by the frame-chasing detection module whether the current high-frequency TE will only be turned on 2.8ms in advance. In other words, if the time for the third image to wait for the next Vsync signal after the display data is prepared is greater than 2 times or more of 2.8ms, then the image display driver sends an instruction 1 for controlling the turning on of the high-frequency TE to the display screen through the display module serial interface (DSI) that establishes a communication connection with the display screen. Instruction 1 includes that the moment of turning on the high-frequency TE is only 2.8ms earlier than the original moment of generating the next Vsync signal. Thereby, the display screen is controlled to respond to the instruction 1 to turn on the pre-set 360Hz-TE high-frequency synchronization scheme 2.8ms in advance to increase the frequency of the Vsync signal output by the display screen to 360Hz. Therefore, when the time it takes for the third image to wait for the next Vsync signal after the display data is prepared is greater than 2 times or more of 2.8ms, the image display driver will not control the display screen to generate the Vsync signal with a higher frequency in advance by 2 or more cycles of 360hz, but will delay to a moment only 2.8ms in advance to control the display screen to generate the Vsync signal with a higher frequency.

[0180] Among them, if the result detected by the frame tracking detection module determines that the current high-frequency TE is turned on only 2.8ms in advance, then the image display driver immediately sends an instruction 1 for controlling the turning on of the high-frequency TE to the display screen through the display module serial interface (DSI) that establishes a communication connection with the display screen, thereby controlling the display screen to respond to the instruction 1 and turn on the preset 360Hz-TE high-frequency synchronization scheme 2.8ms in advance, thereby increasing the frequency of the Vsync signal output by the display screen to 360Hz.

[0181] In an embodiment of the present application, the duration for which the second image waits for the next Vsync signal after display data preparation is completed can be calculated by recording the timestamp when the second image starts waiting for the arrival of the next Vsync signal after display data preparation is completed, and recording the timestamp when the next Vsync signal arrives and the image display driver writes the display data of the second image to the display screen.

[0182] See also Fig.18 , Fig.18 A control logic for obtaining the time length for waiting for the next Vsync signal after the display data of the second image is prepared after the display data is prepared is shown in an embodiment of the present application. Assuming that the display screen of the electronic device supports a 360Hz basic frequency, when the display screen displays an image according to the first Vsync period of 16.6ms corresponding to a 60Hz refresh rate, when the display screen displays the first image, the browser application APP of the electronic device system application layer also draws the second image of the next frame of the first image, and sends the display data of the second image that has been drawn but needs to be rendered to the image rendering service (SF) in the application framework layer. After the SF completes the rendering of the display data, if the display data needs to be further synthesized, the rendered display data is further sent to the image synthesis service (GPU), and after the GPU synthesizes the display data, it is sent to the hardware abstraction layer as the display data of the second image to be displayed, so that the hardware abstraction layer performs hardware matching to send the display data of the second image to the image display driver of the kernel layer, and the image display driver performs pre-image sending preparation after receiving the display data of the second image.

[0183] Then, the image display driver determines whether to start the frame chasing scheme. If the frame chasing scheme is not started, the image display driver directly waits for the next Vsync signal to send the picture. If the frame chasing scheme is turned on, at this time, the image display driver starts to record the timestamp when the second image starts waiting for the next Vsync signal to arrive after the display data preparation is completed. Then, after waiting for the next Vsync signal, the image display driver performs the picture sending operation, that is, writes the display data of the second image to the display screen. At this time, the image display driver will also determine whether to start the frame chasing scheme. If the frame chasing scheme is not started, the process ends. If the frame chasing scheme is turned on, at this time, the image display driver starts to record the timestamp when the next Vsync signal arrives and the image display driver executes the picture sending. Therefore, through the two recorded timestamps, the length of time the two images wait for the next Vsync signal after the display data preparation is completed can be calculated.

[0184] See also Fig.19 , Fig.19 A flow chart for configuring a frame chasing scheme is shown. The SF module can write a node through the Android Interface Definition Language (AIDL) interface to turn on the frame chasing scheme and send a frame chasing start time value. The frame chasing start time value indicates the length of time that the display screen outputs the VSync signal in advance. For example, the frame chasing start time value can be 2.8ms, or the frame chasing start time value can be indicated by a flag bit, such as a flag bit of 1 can indicate that the frame chasing start time value is 2.8ms, and a flag bit of 2 can indicate that the frame chasing start time value is 5.5ms.

[0185] In some embodiments, the present application provides an electronic device having the function of implementing the image display method described in each of the above embodiments. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0186] In some embodiments, an embodiment of the present application provides an electronic device, including: a processor and a memory; the memory is used to store computer program code, the computer program code includes computer execution instructions, and when the electronic device is running, the processor executes the computer execution instructions to enable the electronic device to perform the image display method described in the above embodiments.

[0187] In some embodiments, an embodiment of the present application provides an electronic device, comprising: a processor; the processor is used to couple with a memory, and after reading instructions in the memory, execute the image display method described in the above embodiments according to the instructions.

[0188] In some embodiments, an embodiment of the present application provides a computer-readable storage medium, including computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the wallpaper display method as described above.

[0189] In some embodiments, the embodiments of the present application provide a computer program product. When the computer program product is run on an electronic device, the electronic device executes the image display method described in the above embodiments.

[0190] In some embodiments, the embodiments of the present application provide a computer program product including instructions, which, when executed on a computer, enables the computer to execute the image display method described in the above embodiments.

[0191] In some embodiments, the embodiments of the present application provide a device (for example, the device may be a display system), the device including a processor for supporting an electronic device to implement the functions of the image display method described in the above embodiments. In one possible design, the device also includes a memory for storing necessary program instructions and data for the electronic device.

[0192] The present application also provides a chip system, such as Fig. 20As shown, the chip system 90 includes at least one processor 901 and at least one interface circuit 902. The processor 901 and the interface circuit 902 can be interconnected via lines. For example, the interface circuit 902 can be used to receive signals from other devices (such as a memory of an electronic device). For another example, the interface circuit 902 can be used to send signals to other devices (such as processor 901). Exemplarily, the interface circuit 902 can read instructions stored in the memory and send the instructions to the processor 901. When the instructions are executed by the processor 901, the electronic device can execute the various steps in the above embodiments. Of course, the chip system may also include other discrete devices, which are not specifically limited in the embodiments of the present application.

[0193] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0194] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point, the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms. The unit described as a separate component may or may not be physically separated, and the component displayed as a unit may be a physical unit or multiple physical units, that is, it may be located in one place, or it may be distributed in multiple different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the scheme of this embodiment.

[0195] In addition, each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of a software functional unit. If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or part of the prior art that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0196] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. An image display method, characterized in that: Applied to an electronic device, the electronic device includes a display screen, and the method includes: At a first moment, the electronic device generates a first Vsync signal, and in response to the first Vsync signal, starts to display a first image on the display screen, wherein the first Vsync signal corresponds to a first Vsync signal cycle, and a first display duration of displaying the first image is the same as a duration of the first Vsync signal cycle; At a second moment, the electronic device generates a second Vsync signal, and in response to the second Vsync signal, starts to display a second image on the display screen, wherein the second Vsync signal corresponds to a second Vsync signal cycle, the second moment is after the first moment, and the second image is a next frame image of the first image; After starting to display the second image on the display screen, detecting whether the display data of the third image has been synthesized, wherein the third image is the next frame image of the second image; if the display data of the third image has been synthesized, sending a control instruction to the display screen, wherein the control instruction is used to control the frequency of generating the Vsync signal.

2. The method according to claim 1, characterized in that If the display data of the third image is synthesized, the image display driver sends a control instruction to the display screen, including: If the duration between the moment when the display data of the third image is synthesized and the moment when the electronic device generates the third Vsync signal is greater than or equal to the preset interval duration, a control instruction is sent to the display screen.

3. The method according to claim 2, characterized in that The electronic device further includes an image display driver, which sends a control instruction to the display screen if the time between the moment when the display data of the third image is synthesized and the moment when the electronic device generates the third Vsync signal is greater than or equal to the preset interval time, specifically: If the duration between the moment when the display data of the third image is synthesized and the moment when the electronic device is preset to generate the third Vsync signal is greater than or equal to a preset interval duration, the image display driver sends a control instruction to the display screen, and the control instruction is used to control the frequency of generating the Vsync signal so that the frequency of the Vsync signal generated by the display screen is higher than the frequency of the Vsync signal currently generated by the display screen.

4. The method according to claim 2, characterized in that: The preset interval duration is 2.8 ms.

5. The method according to any one of claims 1 to 4, characterized in that After sending the control instruction to the display screen, the method further includes: At a third moment, the electronic device generates a third Vsync signal; wherein the third Vsync signal corresponds to a third Vsync signal period, the third moment is after the second moment, and the third Vsync signal period is shorter than the first Vsync signal period.

6. The method according to claim 5, characterized in that The second Vsync signal period is shorter than the first Vsync signal period, and a second display time length for displaying the second image is shorter than the first display time length.

7. The method according to claim 6, characterized in that The first Vsync signal period is 16.6 ms, and the third Vsync signal period is 2.8 ms.

8. The method according to claim 7, characterized in that The second Vsync signal period is 13.8 ms, and the second display duration is 13.8 ms.

9. The method according to claim 5, characterized in that The method further comprises: At a fourth moment, the electronic device generates a fourth Vsync signal, and in response to the fourth Vsync signal, starts to display a fourth image on the display screen, wherein the fourth moment is after the third moment, the fourth Vsync signal corresponds to the fourth Vsync signal cycle, the fourth Vsync signal cycle is the same as the first Vsync cycle, and a fourth display time for displaying the fourth image is the same as the first display time.

10. The method according to claim 9, characterized in that The method further includes: before the fourth moment, sending a control instruction to the display screen, wherein the control instruction is used to control the frequency of generating a Vsync signal.

11. The method according to claim 10, characterized in that Before the fourth moment, a control instruction is sent to the display screen, wherein the control instruction is used to control the frequency of generating the Vsync signal, specifically: The image display driver sends a control instruction to the display screen, wherein the control instruction is used to control the frequency of generating the Vsync signal so that the frequency of generating the Vsync signal by the display screen is lower than the current frequency of generating the Vsync signal by the display screen.

12. An electronic device, characterized in that: The electronic device comprises: a communication module, a display screen, a memory and one or more processors; the communication module, the display screen, the memory and the processor are coupled; the memory is used to store computer program code, and the computer program code comprises computer instructions, and when the computer instructions are executed by the electronic device, the electronic device executes the method as described in any one of claims 1-11.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, and when the instructions are executed in an electronic device, the electronic device executes the method according to any one of claims 1 to 11.

Citation Information

Patent Citations

  • Display parameter adjusting method, electronic equipment, chip and readable storage medium

    CN115686403A

  • Screen refresh rate switching method and electronic equipment

    CN116052618A

  • Parameter adjusting method and electronic equipment

    CN116704087A

  • Display method, chip and electronic equipment

    CN117133232A

  • Frame control device and method, display system, electronic equipment and storage medium

    CN117153076A

Cited By

  • Image display method and electronic device

    WO2025148999A1