Image display method and electronic equipment
By increasing the Vsync signal frequency output by the display screen in electronic devices and sending images to the signal after the frequency is increased, the delay problem caused by the display timeout display is solved, and the immediacy and stability of the image display is improved.
Patent Information
- Application Number
- CN202411288263.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-01-09
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2044-01-09
AI Technical Summary
The electronic device timed out when processing images, causing the display screen to miss the Vsync signal and fail to refresh the image in time, resulting in delay in display screen. The existing improved system upper-level software control logic is difficult to effectively solve this problem.
When the display screen timeouts to display images, increase the frequency of the output Vsync signal to transmit images in response to the Vsync signal after the frequency is increased, reduce the time-out display time of the display screen to ensure that the user does not easily detect the delay in the device display screen.
Through the Vsync signal after the frequency is increased, the next frame of image can be displayed in a short time, reducing the time-out display time of the display screen on the image, improving the instant image display performance, and reducing users' perception of delay.
Smart Images

Figure CN119091789A_ABST
Abstract
Description
[0001] This application is a divisional application. The application number of the original application is 202480001796.4, and the original application date is January 9, 2024. The entire content of the original application is incorporated into this application by reference. Technical Field
[0002] The embodiments of the present application relate to the field of display technology, and in particular to an image display method and an electronic device. Background Art
[0003] Vertical synchronization (Vsync) technology synchronizes the frame rate of the graphics processing unit (GPU) with the refresh rate of the display screen, thereby avoiding the display screen tearing phenomenon caused by the GPU frame rate being different from the display screen refresh rate, when the display screen starts refreshing the next frame of the image before the previous frame of the image is finished.
[0004] However, in the actual application of Vsync technology in electronic devices, based on the display driver integrated circuit (DDIC) specifications used by the electronic devices and the vertical synchronization response mechanism of the Vsync technology, once the upper system layer of the electronic device times out when processing an image, the DDIC will miss the Vsync signal and will be unable to send the image to the display screen (i.e., the image display data cannot be written to the display screen). In this case, the display screen will time out to display the currently displayed image for at least two consecutive refresh cycles, and the user of the electronic device will clearly feel a delay in the device display screen.
[0005] At present, some means of improving the software control logic of the upper layer of the system still cannot prevent the DDIC from missing the Vsync signal, and thus it is difficult to effectively solve the problem that the display screen displays the first image for a long time so that the user feels that there is a delay in the device display screen. Summary of the invention
[0006] The embodiments of the present application provide an image display method and an electronic device, which are used to reduce the time for which a display screen overtime displays an image so that a user is less likely to notice a delay in the device display screen.
[0007] To achieve the above-mentioned purpose, the embodiment of the present application adopts the following technical solution: when the display screen of the electronic device has a timeout in displaying an image, the image display driver of the electronic device immediately increases the frequency of the output Vsync signal, thereby sending and displaying the image in response to the Vsync signal with the increased frequency (writing the display data of the image to the display screen). That is, when the display screen has a timeout in displaying an image, the present application enables the image display driver to send and display the image in response to the Vsync signal with the increased frequency, thereby effectively reducing the duration of the timeout display of the image on the display screen, thereby making it difficult for the user to perceive the delay in the display screen of the device.
[0008] In a first aspect, the present application provides an image display method, which is applied to an electronic device. At a first moment, the electronic device generates a first vertical synchronization Vsync signal, and in response to the first Vsync signal, the display screen of the electronic device starts to display a first image. At a second moment after the first moment, the electronic device generates a second Vsync signal, and in response to the second Vsync signal, the display screen starts to display a second image. At a third moment, in response to the second display duration of the display screen displaying the second image being greater than the first display duration of the display screen displaying the first image, the electronic device generates a third Vsync signal.
[0009] In the present application, the first Vsync signal generated by the electronic device at the first moment corresponds to the first Vsync cycle, and the first Vsync cycle corresponds to the first display duration of the above-mentioned first image. The second Vsync signal generated by the electronic device at the second moment corresponds to the second Vsync cycle, and the second Vsync cycle is equal to the first Vsync cycle. The third Vsync signal generated by the electronic device at the third moment corresponds to the third Vsync cycle, and the third Vsync cycle is less than the first Vsync cycle. It can be understood that the third Vsync signal is the Vsync signal after the above-mentioned frequency is increased.
[0010] In the present application, by increasing the frequency of the output Vsync signal when the display screen of the electronic device times out on the display of the second image, the image display driver of the electronic device can respond to the Vsync signal with the increased frequency fed back by the display screen, and write the display data of the next frame of the second image to the display screen within a short period of time when the display screen times out on the display of the second image, so as to drive the display screen to instantly display the next frame of the image. In this way, the image instant display performance of the electronic device during the image display process can be effectively improved. Compared with the traditional solution, the image display driver of the electronic device responds to the Vsync signal with the increased frequency to display the next frame of the second image, which can effectively reduce the duration of the display screen's timeout display of the second image, thereby making it difficult for the user to notice the delay in the device display screen.
[0011] In a possible implementation manner of the first aspect, the second image is a next frame image of the first image.
[0012] In a possible implementation manner of the first aspect, the second display duration is less than twice the first display duration.
[0013] In the present application, when the second display time of the second image on the display screen is longer than the first display time but less than twice the first display time, the frequency of the output Vsync signal is increased so that the image display driver drives the display screen to start displaying the next frame of the second image when the second display time is less than twice the first display time. As a result, the display screen will not display the second image for a long time for two consecutive first Vsync cycles, and thus there will be no device display screen delay phenomenon similar to the traditional solution.
[0014] In a possible implementation manner of the first aspect, in response to the third Vsync signal, the display screen displays a third image of a next frame of the second image.
[0015] In the present application, when the image display driver of the electronic device receives the display data of the third image of the next frame of the second image, it responds to the third Vsync signal triggered by the display screen at the third moment to write the third image display data to the display screen, thereby driving the display screen to refresh and display the third frame image after a short timeout display of the second image. In this way, the display screen does not need to refresh and display the third image after a timeout display of the second image for at least two consecutive Vsync cycles, thereby effectively reducing the time for the display screen to timeout the second image, and making it difficult for the user to notice the delay in the device display screen.
[0016] In a possible implementation manner of the first aspect, a third display time duration during which the display screen displays the third image is shorter than a first display time duration corresponding to the first Vsync period.
[0017] In a possible implementation manner of the first aspect, a third display time length during which the display screen displays the third image is the same as a first display time length corresponding to the first Vsync period.
[0018] In the present application, by making the display duration of the third image displayed on the display screen the same as the first display duration corresponding to the above-mentioned first Vsync period, the stability of displaying each frame of the image during the image refresh display process of the display screen can be ensured.
[0019] In a possible implementation manner of the first aspect, the electronic device generates a fourth Vsync signal at a fourth moment after the second moment and before the third moment.
[0020] In a possible implementation manner of the first aspect, in response to the fourth Vsync signal, the display screen continues to display the second image for a timeout period.
[0021] In a possible implementation of the first aspect, when the display screen generates a first Vsync signal at a first moment using a frequency of 120 Hz, a first Vsync period corresponding to the first Vsync signal is approximately 8.3 (1 / 120≈8.3) ms. Thereafter, when the frequency of the Vsync signal output by the display screen is increased to 360 Hz, a third Vsync period corresponding to a third Vsync signal output by the display screen at a third moment is approximately 2.8 (1 / 360≈2.8) ms.
[0022] In a possible implementation of the first aspect, when the first Vsync cycle is approximately 8.3 ms and the third Vsync cycle is approximately 2.8 ms, the first display duration corresponding to the first Vsync cycle is approximately 8.3 ms, and the second display duration of the display screen displaying the second image is approximately 8.3 ms+2.8 ms=11.1 ms.
[0023] In a possible implementation of the first aspect, at a fifth moment after the third moment, the electronic device generates a fifth Vsync signal, wherein the fifth Vsync signal corresponds to a fifth Vsync cycle, and the fifth Vsync cycle is equal to the first Vsync cycle.
[0024] In a possible implementation of the first aspect, the display duration of the fourth image is greater than the preset interval duration; the fourth image is an image displayed in the previous frame at the fifth moment, the preset interval duration is the interval duration between the fifth moment and the sixth moment minus the time required to reduce the frequency of the output Vsync signal, and the sixth moment is the moment when the fourth image is written to the display screen.
[0025] In the present application, after the display screen starts to display the third image, in response to the display duration of the fourth image being greater than the interval duration between the fifth moment and the sixth moment minus the time required to reduce the frequency of the output Vsync signal, the electronic device reduces the frequency of the output Vsync signal. Afterwards, at the fifth moment after the third moment, the electronic device generates a fifth Vsync signal whose Vsync period is equal to the first Vsync period. Among them, the fourth image is the third image itself or a frame of image after the third image. The sixth moment is the moment when the fourth image is written to the display screen, that is, when the fourth image is the third image itself, the sixth moment is the third moment when the display screen responds to the third Vsync signal to start displaying the third image (at this time, the third image is written to the display screen and starts to be displayed by the display screen), and when the fourth image is a frame of image after the third image, the sixth moment is the moment when the display screen starts to display a frame of image after the third image (at this time, a frame of image after the third image is written to the display screen and starts to be displayed by the display screen). The interval between the fifth moment and the sixth moment is the first display duration corresponding to the above-mentioned first Vsync cycle.
[0026] For example, Fig. 20 As shown, taking the fourth image as the third image itself and the sixth moment as the third moment itself as an example, after the display screen starts to display the third image (image 2) at the third moment (t5), the electronic device calculates the third display duration of image 2 in real time. When the third display duration is greater than the interval duration of 8.3ms between the fifth moment (t6) and t5 minus the time consumed to reduce the frequency of the output Vsync signal (the time consumed is the time between the moment indicated by the vertical dotted line on the right side of the figure and t6), the electronic device reduces the frequency of the output Vsync signal at the moment indicated by the vertical dotted line on the right side of the figure. In this way, at moment t6, the electronic device generates a fifth Vsync signal (Vsync signal 6) with a fifth Vsync period of 8.3ms (equal to the first Vsync period).
[0027] In the present application, by reducing the frequency of the output Vsync signal, it is possible to avoid the display screen outputting the Vsync signal (third Vsync signal) with an increased frequency for a long time, which causes waste of device power consumption, thereby achieving the purpose of saving device power consumption.
[0028] In a possible implementation manner of the first aspect, the fifth moment is N 8.3 ms away from the third moment, where N is a positive integer greater than or equal to 1.
[0029] In a possible implementation of the first aspect, after the display screen of the electronic device displays the third image, the image display driver of the electronic device determines whether display data of a next frame of the third image has been received within a third display time duration of the display screen displaying the third image. If the determination is yes, the image display driver reduces the frequency of the Vsync signal output by the display screen.
[0030] In the present application, after determining that the display screen has stabilized the display of the third image, the frequency of the output Vsync signal is reduced, so as to avoid the display screen outputting the Vsync signal with increased frequency for a long time, causing waste of device power consumption, thereby achieving the purpose of saving device power consumption.
[0031] In another possible implementation of the first aspect, after the display screen of the electronic device displays the third image, the electronic device may further detect whether the image display driver receives display data of an Nth frame of image after the third image within a display duration of an N-1th frame of image after the display screen displays the third image, where N is a positive integer greater than 1.
[0032] In this way, when it is detected that the image display driver has received display data of the Nth frame image after the third image within the display duration of the N-1th frame image after the display screen displays the third image, the image display driver further reduces the frequency of the Vsync signal output by the display screen.
[0033] In the present application, after determining that the display screen has stabilized the display of the N-1th frame image after the third image, the frequency of the output Vsync signal is reduced. This can also avoid the waste of device power consumption caused by the display screen still outputting the Vsync signal with an increased frequency after the display of the image has stabilized.
[0034] Furthermore, by reducing the frequency of the output Vsync signal after the display screen displays the N-1th frame image after the third image and becomes stable, the phenomenon of frequently increasing and decreasing the frequency of the output Vsync signal can be avoided, thereby further saving the power consumption required for the device to frequently adjust the frequency of the output Vsync signal.
[0035] In another possible implementation of the first aspect, the electronic device further includes an image display driver. In response to the display screen displaying the second image, the image display driver calculates a second display duration for the display screen to display the second image. Furthermore, the image display driver compares the second display duration with the first display duration described above. When the second display duration is greater than the first display duration, the image display driver sends a control instruction to the display screen in response to the second display duration being greater than the first display duration. The display screen increases the frequency of the output Vsync signal in response to the control instruction, and generates a third Vsync signal with an increased frequency at a third moment after the second moment.
[0036] Exemplarily, by configuring a delay detection module in the image display driver of the electronic device, and detecting whether the second display duration is greater than the first display duration through the delay detection module, the frequency of the output Vsync signal is increased when the delay detection module detects that the second display duration is greater than the first display duration. In this way, since the image display driver is located in the kernel layer of the entire system of the electronic device, whether the upper layer of the system (such as the application layer, the application framework layer or the hardware abstraction layer) causes the second display duration to be greater than the first display duration, or the kernel layer itself causes the second display duration to be greater than the first display duration, it can be detected by the newly added delay detection module in the kernel layer. That is, the comprehensiveness and accuracy of detecting whether the second display duration is greater than the first display duration are improved.
[0037] In another possible implementation of the first aspect, when the image display driver of the electronic device detects whether the second display duration is greater than the first display duration through the delay detection module, the electronic device may first detect whether the image display driver responds to the second Vsync signal. Then, when it is detected that the image display driver responds to the second Vsync signal, thereby determining that the electronic device displays the second image and is not in a state where the display screen delays displaying the first image, the image display driver detects through the delay detection module whether the second display duration of the display screen displaying the second image is greater than the first display duration.
[0038] In the present application, before the delay detection module detects whether the second display duration is greater than the first display duration, it first detects whether the image display driver responds to the second Vsync signal, so as to determine that the electronic device is currently displaying the second image and is not in a state where the display screen delays displaying the first image, and then the delay detection module is used to detect whether the second display duration is greater than the first display duration. In this way, it can be ensured that the frequency of the output Vsync signal is increased only when the electronic device enters the delayed display state (the display screen displays the image overtime) from the non-delayed display state, so as to achieve fixed-point reduction of the degree of delay in the device display screen caused by long-term display of the image.
[0039] In another possible implementation of the first aspect, when the image display driver of the electronic device increases the frequency of the output Vsync signal, it can control the display screen to increase the frequency of the output Vsync signal to M times the original frequency. Wherein, M is a positive integer greater than 1; the original frequency is the frequency of the Vsync signal fed back to the image display driver and other software and hardware modules of the upper layer of the electronic device system when the display screen displays the image at the current refresh rate. For example, when the display screen supports a 360Hz base frequency, the original frequency can be 60Hz, 90Hz or 120Hz.
[0040] In another possible implementation of the first aspect, when the image display driver of the electronic device controls the display screen to increase the frequency of the output Vsync signal to M times the original frequency, the image display driver can receive the display data of the third image sent by the upper layer of the system before the display screen outputs the i-th Vsync signal after the frequency is increased. Here, i is a positive integer and i is less than M. Based on this, the image display driver writes the display data of the third image to the display screen in response to the i-th Vsync signal after the frequency is increased to drive the display screen to display the third image.
[0041] In the present application, the image display driver of the electronic device receives the display data of the third image before the display screen outputs the i-th Vsync signal after the frequency is increased, and then writes the display data of the third image to the display screen in response to the i-th Vsync signal after the frequency is increased to drive the display screen to display the third image. In this way, it can be ensured that the image display driver of the electronic device responds to the Vsync signal after the frequency is increased triggered by the display screen within a short period of time when the display screen displays the second image overtime, and sends the third image of the next frame of the second image for display, instead of displaying the second image within at least two consecutive Vsync cycles like the traditional solution, resulting in a long time of timeout display of the second image, and then responding to the Vsync signal triggered by the display screen at the original frequency to send the third image for display. That is, the stability of reducing the time length of the display screen displaying the second image overtime is ensured.
[0042] In another possible implementation of the first aspect, after the image display driver of the electronic device starts writing the display data of the third image to the display screen to drive the display screen to start displaying the third image, in order to avoid the image display driver directly responding to the new frequency-increased Vsync signal, the next frame of the third image is sent to the display screen in advance, causing the display screen to display the third image in a shorter time. The image display driver also stops responding to any frequency-increased Vsync signal triggered by the display screen within a third display duration when the display screen displays the third image, thereby refusing to write the display data of the next frame of the third image to the display screen within the third display duration.
[0043] Afterwards, when the third display time is greater than the difference between the first display time and the third Vsync cycle, the image display driver resumes responding to the frequency-increased Vsync signal triggered by the display screen, thereby responding to the frequency-increased Vsync signal and writing display data of the next frame of the third image to the display screen after ensuring that the third display time reaches the first display time.
[0044] In the present application, by not responding to the Vsync signal with an increased frequency during the third display duration, it is possible to avoid the phenomenon that the image display driver sends the next frame of the third image to the display in advance during the display of the third image, causing the display to only briefly display the third image. This further improves the stability of the electronic device in displaying the third image and subsequent images.
[0045] In a second aspect, the present application provides an electronic device having the function of implementing the method described in the first aspect. The function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.
[0046] In a third aspect, the present application provides an electronic device comprising: a processor and a memory; the memory is used to store computer program code, the computer program code includes computer execution instructions, and when the electronic device is running, the processor executes the computer execution instructions to enable the electronic device to perform the method described in the first aspect above.
[0047] In a fourth aspect, the present application provides an electronic device, comprising: a processor; the processor is used to couple with a memory, and after reading instructions in the memory, execute the method described in the first aspect according to the instructions.
[0048] In a fifth aspect, the present application provides a computer-readable storage medium, which stores computer instructions. When the computer-readable storage medium is run on an electronic device, the electronic device can execute the method described in the first aspect above.
[0049] In a sixth aspect, the present application provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the method described in the first aspect above.
[0050] In a seventh aspect, a device (for example, the device may be a display system) is provided, the device including a processor for supporting an electronic device to implement the functions involved in the first aspect. In a possible design, the device also includes a memory for storing program instructions and data necessary for the electronic device.
[0051] Among them, the technical effects brought about by any design method in the second to seventh aspects can refer to the technical effects brought about by different implementation methods in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0052] Figure 1 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;
[0053] Figure 2 A schematic diagram of a system architecture of an electronic device in conventional technology;
[0054] Figure 3 A schematic diagram of the principle of layer drawing, rendering, synthesis and image frame display of an electronic device in conventional technology;
[0055] Figure 4 A schematic diagram of the principle of another electronic device in conventional technology for layer drawing, rendering, synthesis and image frame display;
[0056] Figure 5 A schematic diagram of a system architecture of an electronic device in an embodiment of the present application;
[0057] Figure 6 A schematic diagram of the principles of layer drawing, rendering, synthesis and image frame display by an electronic device in an embodiment of the present application;
[0058] Figure 7 A schematic diagram of the principles of another electronic device performing layer drawing, rendering, synthesis and image frame display in an embodiment of the present application;
[0059] Figure 8 A schematic diagram of a method for displaying an image provided in an embodiment of the present application Figure 1 ;
[0060] Fig. 9 This is a waveform diagram of the Vsync signal output by the display screen using the 120Hz-TE standard frequency synchronization scheme in the embodiment of the present application;
[0061] Fig.10 This is a waveform diagram of the Vsync signal output by the display screen using a 360Hz-TE high-frequency synchronization solution in the embodiment of the present application;
[0062] Fig.11 A schematic diagram of the duration of displaying an image on a display screen in a case involved in an embodiment of the present application;
[0063] Fig.12 A schematic diagram of the duration of displaying an image on a display screen in another case involved in an embodiment of the present application;
[0064] Fig.13A schematic diagram of the principle of an electronic device sending and displaying an image in response to a Vsync signal with an increased frequency in a case involved in an embodiment of the present application;
[0065] Fig.14 A schematic diagram of the principle of an electronic device sending and displaying an image in response to a Vsync signal with an increased frequency in another case involved in an embodiment of the present application;
[0066] Fig.15 A schematic diagram of the principle of an electronic device sending and displaying an image in response to a Vsync signal with an increased frequency in another case involved in an embodiment of the present application;
[0067] Fig.16 A schematic diagram of the system architecture and data signal flow of an electronic device involved in an embodiment of the present application;
[0068] Fig.17 A schematic diagram of control logic for image display of an electronic device involved in an embodiment of the present application;
[0069] Fig.18 A schematic diagram of a method for displaying an image provided in an embodiment of the present application Figure 2 ;
[0070] Fig.19 A schematic diagram of the principle of extending the image display time of an electronic device involved in an embodiment of the present application;
[0071] Fig. 20 A schematic diagram of the principle of reducing the frequency of an output Vsync signal by an electronic device in a case involved in an embodiment of the present application;
[0072] Fig.21 This is a schematic diagram of the principle of reducing the frequency of the output Vsync signal of an electronic device in another case involved in an embodiment of the present application. DETAILED DESCRIPTION
[0073] The embodiment of the present application provides an image display method, which can be applied to an electronic device including a display screen, and by increasing the frequency of the vertical synchronization signal output by the display screen when the display screen displays an image for a timeout, the image display driver of the electronic device responds to the vertical synchronization signal with a higher frequency to display the image. In this way, the time for the display screen to display the image for a timeout can be effectively reduced, so that the user is not easily aware of the delay in the device display screen.
[0074] It should be noted that the above-mentioned electronic device can be a mobile phone, a tablet computer, a desktop / laptop / handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), an augmented reality (AR) / virtual reality (VR) device, and other electronic devices with a display screen. The embodiments of the present application do not impose any special restrictions on the specific form of the electronic device.
[0075] The implementation of the embodiments of the present application will be described in detail below with reference to the accompanying drawings.
[0076] Please refer to Figure 1 , Figure 1 FIG. 1 is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application. Figure 1 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 111, a power management module 112, a battery 113, an antenna 1, an antenna 2, a mobile communication module 140, a wireless communication module 150, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0077] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0078] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural-network processing unit (neural-network processing unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. Among them, the controller can be the nerve center and command center of the electronic device 100. The controller can generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions.
[0079] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0080] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0081] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
[0082] The charging management module 111 is used to receive charging input from a charger. While the charging management module 111 charges the battery 113, it can also power the electronic device through the power management module 112. The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 140, the wireless communication module 150, the modem processor and the baseband processor.
[0083] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0084] The mobile communication module 140 can provide solutions for wireless communications including 2G / 3G / 4G / 5G / 6G applied to the electronic device 100. The modulation and demodulation processor may include a modulator and a demodulator. The wireless communication module 150 can provide solutions for wireless communications including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc. applied to the electronic device 100.
[0085] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
[0086] The display screen (or screen) 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel may include, but is not limited to, a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode or an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini organic light-emitting diode (MINILED), a micro organic light-emitting diode (MicroLed), a quantum dot light emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
[0087] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.
[0088] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 200 .
[0089] The internal memory 121 may be used to store computer executable program codes, wherein the executable program codes include instructions.
[0090] The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0091] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0092] The buttons 190 include a power button, a volume button, etc. The indicator 192 may be an indicator light.
[0093] The sensor module 180 may include a folding angle detection sensor, a pressure sensor, a gyro sensor, an air pressure sensor,
[0094] Magnetic sensor, acceleration sensor, distance sensor, proximity light sensor, fingerprint sensor, temperature sensor, touch sensor, ambient light sensor, bone conduction sensor, etc.
[0095] It should be noted that, in the embodiment of the present application, the display screen of the electronic device to which the image display method provided by the embodiment of the present application is applied belongs to the type of screen that supports source chip (Source IC) refresh interruption. Among them, the Source IC refresh interruption means that the Source IC of the display screen can be interrupted by the driver at any time when it is not in the refresh state (referred to as Source refresh interruption), so as to re-enter the refresh state and start working. The work performed by the Source IC in the refresh state can be: refreshing the display data of the image so that the display screen starts to display the image, or, responding to the frame cutting instruction to switch the refresh rate of the display screen.
[0096] Exemplarily, the display screen of the electronic device may be a display screen that uses low temperature polysilicon oxide (LTPO) transistors, thereby supporting Source refresh interrupts based on the low leakage characteristics of LTPO. However, the display screen of the electronic device is usually not a display screen that uses low temperature polysilicon (LTPS) transistors. Because as the leakage of the transistor increases, even if the Source refresh interrupt can still be supported, the overall display effect of the display screen will be seriously affected. Therefore, due to the serious leakage characteristics of LTPS, the display screen using LTPS usually does not support the function of Source refresh interrupts. Therefore, it can be understood that as long as the display screen of the electronic device uses transistors with low leakage characteristics, it can support Source refresh interrupts.
[0097] Based on different design requirements of actual applications, the transistor types that can be used for the display of electronic devices can of course be other types besides LTPO. However, no matter what type of transistors are used in the display screen, and whether the transistors have the characteristic of low leakage current and can support source refresh interrupts, as long as the display screen of the electronic device is a screen type that supports source refresh interrupts, it should be included in the protection scope of the image display method provided in the embodiments of the present application.
[0098] In an embodiment of the present application, the basic frequency supported by the display screen of the electronic device may be 60 Hz, 70 Hz, 75 Hz, 80 Hz, 90 Hz, 120 Hz or 360 Hz, etc. The refresh rate of the display screen for displaying images (abbreviated as image refresh rate or display frame rate) is less than or equal to the basic frequency supported by the display screen. Moreover, the image refresh rate supported by the display screen is generally less than or equal to 120 Hz. For example, the image refresh rate of the display screen can generally be configured as 60 Hz, 70 Hz, 75 Hz, 80 Hz, 90 Hz or 120 Hz.
[0099] When the display screen supports a 120Hz image refresh rate, the display screen can increase the image refresh rate from 60Hz, 70Hz, 75Hz, 80Hz, 90Hz to 120Hz, or reduce it from 120Hz to 90Hz, 80Hz, 75Hz, 70Hz or 60Hz. The image refresh rate of the electronic device in the embodiment of the present application is the image refresh rate currently used by the display screen of the electronic device. Therefore, in some feasible embodiments of the present application, the image refresh rate of the electronic device or the image refresh rate of the display screen of the electronic device may also be referred to as the current refresh rate.
[0100] It should be noted that in the embodiment of the present application, the Vsync signal is a periodic discrete signal involved in the process of applying the Vsync technology to the electronic device, that is, there is a Vsync signal triggered by the hardware driver every Vsync period (also called refresh period or refresh duration, etc.).
[0101] It should be noted that in the embodiment of the present application, the Vsync signal is used to trigger the hardware to refresh the display image frame. The Vsync signal can be generated by the display screen and fed back to the APP, the modem processor, the GPU, the ISP, and the controller. Therefore, the Vsync signal can also be considered as a type of tearing effect (TE) signal fed back from the display screen 194 to the processor 110.
[0102] In an embodiment of the present application, when the display screen supports a basic frequency of 360 Hz, the display screen can adaptively switch the frequency of the output Vsync signal to 60 Hz, 90 Hz, 120 Hz or 360 Hz based on the control of the image display driver in the electronic device, thereby triggering and outputting Vsync signals with different Vsync periods at different times.
[0103] In different systems or architectures, the name of the Vsync signal may be different. For example, in some systems or architectures, the Vsync signal may specifically be VSYNC_APP, or it may be VSYNC_SF or VSYNC_HW. But no matter what the name of the Vsync signal is, as long as it is a synchronization signal with similar functions and conforms to the technical ideas of the method provided in the embodiments of the present application, it should be covered within the scope of protection of the present application. Moreover, in different systems or architectures, the definition of the Vsync signal may also be different, but no matter what definition is made for the Vsync signal, as long as it is a synchronization signal with similar functions and conforms to the technical ideas of the method provided in the embodiments of the present application, it should also be covered within the scope of protection of the present application.
[0104] It should be noted that the software system of the electronic device can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture or a cloud architecture. For ease of understanding, the present application embodiment takes the Android system with a layered architecture as an example to describe in detail the image display method provided by the present application embodiment when the electronic device is applied.
[0105] The following will be combined Figure 2 Taking the example of an electronic device responding to a Vsync signal to send (or write) an image to a display screen for display, the software and hardware processing flow of the electronic device of the Android system in this process is introduced.
[0106] like Figure 2As shown, the software and hardware architecture of the electronic device adopts a layered design. Among them, the software layer includes the application layer (Application Layer, APP Layer), the application framework layer (Application Framework Layer, FWKLayer), the hardware abstraction layer (HAL) and the kernel layer (Kernel Layer), and the hardware layer includes the display screen (panel). Among them, the application layer can include various applications running in the electronic device, such as: gallery, browser, theme application and wallpaper application. The application framework layer mainly involves graphics processing services, such as: image rendering service (surface flinger, SF) for rendering the image to be displayed given by the application, and image synthesis service (GPU) for synthesizing multiple layers of the image to be displayed. The kernel layer mainly includes the image display driver, which is mainly used to send the image to be displayed processed and issued by the upper layer of the system (other system layers above the kernel layer where the image display driver is located, such as the application layer, the application framework layer and the hardware abstraction layer) to the display screen. The hardware layer mainly includes the display screen (panel) that refreshes the image to be displayed based on the call of the image display driver.
[0107] In such Figure 2 In the system framework of the electronic device shown, the drawing and display of the image requires the coordination of each system level based on the Vsync signal output by the display screen. That is, when the application layer's gallery, browser, theme application or wallpaper application and other application APPs receive the Vsync signal output by the display screen, they respond to the Vsync signal to draw the image, and then, when the next Vsync signal output by the display screen arrives, the APP responds to the Vsync signal to send the drawn image to the application framework layer, so that the SF and GPU in the application framework layer respectively perform image rendering and layer synthesis processing on the drawn image to obtain the display data of the image to be displayed, and pass the display data of the image to be displayed to the image display driver of the kernel layer through the hardware abstraction layer. Furthermore, when the display screen outputs a new Vsync signal again, the image display driver responds to the new Vsync signal to call the display module serial interface (DSI) through the smart display engine (SDE) to write the display data of the image to be displayed into the DDIC of the display screen. The DDIC of the display screen can store the image data sent by the software side in a buffer, thereby controlling the display panel to complete the refresh display of the image by scanning (or reading) the display data in the buffer.
[0108] In the above-mentioned electronic device image display processing flow, since each system level of the electronic device software layer is based on the Vsync signal output by the display screen to cooperate to realize the final display of the image, the monitoring and response of each level to the Vsync signal is crucial. However, in the actual application of Vsync technology in electronic devices, based on the DDIC specification and the vertical synchronization response mechanism of Vsync technology adopted by electronic devices, once the upper system layer of the electronic device times out when processing the image, the image display driver will miss the Vsync signal and cannot send the image to the display screen, and needs to wait at least until the next Vsync signal is received before responding to send the image. In this way, the display screen will time out the display of the same frame of image in at least two consecutive refresh cycles. In this way, the user of the electronic device will visually feel that there is a delay in the device display screen.
[0109] like Figure 3 As shown, the DDIC of the display screen of the electronic device supports a 120Hz image refresh rate. When the DDIC refreshes the output vertical synchronization signal at a frequency of 120Hz, the Vsync period of the output vertical synchronization signal is about 8.3ms, so that the display screen displays the image for a display duration of about 8.3ms. In this way, at time t1, the Vsync signal 1 output by the display screen arrives; the APP of the electronic device application layer responds to the Vsync signal 1 to start drawing image 1, and the SF of the electronic device application framework layer also responds to the Vsync signal 1, and renders the image 0 previously sent by the APP through the rendering service render server (also called the render thread), and after SF completes the rendering of image 0, it will further send image 0 downward to the GPU, so that after receiving image 0, the GPU immediately starts to process the layer synthesis of image 0. At this time, the display screen will also start to display the image -1 of the previous frame of image 0 for a period of 8.3ms until the arrival of time t2.
[0110] At time t2, the Vsync signal 2 output by the display screen arrives; the APP of the electronic device application layer responds to the Vsync signal 2 to start drawing image 2, and the SF also responds to the Vsync signal 2 to render the image 1 sent by the APP at time t2, and after SF completes the rendering of image 1, it further sends image 1 to the GPU, so that after receiving image 1, the GPU starts to process the layer synthesis of image 1. At this time, after the GPU completes the synthesis of image 1, it will synchronously send the display data of image 1 to the image display driver of the electronic device system kernel layer (that is, the moment when the GPU completes the image synthesis also means that the image display driver has received the display data of the synthesized image 1). Therefore, after the GPU completes the synthesis of image 0 before time t2 and sends image 0 to the image display driver, the image display driver writes the display data of image 0 to the display screen in response to the Vsync signal 2 at time t2, so that the display screen refreshes and displays image 0 at time t2 until time t3.
[0111] At t3, the Vsync signal 3 output by the display screen arrives. However, if the electronic device is in a high-load scenario between t2 and t3, resulting in the APP in the application layer not completing the drawing of image 2 at this time, both SF and GPU will not perform any image processing actions until the next Vsync signal arrives because they did not receive the image 2 that should have been sent by the APP at t3. At this time, since the GPU has completed the synthesis of image 1 before t3 and sent the display data of image 1 to the image display driver, the image display driver responds to the Vsync signal 3 at t3 and writes the display data of image 1 to the display screen. The display screen starts to refresh the display image 1 at t3 until t4.
[0112] At time t4, the Vsync signal 4 output by the display screen arrives. If the electronic device does not have a new image display requirement at this time, the APP will not respond to the Vsync signal 4 to draw the image at this time. However, since SF has received the image 2 that the APP has completed drawing and sent before at time t4, it will still respond to the Vsync signal 4 to start rendering the image 2. After SF completes the rendering of image 2, the GPU will further perform layer synthesis on the image 2 sent by SF, and send the display data of the synthesized image 2 to the image display driver. At this time, since the image display driver did not receive any image display data at time t4, it missed the Vsync signal 4 and did not write the image display data to the display screen. In this way, the display screen will continue to display image 1 at time t4 until time t5.
[0113] At time t5, the Vsync signal 5 output by the display screen arrives, and the image display driver writes the display data of the image 2 received before this into the display screen in response to the Vsync signal 5. Thus, the display screen refreshes and displays the image 2 at time t5 until time t6. At time t6, since the APP has completed the original image display requirements of the electronic device before time t4, no new image drawing is performed, and the electronic device has not generated any new image display requirements from time t3 to time t6, the display screen will no longer continue to refresh the image after the display of image 2 ends at time t6. At this time, the display screen enters the sleep or off-screen state.
[0114] like Figure 4 As shown, the display screen of the electronic device still uses a refresh rate of 120Hz, outputs a Vsync signal with a Vsync period of 8.3ms, and also displays images with a display duration of 8.3ms. In this case, at time t4, the Vsync signal 4 output by the display screen arrives, but if the electronic device is in a high-load scenario between time t3 and time t4, resulting in the GPU not having completed the synthesis of image 2, the image display driver of the core layer of the electronic device will not receive the display data of the image 2 before time t4, and will miss the Vsync signal 4 without writing any image display data to the display screen, so that the display screen will continue to display the image 1 that was displayed at time t3 until time t5 at time t4.
[0115] In combination with the above, in some high-load scenarios, electronic devices may have an application layer APP drawing image timeout, an application framework layer SF rendering image timeout (not shown in the attached figure), or an application framework layer GPU synthesis image timeout, which causes the kernel layer image display driver to miss the Vsync signal to send the image to the display screen. Therefore, the display screen needs to display the image being displayed for two consecutive cycles (16.6ms), that is, the display screen shows that the current refresh rate drops directly from 120Hz to 60Hz. For users, the current refresh rate of the display screen drops directly from 120Hz to 60Hz, which will visually show that the display screen has a delay.
[0116] It should be noted that, in the embodiment of the present application, the above-mentioned electronic device is in a high-load scenario where the electronic device has too many threads opened at the same time, resulting in a decrease in the available system resources allocated to the APP, SF or GPU. It should be understood that in different systems or architectures, the definition of high-load scenarios for electronic devices may also be different, but no matter how the high-load scenario is defined, as long as the scenario affects the system's response to the vertical synchronization signal for image drawing, rendering or synthesis, thereby causing the display screen to time out the image display, so that the user feels the delay in the device display screen, it is in line with the technical ideas of the method provided in the embodiment of the present application, and should also be covered within the scope of protection of the present application.
[0117] In view of the above situation, even if there are some means to improve the above user experience, these means are all through improving the software control logic of the upper layer of the electronic device system, such as changing the algorithm processing logic of the upper layer of the system for image drawing, rendering or synthesis, so as to reduce the intermediate time of image processing as much as possible. However, no matter how the software control logic of the upper layer of the system is adjusted, it is impossible to fundamentally avoid the performance limitations of the hardware used by the electronic device, which leads to the phenomenon that the electronic device responds to the Vsync signal timeout or directly misses the Vsync signal. In other words, currently only improving the software control logic of the upper layer of the electronic device system is difficult to effectively solve the problem that the display screen has timed out to display the image for a long time, causing the user to feel that there is a delay in the device display screen.
[0118] In order to reduce the degree to which the user feels that there is a delay in the device display screen due to the display screen overtime displaying the image, and to effectively improve the user's poor visual experience of the device display screen, the present application proposes an image display method to reduce the length of time that the display screen overtime displays the image, so that the user is not easily aware of the delay in the device display screen.
[0119] It should be noted that the method proposed in the embodiment of the present application can be considered as a separate improvement relative to the above-mentioned solution of adjusting the software control logic of the upper layer of the electronic device system, and can also be considered as a further optimization and supplement to the solution of adjusting the software control logic. That is, the image display method proposed in the embodiment of the present application is improved separately at the software control level of the electronic device system, and the method proposed in the embodiment of the present application is also creatively improved at the system hardware level, thereby combining the improvements at both the system software and hardware levels to further reduce the duration of the display screen's timeout display of the image, and greatly reduce the degree of delay in the device display screen, making it difficult for users to perceive the delay in the device display screen.
[0120] In a feasible implementation of the embodiment of the present application, as Figure 5As shown, the method proposed in the embodiment of the present application can be used to detect whether the duration of the display screen of the electronic device for displaying the image is greater than the image display duration corresponding to the current refresh rate adopted by the display screen by adding a delay detection module in the core layer of the electronic device system during the process of the electronic device displaying the image. Based on this, when the delay detection module detects that the display screen displays the image timeout, the image display driver of the electronic device immediately increases the frequency of the Vsync signal output by the display screen, thereby writing the display data of the next frame of the image to the display screen in a short time by responding to the Vsync signal after the frequency is increased, so as to drive the display screen to display the next frame of the image. That is, the method proposed in the embodiment of the present application can make the display screen quickly display the next frame of the image when there is a slight delay in displaying the image, instead of requiring the display screen to display the image for at least two consecutive Vsync cycles corresponding to the image display duration, and then display the next frame of the image. In this way, the duration of the display screen displaying the image overtime can be effectively reduced, thereby greatly reducing the delay degree of the device display screen, making it difficult for the user to perceive the phenomenon of delay in the device display screen.
[0121] The method proposed in the embodiment of the present application is to configure the delay detection module in the image display driver of the kernel layer of the electronic device system. In this way, whether it is the kernel layer where the delay detection module itself is located that causes the display screen to display the image timeout, or the application layer, application framework layer or hardware abstraction layer of the system causes the display screen to display the image timeout, it can be detected by the delay detection module. This also improves the comprehensiveness of the detection of whether the display screen displays the image timeout, and increases the frequency of the output Vsync signal so that the image display driver can send the next frame of the image immediately.
[0122] Next, combine Figure 6 , a feasible specific implementation method of the image display method provided in an embodiment of the present application is described.
[0123] like Figure 6As shown, in the process of refreshing and displaying the image at the current refresh rate of 120Hz by the display screen of the electronic device (supporting 360Hz basic frequency), if at time t3, the APP used by the system application layer to draw the image 2 to be displayed, the time exceeds the Vsync period of 8.3ms corresponding to the current refresh rate of 120Hz, the APP will not respond to the Vsync signal 3 to send the display data of the image 2 to the SF of the application framework layer at time t3, and thus cause the image display driver to miss the Vsync signal 3 and fail to send the image to the display screen at time t3, resulting in the phenomenon that the display screen displays the image 1 overtime. The image display method provided in the embodiment of the present application uses a new hardware module-delay detection module in the kernel layer of the electronic device system. When the display screen displays the image 1 overtime (exceeding 8.3ms) at time t4, the image display driver of the electronic device increases the frequency of the Vsync signal output by the display screen to 360Hz. Thus, the display screen outputs the Vsync signal a with a frequency increase at time t5 (the corresponding Vsync period is 2.8ms), and the image display driver for driving the display screen in the system kernel layer can write the display data of image 2 received before time t5 to the display screen in response to the Vsync signal a after receiving the Vsync signal a. In this way, the display screen starts to display image 2 when the display time of image 1 at time t5 is only about 2.8ms longer.
[0124] like Figure 7 As shown, in the process of image refresh display of the display screen of the electronic device (supporting 360Hz basic frequency) according to the current refresh rate of 120Hz, if the GPU of the system application framework layer synthesizes the image 2 for more than 8.3ms, the GPU will send the display data of image 2 to the image display driver of the kernel layer after t4, and thus cause the image display driver to miss the Vsync signal 4 and fail to send the image to the display screen at t4, so that the display screen displays the image 1 for timeout. In view of this phenomenon, the image display method provided by the embodiment of the present application increases the frequency of the Vsync signal output by the display screen to 360Hz when the electronic device detects that the display screen displays the image 1 for timeout through the delay detection module. Thus, the display screen can output the Vsync signal a with the frequency increased at t5 (the corresponding Vsync period is 2.8ms), and the image display driver responds to the Vsync signal a at t5, and writes the display data of image 2 that the GPU has synthesized and sent to the image display driver before t5 to the display screen, so that the display screen starts to display image 2 when the display time of image 1 is only about 2.8ms overtime.
[0125] Compared with the traditional solution, the image display method provided in the embodiment of the present application uses a newly added delay detection module. When it is found that the display screen displays an image timeout due to the loss of Vsync signals (also known as frame loss) at various levels of the electronic device system, the frequency of the Vsync signal output by the display screen is immediately increased, so that the image display driver can send and display the image instantly based on the Vsync signal after the frequency increase. In this way, the display screen does not need to display the image in at least two consecutive Vsync cycles (such as 1 Vsync cycle is 8.3ms, and two Vsync cycles are 16.6ms) as in the traditional solution, resulting in a long time (such as 8.3ms) of timeout display of the image, and then display the next frame of the image written by the image display driver. Instead, the image can be displayed after a very short time (such as 2.8ms) of timeout display, and then respond to the image display driver to display the next frame of the image. For the user, the very short time of timeout display of the image by the display screen is almost imperceptible to the user visually. That is, when the display screen of an electronic device displays an image overtime, the present application can increase the frequency of the output Vsync signal to enable the image display driver to quickly send and display the next frame of image, thereby effectively reducing the duration of the display screen's overtime display of the image, making it difficult for users to notice the delay in the device's display screen.
[0126] In addition, in the examples of the present application, by comparison Figure 3 and Figure 6 Or compare Figure 4 and Figure 7 It can be found that compared with the traditional solution, the image display method provided in the embodiment of the present application can display more image frames in response to the Vsync signal of the electronic device within the same unit time. That is, the method provided in the embodiment of the present application can also effectively improve the average frame rate of the electronic device in response to the Vsync signal for image display. Moreover, the more times the display screen times out to display images due to missing the Vsync signal in the system of the electronic device, the more image frames the method provided in the embodiment of the present application will respond to display within the same unit time, so that the improvement of the average frame rate of the electronic device for image display will be more obvious and effective.
[0127] Based on the overall overview of the image display method provided by the above-mentioned embodiment of the present application, the specific embodiments of the image display method provided by the embodiment of the present application are described in turn below.
[0128] Please refer to Figure 8 , Figure 8 The following is a flowchart of an image display method provided in an embodiment of the present application in a specific implementation. It should be understood that although Figure 8The execution order of some method steps is shown in the figure, but the image display method provided in the embodiment of the present application can adopt an execution order different from the method steps shown in the figure based on different design requirements of actual applications. That is, Figure 8 The order of the steps in the method shown does not constitute a limitation on the execution logic order of the image display method provided in the embodiment of the present application. Figure 8 Reasonable changes in the sequence of steps of the method shown should be included in the protection scope of the image display method provided in the embodiments of the present application.
[0129] In a feasible embodiment of the image display method provided in the embodiment of the present application, when the image display method is executed by an electronic device, at a first moment, the electronic device generates a first Vsync signal, and in response to the first Vsync signal, the display screen of the electronic device starts to display the first image. At a second moment after the first moment, the electronic device generates a second Vsync signal. In response to the second Vsync signal, the display screen starts to display the second image. At a third moment after the second moment, in response to the second display duration of the display screen displaying the second image being greater than the first display duration of the display screen displaying the first image, the electronic device generates a third Vsync signal.
[0130] It should be noted that, in the embodiment of the present application, the first Vsync signal generated by the electronic device at the first moment corresponds to the first Vsync cycle, and the first Vsync cycle corresponds to the first display duration of the first image, that is, the first Vsync cycle is equal to the first display duration. The second Vsync signal generated by the electronic device at the second moment corresponds to the second Vsync cycle, and the second Vsync cycle is equal to the first Vsync cycle. The third Vsync signal generated by the electronic device at the third moment corresponds to the third Vsync cycle, and the third Vsync cycle is less than the first Vsync cycle.
[0131] In the embodiment of the present application, the smaller the Vsync period, the higher the frequency of the output Vsync signal. At the third moment, the electronic device generates the third Vsync signal in response to the second display duration being greater than the first display duration. This can be: the electronic device controls the display screen to increase the frequency of the trigger Vsync signal through its own image display driver when the second display duration is greater than the first display duration, so that the display screen outputs the third Vsync signal with the increased frequency at the third moment according to the increased frequency.
[0132] In the embodiment of the present application, by generating the third Vsync signal at the third moment, the display screen can start displaying the image of the next frame of the second image after displaying the second image for a very short time.
[0133] In a feasible embodiment, the electronic device controls the display screen through the image display driver to increase the frequency of triggering the Vsync signal, and the specific process of the electronic device generating the third Vsync signal at the third moment can be referred to. Figure 8 S1 to S3 shown.
[0134] S1: Detect whether the second display duration is greater than the first display duration.
[0135] In an embodiment of the present application, the image display driver of the electronic device calculates in real time a second display time for the display screen to display the second image after the display screen responds to a second Vsync signal at a second moment to display the second image, and detects whether the second display time is greater than the first display time for the display screen to display the first image.
[0136] It should be noted that, in the embodiment of the present application, the second image displayed on the display screen is the next frame image of the first image displayed on the display screen.
[0137] Exemplarily, when the display screen uses 60 Hz as the current refresh rate to refresh the image, and uses the 60 Hz frequency as the frequency of triggering the Vsync signal, when the first Vsync signal is triggered at the first moment, the first Vsync period corresponding to the first Vsync signal is approximately 1 / 60≈16.6 ms, that is, the display screen triggers a first Vsync signal every 16.6 ms. At this time, the first display duration corresponding to the first Vsync period is also approximately 16.6 ms, that is, the display screen refreshes and displays a frame of image every approximately 16.6 ms. In this way, because the second Vsync period is equal to the first Vsync period, after the display screen responds to the second Vsync signal to display the second image at the second moment, the second display duration for the display screen to continue to display the second image is also approximately 16.6 ms. In this way, if after the display screen displays the second image, the image display driver of the electronic device calculates the second display duration in real time and detects that the second display duration is greater than 16.6 ms, it can be determined that the second display duration is greater than the first display duration.
[0138] S2: when the second display duration is longer than the first display duration, the frequency of the output Vsync signal is increased.
[0139] In the embodiment of the present application, the image display driver of the electronic device controls the display screen to increase the frequency of the output Vsync signal when detecting that the second display duration of the second image is greater than the first display duration during the process of the display screen displaying the second image.
[0140] For example, when the display screen uses the current refresh rate of 60 Hz as the frequency of the output Vsync signal to display the second image, the image display driver calculates the second display time of the second image displayed by the display screen in real time, and detects that the second display time is greater than the first display time of 16.6 ms, then it is determined that the current display screen has a delay in displaying the second image. Therefore, the image display driver immediately sends a control instruction to the display screen to control the display screen to increase the frequency of the output Vsync signal currently used, 60 Hz.
[0141] S3: Generate a third Vsync signal.
[0142] In an embodiment of the present application, after the image display driver of the electronic device controls the display screen to increase the frequency of the output Vsync signal, the display screen outputs a third Vsync signal with an increased frequency to the image display driver and other software and hardware modules at a third moment after the second moment.
[0143] It should be noted that in the embodiment of the present application, since the higher the frequency of the output Vsync signal, the smaller the Vsync period, therefore, after the display screen increases the frequency of the output Vsync signal, the third Vsync period corresponding to the third Vsync signal triggered at the third moment is smaller than the above-mentioned first Vsync period, and also smaller than the above-mentioned second Vsync period (when the display screen outputs the first Vsync signal at the first moment and outputs the second Vsync signal at the second moment, the frequency of the output Vsync signal has not yet been increased).
[0144] For example, after the electronic device controls the display to increase the frequency of the currently used output Vsync signal from 60 Hz to 360 Hz, the display screen outputs the third Vsync signal with the first output frequency increased after increasing the frequency of the output Vsync signal by about 2.8 ms according to the Vsync period 1 / 360≈2.8 ms corresponding to the increased frequency 360 Hz. At this time, the third Vsync period corresponding to the third Vsync signal is about 2.8 ms, which is less than the first Vsync period of about 16.6 ms.
[0145] In a feasible embodiment, the specific process of the display screen displaying the next frame image of the second image in response to the third Vsync signal can be further referred to. Figure 8 S4 shown.
[0146] S4: Writing display data of the third image.
[0147] It should be noted that, in the embodiment of the present application, the third image is the next frame image of the above-mentioned second image.
[0148] In the embodiment of the present application, in response to the electronic device generating a third Vsync signal at a third moment, the display screen displays a third image. That is, after the image display driver of the electronic device has received the display data of the third image sent by the upper layer of the system, in response to the third Vsync signal with a frequency boost output by the display screen at the third moment, the display screen writes the display data of the third image to the display screen, so that the display screen displays the third image at the third moment.
[0149] Exemplarily, assuming that the display screen of the electronic device supports a 360Hz base frequency, when the display screen uses the current refresh rate of 120Hz corresponding to an image display duration of 8.3ms, in the process of displaying the image, the display screen uses the 120Hz frequency as the frequency of the output Vsync signal. After the display screen responds to the second Vsync signal at the second moment and starts to display the second image, the image display driver of the electronic device continuously detects whether the second display duration of the display screen displaying the second image is greater than the first display duration of 8.3ms (the Vsync period corresponding to the 120Hz frequency is approximately 8.3ms). In this way, when the image display driver detects that the second display duration is greater than 8.3ms, it determines that there is a delay problem in the current display of the second image on the display screen, thereby controlling the display screen to start the pre-set 360Hz-TE high-frequency synchronization scheme to control the display screen to increase the frequency of the output Vsync signal to 360Hz. In this way, at the third moment, the display screen outputs the third Vsync signal with an increased frequency according to the Vsync period 1 / 360≈2.8ms corresponding to the 360Hz frequency. After receiving the third Vsync signal, the image display driver responds to the third Vsync signal and writes the display data of the third image sent by the upper layer of the system before the third moment to the display screen. In this way, the display screen starts to refresh and display the third image at the third moment. At this time, the display screen only displays the second image for about 2.8ms.
[0150] In other feasible embodiments, the image display driver of the electronic device can receive the display data of the third image before receiving the third Vsync signal, and can also receive the display data of the third image sent by the upper layer of the system in response to the third Vsync signal while receiving the third Vsync signal, and write the display data of the third image to the display screen when responding to the third Vsync signal. For example, when the amount of the display data of the third image is small, so that the upper layer of the system processes the display data of the third image, and the time consumed in transmitting the display data of the third image between the software and hardware modules is short, the image display driver will not be unable to receive the display data before completing the response to the Vsync signal. In this way, the image display driver can receive the display data of the third image with a small amount of data after receiving the third Vsync signal, and write the display data of the third image to the display screen while responding to the third Vsync signal.
[0151] It should be noted that in the embodiment of the present application, the 360Hz-TE high frequency synchronization scheme can be pre-added in the display screen, and the display screen can switch the frequency of the output Vsync signal based on the need of the Vsync signal output control scheme. It should be understood that based on the different design requirements of actual applications, other Vsync signal output control schemes of the same type but with different frequencies can also be pre-added in the display screen, for example, a 60Hz-TE low frequency synchronization scheme and a 120Hz-TE standard frequency synchronization scheme.
[0152] When the display screen responds to the synchronization scheme of a certain frequency, it outputs a Vsync signal according to the Vsync period corresponding to the frequency. For example, when the display screen responds to the 360Hz-TE high-frequency synchronization scheme, the Vsync period corresponding to the 360Hz frequency is 2.8ms, and a Vsync signal is output every 2.8ms. When the display screen responds to the 120Hz-TE standard frequency synchronization scheme, the Vsync period corresponding to the 120Hz frequency is 8.3ms, and a Vsync signal is output every 8.3ms. When the display screen responds to the 60Hz-TE low-frequency synchronization scheme, the Vsync period corresponding to the 60Hz frequency is 16.6ms, and a Vsync signal is output every 16.6ms.
[0153] In the embodiment of the present application, when the display screen of the electronic device uses 120Hz as the current refresh rate to refresh the image, the 120Hz-TE standard frequency synchronization scheme can be used by default to output the Vsync signal with 120Hz as the original frequency. Fig. 9 The display screen uses the 120Hz-TE standard frequency synchronization scheme to refresh the output Vsync signal waveform, and Fig.10The display screen uses the 360Hz-TE high-frequency synchronization solution to refresh the output Vsync signal waveform. For comparative analysis, the display screen outputs the Vsync signal at a frequency of 120Hz ( Fig. 9 and Fig.10 In the process (in which all dotted arrows point to the moment when the display screen outputs the Vsync signal), if the image display driver misses a Vsync signal and causes a delay in sending image 1 to the display screen, the display screen will display image 0 of the previous frame of image 1 within at least two consecutive Vsync cycles. If the image display driver misses the Vsync signal and causes a delay in sending image 3 to the display screen, the display screen will also display image 2 of the previous frame of image 3 within at least two consecutive Vsync cycles. If the display screen outputs the Vsync signal at a frequency of 360Hz, when the image display driver misses a Vsync signal (a high-frequency Vsync signal at this time) and causes a delay in sending image 1 to the display screen, the image display driver only needs to timeout and display image 0 for a shorter Vsync cycle, that is, respond to the next high-frequency Vsync signal to send an image to the display screen so that the display screen starts to display image 1. Even if the image display driver misses two high-frequency Vsync signals in succession and fails to send image 3 to the display screen, the display screen only needs to timeout and display image 2 for two shorter Vsync cycles. Even two shorter Vsync periods (2.8 ms+2.8 ms=5.4 ms) are shorter than one Vsync period (8.3 ms) of outputting the Vsync signal at a frequency of 120 Hz.
[0154] Compared with the traditional solution, the image display method provided in the embodiment of the present application increases the frequency of the Vsync signal output by the display screen when the display screen displays the image for a timeout, so that the image display driver can display the image instantly based on the high-frequency Vsync signal after the frequency increase. In this way, the display screen can respond to the image display driver to display the next frame of the image only after the image is displayed for a very short time. The user will hardly be able to visually perceive the phenomenon of delay in the display screen of the device. That is, the method provided in the embodiment of the present application can effectively reduce the duration of the display screen displaying the image for a timeout, so that the user is not easy to perceive the delay in the display screen of the device.
[0155] In a feasible embodiment, the second display time length during which the display screen displays the second image is less than twice the first display time length.
[0156] In the embodiment of the present application, as long as the second display time is greater than the first display time but less than twice the first display time, the display screen responds to the third Vsync signal with a smaller Vsync period to start displaying the third image, the display screen will not display the second image for a long time for two consecutive first Vsync periods, and thus there will be no device display screen delay phenomenon similar to the traditional solution.
[0157] In this way, the image display driver of the electronic device can control the display screen to increase the frequency of the output Vsync signal when it detects that the second display duration is greater than the first display duration at the beginning, and can also control the display screen to increase the frequency of the output Vsync signal at any time when the second display duration is greater than the first display duration but less than twice the first display duration. At this time, the image display driver responds to the third Vsync signal whose frequency is increased and output by the display screen to write the display data of the third image to the display screen, so that the display screen displays the third image when the duration of the second image displayed overtime does not exceed the first display duration.
[0158] In a feasible embodiment, a third display time length during which the display screen displays the third image is shorter than the first display time length.
[0159] In the embodiment of the present application, since the display screen displays the third image in response to the third Vsync signal after the frequency is increased when the display of the second image times out (the second display duration is longer than the first display duration), if the electronic device generates a new Vsync signal using the Vsync cycle corresponding to the third Vsync signal, and the image display driver of the electronic device also receives the display data of the image of the next frame of the third image before (or at the same time as) the electronic device generates the new Vsync signal, the image display driver will respond to the new Vsync signal and write the display data of the image of the next frame of the third image to the display screen. That is, the display screen starts to refresh and display the image of the next frame of the third image in response to the new Vsync signal. In this way, the third display duration (approximately from the third moment to the moment when the electronic device generates a new Vsync signal) of the display screen displaying the third image will be less than the first display duration corresponding to the first Vsync cycle.
[0160] For example, Fig.11As shown, after the image display driver controls the display screen to output the frequency of the Vsync signal after the t4 moment (the moment shown by the vertical dotted line in the figure), the frequency is increased from the original frequency 120Hz to 360Hz, and the display screen displays the third image (image 2) in response to the third Vsync signal a at the third moment (t5). Afterwards, if the display screen still triggers a new Vsync signal a at 360Hz, then at the t6 moment, the display screen will start to refresh the image 3 of the next frame of the image 2 in response to the new Vsync signal a. At this time, the third display duration of the display screen displaying the third image is only about 5.4ms, which is less than the first display duration of the first image (image 0) of 8.3ms.
[0161] In another feasible embodiment, the third display time length for the display screen to display the third image may also be the same as the first display time length mentioned above.
[0162] In the embodiment of the present application, since the display screen starts to display the third image in response to the third Vsync signal after the frequency is increased when the display of the second image times out, if the electronic device generates a new Vsync signal using the Vsync cycle corresponding to the third Vsync signal, and the image display driver of the electronic device receives the display data of the next frame of the third image before (or at the same time as) the electronic device generates the M+1th new Vsync signal, the image display driver responds to the new Vsync signal and writes the display data of the next frame of the third image to the display screen. That is, the display screen refreshes and displays the image of the next frame of the third image in response to the new Vsync signal. In this way, the display duration of the display screen displaying the third image will be equal to the first display duration corresponding to the first Vsync cycle.
[0163] It should be noted that, in the embodiment of the present application, M is a multiple of the frequency of the Vsync signal output by the display screen after the boost, which is greater than 1 compared to the frequency of the Vsync signal output by the display screen before the boost.
[0164] For example, Fig.12As shown, after the image display driver controls the display screen to increase the frequency of the output Vsync signal to M=3 times (360Hz) of the original frequency of 120Hz after t4 (the moment shown by the vertical dotted line in the figure), the display screen displays the third image (image 2) in response to the third Vsync signal (the first Vsync signal a) after the frequency is increased at the third moment (t5). After that, the display screen continues to output the Vsync signal a after the frequency is increased at 360Hz. If the image display driver receives the display data of the image 3 of the next frame of image 2 before the display screen triggers the fourth Vsync signal a at t8, the image display driver responds to the fourth Vsync signal a and writes the received display data of image 3 to the display screen to drive the display screen to display image 3. In this way, the third display duration of the display screen displaying image 2 is equal to the first display duration of the display screen displaying the first image (image 0), which is 8.3ms.
[0165] It should be noted that Fig.12 The moments indicated by the dashed arrows are the moments when the image display driver does not respond to the Vsync signal a to send images to the display screen.
[0166] In a feasible embodiment, at a fourth moment after the second moment and before the third moment, the electronic device will also generate a fourth Vsync signal. At this time, if the image display driver of the electronic device has not received the display data of the third image in the next frame of the second image, the image display driver will not respond to the fourth Vsync signal to write the display data of any image to the display screen, so that the display screen will respond to the fourth Vsync signal to the second image currently being displayed and continue to display the second image overtime.
[0167] For example, Fig.11 or Fig.12As shown, after the display screen starts to display the second image (image 1) in response to the second moment (t3), the display screen will continue to trigger a fourth Vsync signal at the fourth moment (t4) according to the second Vsync cycle 8.3ms equal to the first Vsync cycle. At this time, since the image display driver has not received the display data of the third image (image 2) sent by the upper layer of the electronic device system, the image display driver will not respond to the fourth Vsync signal to write the display data of image 2 to the display screen. Therefore, at the moment t4, the display screen can only continue to display image 2 in response to the fourth Vsync signal. Since the second display duration of the second image displayed by the display screen has reached 8.3ms at this time, the display screen displays the second image as a timed display after the moment t4. Afterwards, at the third moment (t5), since the display screen outputs the third Vsync signal (the first Vsync signal a) according to the frequency of the Vsync signal after the boost, 360Hz, and the image display driver receives the display data of image 2 before t5, the image display driver can write the display data of image 2 to the display screen in response to the first Vsync signal a. The display screen responds to the first Vsync signal a at t5 and starts to refresh the display image 2.
[0168] In a feasible embodiment, when the display screen outputs the Vsync signal at 120 Hz as the original frequency, the first Vsync period corresponding to the first Vsync signal generated by the electronic device through the display screen at the first moment is approximately 8.3 (1 / 120≈8.3) ms. Afterwards, if the electronic device increases the frequency of the Vsync signal output by the display screen by 3 times the original frequency of 120 Hz through the image display driver, that is, increased to 360 Hz, then the third Vsync period corresponding to the third Vsync signal generated by the electronic device through the display screen at the third moment after the frequency of the output Vsync signal is increased is approximately 2.8 (1 / 360≈2.8) ms.
[0169] In a feasible embodiment, when the first Vsync cycle is approximately 8.3ms and the third Vsync cycle is approximately 2.8ms, the first display duration corresponding to the first Vsync cycle is also approximately 8.3ms, and the second display duration of the display screen displaying the second image is approximately 8.3ms+2.78ms=11.1ms.
[0170] For example, assuming that a display screen supporting a 360Hz base frequency initially outputs a Vsync signal at an original frequency of 120Hz, the display screen displays the first image according to the first display duration of 8.3ms corresponding to the first Vsync cycle of 8.3 (1 / 120≈8.3)ms, and then responds to a new Vsync signal to display the second image of the next frame of the first image. In the process of displaying the second image, if the display screen displays the second image overtime (the second display duration is greater than the first display duration of 8.3ms), the image display driver controls the display screen to increase the frequency of the output Vsync signal to 3 times the original frequency of 120Hz, that is, to 360Hz. In this way, the display screen outputs a Vsync signal at a frequency of 360Hz, and the image display driver responds to the Vsync signal to write the display data of the third image of the next frame of the second image to the display screen, so as to drive the display screen to display the third image after only the second image is overtime displayed for about 2.8ms. At this time, the display screen displays the second image for a complete second display duration of about 8.3ms+2.78ms=11.1ms.
[0171] In some feasible embodiments, when the image display driver of the electronic device increases the frequency of the Vsync signal output by the display screen to M times the original frequency of the Vsync signal, the image display driver can receive display data of the third image of the next frame of the second image displayed by the display screen before the display screen outputs the i-th Vsync signal with the increased frequency according to the increased frequency, where i is a positive integer and i is less than M.
[0172] In this case, the image display driver writes the display data of the third image to the display screen in response to the Vsync signal with increased frequency. This may be: writing the display data of the third image to the display screen in response to the i-th Vsync signal with increased frequency.
[0173] For example, Fig.13As shown, when the image display driver controls the display screen to increase the frequency of the output Vsync signal to M=3 times (360Hz) of the original frequency of 120Hz after time t4 (the time shown by the vertical dotted line in the figure), if the upper layer of the system of the electronic device sends the display data of the third image (image 2) of the next frame of the second image (image 1) displayed on the display screen to the image display driver before the display screen outputs the i=1th Vsync signal a after the frequency increase at 360Hz at the third time (t5), that is, the image display driver receives the display data of image 2 before time t5, then the image display driver writes the display data of image 2 to the display screen in response to the i=1th Vsync signal a at time t5 to drive the display screen to display image 2. In this way, the image display driver displays image 2 within 2.8ms after the display screen times out displaying image 1, thereby shortening the traditional solution, which requires the display screen to display image 1 for at least two consecutive Vsync cycles (8.3ms+8.3ms=16.6ms) for a long time before displaying image 2, to only needing the display screen to display image 1 for 8.3ms+2.8ms=11.1ms before displaying image 2. That is, the time for the display screen to timeout display image 1 is effectively reduced (from the traditional solution timeout of about 16.6ms to only about 2.8ms).
[0174] For example, Fig.14 As shown, if the upper layer of the system of the electronic device sends the display data of image 2 to the image display driver after the third moment (t5), that is, the image display driver receives the display data of image 2 before the display screen outputs the i=2nd Vsync signal a at 360Hz. At this time, the image display driver responds to the i=2nd Vsync signal a and writes the received display data of image 2 to the display screen to drive the display screen to display image 2. At this time, the image display driver can also send the image 2 for display after the display screen only displays image 1 for about 5.4ms. Compared with the traditional solution that requires the display screen to display image 1 for a long time of about 16.6ms, the display screen can still shorten the display time of image 1 by about 8.3ms+5.4ms=13.9ms. That is, the time for the display screen to display image 1 overtime is still effectively reduced (from the traditional solution timeout of about 16.6ms to only about 5.4ms).
[0175] It should be noted that Fig.13 and Fig.14 The moments indicated by the dashed arrows are the moments when the image display driver does not respond to the Vsync signal a to send images to the display screen.
[0176] In some other feasible embodiments, the above M may not be a positive integer, but M is still greater than 1.
[0177] For example, Fig.15 As shown, the image display driver is after time t4 (such as Fig.13 At the moment shown by the vertical dotted line in the middle), the display screen is controlled to increase the frequency of the output Vsync signal to M=1.5 times (180Hz) of the original frequency of 120Hz. In this way, if the upper layer of the system of the electronic device sends the display data of the third image (image 2) of the next frame of the second image (image 1) displayed on the display screen to the image display driver before the i=1th Vsync signal a with the frequency increased by 180Hz is triggered by the display screen at the third moment (t5), that is, the image display driver receives the display data of image 2 before the moment t5, then the image display driver responds to the i=1th Vsync signal a at the moment t5, writes the display data of image 2 to the display screen to drive the display screen to display image 2. In this way, the image display driver can send image 2 for display after the display screen has timed out to display image 1 for about 5.5ms. Compared with the traditional solution that the display screen displays image 1 for a long time of about 16.6ms, the display time of image 1 on the display screen can also be shortened to about 13.8ms. That is, the time for the display screen to overtime display image 1 is still effectively reduced.
[0178] In the embodiment of the present application, the image display driver of the electronic device receives the display data of the third image before the display screen outputs the i-th Vsync signal after the frequency is increased, and then writes the display data of the third image to the display screen in response to the received i-th Vsync signal after the frequency is increased to drive the display screen to display the third image. In this way, it can be ensured that the image display driver of the electronic device responds to the Vsync signal after the frequency is increased triggered by the display screen within a short period of time when the display screen displays the image overtime, and sends the next frame of image for display. That is, the duration of the display screen displaying the second image overtime is effectively reduced.
[0179] In some feasible embodiments, in response to the display screen displaying the second image, the image display driver of the electronic device calculates the second display duration for the display screen to display the second image. In addition, the image display driver compares the second display duration with the first display duration. In the case where the second display duration is longer than the first display duration, the image display driver sends a control instruction to the display screen in response to the second display duration being longer than the first display duration. The display screen increases the frequency of the output Vsync signal in response to the control instruction, and generates a third Vsync signal with an increased frequency at a third moment after the second moment.
[0180] Exemplarily, by configuring a delay detection module in the image display driver of the electronic device, and detecting whether the second display duration is greater than the first display duration through the delay detection module, the frequency of the output Vsync signal is increased when the delay detection module detects that the second display duration is greater than the first display duration. In this way, since the image display driver is located in the kernel layer of the entire system of the electronic device, whether the upper layer of the system (such as the application layer, the application framework layer or the hardware abstraction layer) causes the second display duration to be greater than the first display duration, or the kernel layer itself causes the second display duration to be greater than the first display duration, it can be detected by the newly added delay detection module in the kernel layer. That is, the comprehensiveness and accuracy of detecting whether the second display duration is greater than the first display duration are improved.
[0181] In the embodiment of the present application, the electronic device can determine whether to increase the frequency of the output Vsync signal by combining improvements at the software level and the hardware level. That is, the electronic device adds a new hardware module to the system kernel layer, and uses the hardware module to detect whether there is a delay in the device display screen (that is, detect whether the display screen displays the image for a timeout). When the hardware module detects that there is a delay in the device display screen, the frequency of the Vsync signal output by the display screen is increased to achieve the purpose of reducing the degree of delay in the device display screen. Fig.16 As shown, the electronic device newly configures a delay detection module in the image display driver of the kernel layer. Based on this, in response to the display screen starting to display the second image, the electronic device continuously calculates the second display duration of the display screen displaying the second image through the delay detection module, and detects whether the second display duration is greater than the first display duration. Afterwards, when the delay detection module detects that the second display duration is greater than the first display duration, it is determined that there is a delay in the display screen of the device, so that the image display driver sends a control instruction to the display screen to control the display screen to increase the frequency of the output Vsync signal.
[0182] It should be noted that in the embodiment of the present application, the image display driver continuously detects whether the duration of the image displayed on the display screen has timed out through the delay detection module during the process of displaying the image on the display screen. Among them, if the image display driver in the kernel layer of the electronic device, the applications in the application layer, the image rendering framework and the image synthesis framework in the application framework layer, and the hardware abstraction layer miss the Vsync signal triggered by the display screen at the original frequency, it will cause the second display duration to be longer than the first display duration, thereby causing the image displayed on the display screen to be in a delayed state.
[0183] In the embodiment of the present application, when the image display driver of the electronic device detects whether the second display duration is greater than the first display duration, it can detect, through its newly added delay detection module, whether the second display duration of the second image displayed by the display screen is greater than the first display duration corresponding to the first Vsync during the process of the display screen displaying the second image. When the delay detection module detects that the second display duration is greater than the first display duration, the image display driver determines that the display screen has timed out to display the second image, thereby placing the image displayed on the display screen in a delayed state.
[0184] When the image display driver determines that the second display duration is greater than the first display duration and thus increases the frequency of the Vsync signal output by the display screen, it can send a control instruction to the display screen through the display module serial interface that establishes a communication connection between itself and the display screen. The display screen responds immediately after receiving the control instruction, thereby increasing the frequency of the output Vsync signal from the original frequency to the frequency indicated by the control instruction.
[0185] In an embodiment of the present application, when the delay detection module detects that the second display duration exceeds the first display duration, the image display driver of the electronic device immediately increases the frequency of the Vsync signal output by the display screen, and responds to the Vsync signal after the frequency is increased, and writes the display data of the third image to the display screen to drive the display screen to display the third image. In this way, it is possible to effectively reduce the duration of the display screen displaying the image overtime, thereby reducing the degree of delay in the device display screen, and it is also possible to improve the comprehensiveness of detecting whether the display screen displays the second image overtime, and to increase the frequency of the output Vsync signal so that the image display driver can send the third image to the display immediately. Because the delay detection module is configured in the image display driver of the kernel layer of the electronic device system, whether the kernel layer where the delay detection module itself is located causes the display screen to display the second image overtime, or the application layer, application framework layer or hardware abstraction layer of the system causes the display screen to display the second image overtime, it can be detected by the delay detection module.
[0186] In some feasible embodiments, the image display driver of the electronic device detects whether the image display driver responds to the Vsync signal triggered by the display screen at the original frequency before detecting whether the second display duration is greater than the first display duration through a delay detection module.
[0187] In an embodiment of the present application, the image display driver of the electronic device detects whether the display screen is in a delayed state for displaying an image through a delay detection module each time the display screen refreshes the displayed image. That is, in addition to detecting whether there is a delay in displaying an image on the display screen through a delay detection module when the display screen displays the second image (the second display duration exceeds the first display duration, indicating that there is a delay in displaying the second image on the display screen), the image display driver also detects whether the display screen is in a delayed state for displaying the first image through a delay detection module when the display screen displays the first image. Afterwards, when the image display driver detects that the display screen is not in a delayed state for displaying the first image through the delay detection module, it further detects whether there is a delay in displaying the second image on the display screen through the delay detection module, that is, detects whether the second display duration exceeds the first display duration.
[0188] In an embodiment of the present application, the image display driver detects whether the display of the first image by the display screen is in a delayed state through the delay detection module: the delay detection module detects whether the image display driver responds to the first Vsync signal triggered by the display screen at the original frequency at the first moment, and writes the display data of the second image to the display screen, thereby driving the display screen to display the second image when the display screen does not time out to display the first image. If it is detected that the image display driver responds to the first Vsync signal to drive the display screen to display the second image, it is determined that the display screen is not in a delayed state for displaying the first image. If it is detected that the image display driver does not respond to the first Vsync signal (or misses the first Vsync signal), resulting in the display screen timeout displaying the first image, it is determined that the display screen is in a delayed state for displaying the first image.
[0189] In some feasible embodiments, if the image display driver detects through the delay detection module that the image display driver writes the display data of the second image to the display screen in response to the first Vsync signal, thereby determining that there is no delay when the display screen displays the first image, the image display driver detects through the delay detection module whether the second display duration is greater than the first display duration, thereby determining whether there is a delay in the display screen displaying the second image based on the detection result. When it is determined that there is a delay in the display screen displaying the second image, the image display driver controls the display screen to increase the frequency of the output Vsync signal.
[0190] For example, in combination Fig.16 The system framework of the electronic equipment shown and Fig.17The electronic device shown applies the control logic of image display by the method provided in the embodiment of the present application. Assuming that the display screen of the electronic device supports a basic frequency of 360 Hz, when the display screen displays an image according to the first Vsync period of 8.3 ms corresponding to a refresh rate of 120 Hz, when the display screen displays an image, the browser application APP of the application layer of the electronic device system also synchronously draws the third image of the next frame of the second image, and sends the display data of the third image that is drawn but needs to be rendered to the image rendering service in the application framework layer. After the image rendering service completes rendering of the display data, if the display data needs to be further synthesized, the rendered display data is further sent to the image synthesis service. After the image synthesis service synthesizes the display data, it is sent to the hardware abstraction layer as the display data of the third image to be displayed, so that the hardware abstraction layer performs hardware matching to send the display data of the third image to the image display driver of the kernel layer. The image display driver performs preparation before sending the image after receiving the display data of the third image.
[0191] At this time, the image display driver obtains the result detected in advance by the delay detection module. When the result is that the display screen is not in a delayed state when displaying the first image (the first display duration does not exceed 8.3ms), the delay detection module is further used to detect whether the second display duration of the second image displayed by the display screen is greater than 8.3ms. When it is detected that the second display duration is greater than 8.3ms, the image display driver immediately sends a command 1 for controlling the start of the high-frequency TE to the display screen through the display module serial interface (DSI) that establishes a communication connection with the display screen, thereby controlling the display screen to respond to the command 1 to start the pre-set 360Hz-TE high-frequency synchronization scheme, thereby increasing the frequency of the Vsync signal output by the display screen to 360Hz.
[0192] Alternatively, the image display driver obtains the result detected in advance by the delay detection module, but the result is that the display screen is already in a delayed state when displaying the first image (the first display duration exceeds 8.3ms), which means that when the display screen displays the first image, the display screen has experienced a delay caused by image display timeout, and in order to reduce the degree of delay, the image display driver has controlled the display screen to increase the frequency of the output Vsync signal to 360Hz.
[0193] In some feasible embodiments, after the image display driver of the electronic device increases the frequency of the output Vsync signal, thereby driving the display screen to display an image in response to the Vsync signal with the increased frequency, in order to avoid the image display driver sending the next frame of the image for display in advance, causing the display screen to only briefly display the image and then quickly display the next frame of the image, the electronic device can use the image display driver to not respond to the Vsync signal with the increased frequency output by the display screen within the display time of the display screen displaying the image, thereby forcing the display screen to display the image for a longer time.
[0194] In the embodiment of the present application, the electronic device can Fig.18 The steps S5 and S10 shown in the figure forcibly extend the duration of the display screen displaying the third image. Among them, after the display screen displays the third image, the step S5 is executed: the Vsync signal with the frequency increased is fed back. When the image display driver receives the Vsync signal with the frequency increased fed back by the display screen, if the third display duration of the third image displayed by the display screen is not greater than the difference between the first display duration and the third Vsync cycle, the step S6 is executed: stop responding to the Vsync signal with the frequency increased. After that, the display screen continues to execute step S7: feedback the Vsync signal with the frequency increased. After the image display driver receives the Vsync signal with the frequency increased fed back by the display screen, if the third display duration is greater than the difference between the first display duration and the third Vsync cycle, the image display driver executes S8: resumes responding to the Vsync signal with the frequency increased. After that, the display screen executes step S9: feedback the Vsync signal with the frequency increased. After receiving the Vsync signal, the image display driver executes step S10: responds to the Vsync signal with the frequency increased and writes the display data of the next frame of the image to the display screen. In this way, the display screen starts to display the next frame of the image.
[0195] In an embodiment of the present application, after the image display driver of the electronic device writes the display data of the third image to the display screen to drive the display screen to display the third image, the image display driver stops responding to the frequency-increased Vsync signal output by the display screen within the third display time duration when the display screen displays the third image, so as to refuse to write the display data of the next frame image of the third image to the display screen within the third display time duration.
[0196] Afterwards, when the third display time is greater than the difference between the first display time and the third Vsync cycle, the image display driver resumes responding to the Vsync signal with increased frequency output by the display screen, thereby achieving writing the display data of the next frame of the third image to the display screen after the third display time reaches the first display time.
[0197] In the embodiment of the present application, the image display driver does not respond to the Vsync signal with a frequency increase triggered by the display screen during the third display duration of the display screen displaying the third image, so as to avoid the phenomenon that the display screen briefly displays the third image due to the image display driver sending the next frame of the third image to display in advance during the display screen displaying the third image. In this way, the stability of the electronic device displaying the third image and subsequent images is further improved.
[0198] For example, Fig.19 As shown, it is assumed that the image display driver of the electronic device detects that the second display duration of the display screen displaying the second image at a refresh rate of 120Hz after time t4 is greater than the first display duration corresponding to the first Vsync cycle (1 / 120Hz) of about 8.3ms, and at the time shown by the dotted line between time t4 and time t5 in the figure, the display screen is controlled to increase the frequency of the output vertical synchronization signal from the original frequency 120Hz to 360Hz. Then, in response to the third Vsync signal (Vsync signal a) output by the display screen at the third time (t5) according to the third Vsync cycle (1 / 360≈2.8ms) corresponding to the frequency of 360Hz, the image display driver writes the third image (image 2) into the display screen to drive the display screen to display image 2 when the display screen only displays the second image (image 1) for about 2.8ms.
[0199] Afterwards, since the display screen increases the frequency of the output Vsync signal to 360Hz, the display screen continues to output a new Vsync signal a at time t6, which is about 2.8ms after displaying image 2 (indicated by the dotted line at time t6 in the figure). At this time, since the display screen displays image 2 for only about 2.8ms, the image display driver stops responding to the Vsync signal a received at time t6 (the moments indicated by the dotted arrows in the figure are the moments when the image display driver does not respond to the Vsync signal a to send images to the display screen), so as to refuse to write the display data of the next frame of image 2 (image 3) to the display screen at time t6.
[0200] After that, the display screen continues to output a new Vsync signal a at time t7, about 2.8ms after displaying image 2 (indicated by the dotted line at time t7 in the figure). At this time, since the second display duration of the display screen for displaying image 2 is still only 5.4ms, that is, the second display duration has not reached the first display duration of about 8.3ms, the image display driver still does not respond to the Vsync signal a at time t7, so as to refuse to write the display data of image 3 to the display screen at time t7.
[0201] However, after that, when the second display duration is greater than 5.5ms (the first display duration is 8.3ms minus the third Vsync period of about 2.8ms), the image display driver resumes responding to the Vsync signal a output by the display screen. As a result, the display screen continues to output a new Vsync signal a at time t8 (at which time the second display duration is already approximately equal to 8.3ms) after further displaying image 2 for about 2.8ms. At this time, since the second display duration has reached 8.3ms, the image display driver responds to the Vsync signal a at time t8 to write the display data of image 3 to the display screen.
[0202] In this way, it can be ensured that the display screen displays image 2 for about 8.3ms. After that, as long as the display screen continues to trigger a new Vsync signal a at a frequency of 360Hz, when the display screen displays image 3 and subsequent images (if any), the image display driver refers to the same processing process of sending images to the display screen when the display screen displays image 2, and responds to the Vsync signal a to send images to the display screen.
[0203] It should be noted that in the embodiments of the present application, Fig.19 The image display driver shown in the figure does not respond to the Vsync signal a when the display screen displays the image 2 and sends the image to the display screen, which can also be applied to the above Fig.12 , Fig.13 and Fig.14 The example scenario shown is combined with the following application Fig.21 That is, in the above example scenario Fig.12 , Fig.13 and Fig.14 And later Fig.21 In the example scenario shown, the image display driver continues to respond to the Vsync signal a with a frequency increase and writes the display data of the next frame of the third image to the display screen during the process of the display screen displaying the third image and the subsequent images (if any). Fig.19 The process of the image display driver shown in the figure responding to the Vsync signal a to send the image 3 to the display screen when the display screen displays the image 2 is the same, and will not be described in detail here.
[0204] In some feasible embodiments, when the image display method provided in the embodiment of the present application is executed by an electronic device, after the image display driver writes the display data of the third image to the display screen to drive the display screen to display the third image in real time, the image display driver further adaptively reduces the frequency of the Vsync signal. In this way, it is possible to avoid the waste of power consumption caused by the display screen outputting the Vsync signal at an unnecessary high frequency for a long time, thereby achieving the purpose of saving power consumption of the device.
[0205] In an embodiment of the present application, after the display screen of the electronic device displays the third image in response to the third Vsync signal, if the third display time length of the display screen displaying the third image is greater than the preset interval time length, the electronic device reduces the frequency of the output Vsync signal. The preset interval time length is equal to the first display time length minus the time length consumed for reducing the frequency of the output Vsync signal, that is, the preset interval time length is the difference between the first display time length minus the time length consumed for reducing the frequency of the output Vsync signal.
[0206] It should be noted that, in the embodiment of the present application, the time required for reducing the frequency of the output Vsync signal can be an empirical value pre-added in the image display driver for the image display driver to flexibly read. Alternatively, the time consumed can also be a value temporarily determined by the electronic device based on its own real-time system resource occupancy and performance when it is necessary to determine the preset interval time. The temporarily determined value can be obtained by the image display driver at any time. It should be understood that based on the different design needs of actual applications, the time consumed for reducing the frequency of the output Vsync signal can of course be different values. For example, the time consumed can specifically be any value of 0.3ms, 0.5ms, 0.8ms or even 1ms. That is, the method provided in the embodiment of the present application does not limit the specific value of the time required to reduce the frequency of the output Vsync signal.
[0207] like Fig.16 and Fig.17 As shown, after the image display driver of the electronic device has controlled the display screen to increase the frequency of the Vsync signal output by the display screen to 360Hz, thereby reducing the delay caused by the display screen's timeout display of the image, in order to avoid the waste of device power consumption caused by the display screen still triggering the Vsync signal at 360Hz, the image display driver calculates the interval time b from the current moment to the moment when the image display driver writes the display data of the first image to the display screen, and compares the interval time b with the first display time of about 8.3ms minus the time spent on reducing the Vsync signal (assuming 1ms) 7.3ms. Thus, when the comparison finds that the interval time b is greater than or equal to 7.3ms, the image display driver determines that the current operation of increasing the frequency of the output Vsync signal has reduced the delay that occurs when the display screen displays the second image, that is, the display screen's display of the third image has stabilized. Thus, the image display driver sends a control instruction 2 for turning off the high-frequency TE to the display screen through the DSI, so as to control the display screen to turn off the preset 360Hz-TE high-frequency synchronization scheme in response to the instruction 2, and reduce the frequency of the Vsync signal output by the display screen from 360Hz to 120Hz.
[0208] In some feasible embodiments, the image display driver can also obtain the current time of the electronic device system after the display screen displays the third image, and use the current time minus the image sending time of the Vsync signal after the image display driver response frequency is increased (the time when the display data of the third image is written to the display screen), so as to use the calculated time as the third display time for the display screen to display the third image. Afterwards, the third display time is compared with the preset interval time.
[0209] Alternatively, in some other feasible embodiments, the image display driver can also directly compare the duration obtained by subtracting the image sending time from the current time with the preset interval duration, so that when the duration obtained by subtracting the image sending time from the current time is greater than or equal to the preset interval duration, the frequency of the previously increased output Vsync signal is reduced.
[0210] In some feasible embodiments, after the display screen starts to display the third image, the image display driver of the electronic device may reduce the frequency of outputting the Vsync signal when the display screen receives display data of the next frame of the third image within the third display duration of the display screen displaying the third image. In this way, at the fifth moment after the third moment, the electronic device generates the fifth Vsync signal.
[0211] It should be noted that, in the embodiment of the present application, the fifth Vsync signal corresponds to the fifth Vsync period, which is equal to the first Vsync period mentioned above.
[0212] In some feasible embodiments, the display time of the fourth image is greater than the preset interval time; the fourth image is an image displayed in the previous frame of the fifth moment, the preset interval time is the interval time between the fifth moment and the sixth moment minus the time required to reduce the frequency of the output Vsync signal, and the sixth moment is the moment when the fourth image is written to the display screen.
[0213] In the embodiment of the present application, after the display screen starts to display the third image, in response to the display duration of the fourth image being greater than the interval duration between the fifth moment and the sixth moment minus the time required to reduce the frequency of the output Vsync signal, the electronic device reduces the frequency of the output Vsync signal. Afterwards, at a fifth moment after the third moment, the electronic device generates a fifth Vsync signal having a Vsync period equal to the first Vsync period.
[0214] It should be noted that, in the embodiment of the present application, the fourth image is the third image itself or a frame image after the third image. The sixth moment is the moment when the fourth image is written to the display screen, that is, when the fourth image is the third image itself, the sixth moment is the third moment when the display screen responds to the third Vsync signal and starts to display the third image (at this time, the third image is written to the display screen and starts to be displayed by the display screen), and when the fourth image is a frame image after the third image, the sixth moment is the moment when the display screen starts to display the frame image after the third image (at this time, the frame image after the third image is written to the display screen and starts to be displayed by the display screen). The interval between the fifth moment and the sixth moment is the first display duration corresponding to the above-mentioned first Vsync cycle.
[0215] For example, Fig. 20 As shown, taking the fourth image as the third image itself and the sixth moment as the third moment itself as an example, after the display screen starts to display the third image (image 2) at the third moment (t5), the electronic device calculates the third display duration of image 2 in real time. When the third display duration is greater than the interval duration of 8.3ms between the fifth moment (t6) and t5 minus the time consumed to reduce the frequency of the output Vsync signal (the time consumed is the time between the moment indicated by the vertical dotted line on the right side of the figure and t6), the electronic device reduces the frequency of the output Vsync signal at the moment indicated by the vertical dotted line on the right side of the figure. In this way, at moment t6, the electronic device generates a fifth Vsync signal (Vsync signal 6) with a fifth Vsync period of 8.3ms (equal to the first Vsync period).
[0216] In some feasible embodiments, if the electronic device reduces the frequency of the Vsync signal output by the display screen during the process of displaying the third image on the display screen through the image display driver, the fifth moment when the electronic device generates the fifth Vsync signal through the display screen and the third moment when the display screen outputs the third Vsync signal are N = 1 8.3ms apart.
[0217] For example, Fig. 20As shown, the electronic device detects that the display screen displays image 1 timeout after time t4 through the delay detection module, and increases the frequency of the Vsync signal output by the display screen (the moment shown by the vertical long dashed line on the left side of the figure is the moment of increasing the frequency of the output Vsync signal), so that the display screen outputs the third Vsync signal (Vsync signal a) with the frequency increased at the third moment (t5). The image display driver responds to the Vsync signal a at time t5, and writes the display data of the third image (image 2) that the GPU has synthesized and sent to the image display driver to the display screen, so that the display screen starts to display image 2 after the second display time length of displaying the second image (image 1) is about 2.8ms. After the display screen displays image 2, if the image display driver receives the display data of image 3 sent by the GPU within 8.3ms of the display screen displaying image 2 (that is, the display data of image 3 is received before time t6), it is determined that the display screen currently displays image 2 stably, and thus sends a control instruction to the display screen to reduce the frequency of the output Vsync signal (the moment shown by the vertical long dashed line on the right side of the figure is the moment of reducing the output Vsync signal). In this way, the display screen can feedback the fifth Vsync signal (Vsync signal 6 of the original frequency) to the image display driver, APP, SF and GPU at the fifth moment (t6) about 8.3ms after t5, and the image display driver can respond to the Vsync signal 6 to write the display data of image 3 to the display screen, thereby driving the display screen to display image 3.
[0218] In an embodiment of the present application, the method provided in the embodiment of the present application receives display data of the next frame of the third image within a third display time of the display screen displaying the third image through an image display driver, thereby determining that the display screen's display of the third image tends to be stable, and then reducing the frequency of the Vsync signal output by the display screen. In this way, it is possible to avoid the waste of power consumption caused by the display screen still outputting the Vsync signal at a higher frequency for a long time after the display of the third image is stable, thereby achieving the purpose of saving device power consumption.
[0219] It should be noted that the above-mentioned Vsync signal of the original frequency is a Vsync signal triggered at the original frequency before the image display driver increases the frequency of the output Vsync signal. For example, it is assumed that the display screen is initially triggered at a frequency of 120Hz and feeds back the Vsync signal to the image display driver. Afterwards, in the process of the display screen displaying the second image, because the display screen overtime displays the second image, the image display driver increases the frequency of the output Vsync signal to 360Hz, and responds to the third Vsync signal triggered by the display screen at a frequency of 360Hz at the third moment to send the image to the display screen to drive the display screen to display the third image. At this time, the third Vsync signal triggered by the display screen at a frequency of 360Hz is a Vsync signal after the frequency is increased. Afterwards, the image display driver determines that the display screen is stable in displaying the third image, and thus sends a control instruction to the display screen to reduce the frequency of the output Vsync signal, that is, from 360Hz to 120Hz. Then the fifth Vsync signal triggered by the display screen at a frequency of 120Hz again at the fifth moment is a Vsync signal of the original frequency.
[0220] In other feasible embodiments, the image display driver of the electronic device may further reduce the frequency of the output Vsync signal after determining that the display screen has stabilized the display of the third image, or may further reduce the frequency of the output Vsync signal after determining that the display screen has stabilized the display of the third image and the subsequent multiple frames of images. In this way, the continuous freeze that may occur during the image display process of the electronic device can be alleviated.
[0221] It should be noted that in the embodiments of the present application, the high temperature of the electronic device caused by long-term operation or insufficient system resources may cause the upper layer of the system and / or the image display driver to be unable to respond to the vertical synchronization signal in time to perform image processing, thereby causing the display screen to continuously freeze during the image display process.
[0222] In the embodiment of the present application, if the electronic device reduces the frequency of the Vsync signal output by the display screen during the process of displaying the N-1th frame image after the third image through the image display driver, the fifth moment when the electronic device generates the fifth Vsync signal through the display screen and the third moment when the display screen outputs the third Vsync signal will be only N 8.3ms apart. At this time, N is a positive integer greater than 1.
[0223] In an embodiment of the present application, after the display screen starts to display the third image, the image display driver of the electronic device can detect frame by frame whether the image display driver has received display data of the Nth frame image after the third image within the display duration of the N-1th frame image after the display screen displays the third image. In this way, the image display driver reduces the frequency of the Vsync signal output by the display screen only when it is continuously detected that the image display driver has received display data of the Nth frame image within the display duration of the N-1th frame image displayed by the display screen.
[0224] It should be noted that, in the embodiment of the present application, N is a positive integer greater than 1. As with the above-mentioned reduction in the time taken for the Vsync signal, the specific value of N may also be an empirical value pre-added to the image display driver, or N may also be a value temporarily determined by the electronic device based on its own real-time system resource occupancy, device energy storage margin, and performance. It should be understood that, based on different design requirements of actual applications, N can of course be a different positive integer greater than 1. That is, the method provided in the embodiment of the present application is not limited to the specific value of N.
[0225] For example, Fig.21 As shown, when the electronic device detects that the display screen has timed out displaying image 0 after time t1 through the delay detection module, the frequency of the Vsync signal output by the display screen is increased (the moment indicated by the vertical long dashed line on the left side of the figure is the moment of increasing the frequency of the output Vsync signal), and then the display screen outputs the third Vsync signal (Vsync signal a) with the frequency increased at the third moment (t2), so that the image display driver responds to the Vsync signal a at time t2 and writes the display data of the third image (image 1) to the display screen, so that the display screen displays image 1 after the display time of image 0 is about 2.8ms (the third Vsync cycle 1 / 360Hz corresponding to the third Vsync). When the display screen displays image N-1 after image 1 (the N-1th frame image after image 1), if the image display driver also receives the display data of image N sent by the GPU within 8.3ms of the display screen displaying image N-1, it is determined that the display screen is currently displaying multiple frames of images continuously, thereby reducing the frequency of the output Vsync signal (the moment indicated by the vertical long dashed line on the right side of the figure is the moment of reducing the output Vsync signal). In this way, the display screen can feedback the fifth Vsync signal to the image display driver, APP, SF and GPU at the fifth moment (tN+3) after the third moment, and the image display driver writes the display data of image N to the display screen in response to the fifth Vsync signal, thereby driving the display screen to display image N.
[0226] In an embodiment of the present application, after the display screen displays the third image, the image display driver of the electronic device continues to respond to the Vsync signal with a frequency increase triggered by the display screen, and writes the display data of the next frame of the third image to the display screen to drive the display screen to display the next frame of the image, until the display screen is driven to display the N-1 frame of the image after the third image. The image display driver detects whether it has received the display data of the N-frame image after the third image of the electronic device within the display duration of the N-1 frame of the image displayed by the display screen (the N-frame image is located after the N-1 frame of the image). In addition, after the image display driver detects that the display data of the N-frame image has been received within the display duration of the N-1 frame of the image displayed by the display screen, the image display driver determines that the current display of the N-1 frame of the image after the third image has stabilized, thereby reducing the frequency of the Vsync signal output by the display screen.
[0227] In the embodiment of the present application, the electronic device can avoid the waste of power consumption caused by the display screen outputting the Vsync signal at a higher frequency after the display of the image becomes stable by reducing the frequency of the output Vsync signal after determining that the display screen displays the N-1th frame of the image after the third image, and further reducing the frequency of the output Vsync signal. In addition, after the display screen displays the N-1th frame of the image after the third image, the frequency of the output Vsync signal is reduced, and the phenomenon of the image display driver frequently increasing and reducing the frequency of the output Vsync signal is avoided, further saving the power consumption required for the device to frequently adjust the frequency of the output Vsync signal.
[0228] In other feasible embodiments, the image display driver of the electronic device can also detect, after the display screen displays the third image, whether the display data of the next frame of the image displayed by the display screen has been received within the display duration of the single frame of the image displayed by the display screen after the third image is displayed by the display screen. And continuously during the process of the display screen displaying each frame of the third image to the N-1 frame of the image after the third image, whether the image display driver has received the display data of the N-th frame of the image within the display duration of the N-1 frame of the image displayed by the display screen, so that the image display driver will reduce the frequency of the output Vsync signal only when the yes condition is detected (the display data of the N-th frame of the image is received within the display duration of the N-1 frame of the image displayed by the display screen). In this way, the phenomenon of the image display driver frequently increasing and decreasing the frequency of the output Vsync signal can be avoided more accurately, thereby saving the waste of equipment power consumption caused by frequently increasing and decreasing the frequency of the output Vsync signal.
[0229] In some embodiments, an embodiment of the present application provides an electronic device having the function of implementing the image display method described in each of the above embodiments. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.
[0230] In some embodiments, an embodiment of the present application provides an electronic device, including: a processor and a memory; the memory is used to store computer program code, the computer program code includes computer execution instructions, and when the electronic device is running, the processor executes the computer execution instructions to enable the electronic device to perform the image display method described in the above embodiments.
[0231] In some embodiments, an embodiment of the present application provides an electronic device, comprising: a processor; the processor is used to couple with a memory, and after reading instructions in the memory, execute the image display method described in the above embodiments according to the instructions.
[0232] In some embodiments, an embodiment of the present application provides a computer-readable storage medium, including computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the wallpaper display method as described above.
[0233] In some embodiments, the embodiments of the present application provide a computer program product. When the computer program product is run on an electronic device, the electronic device executes the image display method described in the above embodiments.
[0234] In some embodiments, the embodiments of the present application provide a computer program product including instructions, which, when executed on a computer, enables the computer to execute the image display method described in the above embodiments.
[0235] In some embodiments, the embodiments of the present application provide a device (for example, the device may be a display system), the device including a processor for supporting an electronic device to implement the functions of the image display method described in the above embodiments. In one possible design, the device also includes a memory for storing program instructions and data necessary for the electronic device.
[0236] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0237] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point, the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms. The unit described as a separate component may or may not be physically separated, and the component displayed as a unit may be a physical unit or multiple physical units, that is, it may be located in one place, or it may be distributed in multiple different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the scheme of this embodiment.
[0238] In addition, each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of a software functional unit. If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or part of the contribution to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.
[0239] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims
1. An image display method, It is characterized in that Applied to an electronic device, the electronic device includes a display screen, and the method includes: At a first moment, the electronic device generates a first Vsync signal, and in response to the first Vsync signal, starts to display a first image on the display screen, wherein the first Vsync signal corresponds to a first Vsync cycle, and a first display duration of displaying the first image is the same as a duration of the first Vsync cycle; At a second moment, the electronic device generates a second Vsync signal, and in response to the second Vsync signal, starts to display a second image on the display screen, wherein the second Vsync signal corresponds to a second Vsync cycle, the second Vsync cycle is the same as the first Vsync cycle, the second moment is after the first moment, and the second image is a next frame image of the first image; After starting to display the second image on the display screen, detect whether a second display time for displaying the second image is greater than the first display time; if the second display time is greater than the first display time, send a control instruction to the display screen, and the control instruction is used to control the frequency of generating a Vsync signal.
2. The method according to claim 1, It is characterized in that The electronic device further includes an image display driver, and if the second display duration is greater than the first display duration, a control instruction is sent to the display screen, wherein the control instruction is used to control the frequency of generating a Vsync signal, specifically: If the second display duration is greater than the first display duration, the image display driver sends a control instruction to the display screen, and the control instruction is used to control the frequency of generating the Vsync signal so that the frequency of the Vsync signal generated by the display screen is higher than the current frequency of the Vsync signal generated by the display screen.
3. The method according to claim 1, It is characterized in that After sending the control instruction to the display screen, the method further includes: At a third moment, the electronic device generates a third Vsync signal, wherein the third Vsync signal corresponds to a third Vsync period, the third moment is after the second moment, and the third Vsync period is shorter than the first Vsync period.
4. The method according to claim 3, It is characterized in that The second display duration is less than twice the first display duration.
5. The method according to claim 3 or 4, It is characterized in that The method further comprises: In response to the third Vsync signal, a third image starts to be displayed on the display screen, and the third image is a next frame image of the second image.
6. The method according to claim 5, It is characterized in that A third display time length for displaying the third image is shorter than the first display time length.
7. The method according to claim 5, It is characterized in that A third display time length for displaying the third image is the same as the first display time length.
8. The method according to claim 5, It is characterized in that The method further comprises: At a fourth moment, the electronic device generates a fourth Vsync signal and continues to display the second image on the display screen, wherein the fourth moment is after the second moment and before the third moment.
9. The method according to any one of claims 1 to 8, It is characterized in that The first Vsync period is 8.3 ms, and the third Vsync period is 2.8 ms.
10. The method according to any one of claims 1 to 9, It is characterized in that The first display time length is 8.3 ms, and the second display time length is 11.1 ms.
11. The method according to any one of claims 1 to 10, It is characterized in that The method further comprises: At a fifth moment, the electronic device generates a fifth Vsync signal, wherein the fifth Vsync signal corresponds to a fifth Vsync cycle, the fifth moment is after the third moment, and the fifth Vsync cycle is the same as the first Vsync cycle.
12. The method according to claim 11, It is characterized in that Before the fifth moment, the method further includes: comparing a fourth display duration of a fourth image displayed with a preset interval duration, wherein the fourth image is an image displayed in a frame before the fifth moment; If the comparison result meets the preset condition, a control instruction is sent to the display screen, and the control instruction is used to control the frequency of generating the Vsync signal.
13. The method according to claim 12, It is characterized in that If the comparison result meets the preset conditions, a control instruction is sent to the display screen, and the control instruction is used to control the frequency of generating the Vsync signal, specifically: If the comparison result meets the preset conditions, the image display driver sends a control instruction to the display screen, and the control instruction is used to control the frequency of generating the Vsync signal so that the frequency of the Vsync signal generated by the display screen is lower than the current frequency of the Vsync signal generated by the display screen.
14. The method according to claim 11, It is characterized in that The fifth moment is N 8.3 ms away from the third moment, where N is a positive integer greater than or equal to 1.
15. The method according to claim 1, It is characterized in that The method also includes: if the second display duration is less than or equal to the first display duration, then at a sixth moment, the electronic device generates a sixth Vsync signal, and in response to the sixth Vsync signal, starts to display a third image on the display screen, wherein the sixth moment is after the second moment, the third image is the next frame image of the second image, the sixth Vsync signal corresponds to a sixth Vsync cycle, the sixth Vsync cycle is the same as the first Vsync cycle, and the third display duration for displaying the third image is the same as the first display duration.
16. An electronic device, It is characterized in that The electronic device comprises: a processor and a memory, wherein the processor is coupled to the memory; the memory is used to store computer program code; the computer program code comprises computer instructions, and when the processor executes the above-mentioned computer instructions, the terminal device executes the method as described in any one of claims 1-15.
17. A computer-readable storage medium, It is characterized in that The computer-readable storage medium includes computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 15.
Citation Information
Patent Citations
Display screen frequency conversion method, display driving integrated circuit chip and application processor
CN113160747A
Backlight driving method for display
CN113450720A
Under-display sensors, systems, and methods
CN114730226A
Display parameter adjusting method, electronic equipment, chip and readable storage medium
CN115686403A
Parameter adjusting method and electronic equipment
CN116704087A
Cited By
Image processing method, and electronic device
WO2026188938A1
