Signal period synchronization method, electronic device and computer-readable storage medium

Abstract

Disclosed in the embodiments of the present application are a signal period synchronization method, an electronic device, and a computer-readable storage medium. The method comprises: determining a signal period corresponding to a vertical synchronization signal of a display controller; and adjusting a decoding frame rate of a decoding module on the basis of the signal period. The signal period synchronization method provided in the embodiments of the present application can adjust a decoding frame rate of a decoding module in a terminal device on the basis of a signal period of a vertical synchronization signal, thereby avoiding the phenomenon of tearing and stuttering of a display picture.

Description

Signal periodic synchronization methods, electronic devices and computer-readable storage media

[0001] This application claims priority to Chinese Patent Application No. 2025100213006, filed on January 7, 2025, entitled “Signal Periodic Synchronization Method, Apparatus, Electronic Device and Computer-Readable Storage Medium”, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of computer technology, specifically to a signal period synchronization method, apparatus, electronic device, and computer-readable storage medium. Background Technology

[0003] In existing terminal devices, taking Android devices as an example, the vertical synchronization signal (Vsync) received by the display hardware (such as a display or graphics processing component) is usually 50Hz. However, the frame rate (FPS) set by the terminal device for the graphics function component (such as an image compositing component) in display mode is usually 60FPS. This causes a mismatch between the vertical synchronization signal received by the display hardware and the frame rate set by the graphics function component, resulting in problems such as screen tearing and stuttering in the displayed image.

[0004] To address issues like screen tearing and stuttering, current Android devices use a Surface Flinger component to synthesize graphics data into multiple buffers. This buffered data is then output to the hardware display's frame buffer, where the High-Wave Component (HWC) processes it before displaying it on the screen. This method of processing the buffered data through the HWC, rather than directly processing the data synthesized by the Surface Flinger, mitigates screen tearing and stuttering to some extent. Technical issues

[0005] However, in practical applications, due to various factors, the frame rate at which the Surface Flinger composites graphics data may not be the standard 60 FPS. In this case, if the vertical sync signal received by the display hardware differs significantly from the frame rate of the graphics component, even if the graphics processing group processes the buffer data, it cannot compensate for the frame rate difference. This will still result in a mismatch between the frame rate of the graphics component and the signal period of the vertical sync signal received by the display hardware, ultimately leading to problems such as screen tearing and stuttering, which will affect the user experience. Technical solutions

[0006] This application provides a signal period synchronization method, apparatus, electronic device, and computer-readable storage medium, which can adjust the decoding frame rate of the decoding module in the terminal device according to the signal period of the vertical synchronization signal, thereby avoiding screen tearing and stuttering.

[0007] In a first aspect, embodiments of this application provide a signal period synchronization method applied to a terminal device, the terminal device including a display, a display controller, and a decoding module, the method comprising:

[0008] Determine the signal period corresponding to the vertical synchronization signal of the display controller;

[0009] The decoding frame rate of the decoding module is adjusted according to the signal period.

[0010] Optionally, in some embodiments of this application, adjusting the image synthesis rate of the image synthesis component according to the signal period includes:

[0011] The image synthesis rate of the image synthesis component is adjusted according to the signal period, wherein the image synthesis rate is associated with the decoding frame rate;

[0012] or,

[0013] The image synthesis time of the image synthesis component is adjusted according to the signal period, and the graphics processing time of the graphics processing component is adjusted according to the signal period, wherein the image synthesis time and the graphics processing time are associated with the decoding frame rate.

[0014] Optionally, in some embodiments of this application, adjusting the image synthesis rate of the image synthesis component according to the signal period includes:

[0015] Determine the refresh frequency of the display corresponding to the signal period, wherein the refresh frequency is the number of times the display refreshes per second;

[0016] The target synthesis rate of the image synthesis component is determined based on the refresh rate.

[0017] The image synthesis rate of the image synthesis component is adjusted to the target synthesis rate.

[0018] Optionally, in some embodiments of this application, adjusting the image synthesis rate of the image synthesis component to the target synthesis rate includes:

[0019] The target synthesis rate is determined to satisfy a preset condition of the image synthesis component, wherein the preset condition is that the maximum image synthesis rate of the image synthesis component is greater than or equal to the target synthesis rate;

[0020] The image compositing component is controlled to set the image compositing rate to the target compositing rate.

[0021] Optionally, in some embodiments of this application, after adjusting the image synthesis rate of the image synthesis component to the target synthesis rate, the method further includes:

[0022] Store the target synthesis rate;

[0023] In response to a vertical synchronization signal with a signal period that is the same as the signal period corresponding to the target synthesis rate, the image synthesis component is controlled to perform an image synthesis operation according to the target synthesis rate.

[0024] Optionally, in some embodiments of this application, before adjusting the image synthesis time of the image synthesis component according to the signal period and adjusting the graphics processing time of the graphics processing component according to the signal period, the method further includes: determining the refresh time of the display according to the signal period.

[0025] Optionally, in some embodiments of this application, adjusting the decoding frame rate of the decoding module according to the signal period includes:

[0026] In response to the vertical synchronization signal, the time calculation function is invoked via a callback function;

[0027] The target synthesis time of the image synthesis component is determined according to the signal period and the time calculation function; the target processing time of the graphics processing component is determined according to the signal period and the time calculation function; and the target refresh time of the display is determined according to the signal period and the time calculation function.

[0028] The image compositing time of the image compositing component is adjusted to the target compositing time, the graphics processing time of the graphics processing component is adjusted to the target processing time, and the refresh time of the display is adjusted to the target refresh time.

[0029] Optionally, in some embodiments of this application, determining the target synthesis time of the image synthesis component based on the signal period and the time calculation function, determining the target processing time of the graphics processing component based on the signal period and the time calculation function, and determining the target refresh time of the display based on the signal period and the time calculation function include:

[0030] The timestamp information of the vertical synchronization signal is determined based on the signal period;

[0031] Determine the refresh frequency of the display corresponding to the signal period, wherein the refresh frequency is the number of times the display refreshes per second;

[0032] Based on the timestamp information and the refresh frequency, the target synthesis time, the target processing time, and the target refresh time are determined.

[0033] Secondly, embodiments of this application also provide a signal period synchronization device applied to a terminal device, the terminal device including a display, a display controller, and a decoding module, the device comprising:

[0034] The processing module is used to determine the signal period corresponding to the vertical synchronization signal of the display controller;

[0035] The processing module is also used to adjust the decoding frame rate of the decoding module and the refresh time of the display according to the signal period.

[0036] Optionally, in some embodiments of this application, the processing module is further configured to:

[0037] The image synthesis rate of the image synthesis component is adjusted according to the signal period, wherein the image synthesis rate is associated with the decoding frame rate;

[0038] or,

[0039] The image synthesis time of the image synthesis component is adjusted according to the signal period, and the graphics processing time of the graphics processing component is adjusted according to the signal period, wherein the image synthesis time and the graphics processing time are associated with the decoding frame rate.

[0040] Optionally, in some embodiments of this application, the processing module is further configured to:

[0041] Determine the refresh frequency of the display corresponding to the signal period, wherein the refresh frequency is the number of times the display refreshes per second;

[0042] The target synthesis rate of the image synthesis component is determined based on the refresh rate.

[0043] The image synthesis rate of the image synthesis component is adjusted to the target synthesis rate.

[0044] Optionally, in some embodiments of this application, the processing module is further configured to:

[0045] The target synthesis rate is determined to satisfy a preset condition of the image synthesis component, wherein the preset condition is that the maximum image synthesis rate of the image synthesis component is greater than or equal to the target synthesis rate;

[0046] The image compositing component is controlled to set the image compositing rate to the target compositing rate.

[0047] Optionally, in some embodiments of this application, the processing module is further configured to:

[0048] Store the target synthesis rate;

[0049] In response to a vertical synchronization signal with a signal period that is the same as the signal period corresponding to the target synthesis rate, the image synthesis component is controlled to perform an image synthesis operation according to the target synthesis rate.

[0050] Optionally, in some embodiments of this application, the processing module is further configured to:

[0051] The refresh time of the display is determined based on the signal period.

[0052] Optionally, in some embodiments of this application, the processing module is further configured to:

[0053] In response to the vertical synchronization signal, the time calculation function is invoked via a callback function;

[0054] The target synthesis time of the image synthesis component is determined according to the signal period and the time calculation function; the target processing time of the graphics processing component is determined according to the signal period and the time calculation function; and the target refresh time of the display is determined according to the signal period and the time calculation function.

[0055] The image compositing time of the image compositing component is adjusted to the target compositing time, the graphics processing time of the graphics processing component is adjusted to the target processing time, and the refresh time of the display is adjusted to the target refresh time.

[0056] Optionally, in some embodiments of this application, the processing module is further configured to:

[0057] The timestamp information of the vertical synchronization signal is determined based on the signal period;

[0058] Determine the refresh frequency of the display corresponding to the signal period, wherein the refresh frequency is the number of times the display refreshes per second;

[0059] Based on the timestamp information and the refresh frequency, the target synthesis time, the target processing time, and the target refresh time are determined.

[0060] Thirdly, embodiments of this application also provide an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, it implements the steps in the above-described signal period synchronization method.

[0061] Fourthly, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps in the above-described signal period synchronization method.

[0062] Fifthly, embodiments of this application also provide a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in the various optional implementations described in embodiments of this application. Beneficial effects

[0063] This application embodiment adopts a technical solution that determines the signal period corresponding to the vertical synchronization signal of the display controller and adjusts the decoding frame rate of the decoding module according to the signal period. This can adjust the decoding frame rate of the terminal device decoding module according to the signal period of the vertical synchronization signal, thereby avoiding screen tearing and stuttering and improving the smoothness of the display animation. Attached Figure Description

[0064] To more clearly illustrate the technical solutions in this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0065] Figure 1 is a timing diagram of the signal period mismatch in the prior art;

[0066] Figure 2 is a schematic diagram of existing methods for avoiding screen stuttering;

[0067] Figure 3 is a schematic diagram of a scenario for the signal period synchronization method provided in an embodiment of this application;

[0068] Figure 4 is a schematic diagram of a scenario in which a smart device performs the signal periodic synchronization method according to an embodiment of this application;

[0069] Figure 5 is a schematic diagram of an image synthesis rate adjustment process of an image synthesis component according to an embodiment of this application;

[0070] Figure 6 is a schematic diagram of a process for adjusting image synthesis time, graphics processing time and refresh time according to an embodiment of this application;

[0071] Figure 7 is a schematic diagram of the signal period synchronization device provided in an embodiment of this application;

[0072] Figure 8 is a schematic diagram of the structure of the electronic device provided in an embodiment of this application. Embodiments of the present invention

[0073] The technical solutions of this application will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0074] In the description of this invention, it should be understood that the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the aforementioned features. In the description of this invention, "a plurality of" means two or more, unless otherwise explicitly specified.

[0075] In this application, the term "exemplary" is used to mean "serving as an example, illustration, or description." Any embodiment described as "exemplary" in this application is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is provided to enable any person skilled in the art to make and use the invention. Details are set forth in the following description for purposes of explanation. It should be understood that those skilled in the art will recognize that the invention can be made without using these specific details. In other instances, well-known structures and processes will not be described in detail to avoid obscuring the description of the invention with unnecessary detail. Therefore, the invention is not intended to be limited to the embodiments shown, but is consistent with the broadest scope of the principles and features disclosed in this application.

[0076] First, let's explain the terms used in this application:

[0077] HWC: Hardware Composer, is a Hardware Abstraction Layer (HAL) component in the Android system's decoding module, responsible for managing and optimizing the image compositing process (hereinafter referred to as: graphics processing component).

[0078] Surface Flinger: It is a core component of the System Services layer in the Android system decoding module. It is responsible for image compositing and display management, ensuring that the application's graphical content can be correctly displayed on the device screen (hereinafter referred to as: image compositing component).

[0079] Vsync: Vertical synchronization signal. In Android devices, this signal is generated by the hardware (display controller) to coordinate the refresh rate of the display device (monitor, graphics processing components, and image compositing components, etc.). For example, the Hardware Abstraction Layer can use this signal to notify the display to perform refresh, drawing, and other operations.

[0080] Vsync-SF: This can be used to represent the time interval at which the image compositing component receives the vertical synchronization signal. This vertical synchronization signal can be used by the image compositing component to perform image frame synthesis and updates. Generally, the frequency of this signal is equal to Vsync-APP.

[0081] Vsync-APP: This can be used to represent the time interval at which an application receives a vertical synchronization signal. This vertical synchronization signal can be used by the application to send graphics data. Generally, the frequency of this signal is equal to Vsync-SF.

[0082] Vsync-HWC: This can be used to represent the time interval at which a graphics processing component receives a vertical synchronization signal, which can be used by the graphics processing component to perform operations such as graphics composition and rendering.

[0083] Choreographer: A core class in the Android system used to handle and coordinate drawing and animation on the user interface (UI) thread.

[0084] Binder IPC: A mechanism for inter-process communication in the Android system that allows different applications or components to communicate securely and efficiently.

[0085] Surface object: An important concept in the Android system, used to provide a drawing surface on which drawing operations can be performed. It can also be used to draw images and render graphics on the screen, and then display the results on the display. In the prior art, as shown in the timing diagram of the signal period mismatch in Figure 1, the display hardware such as the terminal device's display and graphics processing components typically receive a vertical synchronization signal frequency of 50Hz from the display controller. However, the frame rate set by the display controller for functional components such as the image compositing component in display mode is usually 60FPS. Therefore, there is a phenomenon where the frequency at which the display hardware displays images is inconsistent with the frequency at which the functional components process images. Part of the composited image cannot be displayed correctly, resulting in problems such as screen tearing and stuttering in the final image displayed on the screen. For example, if a region adopts the PAL (Phase Alternating Line) standard, under this standard, the refresh rate of the display is 50 Hz, meaning the display refreshes 50 times per second, and the graphics processing unit can perform graphics processing 50 times per second (corresponding to 50 FPS, with a corresponding vertical sync signal period of 20 ms). However, the display controller sets the frame rate of the image compositing component to 60 FPS under the PAL standard, with a corresponding vertical sync signal period of 16.67 ms. Therefore, the frame rate at which the image compositing component synthesizes the image is greater than the frame rate at which the graphics processing unit processes the graphics. This results in the situation shown in Figure 1, where the image at time T5 cannot be combined and displayed in time, leading to stuttering and tearing in the final display.

[0086] In existing technologies, to avoid screen tearing and stuttering issues, as illustrated in Figure 2, the display controller sends corresponding vertical sync signals to the graphics processing component, image compositing component, and application (or optionally, not to the application). The application generates a Surface object based on the graphics data, and the image compositing component in the system service layer composites the Surface object into multiple buffer data sets based on the vertical sync signals. This buffer data is then output to a buffer for caching, awaiting processing by the graphics processing component based on the vertical sync signals to obtain the final image data for display. Because the graphics processing component processes the buffer data, rather than directly processing the data composited by the image compositing component, even if the signal periods of the vertical sync signals from the graphics processing component and the image compositing component are inconsistent, screen tearing and stuttering issues can be avoided to some extent.

[0087] However, in practical applications, various factors may affect the frame rate at which the image compositing component processes the graphics data, causing a difference between the frame rate corresponding to the vertical synchronization signal sent by the display controller. In this case, if the difference between the vertical synchronization signal received by the graphics processing component and the frame rate processed by the image compositing component is large—for example, the compositing rate of the image compositing component is much greater than the processing rate of the graphics processing component (i.e., the frame rate of the graphics processing component is greater than the refresh rate of the display, and the refresh rate of the display corresponds to the processing rate of the graphics processing component)—even with a buffer, the frame rate of the image compositing component will still mismatch with the signal period of the vertical synchronization signal received by the display hardware. This will ultimately lead to problems such as screen tearing and stuttering, affecting the user experience.

[0088] Therefore, existing methods for avoiding screen stuttering still suffer from screen tearing and stuttering due to the mismatch between the frame rate of the image synthesis component and the signal cycle of graphics processing, which directly affects the user experience.

[0089] This application provides a signal period synchronization method, apparatus, electronic device, and computer-readable storage medium. It employs a technical solution that determines the signal period corresponding to the vertical synchronization signal of the display controller; and adjusts the decoding frame rate of the decoding module and the refresh time of the display based on the signal period.

[0090] In summary, the signal period synchronization method in this application embodiment can adjust the decoding frame rate of the terminal device decoding module and the refresh time of the display according to the signal period of the vertical synchronization signal, so that the decoding frame rate corresponds to the refresh time, thereby achieving the technical effect of avoiding screen tearing and stuttering and improving the smoothness of display animation.

[0091] The following sections provide detailed descriptions of each example. It should be noted that the order in which the embodiments are described is not intended to limit the priority of the embodiments.

[0092] Please refer to Figure 3, which is a schematic diagram of a signal period synchronization method provided in this application embodiment. The signal period synchronization system may include a terminal device 100, which includes a display 200, a display controller 300, and a decoding module 400. The display 200, display controller 300, and decoding module 400 can communicate with each other in any way, including but not limited to signal communication via electronic circuits or wireless signals. Wireless signals can be computer network communication using TCP / IP protocol suite (TCP / IP) or User Datagram Protocol (UDP). The terminal device 100 can receive control signals from a remote control or control panel. The terminal device 100 sends the control signals to the display 200 and decoding module 400 through the display controller 300. The display 200 and decoding module 400 can receive instruction information sent by the display controller 300 and perform corresponding operations according to the corresponding instruction information.

[0093] In this embodiment of the application, the terminal device 100 includes, but is not limited to, televisions, mobile phones, tablets, computers, etc.

[0094] Those skilled in the art will understand that the application environment shown in Figure 3 is only one application scenario of the present application solution and does not constitute a limitation on the application scenario of the present application solution. Other application environments may include more or fewer terminal devices than those shown in Figure 3. For example, only one terminal device is shown in Figure 3. No specific limitation is made here.

[0095] Additionally, as shown in Figure 3, the display 200 may include any physical display device capable of displaying images, such as a screen or projector embedded inside the terminal device; no specific limitation is made here.

[0096] In addition, as shown in Figure 3, the display controller 300 may include any hardware device capable of data processing and instruction sending, such as a CPU, GPU, SOC chip, or microcontroller embedded in the terminal device. No specific limitation is made here.

[0097] Additionally, as shown in Figure 3, the decoding module 400 may include any hardware device and / or software component capable of processing graphics data, such as a graphics processing component and an image compositing component embedded within the terminal device; no specific limitation is made here.

[0098] It should be noted that the schematic diagram of the signal periodic synchronization system shown in Figure 3 is merely an example. The signal periodic synchronization system and scenario described in the embodiments of this application are intended to more clearly illustrate the technical solutions of the embodiments of this application and do not constitute a limitation on the technical solutions provided in the embodiments of this application. As those skilled in the art will know, with the evolution of signal periodic synchronization systems and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0099] Specifically, please refer to Figure 4, which is a schematic diagram of a scenario in which a terminal device according to an embodiment of this application executes the signal period synchronization method. The specific execution process of the terminal device executing the signal period synchronization method is as follows:

[0100] S401: Determine the signal period corresponding to the vertical synchronization signal of the display controller.

[0101] In this embodiment of the application, the terminal device includes a display, a display controller, and a decoding module. The decoding module further includes at least a graphics processing component and an image compositing component. In the terminal device of this embodiment, the display controller sends a vertical synchronization signal to the graphics processing component in the decoding module. Therefore, the signal period of the vertical synchronization signal can be determined based on the time interval at which the display controller of the terminal device sends the vertical synchronization signal.

[0102] In the embodiments of this application, the display and the decoding module can be controlled by a display controller, or the display and the decoding module can be controlled by other controllers (e.g., a processor CPU).

[0103] Specifically, the vertical synchronization signal sent by the display controller can be determined based on the refresh rate of the display. For example, if the refresh rate of the display is 50Hz, that is, the display refreshes 50 times per second, and the graphics processing unit can process at a rate of 50 images per second, then the display controller can determine the signal period of the vertical synchronization signal sent to the graphics processing unit to be 20ms based on the refresh rate of the display. That is, a vertical synchronization signal is sent once every 20ms, so as to control the graphics processing unit to process one image data every 20ms.

[0104] Optionally, the refresh rate of the display can be set by the user or automatically selected by the display controller based on the hardware or software attributes of the terminal device. When the user sets the refresh rate, the display controller can determine the transmission period of the vertical synchronization signal based on the user's setting; when the display controller automatically selects the refresh rate based on the hardware or software attributes of the terminal device, the display controller can send the selected refresh rate to the display to control the display to perform refresh operations.

[0105] As an optional embodiment, the vertical synchronization signal and its corresponding signal period can also be obtained directly through the interface between the display controller and the graphics processing system, for example, by detecting the state of the vertical synchronization signal through the vertical synchronization pin.

[0106] It should be noted that the interfaces may include, but are not limited to: VGA interface, DVI interface, HDMI interface, DisplayPort interface, etc.

[0107] It should also be noted that the display controller can also determine the refresh rate of the display through the interaction interface with the display. The method of determining the refresh rate of the display is not specifically limited in this embodiment.

[0108] Specifically, in the process of directly obtaining the vertical synchronization signal and its corresponding signal period through the interface between the display controller and the graphics processing system, a corresponding signal acquisition function (e.g., DisplayDevice:getVsyncPeriodFromHWC) can be pre-set for the relevant interaction interface to obtain the signal period of the vertical synchronization signal. The pre-set signal acquisition function is defined in the DisplayDevice class (an object used to represent and manage display devices) or the relevant graphics rendering class. This function can be used to communicate with the graphics processing component to obtain the signal period of the current graphics processing component's vertical synchronization signal.

[0109] It's worth noting that in the Android system, each physical display device (such as a monitor screen, projector, etc.) can be represented by a DisplayDevice class. The DisplayDevice class provides attributes and methods related to the terminal device so that the system can properly manage and control the terminal device.

[0110] It should also be noted that the `getVsyncPeriodFromHWC` function is used to obtain the vertical synchronization period from the graphics processing component. The implementation of the `DisplayDevice` class and the `getVsyncPeriodFromHWC` function may differ depending on the specific application or hardware platform. This embodiment is merely an example, and the actual implementation may be adjusted according to requirements.

[0111] As an optional implementation, a frame callback listener can also be registered through Choreographer to obtain the signal period corresponding to the vertical synchronization signal received by the graphics processing system.

[0112] Specifically, a vertical synchronization signal listener can be registered in the ViewRootImpl class of the Android system to detect changes in the signal frequency, thereby determining the signal period of the vertical synchronization signal.

[0113] It should be noted that the ViewRootImpl class is a key class in the Android system, which can be used to manage the application's view hierarchy and handle user interactions.

[0114] S402: Adjusts the decoding frame rate of the decoding module and the refresh time of the display according to the signal cycle.

[0115] In this embodiment of the application, after determining the signal period of the vertical synchronization signal, the graphics processing rate of the graphics processing component and / or the image synthesis rate of the image synthesis component in the decoding module can be adjusted according to the signal period, thereby adjusting the decoding frame rate of the decoding module; the refresh time of the display can also be adjusted according to the signal period, that is, the time for the display to refresh the screen.

[0116] Optionally, the signal period synchronization method provided in this application embodiment further includes: adjusting the image synthesis rate of the image synthesis component according to the signal period.

[0117] In this embodiment, the image synthesis rate is associated with the decoding frame rate. The image synthesis rate is used to characterize the number of times the image synthesis component performs image synthesis per second. The image synthesis rate can be understood as the frame rate of the image synthesis component. As shown in Figure 5, the process of adjusting the image synthesis rate of the image synthesis component is illustrated. The terminal device can send a vertical synchronization signal to the graphics processing component at a certain period according to the refresh frequency of the display through the display controller. After determining the signal period of the vertical synchronization signal, the frame rate corresponding to the signal period is calculated and applied to the image synthesis component so that the image synthesis component can perform image synthesis processing according to the image synthesis rate corresponding to the frame rate.

[0118] It should be noted that the graphics processing component performs graphics processing operations based on the vertical synchronization signal. After determining the frame rate corresponding to the signal period of the vertical synchronization signal and applying it to the image compositing component, the graphics processing rate of the graphics processing component can be made consistent with the image compositing rate of the image compositing component, thereby avoiding screen tearing and stuttering.

[0119] Optionally, the signal cycle synchronization method provided in this application embodiment further includes: determining the refresh frequency of the display under the signal cycle, wherein the refresh frequency is the number of times the display refreshes per second; determining the target synthesis rate of the image synthesis component based on the refresh frequency; and adjusting the image synthesis rate of the image synthesis component to the target synthesis rate.

[0120] In this embodiment, the vertical synchronization signal received by the graphics processing component is data from the hardware abstraction layer in the Android system, while the image compositing component is a functional component of the system service layer. Since the functional components of the system service layer cannot directly use the data from the hardware abstraction layer, the system intermediate layer needs to calculate the refresh frequency of the display under the signal period of the vertical synchronization signal received by the graphics processing component, and determine the image compositing rate of the image compositing component based on the refresh frequency, thereby enabling the application of the frame rate corresponding to the data from the hardware abstraction layer to the functional components of the system service layer.

[0121] For example, if the vertical sync signal received by the graphics processing component has a signal period of 20ms (corresponding to 50FPS), then the refresh rate of the display can be calculated in reverse as 50Hz. Accordingly, it can be determined that the image compositing component needs to perform image compositing processing once every 20ms.

[0122] In this embodiment of the application, after calculating the image synthesis rate of the image synthesis component, the image synthesis component can be adjusted to that image synthesis rate.

[0123] Optionally, the rate at which the application generates Surface objects based on the graphics data can also be set to the same rate as the image compositing rate of the image compositing component.

[0124] For example, after determining that the image compositing component needs to perform image compositing processing once every 20ms, the application can also set the rate at which it generates Surface objects based on the graphics data to perform Surface object generation operations once every 20ms, so that the image compositing component has enough Surface objects for image compositing within each 20ms period.

[0125] Optionally, the signal period synchronization method provided in this application embodiment further includes: determining that the target synthesis rate meets the preset conditions of the image synthesis component; and controlling the image synthesis component to set the image synthesis rate to the target synthesis rate.

[0126] In this embodiment of the application, the preset condition is that the maximum image synthesis rate of the image synthesis component is greater than or equal to the target synthesis rate, that is, the maximum image synthesis rate of the image synthesis component is greater than or equal to the refresh frequency corresponding to the target synthesis rate.

[0127] For example, the maximum image compositing rate of the image compositing component is 144 image compositing processes per second (144 FPS, corresponding to a refresh rate of 144 Hz), and the target compositing rate is 50 image compositing processes per second (50 FPS, corresponding to a refresh rate of 50 Hz). That is, the maximum image compositing rate is greater than the target compositing rate, which meets the preset conditions, and the image compositing rate of the image compositing component can be set to the target compositing rate.

[0128] It should be noted that the maximum image compositing rate of the image compositing component can be determined based on the hardware and software attributes of the terminal device. Specifically, under preset conditions, the image compositing rate of the image compositing component can be set to match the refresh rate of the display (the refresh rate of the display corresponds to the graphics processing rate of the graphics processing component) using the frame rate setting function (setFrameRate). That is, the graphics processing component performs graphics processing according to the frame rate corresponding to the vertical synchronization signal period, the display refreshes according to the refresh rate corresponding to that frame rate, and the image compositing component performs image compositing according to that frame rate. This ensures that the image compositing rate of the image compositing component matches the processing rate of the graphics processing component and the refresh rate of the display, avoiding screen tearing, stuttering, and other display issues.

[0129] Optionally, the frame rate setting function (setFrameRate) can be used to set the generation rate of Surface objects to match the display's refresh rate (the display's refresh rate corresponds to the graphics processing rate of the graphics processing unit). During this process, the display refreshes according to the graphics processing rate of the graphics processing unit (or the graphics processing unit performs graphics processing according to the display's refresh rate), and the image compositing component also performs image compositing according to the refresh rate or graphics processing rate. Setting the generation rate of Surface objects to match the image compositing rate ensures that the image compositing component has enough Surface objects for image compositing operations, thereby further preventing image tearing and stuttering.

[0130] After adjusting the image synthesis rate of the image synthesis component to the target synthesis rate, the signal period synchronization method provided in this application embodiment may optionally further include: storing the target synthesis rate; and controlling the image synthesis component to perform image synthesis operation according to the target synthesis rate in response to a vertical synchronization signal with the same signal period as the signal period corresponding to the target synthesis rate.

[0131] In this embodiment of the application, if the hardware and software performance of the image compositing component supports the target compositing rate, the target compositing rate (or the frame rate corresponding to the target compositing rate) can be stored. When the frame rate corresponding to the signal period of the vertical synchronization signal sent by the display controller in the next (or every subsequent) transmission is the same as the frame rate corresponding to the target compositing rate, the stored target compositing rate can be directly called to perform the image compositing operation.

[0132] For example, if the hardware and software support the requested frame rate, the image compositing component can convert the target compositing rate into a SurfaceFlinger\Client object and store the converted SurfaceFlinger\Client object in the terminal device.

[0133] Optionally, the terminal device may also store the generation rate of the Surface object so that when the frame rate corresponding to the signal period of the vertical synchronization signal sent by the display controller in the next (or every subsequent) transmission is the same as the frame rate corresponding to the generation rate of the Surface object, the stored Surface object generation rate can be directly called to perform the Surface object generation operation.

[0134] It should be noted that the terminal device can send the target compositing rate from the display controller to the image compositing component through the Binder IPC mechanism.

[0135] Optionally, the signal period synchronization method provided in this application embodiment further includes: adjusting the image synthesis time of the image synthesis component according to the signal period, and adjusting the graphics processing time of the graphics processing component according to the signal period.

[0136] In this embodiment, the image synthesis time and the graphics processing time are associated with the decoding frame rate. The image synthesis time is the time for the image synthesis component to synthesize the image, and the graphics processing time is the time for the graphics processing component to process the image.

[0137] Optionally, before adjusting the image synthesis time of the image synthesis component and the graphics processing time of the graphics processing component according to the signal period, the signal period synchronization method provided in this application embodiment further includes: determining the refresh time of the display according to the signal period.

[0138] In this embodiment of the application, the refresh time is the time it takes for the display to refresh the screen.

[0139] In this embodiment of the application, as shown in Figure 6, which illustrates the process of adjusting the image synthesis time, graphics processing time, and refresh time, the terminal device can send a vertical synchronization signal to the graphics processing component at a certain period through the display controller. In response to the vertical synchronization signal, the terminal device can call other functions through a callback function. These other functions calculate the image synthesis time, graphics processing time, and refresh time based on the vertical synchronization signal, so that the image synthesis component performs image synthesis, the graphics processing component performs graphics processing, and the display refreshes the screen at the specified time, thereby avoiding screen tearing and stuttering.

[0140] It's important to note that adjusting the image compositing rate is different from adjusting the image compositing time. The image compositing rate corresponds to the frame rate of the image compositing component. Adjusting the rate will cause a change in the frame rate. For example, adjusting from 120 FPS to 60 FPS means the image compositing component changes from compositing 120 images per second to compositing 60 images per second. The image compositing time, on the other hand, is the time taken for the image compositing component to perform the compositing. Adjusting only the compositing time will not necessarily change the frame rate (correspondingly, the frame rate can also be adjusted to be different from before). For example, if the image compositing time is changed from compositing at seconds X1, X2, ..., Xn (with a 1-second difference between seconds X1 and X2, ..., and a 1-second difference between seconds Xn-1 and Xn) to compositing at seconds M1, M2, ..., Mn (with a 1-second difference between seconds M1 and M2, ..., and a 1-second difference between seconds Mn-1 and Mn), although the compositing time has changed, the overall compositing rate remains the same.

[0141] It should also be noted that the graphics processing time, refresh time, and image compositing time are similar and will not be repeated here. In addition, the above values ​​are just examples and can be adjusted or modified according to the actual situation in practical applications.

[0142] Optionally, the signal period synchronization method provided in this application embodiment further includes: responding to a vertical synchronization signal by calling a time calculation function through a callback function; determining a target synthesis time for an image synthesis component based on the signal period and the time calculation function; determining a target processing time for a graphics processing component based on the signal period and the time calculation function; and determining a target refresh time for a display based on the signal period and the time calculation function; adjusting the image synthesis time of the image synthesis component to the target synthesis time; adjusting the graphics processing time of the graphics processing component to the target processing time; and adjusting the refresh time of the display to the target refresh time.

[0143] In this embodiment, in response to the display controller sending a vertical synchronization signal, a time calculation function can be called through a callback function. The time calculation function can calculate the target compositing time of the image compositing component, the target processing time of the graphics processing component, and the target refresh time of the display based on the timestamp of the vertical synchronization signal.

[0144] Optionally, the signal period synchronization method provided in this application embodiment further includes: determining the timestamp information of the vertical synchronization signal according to the signal period; determining the refresh frequency of the display corresponding to the signal period, wherein the refresh frequency is the number of times the display refreshes per second; and determining the target synthesis time, the target processing time, and the target refresh time according to the timestamp information and the refresh frequency.

[0145] In this embodiment of the application, the time calculation function can be used to calculate the next refresh time and the graphics processing time. The specific formula is as follows: NextVsyncTimeNanos=frameTimeNanos+(long)(10000000000 / (1000 / framePeriod));

[0146] Where NextVsyncTimeNanos: the time of the next synchronization refresh; frameTimeNanos: the timestamp of the current vertical sync signal; framePeriod: the current screen refresh cycle; 1000 / framePeriod calculates the refresh rate per second, in Hz.

[0147] In this embodiment, after calculating the target compositing time of the compositing component, the target processing time of the graphics processing component, and the target refresh time of the display, the image compositing component is controlled to adjust the next image compositing time to the target compositing time, the graphics processing component is controlled to adjust the next graphics processing time to the target processing time, and the display is controlled to adjust the next refresh time to the target refresh time, thereby avoiding screen tearing and stuttering.

[0148] The embodiments of this application employ a technical solution that determines the signal period corresponding to the vertical synchronization signal of the display controller and adjusts the decoding frame rate of the decoding module and the refresh time of the display according to the signal period. This allows the decoding frame rate of the terminal device's decoding module and the refresh time of the display to be adjusted according to the signal period of the vertical synchronization signal, so that the decoding frame rate corresponds to the refresh time. This achieves the technical effect of avoiding screen tearing and stuttering and improving the smoothness of display animation.

[0149] To facilitate better implementation of the signal period synchronization method of this application, this application also provides a signal period synchronization device based on the above-described signal period synchronization method. The meanings of the terms used are the same as in the above-described signal period synchronization method, and specific implementation details can be found in the description of the method embodiments.

[0150] Please refer to Figure 7, which is a schematic diagram of the signal period synchronization device provided in an embodiment of this application. The signal period synchronization device 700 is applied to a terminal device, and can be specifically as follows:

[0151] Processing module 701 is used to determine the signal period corresponding to the vertical synchronization signal of the display controller;

[0152] The processing module 701 is also used to adjust the decoding frame rate of the decoding module according to the signal period.

[0153] Optionally, in some embodiments of this application, the processing module 701 is further configured to:

[0154] The image synthesis rate of the image synthesis component is adjusted according to the signal period, wherein the image synthesis rate is associated with the decoding frame rate;

[0155] or,

[0156] The image synthesis time of the image synthesis component is adjusted according to the signal period, and the graphics processing time of the graphics processing component is adjusted according to the signal period, wherein the image synthesis time and the graphics processing time are associated with the decoding frame rate.

[0157] Optionally, in some embodiments of this application, the processing module 701 is further configured to:

[0158] Determine the refresh frequency of the display corresponding to the signal period, wherein the refresh frequency is the number of times the display refreshes per second;

[0159] The target synthesis rate of the image synthesis component is determined based on the refresh rate.

[0160] The image synthesis rate of the image synthesis component is adjusted to the target synthesis rate.

[0161] Optionally, in some embodiments of this application, the processing module 701 is further configured to:

[0162] The target synthesis rate is determined to satisfy a preset condition of the image synthesis component, wherein the preset condition is that the maximum image synthesis rate of the image synthesis component is greater than or equal to the target synthesis rate;

[0163] The image compositing component is controlled to set the image compositing rate to the target compositing rate.

[0164] Optionally, in some embodiments of this application, the processing module 701 is further configured to:

[0165] Store the target synthesis rate;

[0166] In response to a vertical synchronization signal with a signal period that is the same as the signal period corresponding to the target synthesis rate, the image synthesis component is controlled to perform an image synthesis operation according to the target synthesis rate.

[0167] Optionally, in some embodiments of this application, the processing module 701 is further configured to:

[0168] The refresh time of the display is determined based on the signal period.

[0169] Optionally, in some embodiments of this application, the processing module 701 is further configured to:

[0170] In response to the vertical synchronization signal, the time calculation function is invoked via a callback function;

[0171] The target synthesis time of the image synthesis component is determined according to the signal period and the time calculation function; the target processing time of the graphics processing component is determined according to the signal period and the time calculation function; and the target refresh time of the display is determined according to the signal period and the time calculation function.

[0172] The image compositing time of the image compositing component is adjusted to the target compositing time, the graphics processing time of the graphics processing component is adjusted to the target processing time, and the refresh time of the display is adjusted to the target refresh time.

[0173] Optionally, in some embodiments of this application, the processing module 701 is further configured to:

[0174] The timestamp information of the vertical synchronization signal is determined based on the signal period;

[0175] Determine the refresh frequency of the display corresponding to the signal period, wherein the refresh frequency is the number of times the display refreshes per second;

[0176] Based on the timestamp information and the refresh frequency, the target synthesis time, the target processing time, and the target refresh time are determined.

[0177] In this embodiment, the processing module 701 first determines the signal period corresponding to the vertical synchronization signal of the display controller. Then, the processing module 701 adjusts the decoding frame rate of the decoding module and the refresh time of the display according to the signal period.

[0178] In this application embodiment, by determining the signal period corresponding to the vertical synchronization signal of the display controller and adjusting the decoding frame rate of the decoding module and the refresh time of the display according to the signal period, the decoding frame rate of the terminal device decoding module can be adjusted according to the signal period of the vertical synchronization signal, thereby achieving the technical effect of avoiding screen tearing and stuttering and improving the smoothness of display animation.

[0179] In addition, this application also provides an electronic device, as shown in FIG8, which illustrates a structural schematic diagram of the electronic device involved in this application. Specifically:

[0180] The electronic device may include components such as a processor 801 with one or more processing cores, a memory 802 with one or more computer-readable storage media, a power supply 803, and an input unit 804. Those skilled in the art will understand that the electronic device structure shown in FIG8 does not constitute a limitation on the electronic device, and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein:

[0181] The processor 801 is the control center of the electronic device. It connects various parts of the electronic device via various interfaces and lines. By running or executing software programs and / or modules stored in the memory 802, and by calling data stored in the memory 802, it performs various functions and processes data, thereby providing overall monitoring of the electronic device. Optionally, the processor 801 may include one or more processing cores; preferably, the processor 801 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 801.

[0182] The memory 802 can be used to store software programs and modules. The processor 801 executes various functional applications and data processing by running the software programs and modules stored in the memory 802. The memory 802 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 802 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 802 may also include a memory controller to provide the processor 801 with access to the memory 802.

[0183] The electronic device also includes a power supply 803 that supplies power to the various components. Preferably, the power supply 803 can be logically connected to the processor 801 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 803 may also include one or more DC or AC power supplies, recharging systems, power equipment debugging circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0184] The electronic device may also include an input unit 804, which can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0185] Although not shown, the electronic device may also include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 801 in the electronic device loads the executable files corresponding to the processes of one or more application programs into the memory 802 according to the following instructions, and the processor 801 runs the application programs stored in the memory 802, thereby implementing the steps in any of the signal period synchronization methods provided in the embodiments of this application.

[0186] This application embodiment achieves the technical effect of avoiding screen tearing and stuttering, and improving the smoothness of display animation by determining the signal period corresponding to the vertical synchronization signal of the display controller and adjusting the decoding frame rate of the decoding module and the refresh time of the display according to the signal period.

[0187] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0188] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0189] To this end, this application provides a computer-readable storage medium storing a computer program that can be loaded by a processor to execute the steps in any of the signal period synchronization methods provided in this application.

[0190] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0191] The computer-readable storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0192] Since the instructions stored in the computer-readable storage medium can execute the steps of any of the signal period synchronization methods provided in this application, the beneficial effects that any of the signal period synchronization methods provided in this application can achieve can be realized, as detailed in the preceding embodiments, and will not be repeated here.

[0193] The above provides a detailed description of a signal period synchronization method, apparatus, electronic device, and computer-readable storage medium provided in this application. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, those skilled in the art will recognize that there will be changes in the specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A signal periodic synchronization method, wherein, Applied to a terminal device, the terminal device including a display, a display controller, and a decoding module, the method includes: Determine the signal period corresponding to the vertical synchronization signal of the display controller; The decoding frame rate of the decoding module is adjusted according to the signal period.

2. The method according to claim 1, wherein, The decoding module includes a graphics processing component and an image synthesis component. Adjusting the decoding frame rate of the decoding module according to the signal period includes: The image synthesis rate of the image synthesis component is adjusted according to the signal period, wherein the image synthesis rate is associated with the decoding frame rate; or, The image synthesis time of the image synthesis component is adjusted according to the signal period, and the graphics processing time of the graphics processing component is adjusted according to the signal period, wherein the image synthesis time and the graphics processing time are associated with the decoding frame rate.

3. The method according to claim 2, wherein, Adjusting the image synthesis rate of the image synthesis component according to the signal period includes: Determine the refresh frequency of the display corresponding to the signal period, wherein the refresh frequency is the number of times the display refreshes per second; The target synthesis rate of the image synthesis component is determined based on the refresh rate. The image synthesis rate of the image synthesis component is adjusted to the target synthesis rate.

4. The method according to claim 3, wherein, Adjusting the image synthesis rate of the image synthesis component to the target synthesis rate includes: determining that the target synthesis rate satisfies a preset condition of the image synthesis component, wherein the preset condition is that the maximum image synthesis rate of the image synthesis component is greater than or equal to the target synthesis rate; The image compositing component is controlled to set the image compositing rate to the target compositing rate.

5. The method according to claim 4, wherein, After adjusting the image synthesis rate of the image synthesis component to the target synthesis rate, the method further includes: storing the target synthesis rate; In response to a vertical synchronization signal with a signal period that is the same as the signal period corresponding to the target synthesis rate, the image synthesis component is controlled to perform an image synthesis operation according to the target synthesis rate.

6. The method according to claim 5, wherein, The storage of the target synthesis rate includes: If the hardware and software performance of the image compositing component supports the target compositing rate, the target compositing rate is stored.

7. The method according to claim 5, wherein, The method further includes: If the hardware and software performance of the image synthesis component supports the target synthesis rate, the frame rate corresponding to the target synthesis rate is stored.

8. The method according to claim 2, wherein, Before adjusting the image synthesis time of the image synthesis component according to the signal period and adjusting the graphics processing time of the graphics processing component according to the signal period, the method further includes: The refresh time of the display is determined based on the signal period.

9. The method according to claim 8, wherein, The step of adjusting the decoding frame rate of the decoding module according to the signal period includes: In response to the vertical synchronization signal, the time calculation function is invoked via a callback function; The target synthesis time of the image synthesis component is determined according to the signal period and the time calculation function; the target processing time of the graphics processing component is determined according to the signal period and the time calculation function; and the target refresh time of the display is determined according to the signal period and the time calculation function. The image compositing time of the image compositing component is adjusted to the target compositing time, the graphics processing time of the graphics processing component is adjusted to the target processing time, and the refresh time of the display is adjusted to the target refresh time.

10. The method according to claim 9, wherein, The steps of determining the target synthesis time of the image synthesis component based on the signal period and the time calculation function, determining the target processing time of the graphics processing component based on the signal period and the time calculation function, and determining the target refresh time of the display based on the signal period and the time calculation function include: The timestamp information of the vertical synchronization signal is determined based on the signal period; Determine the refresh frequency of the display corresponding to the signal period, wherein the refresh frequency is the number of times the display refreshes per second; Based on the timestamp information and the refresh frequency, the target synthesis time, the target processing time, and the target refresh time are determined.

11. The method according to claim 1, wherein, The decoding module includes a graphics processing component and an image synthesis component; The method further includes: The display controller sends the vertical synchronization signal to the graphics processing component in the decoding module; Determining the signal period corresponding to the vertical synchronization signal of the display controller includes: determining the signal period of the vertical synchronization signal based on the time interval at which the display controller sends the vertical synchronization signal.

12. The method according to claim 1, wherein, The vertical synchronization signal sent by the display controller is determined according to the refresh rate of the display.

13. The method according to claim 12, wherein, The refresh rate of the display is set by the user.

14. The method according to claim 12, wherein, The refresh rate of the display is automatically selected by the display controller based on the hardware or software attributes of the terminal device.

15. The method according to claim 12, wherein, The refresh rate of the display is determined by the display controller through an interface with the display.

16. The method according to claim 1, wherein, Determining the signal period corresponding to the vertical synchronization signal of the display controller includes: The signal period corresponding to the vertical synchronization signal can be directly obtained through the interface between the display controller and the graphics processing system.

17. The method according to claim 16, wherein, The step of directly obtaining the signal period corresponding to the vertical synchronization signal through the interface between the display controller and the graphics processing system includes: The state of the vertical synchronization signal is detected by the vertical synchronization pin.

18. The method according to claim 1, wherein, Determining the signal period corresponding to the vertical synchronization signal of the display controller includes: By registering a frame callback listener, the signal period corresponding to the vertical synchronization signal received by the graphics processing system can be obtained.

19. An electronic device, wherein, It includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the signal period synchronization method as described in any one of claims 1-18.

20. A computer-readable storage medium, wherein, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the signal period synchronization method as described in any one of claims 1-18.

Images