Refresh rate adjustment method and electronic device
By dynamically adjusting the refresh rate based on frame rate and playback status, the method addresses issues of frame loss and energy consumption in video playback, enhancing user experience and interaction performance.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- HONOR DEVICE CO LTD
- Filing Date
- 2024-07-31
- Publication Date
- 2026-06-29
AI Technical Summary
Conventional video playback technologies use a fixed refresh rate, leading to issues such as frame loss, increased energy consumption, and stalling during interaction operations when dealing with video source files of varying frame rates, resulting in a poor user experience.
An electronic device adjusts its refresh rate based on the frame rate of the video source file, playback status, and the need for animation effects, using pre-set or user-defined rates to match the display's capabilities, thereby ensuring smoother playback and reduced power consumption.
The method ensures smoother video playback and reduced energy consumption by dynamically adjusting the refresh rate to match the frame rate requirements, improving the user experience and interaction performance.
Smart Images

Figure 0007881658000001 
Figure 0007881658000002 
Figure 0007881658000003
Abstract
Description
Technical Field
[0001]
[0001] This application claims priority to Chinese Patent Application No. 202110548052.2, filed with the China National Intellectual Property Administration on May 19, 2021, entitled "Refresh Rate Adjustment Method and Electronic Device", the entire content of which is incorporated herein by reference.
[0002]
[0002] Technical Field This application relates to the field of video displays, and particularly to a refresh rate adjustment method and an electronic device.
Background Art
[0003]
[0003] Currently, most applications installed on terminal devices are integrated with video playback functions, and users can perform a number of interaction operations during the video playback process. Under existing technical conditions, when an application is used to play a video on a terminal device, the terminal usually plays a video source file with various frame rates, which is compatible with video source files with various frame rates, at a large fixed refresh rate.
[0004]
[0004] However, if the frame rate of the video source is higher than the frame rate corresponding to the refresh rate of the terminal's display, the terminal will experience a loss of video playback frames, resulting in a poor user experience. If the frame rate of the video source is lower than the frame rate corresponding to the refresh rate of the terminal's display, invalid frame refreshes will occur, increasing the terminal's energy consumption. Furthermore, if the refresh rate of the terminal's display is low, when the user performs an interaction operation during the video viewing process, the frame rate corresponding to the display's refresh rate may become lower than the frame rate required for the animation effect corresponding to the interaction operation. Thus, the user will clearly perceive stalling. In conclusion, conventional techniques that use a fixed refresh rate to play video source files with various frame rates result in a poor user experience. [Overview of the project]
[0005]
[0005] The present invention provides a refresh rate adjustment method and an electronic device for appropriately adjusting the refresh rate of an electronic device's display during video playback and improving the user experience.
[0006]
[0006] According to a first aspect, the present invention provides a refresh rate adjustment method. The method can be applied to an electronic device. In the method, the electronic device receives a first operation used to give the electronic device a trigger to play at least one video source file; in response to the first operation, it is possible to play at least one video source file at a first refresh rate and obtain a first frame rate of at least one video source file and a playback status of each of the at least one video source files, the playback status including playing state or playback stopped state, and the first refresh rate is less than or equal to the maximum refresh rate of the electronic device's display.
[0007] Next, when the electronic device receives an interaction operation performed by a user on the playback interface of at least one video source file, the electronic device plays at least one video source file at a second refresh rate, the second refresh rate being less than or equal to the maximum refresh rate of the electronic device's display, and the frame rate corresponding to the second refresh rate being within a predetermined range of frame rates required for the animation effect corresponding to the interaction operation.
[0008] If an electronic device has not received another interaction operation within a predetermined period of time since receiving a first operation or a previous interaction operation, and at least one video source file includes the video source file being played, then if the first frame rate is greater than the frame rate corresponding to the third refresh rate, the electronic device plays at least one video source file at the third refresh rate; if the first frame rate is less than or equal to the frame rate corresponding to the third refresh rate, then the electronic device plays at least one video source file at the refresh rate corresponding to the first frame rate, where the third refresh rate is less than or equal to the maximum refresh rate of the electronic device's display.
[0009]
[0007] The first refresh rate, the second refresh rate, and the third refresh rate may be pre-set within the electronic device after being obtained based on actual survey results, or they may be set by the user in one of several setting methods.
[0010]
[0008] According to the aforementioned technical solution, in the process of playing a video source file, the electronic device adjusts the refresh rate of the display based on three factors: the first frame rate of at least one video source file currently being played, the playback status of each video source file, and whether or not a user operation has been performed. Of the three factors, the frame rate of the video source file determines the appropriate refresh rate required when the video source file is being played, whether or not the video source file is being played directly determines whether or not there is content that needs to be displayed by the display at the current refresh rate, and animation effects required for user interaction operations can only be displayed without stalling if a higher refresh rate is available. Accordingly, in this invention, after the three factors are combined, the refresh rate of the display on which the video source file is being played can be appropriately adjusted, and as a result, the refresh rate of the electronic device's display and the refresh rate required in the video source file playback process become closer to or equal to each other. Whether a video source file plays smoothly is determined by the similarity between the refresh rate required by the video source file playback process and the refresh rate of the display. A higher similarity indicates a smoother playback process, greater power savings, and a better user experience. Therefore, in conclusion, the technical solution provided in this application can improve the user experience when an electronic device plays a video source file.
[0011]
[0009] In a possible implementation of the first embodiment, the method further includes the step of adjusting the refresh rate of the display of the electronic device based on the content to be displayed by the electronic device, if the electronic device has not received another interaction operation within a predetermined period of time since it received a first operation or a previous interaction operation, and at least one video source file does not contain the video source file being played.
[0012]
[0010] According to the above solution, if an electronic device has not received another interaction operation within a predetermined period of time since it previously received an operation performed by a user on the electronic device (the first operation or a previous interaction operation), and all video source files have stopped playing, it indicates that the user may no longer be performing an interaction operation. Therefore, in this case, the refresh rate of the display may no longer be the frame rate used to match the animation effects corresponding to the interaction operation, and the display does not need to play the video source files. In this case, the electronic device only needs to refresh the display if there is content that needs to be displayed (content to be displayed), and does not refresh the display if there is no content that needs to be displayed. In this case, the refresh rate of the display can be 0, which can reduce the energy consumption of the electronic device and improve the user experience.
[0013]
[0011] In another possible design of the first embodiment, in actual applications, after controlling the electronic device to play a video, the user is likely to perform a specific interaction operation based on the user's preference. In this case, the first operation may be considered an interaction operation, and the first refresh rate may be set to be the same as the second refresh rate. In this way, the former operation of switching refresh rates is reduced, avoiding some discomfort that occurred due to the user perceiving changes in refresh rates during the video viewing process, thereby improving the user experience.
[0014]
[0012] In another possible design of the first embodiment, the step of obtaining a first frame rate for at least one video source file may include: an electronic device obtaining the frame rate for each of the at least one video source files. The terminal device determines the first frame rate for at least one video source file according to a predetermined rule and based on all the frame rates of the at least one video source file.
[0015]
[0013] For example, the predetermined rules may be as follows: The electronic device uses the maximum frame rate across all frame rates of at least one video source file as the second frame rate. Alternatively, the electronic device uses the average of the frame rates across all frame rates of at least one video source file as the second frame rate. Alternatively, if a selection operation has been performed by the user across all frame rates of at least one video source file, the electronic device uses the frame rate selected by the user as the second frame rate. The electronic device determines the first frame rate based on the second frame rate.
[0016]
[0014] According to the solution described above, a first frame rate of at least one video source file currently being played by the terminal device is determined according to a specific rule, and the first frame rate is used to represent the frame rate of all at least one video source file. The refresh rate of the display determined by the terminal device based on the first frame rate may then match to some extent all video source files, resulting in a better viewing experience for the user.
[0017]
[0015] In another possible design of the first embodiment, the step of determining a first frame rate based on a second frame rate includes: using the second frame rate as the first frame rate if the second frame rate is within a predetermined frame rate range. The minimum value within the predetermined frame rate range may be the frame rate of a video source file at which the human eye can perceive a noticeable image change (stutter) when the video source file is played back, and the maximum value within the predetermined frame rate range may be a predetermined maximum frame rate. The predetermined maximum frame rate may be greater than the frame rate corresponding to the maximum refresh rate of the display of the electronic device.
[0018]
[0016] In this way, after a second frame rate has been provisionally determined based on the frame rates of at least one video source file, the second frame rate is determined to be the first frame rate only if the second frame rate falls within an appropriate frame rate range (a predetermined frame rate range). This ensures that the electronic device plays the video source file smoothly and guarantees a smooth viewing experience for the user during the playback process (without any perceived lag).
[0019]
[0017] In another possible design of the first embodiment, there may be inadequacies in the rules for obtaining the second frame rate, or errors that exist when the frame rate of the video source is obtained, and therefore the ultimately obtained second frame rate is not within the range of a given frame rate, i.e., the second frame rate does not exist, or is greater than a given maximum frame rate, or is smaller than the frame rate of the video source file at which the human eye can perceive a noticeable image change (stutter) when the video source file is played back. These cases indicate that the second frame rate is an abnormal frame rate. In this case, therefore, in order to ensure that the electronic device plays back the video source file smoothly, the frame rate corresponding to a third refresh rate may be used as the first frame rate.
[0020]
[0018] In another possible design of the first embodiment, the step of an electronic device obtaining the frame rate of each of at least one video source files may include: the step of an electronic device obtaining the frame rate of each of at least one video source files by performing the following operation with respect to each of at least one video source files: if the attribute information of the first video source file includes frame rate information, the electronic device may obtain the frame rate in the attribute information of the first video source file.
[0021]
[0019] In this way, the frame rate of each of at least one video source files can be quickly obtained to provide data support for subsequent adjustment of the refresh rate.
[0022]
[0020] In another possible design of the first embodiment, the step of an electronic device obtaining the frame rate of each of at least one video source files may include the step of the electronic device obtaining the frame rate of each of at least one video source files by performing the following actions with respect to each of at least one video source files: If the attribute information of the first video source file does not include frame rate information, the electronic device may search a search platform for the first video source file to obtain the frame rate of the first video source file from the search platform.
[0023]
[0021] In this way, when the attribute information of the video source files does not include frame rate information, the frame rate of at least one video source file can be quickly obtained, providing data support for subsequent adjustment of the refresh rate.
[0024]
[0022] In another possible design of the first embodiment, frame loss often occurs in some video source file (e.g., live video), and therefore the actual frame rate at which the video source file is played back differs from the frame rate indicated in the attribute information of the video source file. Therefore, in order to obtain the actual frame rate of the video source file more accurately, the terminal device may obtain the frame rate of each of at least one video source files by performing the following actions with respect to each of at least one video source files: If the type of the first video source file is a given type, the terminal device calculates the frame rate of the first video source file based on the characteristic parameters of the first video source file, where the characteristic parameters include size, duration, and resolution, and the first video source file is any one of at least one video source file.
[0025]
[0023] For example, the specific formula used to calculate the frame rate of the first video source file based on the characteristic parameters of the first video source file may be as follows: Frame rate = Video size / (Duration × Resolution factor) The resolution factor is determined based on various resolution specifications. For example, the resolution factor for 720P resolution is 50, the resolution factor for 480P resolution is 5, and the resolution factor for 1080P resolution is 75.
[0026]
[0024] In another possible design of the first embodiment, the second refresh rate and the third refresh rate are pre-set refresh rates. Alternatively, the second refresh rate and the third refresh rate are set by an electronic device in response to user configuration operations.
[0027]
[0025] The preset refresh rate may be obtained based on the results of an actual investigation of a number of videos and electronic devices. As a result, the electronic device plays the video source file at the second refresh rate or the third refresh rate, thereby guaranteeing the user experience of the electronic device. For example, if the electronic device is a mobile phone specialized for games, since the frame rate of game videos is high, the second refresh rate and the third refresh rate may be preset to exceed 60 frames. For example, if the electronic device is a mobile phone specialized for shooting, since the videos often played by the mobile phone may not have a high frame rate, the second refresh rate and the third refresh rate can be preset to be around 60 frames or even less.
[0028]
[0026] When the second refresh rate and the third refresh rate are set by a user's setting operation, the user can set the second refresh rate and the third refresh rate required by the user in any executable interaction scenario. For example, the user can set the second refresh rate and the third refresh rate via the setting menu of the terminal device before the video source file is triggered to be played. Alternatively, the user can set the second refresh rate and the third refresh rate in the setting menu of the application corresponding to the video source file. Alternatively, when the video source file receives a trigger to be played, the electronic device displays a pop-up box to instruct the user to set the second refresh rate and the third refresh rate. Alternatively, the user can set the second refresh rate and the third refresh rate via a voice command. In this way, the user's requirements can be ensured, and the video source file can be played at various refresh rates based on various user requirements, improving the user experience.
[0029]
[0027] In another possible design of the first aspect, in the process where the user performs an interaction operation, to ensure the interaction experience, when the second refresh rate is a pre-set refresh rate, the frame rate corresponding to the second refresh rate is the maximum value within a predetermined range of the frame rate required for the animation effect corresponding to the interaction operation.
[0030]
[0028] In this way, a refresh rate corresponding to the maximum value within a predetermined range of frame rates required for animation effects corresponding to interaction operations is used as the second refresh rate. As a result, the animation effects presented by interaction operations performed by the user during the process of viewing a video source file played back on an electronic device can be made smoother, further improving the user's interaction experience.
[0031]
[0029] In another possible design of the first embodiment, the frame rate of the animation effect corresponding to the interaction operation in the actual application is usually required to be greater than the frame rate of the video source file, so in this application, the third refresh rate is greater than the second refresh rate.
[0032]
[0030] According to a second aspect, the present invention provides an electronic device comprising a display, memory, and one or more processors. The display and memory are coupled to the processors. The memory stores computer program code, which includes computer instructions. When the computer instructions are executed by the processor, the electronic device is capable of performing a refresh rate adjustment method according to the first aspect or any one of the possible designs of the first aspect.
[0033]
[0031] According to a third aspect, the present invention provides an electronic device. The electronic device includes a display, a memory, and one or more processors. The display and the memory are coupled to the processors. The memory stores computer program code, which includes computer instructions. When the computer instructions are executed by the processor, the electronic device is capable of performing the following steps: the electronic device undergoes a first operation, which triggers the electronic device to play at least one video source file.
[0034] In response to a first operation, the processor controls the display to play at least one video source file at a first refresh rate, obtains a first frame rate for at least one video source file and the playback status for each of the at least one video source files, where the playback status includes playing or stopped, and the first refresh rate is less than or equal to the maximum refresh rate of the display of the electronic device.
[0035] When an electronic device receives an interaction operation performed by a user on any one of the playback interfaces of at least one video source file, the processor adjusts the refresh rate of the electronic device's display to a second refresh rate, where the second refresh rate is less than or equal to the maximum refresh rate of the electronic device's display, and the frame rate corresponding to the second refresh rate is within a predetermined range of frame rates required for the animation effect corresponding to the interaction operation.
[0036] If an electronic device has not received another interaction operation within a predetermined period of time since receiving a first operation or a previous interaction operation, and at least one video source file contains the video source file being played, and the first frame rate is greater than the frame rate corresponding to the third refresh rate, the processor adjusts the refresh rate of the electronic device's display to the third refresh rate. If the first frame rate is less than or equal to the frame rate corresponding to the third refresh rate, the controller adjusts the refresh rate of the electronic device's display to the refresh rate corresponding to the first frame rate, where the third refresh rate is less than or equal to the maximum refresh rate of the electronic device's display.
[0037]
[0032] In a possible design of the third embodiment, once a computer instruction is executed by the processor, the electronic device may further perform the following steps: If the electronic device has not received another interaction operation within a predetermined period of time since it received a first operation or a previous interaction operation, and at least one video source file does not contain the video source file being played, the processor adjusts the refresh rate of the electronic device's display based on the content to be displayed by the electronic device.
[0038]
[0033] In another possible design of the third embodiment, the first refresh rate is equal to the second refresh rate.
[0039]
[0034] In another possible design of the third embodiment, when a computer instruction is executed by the processor, the electronic device may specifically perform the following steps: The processor obtains the frame rate of each of at least one video source files. The processor uses the maximum frame rate across all frame rates of at least one video source file as the second frame rate. Alternatively, the processor uses the average of the frame rates across all frame rates of at least one video source file as the second frame rate. Alternatively, if a selection operation has been performed by the user across all frame rates of at least one video source file, the processor uses the frame rate selected by the user as the second frame rate. The processor determines the first frame rate based on the second frame rate.
[0040]
[0035] In another possible design of the third embodiment, when a computer instruction is executed by the processor, the electronic device can specifically perform the following steps: When the second frame rate is within a predetermined frame rate range, the processor uses the second frame rate as the first frame rate.
[0041]
[0036] In another possible design of the third embodiment, once a computer instruction is executed by the processor, the electronic device may specifically further perform the following steps: If the second frame rate is not within a predetermined frame rate range, the processor uses the frame rate corresponding to the third refresh rate as the first frame rate.
[0042]
[0037] In another possible design of the third embodiment, once a computer instruction is executed by the processor, the electronic device may specifically perform the following steps: The processor obtains the frame rate of each of the at least one video source files by performing the following operations for each of the at least one video source files: The processor obtains the frame rate in the attribute information of the first video source file. Alternatively, the processor searches a search platform for the first video source file and obtains the frame rate of the first video source file from the search platform. Alternatively, the processor calculates the frame rate of the first video source file based on the characteristic parameters of the first video source file, where the characteristic parameters include size, duration, and resolution, and the first video source file is any one of the at least one video source file.
[0043]
[0038] In another possible design of the third embodiment, the second refresh rate and the third refresh rate are pre-set refresh rates. Alternatively, the second refresh rate and the third refresh rate are set by an electronic device in response to user configuration operations.
[0044]
[0039] In another possible design of the third embodiment, in order to ensure the interaction experience in the process in which the user performs an interaction operation, if the second refresh rate is a pre-set refresh rate, the frame rate corresponding to the second refresh rate is the maximum value within a predetermined range of frame rates required for the animation effect corresponding to the interaction operation.
[0045]
[0040] In another possible design of the third embodiment, the third refresh rate is greater than the second refresh rate.
[0046]
[0041] According to a fourth aspect, the present invention provides a computer-readable storage medium. The computer-readable storage medium includes computer instructions. When the computer instructions are executed in an electronic device, the electronic device is capable of performing a refresh rate adjustment method according to the first aspect or any one of the possible designs of the first aspect.
[0047]
[0042] According to a fifth aspect, the present invention provides a computer program product. When the computer program product is executed on a computer, the computer is capable of performing a refresh rate adjustment method according to the first aspect or any one of the possible designs of the first aspect. The computer may be the aforementioned electronic device.
[0048]
[0043] It will be understood that for useful effects that can be achieved by electronic devices according to the second aspect or any one of the possible designs of the second aspect and by electronic devices according to the third aspect or any one of the possible designs of the third aspect, by computer storage media according to the fourth aspect, and by computer program products according to the fifth aspect, please refer to the useful effects of the first aspect or any one of the possible designs of the first aspect. Further details will not be explained here again. [Brief explanation of the drawing]
[0049] [Figure 1]
[0044] Figure 1 is a schematic diagram illustrating the principle of the refresh rate adjustment method according to an embodiment of the present invention. [Figure 2]
[0045] Figure 2 is a schematic diagram of the hardware structure of an electronic device according to an embodiment of the present invention. [Figure 3]
[0046] Figure 3 is a schematic flowchart of the refresh rate adjustment method according to an embodiment of the present invention. [Figure 4(a)]
[0047] Figure 4(a) is a schematic diagram of a video playback scenario according to an embodiment of the present invention. [Figure 4(b)]
[0047] Figure 4(b) is a schematic diagram of a video playback scenario according to an embodiment of the present invention. [Figure 5(a)]
[0048] Figure 5(a) is a schematic diagram of another video playback scenario according to an embodiment of the present invention. [Figure 5(b)]
[0048] Figure 5(b) is a schematic diagram of another video playback scenario according to an embodiment of the present invention. [Figure 5(c)]
[0048] Figure 5(c) is a schematic diagram of another video playback scenario according to an embodiment of the present invention. [Figure 5(d)]
[0048] Figure 5(d) is a schematic diagram of another video playback scenario according to an embodiment of the present invention. [Figure 6(a)]
[0049] Figure 6(a) is a schematic diagram of yet another video playback scenario according to an embodiment of the present invention. [Figure 6(b)]
[0049] Figure 6(b) is a schematic diagram of yet another video playback scenario according to an embodiment of the present invention. [Figure 7(a)]
[0050] Figure 7(a) is a schematic diagram of yet another video playback scenario according to an embodiment of the present invention. [Figure 7(b)]
[0050] Figure 7(b) is a schematic diagram of yet another video playback scenario according to an embodiment of the present invention. [Figure 8A]
[0051] Figure 8A is a schematic flowchart of another refresh rate adjustment method according to an embodiment of the present invention. [Figure 8B]
[0051] Figure 8B is a schematic flowchart of another refresh rate adjustment method according to an embodiment of the present invention. [Figure 9A]
[0052] Figure 9A is a schematic flowchart of yet another refresh rate adjustment method according to an embodiment of the present invention. [Figure 9B]
[0052] Figure 9B is a schematic flowchart of yet another refresh rate adjustment method according to an embodiment of the present invention. [Figure 10(a)]
[0053] Figure 10(a) is a schematic diagram of a third refresh rate selection scenario according to an embodiment of the present invention. [Figure 10(b)]
[0053] Figure 10(b) is a schematic diagram of a third refresh rate selection scenario according to an embodiment of the present invention. [Figure 10(c)]
[0053] Figure 10(c) is a schematic diagram of a third refresh rate selection scenario according to an embodiment of the present invention. [Figure 11(a)]
[0054] Figure 11(a) is a schematic diagram of another selection scenario for a third refresh rate according to an embodiment of the present invention. [Figure 11(b)]
[0054] Figure 11(b) is a schematic diagram of another selection scenario for a third refresh rate according to an embodiment of the present invention. [Figure 12]
[0055] Figure 12 is a schematic diagram of the structure of another electronic device according to an embodiment of the present invention. [Modes for carrying out the invention]
[0050]
[0056] In the following description, the terms “first” and “second” are used solely for descriptive purposes and should not be understood as indicators or implications of relative importance, or as implications of the quantity of specified technical features. Therefore, features limited by “first” and “second” may explicitly or implicitly include one or more features. In the description of embodiments, “multiple” means two or more unless otherwise specified.
[0051]
[0057] The following explains the relevant technical terms used in this application.
[0052]
[0058] Frame Rate: Frame rate is the frequency (rate) at which a frame of bitmap images is continuously displayed on a screen. Also known as frame frequency, frame rate is expressed in Hertz (Hz).
[0053]
[0059] Refresh Rate: The refresh rate is the refresh frequency, which refers to the speed at which the screen is refreshed. The refresh rate is usually the vertical refresh rate. The vertical refresh rate represents the number of times the image on the screen is redrawn per second, i.e., the number of times the screen is refreshed per second, and its unit is Hz (Hertz). A higher refresh rate results in a more stable image, a more natural and sharp image display, and less strain on the eyes. A lower refresh frequency results in more image flickering and jitter, and faster eye fatigue.
[0054]
[0060] With the continuous advancement of intelligent terminal device performance, most applications currently installed on terminal devices are integrated with video playback functionality, allowing users to perform numerous interactive operations during the video playback process. For example, when watching live video using a short video application, users can send gifts or bullets to the host by performing actions on the touchscreen. In conventional technology, video source files played by terminal devices come from a wide range of sources, and the frame rates of various video source files also vary. Therefore, terminal devices cannot guarantee that content will be played at a refresh rate corresponding to the frame rate of each video source file. To solve this problem, terminal devices typically play video source files with various frame rates at a high, fixed refresh rate. For example, a terminal device might play any video source file at a refresh rate of 60Hz.
[0055]
[0061] However, the following problems exist: (1) When a terminal device plays a video source file with a lower frame rate at a higher refresh rate, the same frame is repeatedly refreshed, increasing system load and power consumption, affecting terminal usage time and resulting in a poor user experience. (2) When a terminal device plays a video source file with a higher frame rate at a lower refresh rate, frame loss occurs, resulting in a poor user experience. Furthermore, when a user performs interaction operations on the terminal device during the video playback process, higher frame rate animation effects corresponding to the interaction operations may not be displayed properly, causing the user to perceive a stall, which significantly impacts the user experience.
[0056]
[0062] Based on this, the present invention provides a refresh rate adjustment method. This method can be applied to electronic devices. Please refer to Figure 1. The electronic device can play a video source file (e.g., at least one video source file) in response to user operation, and then determine a first frame rate for at least one video source file and the playback status of each video source file. The electronic device can then determine the refresh rate to be used to play at least one video source file based on whether the interaction operation and the aforementioned acquired relevant data (e.g., the first frame rate and playback status) have been received. In this way, the refresh rate is determined by combining several factors that may affect the user experience, so that playing the video file at that refresh rate provides the user with a better visual experience.
[0057]
[0063] For example, the terminal device in this embodiment of the present application can be a device capable of playing video, such as a mobile phone, tablet computer, wearable device (e.g., smartwatch or smartband), ultra-mobile personal computer (UMPC), netbook, cellular phone, personal digital assistant (PDA), or augmented reality (AR) / virtual reality (VR) device. The specific form of the terminal device is not particularly limited in this embodiment of the present application.
[0058]
[0064] For example, an electronic device is a mobile phone. As shown in Figure 2, the electronic device may include a processor 110, an external memory interface 120, internal memory 121, a Universal Serial Bus (USB) port 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset jack 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, a subscriber identification module (SIM) card interface 195, and the like.
[0059]
[0065] Sensor module 180 may include pressure sensors, gyroscopes, barometric pressure sensors, magnetic sensors, acceleration sensors, distance sensors, optical proximity sensors, temperature sensors, touch sensors, ambient light sensors, bone conduction sensors, and the like.
[0060]
[0066] It will be understood that the structure shown in this embodiment of the Application does not constitute a particular limitation on the terminal device 100. In some other embodiments of the Application, the electronic device 100 may include more or fewer components than those shown, or may have some components combined, some components divided, or different arrangements of components. The components shown may be implemented as hardware, software, or a combination of software and hardware.
[0061]
[0067] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, a neural network processing unit (NPU), a microcontroller unit (MCU), and / or similar. Different processing units may be independent devices or may be integrated into one or more processors.
[0062]
[0068] The controller may be the neural center and command center of the terminal device 100. The controller is capable of generating operation control signals based on instruction operation codes and time sequence signals in order to complete the control of instruction reading and instruction execution.
[0063]
[0069] The memory may also be located within the processor 110 and configured to store instructions and data. In some embodiments, the memory within the processor 110 is cache memory. The memory is capable of storing instructions or data that are used just or periodically by the processor 110. When the processor 110 needs to use the instructions or data again, the processor 110 can retrieve the instructions or data directly from memory. This avoids repeated access, reduces the latency of the processor 110, and improves system efficiency.
[0064]
[0070] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include integrated circuit (I2C) interfaces, serial peripheral interfaces (SPI), inter-integrated sound (I2S) interfaces, pulse code modulation (PCM) interfaces, universal asynchronous receiver / transmitter (UART) interfaces, mobile industrial processor interfaces (MIPI), general-purpose input / output (GPIO) interfaces, subscriber identification module (SIM) interfaces, universal serial bus (USB) ports, and / or similar.
[0065]
[0071] It will be understood that the intermodal interface connection relationships shown in this embodiment of the present application are merely illustrative examples and do not constitute limitations on the structure of the terminal device 100. In some other embodiments of the present application, the electronic device 100 may use different interface connection methods, or combinations of multiple interface connection methods, than those described in the embodiments above.
[0066]
[0072] The charge management module 140 is configured to receive a charge input from the charger. The power management module 141 is configured to connect the battery 142 and the charge management module 140 to the processor 110. The power management module 141 receives input / multiple inputs from the battery 142 and / or the charge management module 140 and supplies power to the processor 110, internal memory 121, external memory, display 194, camera 193, wireless communication module 160, etc. In some other embodiments, the power management module 141 and the charge management module 140 may alternatively be located within the same device.
[0067]
[0073] The wireless communication function of the electronic device 100 can be realized by antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, baseband processor, etc. Antennas 1 and 2 are configured to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover one or more communication bands. Different antennas may be further multiplexed to improve antenna availability. For example, antenna 1 may be multiplexed as a diversity antenna in a wireless local area network. In some other embodiments, the antennas may be used in combination with tuning switches.
[0068]
[0074] The mobile communication module 150 can provide a wireless communication solution that includes 2G / 3G / 4G / 5G and is applicable to the terminal device 100. The wireless communication module 160 can provide a wireless communication solution that includes wireless local area network (WLAN) (e.g., Wi-Fi network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), NFC, infrared (IR) technology, and is applicable to the terminal device 100.
[0069]
[0075] The electronic device 100 implements display functionality through a GPU, a display 194, an application processor, and the like. The GPU is a microprocessor for image processing and is connected to the display 194 and the application processor. The GPU is configured to perform mathematical and geometric calculations as well as graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0070]
[0076] The display 194 is configured to display images, videos, etc. The display may be a touchscreen. In some embodiments, the electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.
[0071]
[0077] The electronic device 100 can implement the capture function using an ISP, a camera 193, a video codec, a GPU, a display 194, an application processor, and the like. The ISP is configured to process the data fed back by the camera 193. The camera 193 is configured to capture still images or videos. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0072]
[0078] An NPU is a neural network (NN) computing processor. By referencing the structure of biological neural networks, for example, by referencing the transmission modes between neurons in the human brain, the NPU can rapidly process input information and perform continuous self-learning. The NPU can perform applications such as intelligent recognition on terminal devices 100, including film state recognition, image restoration, image recognition, face recognition, speech recognition, and text comprehension.
[0073]
[0079] The external memory interface 120 may be configured to expand the storage capacity of the electronic device 100 by connecting an external storage card, such as a microSD card. The external storage card communicates with the processor 110 via the external memory interface 120 to provide data storage functionality. For example, files such as music and videos are stored on the external storage card.
[0074]
[0080] The internal memory 121 can be configured to store computer-executable program code, where the executable program code includes instructions. The processor 110 performs various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. The program storage area can store applications required by the operating system, at least one function (such as an audio playback function or an image playback function), etc. The data storage area can store data created during use of the electronic device 100 (such as audio data or an address book). Furthermore, the internal memory 121 may include high-speed random-access memory and may further include non-volatile memory, such as at least one disk storage device, a flash memory device, or universal flash storage (UFS).
[0075]
[0081] The electronic device 100 can perform audio functions, such as playing or recording music, through components such as the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0076]
[0082] The touch sensor is also referred to as a “touch panel (TP)”. The touch sensor is located on the display 194, and the touch sensor and the display 194 form a touchscreen. The touch sensor is configured to detect touch operations performed on or near the touch sensor. The touch sensor transmits the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation may be provided via the display 194. In some other embodiments, the touch sensor may also be located on the surface of the electronic device 100 at a different location from the display 194.
[0077]
[0083] Buttons 190 include a power-on button, volume buttons, etc. Motor 191 is capable of generating vibrational stimulation. Indicator 192 may be an indicator light and may be used to indicate the charging status or battery level changes, or to indicate messages, missed calls, notifications, etc. SIM card interface 195 is configured to connect to a SIM card.
[0078]
[0084] Embodiments of the present invention provide a refresh rate adjustment method. This method can be applied to electronic devices including displays. For example, the electronic device is a mobile phone. See Figure 3. The refresh rate adjustment method may include 301 to 310.
[0079]
[0085] 301: The mobile phone receives a first operation and plays at least one video source file at a first refresh rate in response to the first operation.
[0080]
[0086] The first operation is used to trigger the mobile phone to play at least one video source file, and the first refresh rate is less than or equal to the maximum refresh rate of the electronic device's display. The first refresh rate may be pre-set on the mobile phone after being obtained based on an empirical value beforehand, or it may be set by the user (set through various interactions; see the relevant descriptions below for how to set the second and third refresh rates for details).
[0081]
[0087] For example, the first operation may be tapping the application's video on the mobile phone's touchscreen, or the user may use their voice to activate the mobile phone's smart assistant and issue a corresponding voice command to open the application's video, or it may be any other feasible method.
[0082]
[0088] In the first application scenario, the mobile phone displays a preview interface for application A, as shown in Figure 4(a). The preview interface may contain thumbnails of multiple videos. The first operation may be a tap operation performed by the user on video B within the preview interface. As shown in Figure 4(b), in response to the tap operation performed by the user on video B, the mobile phone plays video B at a first refresh rate. For example, the maximum refresh rate supported by the mobile phone may be 90Hz, and the first refresh rate may be 60Hz.
[0089] In the second application scenario, the first operation may be a voice command spoken by the user to the mobile phone, which is used to instruct the phone to play a video source file. Specifically, as shown in Figure 5(a), the mobile phone first uses the phone's microphone to receive a smart assistant activation command spoken by the user, for example, “Hello, YOYO,” and then the mobile phone displays the smart assistant interface shown in Figure 5(b). Next, as shown in Figure 5(c), the mobile phone's smart assistant activates the phone's microphone to acquire and recognize the user’s next voice command, for example, “Open the video B by using application A,” and displays the voice command on the smart assistant interface. Next, as shown in Figure 5(d), the mobile phone’s smart assistant jumps to the video playback interface of application A and plays video B at a first refresh rate. Of course, in actual applications, the activation command for the voice assistant may be determined based on the design of various mobile phones, and the voice command that the user inputs / speaks may be any voice command that can instruct, for example, that video B needs to be opened by using application A.
[0090] In the third application scenario, the first operation may be a tap on the video request rejection icon. Specifically, as shown in Figure 6(a), when a member sends a video request to another member within a communication group in a social software group, the mobile phone responds to the request by displaying a video request rejection icon C1 and a video request acceptance icon C2 on its interface. Then, as shown in Figure 6(b), the mobile phone displays the video call interfaces (C3, C4, C5, and C6) of all members and, in response to a tap on the video request acceptance icon C2, can play video images through multiple small screens at a first refresh rate.
[0083]
[0091] In the fourth application scenario, the first operation may be a tap on an icon for a video call request that the user has sent to a friend while the user is viewing a video source file. Specifically, as shown in Figure 7(a), when the user is playing video A through a viewing application, the mobile phone displays a video call request icon D on its interface in response to a video call request sent from another user's mobile phone. Then, as shown in Figure 7(b), when the user taps the video call request icon D, the mobile phone can display the video call interface E on the small screen at a first refresh rate in response to the tap operation performed by the user on the video call request icon D. It should be noted that if video A is being played on the mobile phone and no video request has been received, the mobile phone needs to determine the refresh rate for playing video A based on the refresh rate adjustment method provided in this embodiment of the present application.
[0084]
[0092] Of course, in actual applications, any other feasible video display scenarios may exist. The four scenarios described above are merely examples. This is not particularly limited to this embodiment of the present application.
[0085]
[0093] 302: The mobile phone obtains the first frame rate of at least one video source file and the playback status of at least one video source file.
[0086]
[0094] The playback status includes playing or stopped playback, and the stopped playback state may include paused or finished playback. The first frame rate is used in this application to represent the overall frame rate for all at least one video source files and may be specifically determined based on the frame rate of each of the at least one video source files.
[0087]
[0095] Specifically, with respect to Figure 3, as shown in Figure 8A, step 302 may specifically include steps 3021 to 3024.
[0088]
[0096] 3021: The mobile phone retrieves the playback status for each video source file, at least one video source file.
[0089]
[0097] For example, a mobile phone may determine the playback status of each video source file by listening to the relevant status parameters of the application for playing the video source file, or by any other viable method. This is not particularly limited in this application.
[0090]
[0098] 3022: The mobile phone obtains the frame rate for each of at least one video source files.
[0091]
[0099] For example, 3022 may be implemented in the following way:
[0100] In the first method, the mobile phone performs the following operation for each of at least one video source files to obtain the frame rate of at least one video source file: If the attribute information of the first video source file includes frame rate information, the mobile phone can obtain the frame rate in the attribute information of the first video source file.
[0092]
[0101] The first video source file may be any one of at least one video source file. In this embodiment of the application, a method by which a mobile phone obtains the frame rate of each of the at least one video source file is illustrated by using an example in which the frame rate of the first video source file is obtained. The following first video source file is the same as that in this embodiment.
[0093]
[0102] In this way, the mobile phone can quickly obtain the frame rate of at least one video source file for each and provide data support for subsequent refresh rate adjustments.
[0094]
[0103] In the second method, the mobile phone obtains the frame rate of at least one video source file by performing the following actions for each at least one video source file: If the attribute information of the first video source file does not include frame rate information, the mobile phone may search the search platform for the first video source file and obtain the frame rate of the first video source file from the search platform.
[0095]
[0104] In this way, if the attribute information of a video source file does not include frame rate information, the mobile phone may be able to quickly retrieve the frame rate of at least one video source file for each and provide data support for subsequent refresh rate adjustments.
[0096]
[0105] In the third method, frame loss often occurs in some video source files (such as live video), and therefore the actual frame rate at which the video source file is played back differs from the frame rate indicated in the attribute information of the video source file. Therefore, in order to obtain the actual frame rate of the video source file more accurately, the mobile phone may include obtaining the frame rate of at least one video source file by performing the following actions for each at least one video source file: If the type of the first video source file is a given type (for example, a video source file in which frame loss is likely to occur, such as a live broadcast type), the mobile phone calculates the frame rate of the first video source file based on the characteristic parameters of the first video source file, where the characteristic parameters include size, duration, and resolution, and the first video source file is any one of at least one video source file.
[0097]
[0106] For example, the specific formula used to calculate the frame rate of a first video source file based on its characteristic parameters may be as follows: Frame rate = Video size / (Duration × Resolution factor) The resolution factor is determined based on various resolution specifications. For example, the resolution factor for 720P resolution is 50, the resolution factor for 480P resolution is 5, and the resolution factor for 1080P resolution is 75.
[0098]
[0107] Of course, the three methods described above are merely examples, and in actual applications, any other feasible implementation may exist. This is not particularly limited in this application.
[0099]
[0108] 3023: The mobile phone determines a second frame rate according to predetermined rules and based on all frame rates of at least one video source file.
[0100]
[0109] The prescribed rule may be any one of the following three feasible solutions: a first solution in which the maximum frame rate across all frame rates of at least one video source file is used as the second frame rate; a second solution in which the average of all frame rates across at least one video source file is used as the second frame rate; and a third solution in which, given a selection operation performed by the user with respect to all frame rates of at least one video source file, the frame rate selected by the user is used as the second frame rate.
[0101]
[0110] The advantage of the first solution is that the second frame rate can be compatible with the frame rates of all video source files, thereby ensuring a consistent viewing experience for the user across all video source files after the display refresh rate is subsequently adjusted based on the first frame rate determined based on the second frame rate. However, if at least one of the video source files has a high frame rate, the second frame rate will be set high, and the refresh rate ultimately determined based on the first frame rate determined based on the second frame rate will also be high, potentially unnecessarily increasing the mobile phone's energy consumption.
[0102]
[0111] The advantage of the second solution is that it is possible to represent the frame rate of all video source files to some extent by using the average frame rate of all video source files, and if the individual frame rates are simply high compared to the frame rates of all video source files, the final second frame rate will not be too high, thereby reducing the energy consumption of the mobile phone.
[0103]
[0112] The advantage of the third solution is that the selection of the second frame rate is entirely determined by the user, and the final refresh rate of the display is controlled by the user, thus fully guaranteeing the user's requirements.
[0104]
[0113] For example, at least one video source file includes a first video source file, a second video source file, and a third video source file. In the implementation of the third solution, when playing at least one video source file, the mobile phone may display a pop-up box on the display, which may include three control options: “Frame rate of the first video source file - 60Hz”, “Frame rate of the second video source file - 50Hz”, and “Frame rate of the third video source file - 55Hz”. The user may choose to tap one of the control options based on their request, and the mobile phone may determine the final second frame rate in response to the user's tap. In another implementation of the third solution, the mobile phone first issues a voice command to the user prompting the user to speak a second frame rate selected by the user, for example, “Please say the name of the video currently on display that you intend to use to represent all displayed videos,” and then, based on the user’s request, receives the voice command spoken by the user (for example, “I will select the frame rate of the old idol drama as the frame rate for all videos”), and finally selects the frame rate of the video source file determined by the user as the second frame rate after recognizing the voice command.
[0105]
[0114] 3024: The mobile phone determines the first frame rate based on the second frame rate.
[0106]
[0115] Based on the aforementioned technical solution, a first frame rate of at least one video source file currently being played by the electronic device is determined according to a specific rule, and this first frame rate is used to represent the frame rate of all at least one video source file. The refresh rate of the display determined by the electronic device based on the first frame rate can then be matched to some extent with all video source files, resulting in a better viewing experience for the user. It should be noted that step 3021 may occur before or after any one of steps 3022 through 3024. Figures 8A and 8B only show possible implementations, and any other feasible implementation may be used in actual applications.
[0107]
[0116] In the implementation, the second frame rate may be directly determined as the first frame rate.
[0108]
[0117] In another implementation, with respect to Figure 9B, in relation to Figures 8A and 8B, step 3024 may include steps 30241 to 30243.
[0109]
[0118] 30241: The mobile phone determines whether the second frame rate is within a predetermined frame rate range.
[0110]
[0119] If the second frame rate is determined to be within a predetermined frame rate range, the mobile phone performs 30242. If the second frame rate is determined to be outside a predetermined frame rate range, the mobile phone performs 30243. The minimum value within the predetermined frame rate range may be the frame rate of a video source file (24Hz) at which the human eye can perceive a clear image change (stutter) when the video source file is played back, and the maximum value within the predetermined frame rate range may be a predetermined maximum frame rate (e.g., 400Hz).
[0111]
[0120] If the second frame rate is not within or does not exist within the specified frame rate range, it indicates that there may be an inadequacy in the rules for acquiring the second frame rate in the acquisition process, or an error that would exist if the frame rate of the video source were acquired. In this case, the second frame rate obtained is abnormal and does not belong to the normal frame rate range of the video source. Therefore, the second frame rate in this case cannot be used as a basis for determining the first frame rate.
[0112]
[0121] Furthermore, step 30241 may not exist in the actual application. The mobile phone directly executes 30242 if the second frame rate is within the range of a given frame rate, and executes 30243 if the second frame rate is not within the range of a given frame rate.
[0113]
[0122] 30242: The mobile phone uses the second frame rate as the first frame rate.
[0114]
[0123] 30243: The mobile phone uses a frame rate corresponding to the third refresh rate as the first frame rate.
[0115]
[0124] The third refresh rate is less than or equal to the maximum refresh rate supported by the mobile phone's display, and the third refresh rate may be a pre-set refresh rate, which may be pre-set on the mobile phone after an appropriate refresh rate has been determined based on relevant data of the user viewing a video in an actual application (for example, the maximum frame rate for the frame rate of all videos viewed by multiple users), or it may be set by the mobile phone in response to user settings operations.
[0116]
[0125] Thus, according to the technical solutions corresponding to 30241 to 30243, a second frame rate is provisionally determined based on all frame rates of at least one video source file, and only if the second frame rate falls within an appropriate frame rate range (a predetermined frame rate range) is the second frame rate determined as the first frame rate. This ensures that electronic devices (e.g., mobile phones) can smoothly play the video source file and guarantees a smooth viewing experience for the user during the playback process (without perceiving any stalls). If the second frame rate is not within the predetermined frame rate range, the frame rate corresponding to a pre-set third refresh rate is used as the first frame rate, thereby ensuring smooth playback of the video source file by the electronic device.
[0117]
[0126] The pre-set refresh rate may be obtained based on the results of actual research on numerous video and electronic devices, and as a result, the electronic device will play the video source file at the third refresh rate, thereby ensuring the user experience of the electronic device. For example, if the electronic device is a mobile phone dedicated to gaming, the frame rate of game video is high, so the third refresh rate may be pre-set to be greater than 60 frames. As another example, if the electronic device is a mobile phone dedicated to taking photos, the video that is often played back by the phone may not have a high frame rate, so the third refresh rate may be pre-set to be around 60 frames, or even less than 60 frames.
[0118]
[0127] The following scenarios are possible for a mobile phone to set a third refresh rate in response to user settings:
[0128] In the first possible scenario, the user can set a third refresh rate via the mobile phone's settings function. Specifically, as shown in Figure 10(a), the mobile phone can receive a tap operation performed by the user regarding the third refresh rate setting option in the settings interface. Then, as shown in Figure 10(b), in response to the user's tap operation, the mobile phone can display several values that can be set for the third refresh rate ("50Hz", "60Hz", and "90Hz" are used as specific examples in the drawing). If the objective is to extend the usage time of the mobile phone, the mobile phone manufacturer can not only guarantee a good user experience but also recommend to the user that they choose an option that consumes less power. For example, "Recommended" can be marked in the upper right corner of "60Hz" as shown in Figure 10(b) to give the user some indication of a choice. As shown in Figure 10(c), in response to a user tap, the mobile phone may display a slider 20 on which a slider bar 21 may be located, and a pre-configured area 22 may be located above the slider 20, displaying the refresh rate corresponding to the current position of the slider bar 21. When the user slides the slider bar 21 to the left end of the slider 20, the refresh rate corresponding to the position of the slider bar 21 may be a predetermined minimum value (e.g., 25Hz). As the slider bar 21 slides to the right, the corresponding frame rate gradually increases, and when the slider bar 21 slides to the right end of the slider, the corresponding refresh rate is the maximum refresh rate supported by the mobile phone (e.g., 144Hz).
[0119]
[0129] In the second possible scenario, the user can set a third refresh rate in the application's settings interface for playing a video source file. Specifically, in the application's settings interface, in response to a tap operation performed by the user regarding the setting option corresponding to the third refresh rate, the mobile phone can display all option values for the third refresh rate (which can be similar to all option values for the third refresh rate in Figure 10(b)) or a selection control for the third refresh rate (which can be similar to the slider and slider bar in Figure 10(c)). The mobile phone then determines the third refresh rate according to the user's relevant operation. For specific implementations, please refer to the description of the first scenario. Further details are not provided here.
[0120]
[0130] In a third possible scenario, the user can set a third refresh rate via the mobile phone's smart assistant. Specifically, the mobile phone can first display the smart assistant interface in response to a smart assistant activation command spoken by the user. Then, in response to a relevant voice command spoken by the user to set a third refresh rate (for example, “Set the third refresh rate to 60Hz” (in actual applications, the third refresh rate may be the normal refresh rate to facilitate user understanding)), the mobile phone determines the third refresh rate. Since the smart assistant has certain AI capabilities, the relevant voice command to set the third refresh rate may be a recognizable voice command. This is not particularly limited in this application.
[0121]
[0131] In a fourth possible scenario, when playback of a video source file is initiated, the mobile phone may prompt the user to set a third refresh rate. Specifically, as shown in Figure 11(a), the mobile phone may display a pop-up window 31 when playback of a video source file is initiated, which may include the message: “Please enter the refresh rate at which the video will be played (minimum refresh rate 25Hz, maximum refresh rate 144Hz).” The content in parentheses is intended to prompt the user for a feasible range of refresh rates to be entered, with the minimum refresh rate of 25Hz being the refresh rate corresponding to a video frame rate at which the human eye cannot perceive image changes, and the maximum refresh rate of 144Hz being the maximum refresh rate that can be displayed by the mobile phone's display. The prompt displayed at the top of the pop-up window may disappear when the user taps inside the pop-up window. The mobile phone can then determine a third refresh rate based on a value entered by the user within a pop-up window, for example, “60Hz” as shown in Figure 11(b). Of course, the pop-up window may be of any other feasible type, provided that the user can input or select a value for the third refresh rate.
[0122]
[0132] Of course, in actual applications, there may be other possible scenarios or other feasible configuration methods for a third refresh rate. The relevant descriptions of the four scenarios mentioned above are merely illustrative. The actual configuration process is not particularly limited.
[0123]
[0133] 303: The mobile phone determines whether it is currently receiving an interaction operation.
[0124]
[0134] The interaction operation may be an interaction operation on any one playback interface of at least one video source file (e.g., a slide operation or a bullet transmission operation), or an interaction operation relating to a specific video source file (e.g., a voice command or a button press operation).
[0125]
[0135] When the mobile phone receives an interaction request, it executes 304. If the mobile phone has not received an interaction request, it executes 305.
[0126]
[0136] For example, interaction operations include, but are not limited to, any one of the following: screen touch and slide operations, tap operations, voice control operations, button press operations, air gestures, remote control operations, mouse operations, keyboard operations, visual control operations, and facial expression recognition operations.
[0127]
[0137] In actual applications, a mobile phone can determine whether it is receiving interaction based on various sensors placed within the phone, such as touch sensors and pressure sensors under buttons.
[0128]
[0138] Interactive operations primarily require specific animation effects, and animation effects typically require high frame rates. Therefore, when a mobile phone determines the refresh rate used to play a video source file, it also needs to determine whether an interactive operation is in progress.
[0129]
[0139] Furthermore, step 303 may not be performed in the actual application. The mobile phone can directly perform step 304 if it is not currently receiving an interaction operation, and can perform step 305 if it is currently receiving an interaction operation.
[0130]
[0140] 304: The mobile phone adjusts the refresh rate of the mobile phone's display to a second refresh rate.
[0131]
[0141] The second refresh rate is less than or equal to the maximum refresh rate of the electronic device's display, and the frame rate corresponding to the second refresh rate is within a predetermined range of frame rates required for animation effects corresponding to interaction operations. The second refresh rate may be pre-set by the mobile phone or set by the mobile phone in response to user settings. The specific implementation for setting the second refresh rate is the same as the implementation for setting the third refresh rate. For details, please refer to the above description of the specific scenario for setting the third refresh rate. Details will not be explained again here.
[0132]
[0142] In possible implementations, if the second refresh rate is a predetermined refresh rate, the frame rate corresponding to the second refresh rate may be the maximum value within a predetermined range of frame rates required for the animation effects corresponding to the interaction operation, in order to improve the interaction experience in the process in which the user performs interaction operations. For example, if the predetermined range is 60Hz to 90Hz, the second refresh rate may be the refresh rate corresponding to a frame rate of 90Hz. In this way, the refresh rate corresponding to the maximum value within a predetermined range of frame rates required for the animation effects corresponding to the interaction operation is used as the second refresh rate, and as a result, the animation effects presented by the interaction operation performed by the user in the process of viewing a video source file played back on an electronic device can be made smoother, thereby improving the user's interaction experience.
[0133]
[0143] In possible designs, in actual applications, after controlling an electronic device to play a video, users are likely to perform specific interaction operations based on their preferences. In this case, the first operation may be considered an interaction operation, and the first refresh rate may be set to the same as the second refresh rate. In this way, the former operation of switching refresh rates is reduced, avoiding some of the visual discomfort that arose from the user perceiving changes in refresh rates during the video viewing process, thereby improving the user experience.
[0134]
[0144] Furthermore, in possible implementations, the frame rate of animation effects corresponding to interaction operations in actual applications typically needs to be higher than the frame rate of the video source file; therefore, in this application, the third refresh rate is higher than the second refresh rate.
[0135]
[0145] 305: The mobile phone determines whether the target duration from the time of the first operation or previous interaction operation on the video source file to the present time is greater than or equal to a predetermined duration.
[0136]
[0146] If the mobile phone determines that the target duration is greater than or equal to a predetermined duration, the mobile phone performs step 306. If the mobile phone determines that the target duration is less than the predetermined duration, the mobile phone performs step 305 again. Step 305 may be understood to specifically determine whether the mobile phone has not received another interaction operation within a predetermined duration since the first operation or previous interaction operation was received.
[0137]
[0147] Step 305 is performed to achieve the following objective: The mobile phone is required to determine a first frame rate based on interaction operations performed by the user with respect to a video source file, so that the playback status of the video source file, the refresh rate for playing the video source file, and the refresh rate, which are determined when interaction operations are present and when no interaction operations are present, are different. If the user performs interaction operations continuously at intervals of several minutes, the mobile phone may repeatedly adjust the refresh rate, which not only increases the likelihood that the user will perceive changes in the refresh rate (deteriorating the user experience) but also increases the power consumption of the mobile phone. Therefore, a predetermined duration may be set in this case. If the user does not perform another interaction operation within a predetermined duration after performing a first operation or interaction operation, it indicates that the user is highly unlikely to perform another interaction operation in a short period of time. In this case, the refresh rate of the mobile phone's display can be reliably increased to the corresponding refresh rate when no interaction operations are present.
[0138]
[0148] For example, the implementation of step 305 may involve the mobile phone setting a timer to maintain timing. The timer is reset to restart timing whenever the mobile phone receives a first operation or an interaction operation. Based on the timing time of the timer, the mobile phone can determine whether it has not received another interaction operation within a predetermined duration since the first operation or previous interaction operation. If the timing duration of the timer reaches the predetermined duration, it indicates that it has not received another interaction operation within the predetermined duration since the first operation or previous interaction operation. If the timing duration of the timer has not reached the predetermined duration, it indicates that it has not received another interaction operation within the predetermined duration since the first operation or previous interaction operation.
[0139]
[0149] Furthermore, step 305 may not be performed in the actual application. The mobile phone directly executes 306 if it determines that the target duration is greater than or equal to a predetermined duration, and executes 305 again if it determines that the target duration is less than a predetermined duration.
[0140]
[0150] 306: The mobile phone determines whether at least one video source file contains the video source file being played.
[0141]
[0151] If the mobile phone determines that at least one video source file contains the video source file being played, the mobile phone executes 307. If the mobile phone determines that at least one video source file does not contain the video source file being played, the mobile phone executes 308.
[0142]
[0152] Step 306 has the following meaning: If the current mobile phone does not need to play video source files or animations that respond to interaction operations, the display may be refreshed only if there is content to be displayed, and not refreshed if there is no content to be displayed, thereby saving power and improving the user experience.
[0143]
[0153] Furthermore, step 306 may not be performed in the actual application. The mobile phone directly performs 307 if it determines that at least one video source file contains the video source file being played, and performs 308 if it determines that at least one video source file does not contain the video source file being played.
[0144]
[0154] 307: The mobile phone determines whether the first frame rate is greater than the frame rate corresponding to the third refresh rate.
[0145]
[0155] If the mobile phone determines that the first frame rate is greater than the frame rate corresponding to the third refresh rate, the mobile phone executes 309. If the mobile phone determines that the first frame rate is less than or equal to the frame rate corresponding to the third refresh rate, the mobile phone executes 310.
[0146]
[0156] If the first frame rate is greater than the frame rate corresponding to the third refresh rate, it indicates that the best playback effect of the video source files (playing at least one video source file at the refresh rate corresponding to the first frame rate) actually exceeds the user's requirements. Therefore, in this case, at least one video source file is played directly at the third refresh rate, and as a result, the user's requirements can be satisfied with low power consumption (step 309).
[0147]
[0157] If the first frame rate is less than or equal to the frame rate corresponding to the third refresh rate, it indicates that the refresh rate requested by the user can fully achieve the best playback effect of the video source file. In this case, at least one video source file can be played back at the refresh rate corresponding to the first frame rate (step 310), which not only improves the user experience but also avoids invalid frame refreshes and saves power.
[0148]
[0158] Furthermore, step 307 may not be performed in the actual application. If the mobile phone determines that the first frame rate is greater than the frame rate corresponding to the third refresh rate, the mobile phone will directly perform step 309, and if the mobile phone determines that the first frame rate is less than or equal to the frame rate corresponding to the third refresh rate, the mobile phone will perform step 310.
[0149]
[0159] 308: A mobile phone adjusts the refresh rate of its display based on the content that should be displayed on the phone.
[0150]
[0160] Specifically, in this case, if there is no content to be displayed on the mobile phone, the display refresh rate can be 0, which can save a significant amount of power.
[0151]
[0161] 309: The mobile phone adjusts the refresh rate of the mobile phone's display to a third refresh rate.
[0152]
[0162] 310: The mobile phone adjusts the refresh rate of the mobile phone's display to a refresh rate that corresponds to the first frame rate.
[0153]
[0163] According to the technical solution provided in this embodiment of the present application, in the process of playing a video source file, the electronic device adjusts the refresh rate of the display based on three factors: namely, the first frame rate of at least one video source file currently being played, the playback status of each video source file, and whether or not it has received user operation. In terms of three factors, the frame rate of the video source file determines the appropriate refresh rate required when the video source file is played; whether the video source file is being played directly determines whether there is content that needs to be displayed by the current refresh rate; and animation effects required for user interaction operations can only be displayed without stalling if a higher refresh rate is available. Therefore, in this application, after the three factors are combined, the refresh rate of the display on which the video source file is played can be appropriately adjusted, resulting in the refresh rate of the electronic device's display and the refresh rate required in the video source file playback process being closer to or equal. Whether the video source file plays smoothly is determined by the similarity between the refresh rate required in the video source file playback process and the refresh rate of the display. A higher similarity indicates a smoother playback process, greater power savings, and a better user experience. Therefore, in conclusion, according to the technical solution provided in this application, the user experience can be improved when an electronic device plays a video source file.
[0154]
[0164] It will be understood that, in order to realize the functions described herein, the devices, etc., include corresponding hardware structures and / or software modules for performing the functions. Those skilled in the art will readily realize that the units, algorithms, and steps in the embodiments described with reference to the embodiments disclosed herein can be implemented in hardware form or in a combination of hardware and computer software in the embodiments of this application. Whether the functions are performed by hardware or computer software-driven hardware depends on the design constraints of the particular application and technical solution. Those skilled in the art may use various methods to implement the described functions for each specific application, but should not consider that such implementations extend beyond the scope of the embodiments of this application.
[0155]
[0165] In embodiments of the present application, an electronic device may be divided into functional modules based on the examples of the methods described above, for example, each functional module may be obtained by division for each corresponding function, or two or more functions may be integrated into a single processing module. The integrated module may be implemented in the form of a hardware or software functional module. It should be noted that the division into modules in embodiments of the present application is illustrative and merely a logical functional division, and other modes of division may be possible in actual implementation.
[0156]
[0166] As shown in Figure 12, if each functional module is obtained by dividing it based on its respective corresponding function, an embodiment of the present application provides an electronic device 12 including an interaction detection module 121, a frame rate determination module 122, a state detection module 123, a configuration module 124, and a control module 125. The modules within the electronic device 12 may be combined to implement the refresh rate adjustment method provided in the embodiments described above.
[0157]
[0167] Please refer to Figure 12. The specific operating principle is as follows:
[0168] After the user performs a first operation on the electronic device 12, the electronic device 12 begins playing at least one video source file at a first refresh rate in response to the first operation. Subsequently, the interaction detection module 121, the frame rate determination module 122, the status detection module 123, the configuration module 124, and the control module 125 are made operational by the electronic device.
[0158]
[0169] The interaction detection module 121 reports interaction commands received by electronic devices to the control module 125 in real time.
[0159]
[0170] The frame rate determination module 122 obtains a first frame rate for at least one video source file and reports the first frame rate to the control module 125, that is, in the embodiment described above, obtains a first frame rate for at least one video source file in step 302. This may specifically include steps such as 3022, 3023, and 3024 (including 30241 to 30243) in the embodiment described above.
[0160]
[0171] The status detection module 123 reports the playback status of each of at least one video source files to the control module; that is, in the embodiment described above, in step 302, it obtains the playback status of each of at least one video source files.
[0161]
[0172] The configuration module 124 reports a second refresh rate, a third refresh rate, and a predetermined duration to the control module 125. Specifically, the second and third refresh rates may be pre-configured within the configuration module 124. Alternatively, the configuration module 124 may perform the specific process of user-configuration of the second and third refresh rates in the embodiments described above.
[0162]
[0173] The control module 125 can determine the refresh rate based on all the data reported by the interaction detection module 121, the frame rate determination module 122, the status detection module 123, and the configuration module 124, and specifically perform steps 303 to 310 in the embodiments described above. Specifically, as shown in Figure 12, the following cases are included.
[0163]
[0174] S1: When it is determined that the electronic device has received interactive operation, the refresh rate of the electronic device's display is adjusted to a second refresh rate.
[0164]
[0175] S2: Determine that the electronic device has not received another interaction operation within a predetermined duration since the first operation or previous interaction operation, and if at least one video source file contains a video being played, determine that the display refresh rate is the third refresh rate if the first frame rate is greater than the frame rate corresponding to the third refresh rate; determine that the display refresh rate is the refresh rate corresponding to the first frame rate if the first frame rate is less than or equal to the frame rate corresponding to the third refresh rate.
[0165]
[0176] S3: If it is determined that the electronic device has not received another interaction operation within a predetermined time period since the first operation or previous interaction operation, and at least one video source file does not contain the video being displayed, the refresh rate of the electronic device's display is adjusted based on the content that the electronic device should display.
[0166]
[0177] The specific method by which the module of the electronic device of the above-described embodiment performs its operation is described in detail in the embodiment of the refresh rate adjustment method of the above-described embodiment. Further details are not described here. For the relevant beneficial effects of the electronic device, please refer to the relevant beneficial effects of the refresh rate adjustment method described above. Further details are not described here.
[0167]
[0178] Embodiments of the present invention further provide an electronic device. The electronic device includes a display, memory, and one or more processors. The display and memory are coupled to the processors. The memory stores computer program code, which includes computer instructions, and when the computer instructions are executed by the processor, the electronic device can perform the refresh rate adjustment method provided in the above embodiments. For specific effects of the electronic device, please refer to the structure of the electronic device 100 shown in Figure 1.
[0168]
[0179] Specifically, when a computer instruction is executed by a processor, the electronic device is capable of performing the following process: the electronic device receives a first operation, where the first operation is used to trigger the electronic device to play at least one video source file. In response to the first operation, the processor plays at least one video source file at a first refresh rate, obtains a first frame rate for at least one video source file and the playback status for each of the at least one video source files, where the playback status includes playing or stopped, and the first refresh rate is less than or equal to the maximum refresh rate of the electronic device's display. When the electronic device receives an interaction operation performed by a user in the playback interface of any one of the at least one video source file, the processor adjusts the refresh rate of the electronic device's display to a second refresh rate, where the second refresh rate is less than or equal to the maximum refresh rate of the electronic device's display, and the frame rate corresponding to the second refresh rate is within a predetermined range of frame rates required for the animation effect corresponding to the interaction operation. If an electronic device has not received another interaction operation within a predetermined period of time since receiving a first operation or a previous interaction operation, and at least one video source file contains the video source file being played, and the first frame rate is greater than the frame rate corresponding to the third refresh rate, the processor adjusts the refresh rate of the electronic device's display to the third refresh rate. If the first frame rate is less than or equal to the frame rate corresponding to the third refresh rate, the controller adjusts the refresh rate of the electronic device's display to the refresh rate corresponding to the first frame rate, where the third refresh rate is less than or equal to the maximum refresh rate of the electronic device's display.
[0169]
[0180] Optionally, once a computer instruction is executed by the processor, the electronic device may perform the following further steps: If the electronic device has not received another interaction operation within a predetermined period of time since the first operation or previous interaction operation, and at least one video source file does not contain the video source file being played, the processor adjusts the refresh rate of the electronic device's display based on the content to be displayed by the electronic device.
[0170]
[0181] Optionally, the first refresh rate is equal to the second refresh rate.
[0171]
[0182] Optionally, when a computer instruction is executed by the processor, the electronic device may specifically perform the following steps: the processor obtains the frame rate for each of at least one video source files. The processor uses the maximum frame rate across all frame rates of at least one video source file as the second frame rate. Alternatively, the processor uses the average of the frame rates across all frame rates of at least one video source file as the second frame rate. Alternatively, if a selection operation has been performed by the user across all frame rates of at least one video source file, the processor uses the frame rate selected by the user as the second frame rate. The processor determines the first frame rate based on the second frame rate.
[0172]
[0183] Optionally, when a computer instruction is executed by the processor, the electronic device may specifically perform the following steps: if the second frame rate is within a predetermined frame rate range, the processor uses the second frame rate as the first frame rate.
[0173]
[0184] Optionally, once a computer instruction is executed by the processor, the electronic device may further perform the following steps: if the second frame rate is not within a given range of frame rates, the processor may use the frame rate corresponding to the third refresh rate as the first frame rate.
[0174]
[0185] Optionally, when a computer instruction is executed by a processor, the electronic device may specifically perform the following steps: the processor performs the following action for each of at least one video source files: the processor obtains the frame rate in the attribute information of the first video source file; or the processor obtains the frame rate for each of at least one video source files. Alternatively, the processor searches a search platform for the first video source file and obtains the frame rate of the first video source file from the search platform. Alternatively, the processor calculates the frame rate of the first video source file based on the characteristic parameters of the first video source file, where the characteristic parameters include size, duration, and resolution, and the first video source file is any one of at least one video source file.
[0175]
[0186] Optionally, the second and third refresh rates are pre-set refresh rates. Alternatively, the second and third refresh rates are set by an electronic device in response to user configuration.
[0176]
[0187] As an option, the third refresh rate is greater than the second refresh rate.
[0177]
[0188] Embodiments of the present invention further provide a computer-readable storage medium. The computer-readable storage medium includes computer instructions. When the computer instructions are executed in an electronic device, the electronic device is capable of performing the refresh rate adjustment method according to the embodiments described above, or the electronic device is capable of performing a function or step performed by a mobile phone in the embodiments described above.
[0178]
[0189] Embodiments of the present invention further provide a computer program product. When the computer program product is executed on a computer, the computer is capable of performing the refresh rate adjustment method according to the embodiments described above, or the electronic device is capable of performing a function or step performed by a mobile phone in the embodiments described above. The computer may be the aforementioned electronic device.
[0179]
[0190] Based on the above-described implementation, those skilled in the art will clearly understand that, for the purpose of simplified explanation, the division into functional modules described above is used only as an example for illustrative purposes. In actual applications, the above-described functions can be assigned to various functional modules on a case-by-case basis, that is, the internal structure of the device can be divided into functional modules with different characteristics to achieve all or part of the above-described functions.
[0180]
[0191] In some embodiments provided herein, it should be understood that the disclosed apparatus and methods may be carried out in other ways. For example, the embodiments of the apparatus described above are merely examples. For example, the division into modules or units is merely a logical functional division, and other divisions may be used in actual implementations. For example, multiple units or components may be combined or integrated with other devices, or some features may be ignored or not performed. Furthermore, the mutual coupling, direct coupling, or communication connection shown or described may be implemented through some interface. Indirect coupling or communication connection between devices or units may be implemented in electrical, mechanical, or other forms.
[0181]
[0192] Units described as separate parts may or may not be physically separated, and parts illustrated as units may be one or more physical units, located in one place, or distributed to multiple different locations. All or some units may be selected based on actual requirements to achieve the objectives of the solution of the embodiment.
[0182]
[0193] Furthermore, the functional units in the embodiments of this application may be integrated into a single processing unit, or each unit may exist physically independently, or two or more units may be integrated into a single unit. The integrated unit may be implemented in the form of a hardware or software functional unit.
[0183]
[0194] If the integrated unit is implemented in the form of a software function unit and sold or used as a separate product, the integrated unit may be stored on a readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present application, the parts that contribute to the prior art, or all or part of the technical solutions may be implemented in the form of a software product. The software product is stored on a storage medium and includes several instructions for instructing a device (which may be a microcontroller, chip, etc.) or processor to perform all or part of the steps of the method described in the embodiments of the present application. The storage medium includes any medium capable of storing program code, such as a USB flash drive, removable hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.
[0184]
[0195] The foregoing describes only a specific implementation of the present application and is not intended to limit the scope of protection of the present application. Any modifications or substitutions within the technical scope disclosed herein shall also fall within the scope of protection of the present application. Accordingly, the scope of protection of the present application shall be subject to the scope of protection of the claims.
Claims
1. A method for adjusting the refresh rate applied to an electronic device: The electronic device plays a first video file at a first refresh rate in response to a first operation; Steps of adjusting the refresh rate of the display of the electronic device to the third refresh rate, based on the fact that the first video file is being played, provided that the electronic device has not received an interaction operation within a predetermined duration from the time it received the first operation, the first video file is being played, and the first frame rate of the first video file is greater than the second frame rate corresponding to the third refresh rate, wherein the third refresh rate is less than the first refresh rate, and the first frame rate is attribute information of the first video file; Steps of adjusting the refresh rate of the display of the electronic device to a fourth refresh rate corresponding to the first frame rate, based on the fact that the first video file is being played, provided that the electronic device has not received the interaction operation within the predetermined duration from the time it received the first operation, the first video file is being played, and the first frame rate of the first video file is less than or equal to the second frame rate corresponding to the third refresh rate; and Steps include: adjusting the refresh rate of the display of the electronic device to the third refresh rate or the fourth refresh rate corresponding to the first frame rate, and then, when the electronic device receives the interaction operation, adjusting the refresh rate of the display of the electronic device to a second refresh rate based on the interaction operation, wherein the first refresh rate is equal to the second refresh rate, and the second refresh rate is equal to the maximum refresh rate of the display of the electronic device; A method that includes this.
2. The method according to claim 1, further: If the electronic device has not received the interaction operation within the predetermined duration from the time it received the first operation, and the first video file is not being played, the step of adjusting the refresh rate of the display of the electronic device based on the content to be displayed on the electronic device; A method that includes this.
3. The method according to claim 1 or 2, further: The electronic device obtains the frame rate for each of at least one video source files, wherein the first video file includes the at least one video source file; The steps of the electronic device using the maximum frame rate at each of the frame rates for the at least one video source file as the third frame rate, or using the average value of the frame rates at each of the at least one video source file as the third frame rate, or, if a selection operation is performed by the user at each of the frame rates for the at least one video source file, the electronic device using the frame rate selected by the user as the third frame rate; and A step of determining the value of the first frame rate based on the third frame rate, wherein the first frame rate is the frame rate of the first video file; A method that includes this.
4. The method according to claim 3, the step of determining the value of the first frame rate based on the third frame rate is: Steps include using the third frame rate as the value of the first frame rate when the third frame rate is within a predetermined frame rate range; Methods that include...
5. The method according to claim 4, further: If the third frame rate is not within the range of predetermined frame rates, the second frame rate corresponding to the third refresh rate is used as the value of the first frame rate; Methods that include...
6. The method according to any one of claims 3 to 5, wherein the electronic device obtains the respective frame rates for the at least one video source file: In order for the electronic device to obtain the respective frame rate for each of the at least one video source files, it performs the following actions with respect to each of the at least one video source files: The electronic device performs the operation of obtaining the frame rate in the attribute information of the first video source file; or The electronic device performs the operation of searching for a search platform for the first video source file and obtaining the frame rate of the first video source file from the search platform; or An operation in which the electronic device calculates the frame rate of the first video source file based on characteristic parameters of the first video source file, wherein the characteristic parameters include size, duration, and resolution, and the first video source file is any one of the at least one video source files; A method that includes the steps to perform the following actions.
7. In the method according to any one of claims 1 to 6, A method in which the second refresh rate and the third refresh rate are set to a predetermined value, or the second refresh rate and the third refresh rate are set by the electronic device in response to a user setting operation.
8. The method according to claim 1, wherein, if the second refresh rate is a preset value, the frame rate corresponding to the second refresh rate is the maximum frame rate within a predetermined range of frame rates required for the animation effect displayed in the process of the user performing the interaction operation.
9. An electronic device comprising a display, memory, and one or more processors, wherein the display and the memory are coupled to the processor; the memory stores computer program code, the computer program code includes computer instructions, and when the computer instructions are executed by the processor, the electronic device becomes capable of performing the refresh rate adjustment method according to any one of claims 1 to 8.
10. A computer-readable storage medium containing computer instructions, wherein when the computer instructions are executed on an electronic device, the electronic device becomes capable of performing the refresh rate adjustment method described in any one of claims 1 to 8.