A video playback control method, device, equipment and computer storage medium

By obtaining the target frame rate and frame rate supported by the video decoding capability of the terminal device, the decoding time and playback lag caused by high video frame rate are solved, and the video fluency is improved.

CN113395592BActive Publication Date: 2024-12-03TENCENT TECH (BEIJING) CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202011295578.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-11-18
Publication Date
2024-12-03
Estimated Expiration
2040-11-18

AI Technical Summary

Technical Problem

When the terminal device plays video, the decoding capability is insufficient due to the high frame rate of the video, which causes the decoding to take a long time and playback stuttering. How to reduce the stuttering of video playback?

Method used

By obtaining the target frame rate supported by the video decoding capability of the terminal device, obtaining the target download address from the video content server, and obtaining and playing the video with the target frame rate based on the address. If the actual playback frame rate is greater than the screen refresh frequency, some videos will be discarded Frames to avoid frame rate buildup.

Benefits of technology

It reduces the time-consuming video decoding, improves the smoothness of video playback, avoids playback lag caused by insufficient decoding capabilities, and realizes stable playback of higher frame rate videos by terminal devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113395592B_ABST
    Figure CN113395592B_ABST
Patent Text Reader

Abstract

This application provides a video playback control method, apparatus, device, and computer storage medium, relating to the field of computer technology, to reduce video playback stuttering. The method includes: a terminal device receiving a playback command for a video to be played; based on the terminal device's video decoding capabilities, obtaining a target download address for the video to be played with a target frame rate from a video content server; the target frame rate is a frame rate supported by the video decoding capabilities; obtaining the video to be played with the target frame rate according to the target download address; and playing the video to be played with the target frame rate. In this method, the terminal device obtains the video to be played with a target frame rate supported by its video decoding capabilities, thereby quickly completing the decoding and playback of the video to be played, reducing video decoding time, and thus reducing video playback stuttering caused by long video decoding times, improving the smoothness of video playback.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a video playback control method, device, equipment and computer storage medium. Background Art

[0002] When a terminal device requests to play a video with a certain video frame rate, the terminal device needs to decode the video before playing it after obtaining the video. However, different terminal devices have different capabilities for decoding video data. It is possible that the video decoding capability of the terminal device cannot meet the decoding requirements of the video frame rate corresponding to the video it obtains. As a result, the process of decoding the video by the terminal device takes a long time, which in turn causes playback jams during video playback. Therefore, how to reduce the jamming of video playback has become a problem that needs to be considered. Summary of the invention

[0003] Embodiments of the present application provide a video playback control method, apparatus, device, and computer storage medium for reducing the degree of stuttering in video playback.

[0004] In a first aspect of the present application, a video playback control method is provided, which is applied to a video playback application installed on a terminal device, and includes:

[0005] Receiving a playback instruction for a video to be played;

[0006] Based on the video decoding capability of the terminal device, obtaining a target download address of a to-be-played video having a video frame rate of a target frame rate from a video content server; the target frame rate is a video frame rate supported by the video decoding capability;

[0007] According to the target download address, obtain the video to be played with the target frame rate;

[0008] Play the video to be played at the target frame rate.

[0009] In a second aspect of the present application, a video playback processing method is provided, comprising:

[0010] Receiving a video request sent by a terminal device;

[0011] If the video request carries identification information and frame rate indication information of the video to be played, a target download address of the video to be played at a target frame rate is determined according to the identification information of the video to be played and the frame rate indication information, and the target download address is returned to the terminal device; the frame rate indication information is determined based on the frame rate information supported by the video decoding capability of the terminal device; the frame rate indication information includes the target frame rate or the frame rate information;

[0012] If the video request carries identification information of the video to be played, at least one video frame rate of the video to be played is returned to the terminal device, and the target frame rate determined by the terminal device based on the at least one video frame rate is received, and the target download address of the video to be played with the target frame rate is determined, and the target download address is returned to the terminal device; or at least one address to be downloaded is indicated to the terminal device, so that the terminal device determines the address to be downloaded corresponding to the target frame rate from the at least one address to be downloaded as the target download address, wherein each address to be downloaded is a download address of the video to be played with a video frame rate, and the target frame rate is determined based on the frame rate information supported by the video decoding capability of the terminal device.

[0013] In a third aspect of the present application, a video playback processing device is provided, comprising:

[0014] An instruction receiving unit, used to receive a play instruction for a video to be played;

[0015] A download address acquisition unit, configured to acquire, based on a video decoding capability of a terminal device, a target download address of a to-be-played video having a video frame rate of a target frame rate from a video content server; the target frame rate is a video frame rate supported by the video decoding capability;

[0016] A video download unit, used to obtain a to-be-played video with a target frame rate according to the target download address;

[0017] The video playing unit is used to play the video to be played at the target frame rate.

[0018] In a possible implementation, the download address obtaining unit is specifically used to:

[0019] Determine frame rate indication information based on frame rate information supported by the video decoding capability of the terminal device, where the frame rate indication information includes the target frame rate or the frame rate information;

[0020] Sending a video request to the video content server, wherein the video request carries the identification information of the video to be played and the frame rate indication information;

[0021] A target download address returned by the video content server is received, where the target download address is determined by the video content server according to the identification information of the video to be played and the frame rate indication information.

[0022] In a possible implementation, the download address obtaining unit is specifically used to:

[0023] Sending a video request to the video content server, wherein the video request carries identification information of the video to be played;

[0024] Receiving at least one video frame rate of the to-be-played video returned by the video content server;

[0025] Determining a target frame rate from the at least one video frame rate;

[0026] indicating the target frame rate to the video content server;

[0027] A target download address returned by the video content server is received, where the target download address is determined by the video content server based on the target frame rate.

[0028] In a possible implementation, the download address obtaining unit is specifically used to:

[0029] Sending a video request to the video content server, wherein the video request carries identification information of the video to be played;

[0030] Receiving at least one to-be-downloaded address indicated by the video content server, wherein each to-be-downloaded address is a download address of a to-be-played video at a video frame rate;

[0031] Determining a target frame rate based on frame rate information supported by the video decoding capability of the terminal device;

[0032] From the at least one address to be downloaded, determine the address to be downloaded corresponding to the target frame rate as the target download address.

[0033] In a possible implementation manner, the video decoding capability is determined based on a local video decoding type.

[0034] In a possible implementation, the video playback unit is further configured to:

[0035] Monitor the actual playback frame rate and screen refresh rate;

[0036] If it is determined that the actual playback frame rate is greater than the screen refresh rate, some video frames in the to-be-played video at the target frame rate are discarded.

[0037] In a fourth aspect of the present application, a video playback processing device is provided, comprising:

[0038] An information receiving unit, used for receiving a video request sent by a terminal device;

[0039] an information processing unit, configured to determine, if the video request carries identification information and frame rate indication information of the video to be played, a target download address of the video to be played at a target frame rate according to the identification information of the video to be played and the frame rate indication information, and return the target download address to the terminal device; the frame rate indication information is determined based on frame rate information supported by the video decoding capability of the terminal device; the frame rate indication information includes the target frame rate or the frame rate information;

[0040] The information processing unit is used to return at least one video frame rate of the video to be played to the terminal device if the video request carries identification information of the video to be played, and receive a target frame rate determined by the terminal device based on the at least one video frame rate, and determine a target download address of the video to be played with the target frame rate, and return the target download address to the terminal device; or indicate at least one address to be downloaded to the terminal device so that the terminal device determines the address to be downloaded corresponding to the target frame rate from the at least one address to be downloaded as the target download address, wherein each address to be downloaded is a download address of the video to be played with a video frame rate, and the target frame rate is determined based on the frame rate information supported by the video decoding capability of the terminal device.

[0041] In a fifth aspect of the present application, a computer device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method described in the first aspect when executing the program.

[0042] In a sixth aspect of the present application, a computer device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method described in the second aspect when executing the computer program.

[0043] In a seventh aspect of the present application, a computer program product is provided, the computer program product comprising computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method provided in various possible implementations of the first aspect or the second aspect.

[0044] In an eighth aspect of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions. When the computer instructions are executed on a computer, the computer executes any method as described in the first aspect and any possible implementation manner or the second aspect and any possible implementation manner.

[0045] Since the embodiment of the present application adopts the above technical solution, it has at least the following technical effects:

[0046] In the embodiment of the present application, based on the video decoding capability of the terminal device itself, the video to be played of the target frame rate supported by its video decoding capability is obtained. After obtaining the video to be played, the terminal device can quickly complete the decoding processing and playback of the video to be played according to its video decoding capability, thereby avoiding the phenomenon that the video decoding takes a long time because its video decoding capability cannot meet the decoding requirement of the video frame rate of the video to be played, thereby reducing the occurrence of video playback jams due to the long video decoding time and improving the smoothness of video playback. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 A schematic diagram of an application scenario provided in an embodiment of the present application;

[0048] Figure 2 An example diagram of a process of a video playback control method provided in an embodiment of the present application;

[0049] Figure 3 A schematic diagram of an application interface of a video playback application provided in an embodiment of the present application;

[0050] Figure 4 A schematic diagram of the process of obtaining a target download address by several terminal devices provided in an embodiment of the present application;

[0051] Figure 5 A schematic diagram of a process for setting a video playback speed provided in an embodiment of the present application;

[0052] Figure 6 A schematic diagram of a process of a video playback control method provided in an embodiment of the present application;

[0053] Figure 7 A schematic diagram of the interaction between various terminals in a video playback control process provided by an embodiment of the present application;

[0054] Figure 8 A schematic diagram of the interaction between various terminals in another video playback control process provided by an embodiment of the present application;

[0055] Fig. 9 A schematic diagram of the interaction between various terminals in another video playback control process provided by an embodiment of the present application;

[0056] Fig.10 A schematic diagram of the principle framework of a video playback control method applied to a terminal device provided in an embodiment of the present application;

[0057] Fig.11 A structural diagram of a video playback control device provided in an embodiment of the present application;

[0058] Fig.12 A structural diagram of a video playback control device provided in an embodiment of the present application;

[0059] Fig.13 A structural diagram of a terminal device provided in an embodiment of the present application;

[0060] Fig.14 A structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0061] In order to better understand the technical solution provided by the embodiments of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0062] In order to help those skilled in the art better understand the technical solution of the present application, the technical terms involved in the present application are explained below.

[0063] Video frame rate: A measure used to test the number of video frames displayed. The unit of measurement is generally the number of video frames displayed per second (Frames per Second, FPS). That is, the video frame rate in this application can be understood as, but is not limited to, the number of video frames displayed per second. Generally speaking, the higher the video frame rate, the better the picture quality of the video.

[0064] Screen refresh rate: used to measure the number of times a terminal device refreshes the screen within a set time period. For example, the screen refresh rate in this application can be understood as, but not limited to, the number of times a terminal device refreshes the screen per second. Generally, the higher the screen refresh rate of a terminal device, the higher the quality of the image displayed on the screen of the terminal device.

[0065] Video decoding capability: the ability of a terminal device to decode compressed video data; the videos downloaded by the terminal device from the video storage server are usually compressed video data. The terminal device needs to decode the compressed video data based on its own hardware device before it can play the video frames in the video data. Different terminal devices have different hardware devices, systems, etc., which will affect their ability to decode video data; the video decoding capability in the embodiments of the present application can be but is not limited to being determined by the video decoding type of the terminal device, and different video decoding capabilities may be able to decode video data at different video frame rates.

[0066] Video to be played: video requested by the terminal device or requested to be played by a video playback application installed on the terminal device, or video played by default, etc.

[0067] Target frame rate: the video frame rate supported by the video decoding capability of the terminal device; the target frame rate in the embodiment of the present application can be one or more video frame rates supported by the video decoding capability of the terminal device; the target frame rate can also be one or more video frame rates supported by the above video processing capability among at least one video frame rate of the video to be processed provided by the video content server; the specific situations of different target frame rates will be described in detail below.

[0068] Target download address: the download address of the video to be played at the target frame rate.

[0069] Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, application technology, etc. based on the cloud computing business model. It can form a resource pool and be used on demand, which is flexible and convenient. Cloud service technology is an important support; the background service of the technical network system requires a large amount of computing and storage resources, such as video websites, picture websites and more portal websites. With the rapid development and application of the Internet industry, in the future, each item may have its own identification mark, which needs to be transmitted to the background system for logical processing. Data of different levels will be processed separately. All kinds of industry data need strong system backing support, which can only be achieved through cloud service technology.

[0070] The design concept of this application is described below.

[0071] With the popularization of smart terminals and the development of the Internet, watching online videos on various smart terminals has become an important part of people's lives, and people have higher and higher requirements for video services; video providers provide videos with higher and higher video frame rates to meet users' requirements for video quality; as video frame rates continue to increase, the performance of terminal devices that play videos is also challenged; when a terminal device requests to play a video with a higher video frame rate (such as but not limited to videos including 120FPS or 24PFS), the server sends a download address of the video corresponding to the video frame rate to the terminal device, so that the terminal device obtains the video data of the corresponding video frame rate according to the download address. However, the video decoding capability of the terminal device may not meet the decoding requirements of the video frame rate corresponding to the downloaded video data, so that the process of decoding the video data takes a long time, which leads to playback jams during video playback.

[0072] In view of this, the inventors have designed a video playback control method, apparatus, device and computer storage medium; considering that the current terminal device plays a video because the acquired video with a higher video frame rate does not match its video decoding capability, resulting in playback jams, the applicant has designed the terminal device to acquire the video with a video frame rate supported by its video decoding capability based on the local video decoding capability for playback, thereby utilizing its video decoding capability to decode the acquired video to reduce the time spent on decoding the acquired video, thereby reducing the occurrence of video playback jams caused by the long video decoding time; specifically, in an embodiment of the present application, the terminal device acquires the target download address of the video to be played at the target frame rate supported by its video decoding capability from the video content server based on the local video decoding capability, and acquires the video to be played at the target frame rate according to the target download address, and plays the video to be played at the target frame rate.

[0073] Furthermore, considering that when a terminal device plays a video, the screen refresh rate of the terminal device may decrease due to changes in power or video playback mode, resulting in accumulation of some video frames in the video, which may cause the video playback to become stuck, the applicant further designed that, in an embodiment of the present application, when playing the video to be played at the target frame rate, if it is monitored that the screen refresh rate is significantly reduced, some video frames in the video to be processed at the target frame rate are discarded more evenly to avoid the accumulation of video frames in the video to be played, thereby improving the smoothness of the video during the playback of the video to be processed.

[0074] In order to more clearly understand the design ideas of this application, the following application scenario is provided. Please refer to Figure 1 The application scenario includes at least one terminal device 100, a video content server 200 and a video storage server 300. The terminal device 100 and the video content server 200 can communicate with each other through a network, and the terminal device 100 and the video storage server 300 can also communicate with each other, wherein:

[0075] The terminal device 100 (such as but not limited to 100-1 or 100-2 in the figure) can receive a playback instruction for a video to be played, and based on the video decoding capability of the terminal device 100, obtain a target download address of the video to be played with a target frame rate from the video content server 200; and according to the target download address, obtain the video to be played with the target frame rate from the video storage server 300 and play it.

[0076] Specifically, when the terminal device 100 obtains the target download address of the video to be played with a target frame rate from the video content server 200 based on the video decoding capability of the terminal device 100, the terminal device 100 can send a video request to the video content server 200, and then determine the above-mentioned target download address based on the information returned by the video content server 200 based on the video request and the above-mentioned video processing capability.

[0077] As an embodiment, a video playback application can be installed on the terminal device 100. After receiving the above-mentioned playback instruction, the video playback application obtains the above-mentioned target download address from the video content server 200 based on the video decoding capability of the terminal device 100, and obtains the video to be played with the target frame rate from the video storage server 300 according to the target download address and plays it.

[0078] The video content server 200 can receive a video request sent by the terminal device 100, and based on the information carried in the video request, return to the terminal device 100 a target download address of a video to be played at a target frame rate, or return to the terminal device 100 at least one video frame rate of a video to be played that the video content server 200 can provide, or return to the terminal device 100 a download address of a video to be played at at least one video frame rate, etc.; thereby enabling the terminal device 100 to obtain the above-mentioned target download address based on the information returned by the video content server 200 and the video decoding capability of the terminal device 100.

[0079] The video storage server 300 is used to store the videos to be played at various video frame rates, and provide the videos to be played at the target frame rate to the terminal device 100 based on the target download address.

[0080] The video content server 200 and the video storage server 300 may be the same server or different servers; and the video content server 200 and the video storage server 300 may be independent physical servers, or a server cluster or distributed system composed of multiple physical servers, or multiple cloud servers that provide basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms in cloud service technology (such as the video content server 200 may include but is not limited to the server 200-1, server 200-2 or server 200-3 shown in the figure; such as the video storage server 300 may include but is not limited to the server 300-1, server 300-2 or server 300-3 shown in the figure); the functions of the video content server 200 may be implemented by one or more cloud servers, or by one or more cloud server clusters, etc.; the functions of the video storage server 300 may be implemented by one or more cloud servers, or by one or more cloud server clusters, etc.

[0081] The terminal device 100 in the embodiment of the present application can be a mobile terminal, a fixed terminal or a portable terminal, such as a mobile phone, a station, a unit, a device, a multimedia computer, a multimedia tablet, an Internet node, a communicator, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device or any combination thereof, including accessories and peripherals of these devices or any combination thereof.

[0082] based on Figure 1 The following is an example of the video playback control method involved in the embodiment of the present application; please refer to Figure 2 , which is a schematic diagram showing the process of video playback control designed in an embodiment of the present application, is applied to the above-mentioned terminal device 100, or to a video playback application installed on the terminal device 100. The specific process is as follows:

[0083] Step S201, receiving a play instruction for a video to be played.

[0084] It should be noted that the play instruction in the embodiment of the present application can be, but is not limited to, triggered by the video object corresponding to the video to be played. The above-mentioned video object can be, but is not limited to, the video screen in the video or the name of the video; and the play instruction is used to indicate a request to play the above-mentioned video to be played.

[0085] Among them, those skilled in the art can flexibly set the specific method of triggering the play instruction for the video to be played according to actual needs; for ease of understanding, some examples of triggering the above-mentioned play instruction are given here: In the embodiment of the present application, after entering the application page of the video playback application on the terminal device 100, the user can trigger the play instruction by clicking or long pressing the video object displayed in the application interface; please refer to Figure 3 , a schematic diagram of an application interface 3001 is provided, and a user can input key information of a video to be played through a video search box 3006, and then the application page presents a video screen or video name of a video related to the input key information, and then the user can click on the presented video screen or video name to trigger the above-mentioned play instruction; the user can also directly trigger the above-mentioned play instruction through the video screen or video name displayed by default in the application page, such as the user can trigger the play instruction for the corresponding video through the video screen of the recommended video in the video recommendation page 3002 in the figure, such as the user can trigger the play instruction for the recommended video 1, the play instruction for the recommended video 2 or the play instruction for the recommended video 3 through, but not limited to, video screen 3003, video screen 3004 or video screen 3005, etc.; the user can also trigger the play instruction for the hot video by clicking on the video screen 3007 of the hot video in the figure, etc.

[0086] Step S202, based on the video decoding capability of the terminal device, obtaining a target download address of a video to be played with a target frame rate from a video content server; the target frame rate is a video frame rate supported by the video decoding capability.

[0087] Specifically, the terminal device 100 can obtain the above-mentioned target download address based on the frame rate information supported by the video decoding capability of the terminal device 100; the frame rate information supported by the above-mentioned video decoding capability can be understood as information on the video frame rate at which the video can be normally decoded and processed with the video decoding capability.

[0088] Step S203, obtaining the to-be-played video with the target frame rate according to the target download address.

[0089] Specifically, the terminal device 100 can obtain the to-be-played video with the target frame rate from the video storage server indicated by the target download address.

[0090] Step S204, playing the video to be played at the acquired target frame rate.

[0091] As an embodiment, considering that the screen refresh rate of the terminal device may decrease due to a decrease in the battery level of the terminal device or a change in the network environment, or after the user changes the video playback mode or adjusts the screen refresh rate of the terminal device, the screen refresh rate of the terminal device may be unable to refresh the video frames obtained by the terminal device in time after decoding the video to be played, thereby causing the video frames obtained by the decoding process to accumulate, and then causing a freeze in the process of the terminal device playing the video to be played. Therefore, in order to solve the above problem, the terminal device 100 in the embodiment of the present application can monitor the actual playback frame rate and screen refresh rate of the terminal device in real time when playing the video to be played with the above target frame rate; when it is determined that the above actual playback frame rate is greater than the screen refresh rate, the video to be played with the target frame rate is dropped, and some video frames in the video to be played with the above target frame rate are discarded.

[0092] The following content in the embodiment of the present application describes in detail the process of the terminal device 100 acquiring the above-mentioned target download address in step S202.

[0093] First, the frame rate information supported by the video decoding capability of the terminal device is described. For the convenience of description, the frame rate information supported by the video decoding capability of the terminal device is described as the target frame rate information in the following content of the embodiment of the present application.

[0094] As an embodiment, the video decoding capability of a terminal device may be but is not limited to being determined based on the local video decoding type of the terminal device; the target frame rate information supported by the video decoding capability may be but is not limited to being determined by the frame rate information supported by the above-mentioned video decoding type; wherein different video decoding types use different hardware devices of the terminal devices, and thus the frame rate information of the video frame rates supported by different video decoding types may be different, thereby different terminal devices may have different video decoding capabilities, and the target frame rate information supported by different video decoding capabilities may also be different.

[0095] Specifically, the above-mentioned video decoding type in the embodiment of the present application may include but is not limited to hardware decoding and software decoding, and further, the above-mentioned target frame rate information in the embodiment of the present application may be but is not limited to being determined by the frequency information supported by at least one video decoding type among the above-mentioned hardware decoding and software decoding; hardware decoding refers to a method in which the terminal device decodes and processes the acquired video together with a local processor and other components except the above-mentioned local processor, and software decoding refers to a method in which the terminal device decodes and processes the acquired video only with its own processor; wherein the processor involved in the embodiment of the present application may include but is not limited to at least one processor of a main processor and an auxiliary processor.

[0096] Specifically, when the target frame rate information is determined by the frame rate information supported by hardware decoding, the terminal device can directly obtain the frame rate information supported by its hardware decoding through the target program interface, and determine the obtained frame rate information as the above-mentioned target frame rate information; if the terminal device is an Android device, the Shanshu target program interface can be but is not limited to the interface of the Android system MediaCodec, and then the terminal device can call the getSupportedFrameRatesFor() method through the Android system MediaCodec interface to obtain the frame rate information supported by the terminal device.

[0097] As an embodiment, when the target frame rate information is determined by the frame rate information supported by hardware decoding, the terminal device can also determine the frame rate information mapped by its own device information as the above-mentioned target frame rate information according to a first preset mapping relationship between the pre-created device information and the frame rate information, wherein the device information of the terminal device can include but is not limited to at least one of the device manufacturer, device type, device system information, etc. of the terminal device; the above-mentioned first preset mapping relationship can be obtained in advance through testing.

[0098] As an embodiment, when the target frame rate information is determined by the frame rate information supported by software decoding, the terminal device can also determine the frame rate information mapped by the local processor of the terminal device as the above-mentioned target frame rate information based on a second preset mapping relationship between the pre-created processor and the frame rate information; the above-mentioned second preset mapping relationship can be obtained in advance through testing.

[0099] It should be noted that, in the embodiment of the present application, the frequency information supported by the video decoding type may also be a frame rate range consisting of a maximum supported frame rate and a minimum supported frame rate, the frame rate information may also be the above-mentioned maximum supported frame rate or the minimum supported frame rate, and the frame rate information may also be some discontinuous video frame rates supported by the above-mentioned video decoding type; wherein the above-mentioned maximum supported frame rate is the maximum value of the video frame rate supported by the above-mentioned video decoding type, and the above-mentioned minimum supported frame rate is the minimum value of the video frame rate supported by the above-mentioned video decoding type; therefore, the above-mentioned target frame rate information may be a frame rate range consisting of a maximum target supported frame rate and a minimum target supported frame rate of the above-mentioned video decoding capability (i.e., equivalent to at least one video decoding type), the target frame rate information may also be the maximum target supported frame rate or the minimum target supported frame rate of the above-mentioned video decoding capability, and the target frame rate information may also be some discontinuous video frame rates supported by the above-mentioned video decoding capability; wherein the above-mentioned maximum target supported frame rate is the maximum value of the video frame rate supported by the above-mentioned video decoding capability, and the above-mentioned minimum target supported frame rate is the minimum value of the video frame rate supported by the above-mentioned video decoding capability.

[0100] Specifically, when the video decoding capability is determined based on hardware decoding, the above-mentioned maximum target supported frame rate may be the maximum supported frame rate for hardware decoding, and the minimum target supported frame rate may be the minimum supported frame rate for hardware decoding; when the video decoding capability is determined based on software decoding, the above-mentioned maximum target supported frame rate may be the maximum supported frame rate for software decoding, and the minimum target supported frame rate may be the minimum supported frame rate for software decoding; when the video decoding capability is determined based on hardware decoding and software decoding, the above-mentioned maximum target supported frame rate may be the maximum value of the maximum supported frame rate for hardware decoding and the maximum supported frame rate for software decoding, and the minimum target supported frame rate may be the minimum value of the minimum supported frame rate for hardware decoding and the minimum supported frame rate for software decoding.

[0101] In the following content, several examples of the first preset mapping relationship and the second preset mapping relationship are given for ease of understanding.

[0102] When the device information of the terminal device includes the system category in the device system information, and the frame rate information is the maximum supported frame rate of hardware decoding, the above-mentioned first preset mapping relationship can be referred to in Table 1 below; when the device information includes the system version and device type of a device system in the device system information, and the frame rate range is the maximum supported frame rate of the hardware type, the above-mentioned first preset mapping relationship can be referred to in Table 2 below; when the device information is the system version of a device system in the device system information, and the frame rate range is the frame rate range composed of the minimum supported frame rate and the maximum supported frame rate of the hardware type, the above-mentioned first preset mapping relationship can be referred to in Table 3 below; wherein the above-mentioned device system category can include but is not limited to Android system, IOS system, Window system, Linux system, etc.

[0103] Table 1: Example 1 of the first preset mapping relationship

[0104] Equipment system category Maximum supported frame rate for hardware decoding Equipment system category 1 M1 Equipment system category 2 M2 … …

[0105] Table 2: Example 2 of the first preset mapping relationship

[0106] Device Type 1 Device Type 2 … System version 1 M11 M12 … System version 2 M21 M22 … … … … …

[0107] The video decoding capability of the terminal device in Table 2 is jointly determined by the device type of the terminal device and the system version of the terminal device, where M11 is the maximum supported frame rate of hardware decoding corresponding to device type 1 and system version 1, M12 is the maximum supported frame rate of hardware decoding corresponding to device type 2 and system version 1, M21 is the maximum supported frame rate of hardware decoding corresponding to device type 1 and system version 2, and M22 is the maximum supported frame rate of hardware decoding corresponding to device type 2 and system version 2.

[0108] Table 3: Example 3 of the first preset mapping relationship

[0109] System version Frame rate range supported by hardware decoding System version 1 E1~E2 System version 2 E3~E4 … …

[0110] Among them, E1 to E4 in Table 3 are video frame rates, and E1 is not greater than E2, and E3 is not greater than E4.

[0111] The following provides two examples of the second preset mapping relationship, please refer to the following Table 4 and Table 5.

[0112] Table 4: Example 1 of the second preset mapping relationship

[0113] Maximum supported frame rate for software decoding Processor 1 M3 Processor 2 M4

[0114] Table 5: Example 2 of the second preset mapping relationship

[0115]

[0116] As an embodiment, in order to improve the flexibility of the terminal device in obtaining the target download address, the embodiments of the present application provide a variety of ways for the terminal device to obtain the above-mentioned target download address based on its own video decoding capability; specifically, the terminal device can indicate the above-mentioned target frame rate information to the video content server, so that the video content server directly returns the corresponding target download address; or after the terminal device indicates a request for a video to be played to the video content server, based on the above-mentioned target frame rate information, a target frame rate is determined from at least one video frame rate of the video to be played returned by the video content server, and the target download address of the video to be played with the target frame rate is obtained. The detailed method for the terminal device to obtain the target download address will be specifically described in the following content.

[0117] As an embodiment, the following is a detailed description of the manner in which the terminal device 100 obtains the target download address in the above step S202. Figure 4 In the embodiment of the present application, the terminal device 100 can obtain the above target download address in the following three ways, but is not limited to:

[0118] The first target download address acquisition method: the terminal device indicates the target frame rate indication information to the video content server, and then the video content server directly returns the target download address.

[0119] Step S401: determining frame rate indication information based on the frame rate information supported by the video decoding capability of the terminal device, where the frame rate indication information includes a target frame rate or the frame rate information supported by the video decoding capability.

[0120] That is, the terminal device determines the target frame rate information or the target frame rate determined from the target frame rate information as the frame rate indication information.

[0121] Step S402: Send a video request to a video content server, where the video request carries identification information of the video to be played and the above frame rate indication information.

[0122] Step S403: receiving a target download address returned by the video content server, where the target download address is determined by the video content server according to the identification information of the video to be played and the frame rate indication information.

[0123] The manner in which the server determines the target download address based on the identification information and frame rate indication information of the video to be played will be described in detail below.

[0124] It should be noted that the target frame rate in the embodiment of the present application may include one video frame rate or multiple video frame rates. When the target frame rate includes multiple video frame rates, before step S403, the video content server will return multiple target download addresses of videos to be played with multiple different target frame rates. In this case, the terminal device can determine a target download address from the multiple target download addresses received in step S403 based on the network environment of the terminal device or the processor occupancy rate or other information, and use the determined target download address to obtain the video to be played with the final target frame rate.

[0125] The second way to obtain the target download address:

[0126] Step S404: Send a video request to the video content server, where the video request carries identification information of the video to be played.

[0127] Step S405: receiving at least one video frame rate of the to-be-played video returned by the video content server.

[0128] The at least one video frame rate is a video frame rate of the video to be played that is determined by the video content server based on the identification information of the video to be played and can be provided by the video content server.

[0129] Step S406: determining a target frame rate from at least one received video frame rate based on the frame rate information supported by the video decoding capability of the terminal device.

[0130] That is, the terminal device can determine, based on the target frame rate information, from the at least one video frequency as the target frame rate, a video frame rate that matches the target frame rate information.

[0131] Specifically, when the target frame rate information is a frame rate range consisting of a maximum target supported frame rate and a minimum target supported frame rate, the terminal device can determine a video frame rate or multiple video frame rates as the target frame rate from the video frame rates in the frame rate range of the above-mentioned at least one video frequency; when the target frame rate information is the above-mentioned maximum target supported frame rate, the terminal device can determine a video frame rate or multiple video frame rates as the target frame rate from the video frame rates in the above-mentioned at least one video frequency that are not greater than the maximum target supported frame rate; when the target frame rate information is the above-mentioned minimum target supported frame rate, the terminal device can determine a video frame rate or multiple video frame rates as the target frame rate from the video frame rates in the above-mentioned at least one video frequency that are not less than the minimum target supported frame rate.

[0132] Step S407: Indicate the determined target frame rate to the video content server.

[0133] Step S408: receiving a target download address returned by the video content server, where the target download address is determined by the video content server based on the target frame rate.

[0134] The manner in which the server determines the target download address based on the target frame rate will be described in detail below.

[0135] The third way to obtain the target download address:

[0136] Step S409: Send a video request to the video content server, where the video request carries identification information of the video to be played.

[0137] Step S410: receiving at least one to-be-downloaded address indicated by a video content server, wherein each to-be-downloaded address is a download address of a to-be-played video of a video frame rate.

[0138] Step S411, determining a target frame rate based on frame rate information supported by the video decoding capability of the terminal device.

[0139] Step S412: Determine, from the received at least one address to be downloaded, an address to be downloaded corresponding to the target frame rate as the target download address.

[0140] In the above steps S411 and S412, the terminal device can determine the target frame rate from at least one video frame rate indicated by at least one address to be downloaded based on the target frame rate information; and then directly determine the address to be downloaded indicating the target frame rate in at least one address to be downloaded as the target download address. The specific process of the terminal device determining the target frame rate from at least one video frame rate based on the target frame rate information can be found in the content of the above step S406, which will not be repeated here.

[0141] In the above steps S411 and S412, the terminal device can also directly determine the target frame rate from the video frame rates supported by the target frame rate information based on the target frame rate information; and then directly determine one of the to-be-downloaded addresses whose video frame rate indicated in at least one to-be-downloaded address is not greater than the target frame rate as the target download address, or directly determine the to-be-downloaded address whose video frame rate indicated in at least one to-be-downloaded address is not greater than the target frame rate and is closest to the target frame rate as the target download address; when the above target frame rate information is a frame rate range composed of a maximum target supported frame rate and a minimum target supported frame rate, the video frame rates supported by the target frame rate information include video frame rates within the frame rate range; when the above target frame rate information is the above maximum target supported frame rate, the video frame rates supported by the target frame rate information include video frame rates not greater than the frame rate range; when the above target frame rate information is the above minimum target supported frame rate, the video frame rates supported by the target frame rate information include video frame rates not less than the frame rate range.

[0142] The following content of the embodiment of the present application further explains the playback process of the video to be played in step S204.

[0143] The actual playback frame rate in the embodiment of the present application can be determined based on the video frame rate of the video being played and the video playback mode, and the above-mentioned video playback mode can be but is not limited to a playback mode including a preset filter style or a multiple-speed playback mode; wherein the video playback mode is a multiple-speed playback mode, in the embodiment of the present application, the actual playback frame rate of the video to be played at the target frame rate can be determined based on the target frame rate and the video playback multiple speed, such as being but not limited to determining the product of the target frame rate and the video playback multiple speed as the above-mentioned actual playback frame rate, and the above-mentioned video playback multiple speed can be indicated by the user through the video playback page of the video to be played, as shown in FIG. Figure 5 , the user can trigger the setting of the video progress of the video to be played through the speed setting button 5002 in the video playback page 5001. For example, after the user clicks or long presses the speed setting button 5002, the video playback page 5003 is displayed on the terminal device, and then the user can indicate the video playback speed through the preset playback speed in the speed selection box 5004; the above preset playback speed can be but is not limited to 0.5X, 0.75X, 1.0X, 1.25X, 1.75X or 2.0X as shown in the figure, wherein 0.5X, 0.75X, 1.0X, 1.25X, 1.75X or 2.0X respectively represent playing the video to be played at a speed of 0.5 times, 0.75 times, 1.0 times, 1.25 times, 1.75 times and 2.0 times the original playback speed of the video to be played.

[0144] In the embodiment of the present application, some video frames in the video to be played at the target frame rate can be discarded in a variety of ways; for example, some video frames in the video to be processed at the target frame rate can be randomly discarded; or a second number of video frames can be discarded from a first number of consecutive video frames in the video frames to be processed of the target video; the above-mentioned first number and second number can be determined based on the relationship between the actual playback frame rate and the screen refresh rate, and the first number is not less than the second number. The specific method of frame loss processing is exemplarily introduced below.

[0145] As an embodiment, in the embodiment of the present application, during the process of playing the video to be played at the target frame rate, the screen refresh rate can be updated in real time based on at least one information such as the power status of the terminal device, the network environment, the video playback mode, or the screen refresh rate updated by the user, and the actual playback frame rate can be updated based on the video playback mode.

[0146] Furthermore, the terminal device can monitor the actual playback frame rate and the screen refresh rate in real time. If it is determined that one of the actual playback frame rate and the screen refresh rate has changed, then determine whether the actual playback frame rate is greater than the screen refresh rate; if it is determined that the actual playback frame rate is greater than the screen refresh rate, then determine the first number and the second number of frame loss processing, and perform frame loss processing based on the first number and the second number. At the same time, continue to monitor the actual playback frame rate and the screen refresh rate. If it is determined again that one of the actual playback frame rate and the screen refresh rate has changed, then re-determine whether the actual playback frame rate is greater than the screen refresh rate, and after determining that the actual playback frame rate is greater than the screen refresh rate, redetermine the first number and the second number of frame loss processing, and perform frame loss processing based on the re-determined first number and second number, until the playback of the video to be played at the target frame rate is completed.

[0147] The terminal device can also determine whether the actual playback frame rate is greater than the screen refresh rate before playing each video frame. If it is determined that the actual playback frame rate is greater than the screen refresh rate, it is determined whether the video frame needs to be discarded. If the number of video frames between the video frame and the last discarded video frame is less than a preset threshold, it is determined that the video frame does not need to be discarded, and the video frame is played. If the number of video frames between the video frame and the last discarded video frame is not less than the preset threshold, the video frame is directly discarded. There is no limitation on the above-mentioned preset threshold, such as it can be but not limited to being set to 2, 3 or 4, etc., to avoid dropping multiple consecutive video frames and affecting the quality of the video to be played.

[0148] Specifically, in the embodiment of the present application, the first quantity and the second quantity may be determined in the following manner but is not limited thereto:

[0149] A first ratio of an actual playback frame rate to a screen refresh frequency is determined, and a first quantity and a second quantity are determined based on the first ratio, wherein a second ratio of the first quantity to a target difference is not less than the first ratio, and the target difference is a difference between the first quantity and the second quantity. For details, see the following formula 1:

[0150]

[0151] In Formula 1, x is the first quantity, y is the second quantity, finalFrameRate is the actual playback frame rate, and curRefreshRate is the screen refresh rate.

[0152] As an embodiment, when performing frame loss processing, the frame loss interval may also be determined based on the first ratio, such as obtaining the frame loss reference value retor based on the following formula 2:

[0153]

[0154] In formula 2, inalFrameRate is the actual playback frame rate, curRefreshRate is the screen refresh rate, and round() is the rounding operation;

[0155] If the frame loss reference value retor obtained based on formula 2 is 1, the frame loss gap dropFramneGap can be set to 2, which means that one video frame is discarded every two video frames; if the frame loss reference value retor obtained based on formula 2 is 2, the frame loss gap dropFramneGap can be set to 1, which means that one video frame is discarded every other video frame, and so on.

[0156] Please refer to Figure 6 , a schematic diagram showing the process of video playback control designed in an embodiment of the present application, which is applied to the above-mentioned video content server 200, is as follows:

[0157] Step S601, receiving a video request sent by a terminal device, and proceeding to the following step S602 or step S603 or step S604 based on the information content carried in the video request.

[0158] If the video request carries the identification information and frame rate indication information of the video to be played, then go to step S602; if the video request only carries the identification information of the video to be played, then go to step S603 or step S604; the above frame rate indication information is determined based on the frame rate information supported by the video decoding capability of the terminal device, and the frame rate indication information includes the target frame rate or the above frame rate information. The specific content of the frame rate indication information can be found in the above description and will not be repeated here.

[0159] Step S602: Determine a target download address of the video to be played at a target frame rate according to the identification information of the video to be played and the frame rate indication information, and return the target download address to the terminal device.

[0160] In this step, when the frame rate indication information is frame rate information (such as the above-mentioned target frame rate information), the video content server can determine that the video frame rate matching the target frame rate information is the target frame rate from at least one video frame rate of the video to be played provided by itself, and then send the download address of the video to be played with the target frame rate as the target download address to the terminal device; specifically, when the target frame rate information is a frame rate range consisting of a maximum target supported frame rate and a minimum target supported frame rate, the video content server can determine that one or more video frame rates are the target frame rate from the video frame rates belonging to the frame rate range in the above-mentioned at least one video frequency; when the target frame rate information is the above-mentioned maximum target supported frame rate, the video content server can determine that one or more video frame rates are the target frame rate from the video frame rates that are not greater than the maximum target supported frame rate in the above-mentioned at least one video frequency; when the target frame rate information is the above-mentioned minimum target supported frame rate, the video content server can determine that one or more video frame rates are the target frame rate from the video frame rates that are not less than the minimum target supported frame rate in the above-mentioned at least one video frequency.

[0161] When the frame rate indication information is a target frame rate, the download address of the to-be-played video of the target frame rate is directly determined as the target download address.

[0162] Step S603, returning at least one video frame rate of the video to be played to the terminal device, receiving a target frame rate determined by the terminal device based on the at least one video frame rate, and determining a target download address of the video to be played with the target frame rate, and returning the target download address to the terminal device.

[0163] Specifically, when the video content server returns at least one video frame rate of the video to be played to the terminal device, it can determine at least one video frame rate of the video to be played that it can provide based on the identification information of the video to be played, and return the at least one video frame rate to the terminal device.

[0164] As an embodiment, if the target frame rate received by the video content server is one, the download address of the video to be played at the target frame rate can be determined as the target download address and returned to the terminal device; if the target frame rate received by the video content server is multiple, the download addresses of the videos to be played at the multiple target frame rates can all be determined as the target download address, and the multiple target download addresses can be returned to the terminal device, and the terminal device selects one target download address from the multiple target download addresses to obtain the corresponding video to be played; or when the target frame rate received by the video content server is multiple, one target frame rate is determined from the multiple target frame rates, and the download address of the video to be played at the determined target frame rate is determined as the target download address and returned to the terminal device.

[0165] In the above content, the video content server can, but is not limited to, determine a target frame rate from multiple target frame rates in the following manner: randomly determine a target frame rate from multiple target frame rates; or, determine the maximum target frame rate among multiple target frame rates; or, determine the minimum target frame rate among multiple target frame rates, etc.

[0166] Step S604, indicating at least one address to be downloaded to the terminal device, so that the terminal device determines the address to be downloaded corresponding to the target frame rate from the above-mentioned at least one address to be downloaded as the above-mentioned target download address, wherein each address to be downloaded is a download address of a video to be played at a video frame rate, and the above-mentioned target frame rate is determined based on the frame rate information supported by the video decoding capability of the above-mentioned terminal device.

[0167] Specifically, after receiving the video request, the video content server determines at least one video frame rate of the video to be played that it can provide based on the identification information of the video to be played, and determines the download address of the video to be played with the above-mentioned at least one video frame rate as the above-mentioned at least one address to be downloaded, and sends the above-mentioned at least one address to be downloaded to the terminal device, and then the terminal device can determine the target download address from multiple addresses to be downloaded through the above-mentioned steps S411 and S412.

[0168] In order to facilitate a clearer understanding of the specific process of the video playback control method in the embodiment of the present application, several interaction examples of the video playback control method are given below from the perspective of the interaction between the terminal device, the video content server and the video storage server.

[0169] Example 1:

[0170] See also Figure 7 , the example specifically includes the following steps:

[0171] Step S701: The terminal device receives a play instruction for a video to be played.

[0172] Step S702: The terminal device determines frame rate indication information based on target frame rate information supported by its own video decoding capability.

[0173] Step S703: The terminal device sends a video request to the video content server. The video request carries identification information and frame rate indication information of the video to be played.

[0174] Step S704: the video content server determines a target download address of the video to be played at a target frame rate according to the identification information of the video to be played and the frame rate indication information.

[0175] Specifically, when the frame rate indication information is the target frame rate information, the video content server determines the target download address through the following steps S7041 and S7042; when the frame rate indication information is the target frame rate, the video content server determines the target download address through the following step S7043.

[0176] Step S7041, the video content server determines, from at least one video frame rate of the to-be-played video provided by it, a video frame rate that matches the target frame rate information as the target frame rate;

[0177] Step S7042: The video content server uses the download address of the to-be-played video at the target frame rate as the target download address.

[0178] Step S7043: The video content server determines the received download address of the to-be-played video at the target frame rate as the target download address.

[0179] Step S705: the video content server sends the target download address to the terminal device.

[0180] Step S706: The terminal device obtains the to-be-played video with the target frame rate from the video storage server according to the received target download address.

[0181] Specifically, when the terminal device receives only one target download address, the terminal device obtains the video to be played at the target frame rate from the video storage server only based on the target download address; when the terminal device receives multiple target download addresses, the terminal device can determine one target download address from the multiple target download addresses received based on the network environment of the terminal device or the occupancy rate of the local processor or other information, and use the determined target download address to obtain the video to be played at the final target frame rate.

[0182] Step S707: The terminal device plays the acquired video to be played at the target frame rate.

[0183] Example 2:

[0184] See also Figure 8 , the example specifically includes the following steps:

[0185] Step S801: The terminal device receives a play instruction for a video to be played.

[0186] Step S802: The terminal device sends a video request to the video content server, where the video request carries identification information of the video to be played.

[0187] Step S803: the video content server determines at least one video frame rate of the provided video to be played.

[0188] Step S804: the video content server returns at least one video frame rate of the video to be played to the terminal device.

[0189] Step S805: The terminal device receives at least one video frame rate of the video to be played, and determines a target frame rate from the at least one received video frame rate based on target frame rate information supported by its own video decoding capability.

[0190] Step S806: The terminal device indicates the determined target frame rate to the video content server.

[0191] Step S807: the video content server receives the target frame rate sent by the terminal device, and based on the received target frame rate, determines the download address of the to-be-played video with the target frame rate as the target download address.

[0192] Step S808: The video content server returns the target download address to the terminal device.

[0193] Step S809: The terminal device obtains the to-be-played video with the target frame rate from the video storage server according to the received target download address.

[0194] Step S810: The terminal device plays the acquired video to be played at the target frame rate.

[0195] Example 3:

[0196] See also Fig. 9 , the example specifically includes the following steps:

[0197] Step S901: The terminal device receives a play instruction for a video to be played.

[0198] Step S902: The terminal device sends a video request to the video content server, where the video request carries identification information of the video to be played.

[0199] Step S903: the video content server determines at least one video frame rate of the provided video to be played.

[0200] Step S904: the video content server determines a download address of the to-be-played video of the at least one video frame rate as at least one address to be downloaded.

[0201] Step S905: the video content server sends the at least one address to be downloaded to the terminal device.

[0202] Step S906: The terminal device determines the target frame rate based on the target frame rate information supported by its own video decoding capability.

[0203] Step S907: The terminal device determines, from the received at least one address to be downloaded, an address to be downloaded corresponding to the target frame rate as a target download address.

[0204] Step S908: The terminal device obtains the to-be-played video with the target frame rate from the video storage server according to the root target download address.

[0205] Step S909: the terminal device plays the acquired video to be played at the target frame rate.

[0206] The following content of the embodiment of the present application provides a specific example of a video playback control method.

[0207] See also Fig.10 , a principle framework diagram of a video playback control method applied to a terminal device 100 is provided, the principle framework diagram includes a decoding capability evaluation module 1001, a download address acquisition module 1002, a video decoding module 1003, a screen refresh detection module 1004, a frame loss processing module 1005, and a video rendering module 1006; wherein:

[0208] The decoding capability evaluation module 1001 is used to determine target frame rate information supported by the video decoding capability of the terminal device based on frame rate information supported by at least one video decoding type of the terminal device 100 .

[0209] The download address acquisition module 1002 is used to obtain the target download address of the video to be played with the target frame rate from the video content server 200 based on the target frame rate information supported by the video decoding capability of the terminal device; the specific method for the terminal device to obtain the target download address can be referred to above Figure 4 The relevant content will not be repeated here.

[0210] The video decoding module 1003 is used to play the video to be played at the target frame rate based on the target download address; specifically, first, according to the target download address, the video to be played at the target frame rate (generally compressed data) is obtained from the video storage server 300; then, the obtained video to be played is simply processed to obtain the audio and video data packets corresponding to the video to be played, and stored in the player queue; finally, the stored audio and video data packets are taken out from the player queue, and the corresponding audio and video decoders are used to decode them respectively, and then the video frames obtained by the decoding are passed to the frame loss processing module 1005; because when obtaining the video to be played at the target frame rate, the video decoding capability of the terminal device has been used, so the terminal device can normally decode the obtained audio and video data packets of the video to be played.

[0211] The screen refresh detection module 1004 is used to detect the logic of the screen refresh rate that the terminal device can support, and can dynamically detect the process of the screen refresh rate change of the terminal device; wherein the screen refresh rate can be obtained through the relevant interface of the user interface of the device system, and the device system can also provide an event callback for the change of the screen refresh rate; specifically, after starting to play the video to be played, the screen refresh detection module 1004 can obtain the current screen refresh rate of the terminal device according to the relevant interface of the above-mentioned user interface, and pass the obtained screen refresh rate value to the frame loss processing module 1005; and during the playback of the video to be played, when the screen refresh rate changes due to changes in the power of the terminal device, changes in the network environment, user switching of the screen refresh rate, or other reasons, the interface callback for the change in the screen refresh rate in the screen refresh detection module 1004 will have a corresponding event trigger, and then the screen refresh detection module 1004 can obtain the updated screen refresh rate through the triggering of the callback event, and pass the updated screen refresh rate to the frame loss processing module 1005 in real time.

[0212] The frame loss processing module 1005 is used to monitor the actual playback frame rate and the screen refresh rate in real time, and determine whether to perform frame loss processing on the video to be played at the target frame rate based on the relationship between the actual playback frame rate and the screen refresh frame rate, and pass the video frames retained after the frame loss processing or the video frames that have not been processed to the video rendering module 1006.

[0213] Specifically, when the above-mentioned frame loss processing module 1005 starts to play the video to be played with the target frame rate, it obtains the current screen refresh rate curRefreshRate of the terminal device and saves curRefreshRate; and monitors the actual playback frame rate finalFrameRate and the screen refresh rate curRefreshRate in real time; wherein when the screen refresh rate changes, the screen refresh detection module 1004 will call the callback interface of the screen refresh rate change, and pass the changed screen refresh to the frame loss processing module 1005, and then the frame loss processing module will update the changed screen refresh rate to newRefreshRate; at the same time, if certain operations of the user or the device environment of the terminal device change, resulting in a change in the actual playback frame rate, the frame loss processing module 1005 can update the changed actual playback frame rate to finalFrameRate.

[0214] Furthermore, when the frame loss processing module 1005 monitors that one of the actual playback frame rate and the screen refresh rate has changed, it compares the size relationship between finalFrameRate and curRefreshRate. If finalFrameRate is less than or equal to curRefreshRate, it indicates that the current screen refresh rate supports the video rendering module 1006 to normally render the video frames of the video to be played at the target frame rate. At this time, no frame loss processing is performed on the video to be played at the target frame rate; if finalFrameRate is greater than curRefreshRate, it indicates that the current screen refresh rate cannot satisfy the video rendering module 1006 to normally render the video frames of the video to be played at the target frame rate. At this time, frame loss processing is performed on the video to be played at the target frame rate. The specific process of frame loss processing for the video to be played at the target frame rate can be found in the above content and will not be repeated here.

[0215] The video rendering module 1006 renders the video frames returned by the frame loss processing module 1005, and displays the rendered video frames on the screen of the terminal device to play the rendered video frames of the video to be played at the target frame rate.

[0216] In the embodiment of the present application, the video to be played of the target frame rate supported by the terminal device is obtained based on the video decoding capability of the terminal device itself, so that the decoding processing and playback of the video to be played can be quickly completed according to its video decoding capability, thereby avoiding the phenomenon that the video decoding takes a long time due to the fact that its video decoding capability cannot meet the decoding requirements of the video frame rate of the video to be played, thereby reducing the occurrence of video playback jams due to the long video decoding time, improving the smoothness of video playback, and enabling the terminal device to play the target video with a larger frame rate supported by it; and on the other hand, during the playback of the video to be played, it can be based on the actual playback frame rate and screen refresh rate in real time. When the screen refresh rate is lower than the actual playback frame rate, part of the video frames of the terminal to be played can be evenly discarded, thereby improving the smoothness of video playback on the terminal device.

[0217] Please refer to Fig.11 Based on the same inventive concept, the embodiment of the present application provides a video playback control device 1100, including:

[0218] The instruction receiving unit 1101 is used to receive a play instruction for a video to be played;

[0219] The download address acquisition unit 1102 is used to acquire, based on the video decoding capability of the terminal device, a target download address of a to-be-played video having a video frame rate of a target frame rate from a video content server; the target frame rate is a video frame rate supported by the video decoding capability;

[0220] The video download unit 1103 is used to obtain the to-be-played video with a target frame rate according to the target download address;

[0221] The video playing unit 1104 is used to play the to-be-played video at the above target frame rate.

[0222] As an embodiment, the download address obtaining unit 1102 is specifically used for:

[0223] Based on the frame rate information supported by the video decoding capability of the terminal device, frame rate indication information is determined, where the frame rate indication information includes the target frame rate or the frame rate information; a video request is sent to the video content server, where the video request carries the identification information of the video to be played and the frame rate indication information; and a target download address returned by the video content server is received, where the target download address is determined by the video content server according to the identification information of the video to be played and the frame rate indication information.

[0224] As an embodiment, the download address obtaining unit 1102 is specifically used for:

[0225] Sending a video request to the video content server, wherein the video request carries identification information of the video to be played; receiving at least one video frame rate of the video to be played returned by the video content server; determining a target frame rate from the at least one video frame rate; indicating the target frame rate to the video content server; receiving a target download address returned by the video content server, wherein the target download address is determined by the video content server based on the target frame rate.

[0226] As an embodiment, the download address obtaining unit 1102 is specifically used for:

[0227] Send a video request to the video content server, wherein the video request carries identification information of the video to be played; receive at least one address to be downloaded indicated by the video content server, wherein each address to be downloaded is a download address of a video to be played at a video frame rate; determine a target frame rate based on frame rate information supported by a video decoding capability of the terminal device; and determine, from the at least one address to be downloaded, an address to be downloaded corresponding to the target frame rate as the target download address.

[0228] As an embodiment, the above-mentioned video decoding capability is determined based on the local video decoding type.

[0229] As an embodiment, the video playback unit 1104 is also used to: monitor the actual playback frame rate and screen refresh frequency; if it is determined that the actual playback frame rate is greater than the screen refresh frequency, discard some video frames in the to-be-played video with the target frame rate.

[0230] As an example, Fig.11 The device in can be used to implement any of the video playback control methods discussed above and applied on the terminal device 100.

[0231] Please refer to Fig.12 Based on the same inventive concept, the embodiment of the present application provides a video playback control device 1200, including:

[0232] The information receiving unit 1201 is used to receive a video request sent by a terminal device;

[0233] The information processing unit 1202 is configured to determine a target download address of the video to be played at a target frame rate according to the identification information of the video to be played and the frame rate indication information if the video request carries the identification information of the video to be played and the frame rate indication information, and return the target download address to the terminal device; the frame rate indication information is determined based on the frame rate information supported by the video decoding capability of the terminal device; the frame rate indication information includes the target frame rate or the frame rate information;

[0234] The above-mentioned information processing unit 1202 is used to return at least one video frame rate of the video to be played to the above-mentioned terminal device if the above-mentioned video request carries the identification information of the video to be played, and receive the target frame rate determined by the above-mentioned terminal device based on the above-mentioned at least one video frame rate, and determine the target download address of the video to be played with the above-mentioned target frame rate, and return the above-mentioned target download address to the above-mentioned terminal device; or indicate at least one address to be downloaded to the above-mentioned terminal device, so that the above-mentioned terminal device determines the address to be downloaded corresponding to the target frame rate from the above-mentioned at least one address to be downloaded as the above-mentioned target download address, wherein each address to be downloaded is a download address of the video to be played with a video frame rate, and the above-mentioned target frame rate is determined based on the frame rate information supported by the video decoding capability of the above-mentioned terminal device.

[0235] As an example, Fig.12 The device in can be used to implement any of the video playback control methods discussed above and applied to the video content server 200.

[0236] Based on the same inventive concept, an embodiment of the present application provides a terminal device, and the terminal device 100 is introduced below.

[0237] Please refer to Fig.13 The terminal device 100 includes a display unit 1340, a processor 1380 and a memory 1320, wherein the display unit 1340 includes a display panel 1341, which is used to display information input by a user or information provided to a user and various operation interfaces of a client of a video playback application, etc. In the embodiment of the present application, it is mainly used to display the interface, shortcut window, etc. of the client installed in the terminal device 100.

[0238] Optionally, the display panel 1341 may be configured in the form of a liquid crystal display (LCD) or an organic light-emitting diode (OLED).

[0239] The processor 1380 is used to read the computer program and then execute the method defined by the computer program. For example, the processor 1380 reads the video playback application, etc., so as to run the application on the terminal device 100 and display the interface of the application on the display unit 1340. The processor 1380 may include one or more general-purpose processors and may also include one or more DSPs (Digital Signal Processors) to perform related operations to implement the technical solutions provided in the embodiments of the present application.

[0240] The memory 1320 generally includes internal memory and external memory, and the internal memory may be a random access memory (RAM), a read-only memory (ROM), and a cache (CACHE), etc. The external memory may be a hard disk, an optical disk, a USB disk, a floppy disk, or a tape drive, etc. The memory 1320 is used to store computer programs and other data, and the computer program includes an application corresponding to the client, etc. Other data may include data generated after the operating system or the application is run, and the data includes system data (such as configuration parameters of the operating system) and user data. In the embodiment of the present application, program instructions are stored in the memory 1320, and the processor 1380 executes the program instructions in the memory 1320 to implement any of the video playback control methods applied to the terminal device 100 discussed in the previous figure.

[0241] In addition, the terminal device 100 may also include a display unit 1340 for receiving input digital information, character information or contact touch operation or non-contact gesture, and generating signal input related to user settings and function control of the terminal device 100. Specifically, in the embodiment of the present application, the display unit 1340 may include a display panel 1341. The display panel 1341 is, for example, a touch screen, which can collect the user's touch operation on or near it (such as the user's operation on the display panel 1341 or on the display panel 1341 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. Optionally, the display panel 1341 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the player's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact point coordinates, and then sends it to the processor 1380, and can receive and execute commands sent by the processor 1380. In an embodiment of the present application, if a user clicks on a client of a video playback application, the touch detection device in the display panel 1341 detects a touch operation, and sends a signal corresponding to the detected touch operation to a touch controller. The touch controller converts the signal into touch point coordinates and sends them to the processor 1380. The processor 1380 determines the operation that the user needs to perform based on the received touch point coordinates.

[0242] The display panel 1341 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the display unit 1340, the terminal device 100 may further include an input unit 1330, which may include, but is not limited to, an image input device 1331 and other input devices 1332, such as a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, and the like.

[0243] In addition to the above, the terminal device 100 may also include a power supply 1390 for supplying power to other modules, an audio circuit 1360, a near field communication module 1370, and an RF circuit 1310. The terminal device 100 may also include one or more sensors 1350, such as an acceleration sensor, a light sensor, a pressure sensor, etc. The audio circuit 1360 specifically includes a speaker 1361 and a microphone 1362, etc. For example, the terminal device 100 can collect the user's voice through the microphone 1362 and perform corresponding operations.

[0244] As an embodiment, the number of processors 1380 may be one or more, and the processor 1380 and the memory 1320 may be coupled or relatively independently configured.

[0245] As an example, Fig.13 The processor 1380 in can be used to implement the following Fig.11 The functions of the instruction receiving unit 1101, the download address obtaining unit 1102, the video downloading unit 1103 and the video playing unit 1104 are shown in FIG.

[0246] The video playback control device 1200 is an example of a hardware entity. Fig.14 The computer device shown includes a processor 1401 , a storage medium 1402 , and at least one external communication interface 1403 ; the processor 1401 , the storage medium 1402 , and the external communication interface 1403 are all connected via a bus 1404 .

[0247] The storage medium 1402 stores a computer program;

[0248] When the processor 1401 executes the computer program, the video playback control method for the video content server 200 discussed above is implemented.

[0249] Fig.14 In the figure, one processor 1401 is taken as an example, but the number of processors 1401 is not limited in practice.

[0250] The storage medium 1402 may be a volatile memory, such as a random-access memory (RAM); the storage medium 1402 may also be a non-volatile memory, such as a read-only storage medium, a flash memory, a hard disk drive (HDD) or a solid-state drive (SSD), or the storage medium 1402 may be any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The storage medium 1402 may be a combination of the above storage media.

[0251] As an example, Fig.14 The processor 1401 in the embodiment can be used to implement the following Fig.12 The functions of the information receiving unit 1201 and the information processing unit 1202.

[0252] As an embodiment, each aspect of the video playback control method provided in the embodiment of the present application can also be implemented in the form of a program product, which includes a program code. When the program product is run on a computer device, the program code is used to enable the computer device to execute the steps of the video playback control method according to various exemplary embodiments of the present application described above in this specification.

[0253] A person skilled in the art can understand that: all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), disks or optical disks, etc. Various media that can store program codes.

[0254] Alternatively, if the above-mentioned integrated unit of the invention is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present invention can be essentially or partly reflected in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the above-mentioned methods of each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROM, RAM, magnetic disks or optical disks.

[0255] Based on the same technical concept, the embodiment of the present application also provides a computer-readable storage medium, which stores computer instructions. When the above computer instructions are executed on a computer, the computer executes the video playback control method discussed above.

[0256] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0257] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A video playback control method, characterized in that: Applied to a video playback application, the video playback application is installed on a terminal device and includes: Receiving a playback instruction for a video to be played; Based on the video decoding capability of the terminal device, obtaining a target download address of a to-be-played video having a video frame rate of a target frame rate from a video content server; the target frame rate is a video frame rate supported by the video decoding capability; According to the target download address, obtain the video to be played with the target frame rate; Play the video to be played at the target frame rate; Wherein, when playing the to-be-played video at the target frame rate, the method further includes: Updating the screen refresh rate based on information of the terminal device, the information including at least one of power status, network environment, video playback mode, and screen refresh rate updated by a user; Updating the actual playback frame rate based on the video playback mode; Monitoring the actual playback frame rate and the screen refresh rate; If it is determined that the actual playback frame rate is greater than the screen refresh rate, a first ratio of the actual playback frame rate to the screen refresh rate is determined, a first quantity and a second quantity are determined based on the first ratio, and the first ratio is rounded to obtain a frame loss reference value, and frame loss processing is performed on the to-be-played video of the target frame rate based on the first quantity, the second quantity, and the frame loss reference value, wherein a second ratio of the first quantity to the target difference is not less than the first ratio, and the target difference is the difference between the first quantity and the second quantity; The step of obtaining, based on the video decoding capability of the terminal device, a target download address of a to-be-played video having a video frame rate of a target frame rate from a video content server comprises: Sending a video request to the video content server, wherein the video request carries identification information of the video to be played; receiving at least one address to be downloaded indicated by the video content server, wherein each address to be downloaded is a download address of the video to be played at a video frame rate; determining a target frame rate based on frame rate information supported by the video decoding capability of the terminal device; and determining, from the at least one address to be downloaded, an address to be downloaded corresponding to the target frame rate as the target download address.

2. The method according to claim 1, characterized in that The step of obtaining, based on the video decoding capability of the terminal device, a target download address of the to-be-played video having an encoding frame rate and a target frame rate from a video content server also includes: Determine frame rate indication information based on frame rate information supported by the video decoding capability of the terminal device, where the frame rate indication information includes the target frame rate or the frame rate information; Sending a video request to the video content server, wherein the video request carries the identification information of the video to be played and the frame rate indication information; A target download address returned by the video content server is received, where the target download address is determined by the video content server according to the identification information of the video to be played and the frame rate indication information.

3. The method according to claim 1, characterized in that The step of obtaining a target download address of a to-be-played video having a video frame rate of a target frame rate from a video content server based on the video decoding capability of the terminal device further includes: Sending a video request to the video content server, wherein the video request carries identification information of the video to be played; Receiving at least one video frame rate of the to-be-played video returned by the video content server; Determining a target frame rate from the at least one video frame rate; indicating the target frame rate to the video content server; A target download address returned by the video content server is received, where the target download address is determined by the video content server based on the target frame rate.

4. The method according to any one of claims 1 to 3, characterized in that: The video decoding capability is determined based on a local video decoding type.

5. A video playback processing method, characterized in that: include: Receiving a video request sent by a terminal device; If the video request carries identification information and frame rate indication information of the video to be played, determining a target download address of the video to be played at a target frame rate according to the identification information and the frame rate indication information of the video to be played, and returning the target download address to the terminal device; The frame rate indication information is determined based on the frame rate information supported by the video decoding capability of the terminal device; the frame rate indication information includes the target frame rate or the frame rate information; If the video request carries identification information of the video to be played, at least one video frame rate of the video to be played is returned to the terminal device, and a target frame rate determined by the terminal device based on the at least one video frame rate is received, and a target download address of the video to be played with the target frame rate is determined, and the target download address is returned to the terminal device; or at least one to-be-downloaded address is indicated to the terminal device, each to-be-downloaded address being a download address of a video to be played with a video frame rate, so that the terminal device determines the target frame rate based on the frame rate information supported by the video decoding capability, and determines the to-be-downloaded address corresponding to the target frame rate from the at least one to-be-downloaded address as the target download address, and obtains and plays the video to be played with the target frame rate according to the target download address, and updates the screen refresh rate based on information of the terminal device, wherein the information includes at least one of power status, network environment, video playback mode, and screen refresh rate updated by the user; Updating the actual playback frame rate based on the video playback mode; Monitoring the actual playback frame rate and the screen refresh rate; If it is determined that the actual playback frame rate is greater than the screen refresh rate, a first ratio of the actual playback frame rate to the screen refresh rate is determined, a first quantity and a second quantity are determined based on the first ratio, and the first ratio is rounded to obtain a frame loss reference value, and frame loss processing is performed on the video to be played at the target frame rate based on the first quantity, the second quantity and the frame loss reference value, wherein a second ratio of the first quantity to the target difference is not less than the first ratio, and the target difference is the difference between the first quantity and the second quantity; wherein each address to be downloaded is a download address of a video to be played at a video frame rate, and the target frame rate is determined based on the frame rate information supported by the video decoding capability of the terminal device.

6. A video playback control device, characterized in that: include: An instruction receiving unit, used to receive a play instruction for a video to be played; A download address acquisition unit, configured to acquire, based on the video decoding capability of the terminal device, a target download address of a to-be-played video having a video frame rate of a target frame rate from a video content server; The target frame rate is a video frame rate supported by the video decoding capability; A video download unit, used to obtain a to-be-played video with a target frame rate according to the target download address; A video playing unit, used for playing the to-be-played video at the target frame rate; Wherein, the video playback unit is also used for: Updating the screen refresh rate based on information of the terminal device, the information including at least one of power status, network environment, video playback mode, and screen refresh rate updated by a user; Updating the actual playback frame rate based on the video playback mode; Monitoring the actual playback frame rate and the screen refresh rate; If it is determined that the actual playback frame rate is greater than the screen refresh rate, a first ratio of the actual playback frame rate to the screen refresh rate is determined, a first quantity and a second quantity are determined based on the first ratio, and the first ratio is rounded to obtain a frame loss reference value, and frame loss processing is performed on the to-be-played video of the target frame rate based on the first quantity, the second quantity, and the frame loss reference value, wherein a second ratio of the first quantity to the target difference is not less than the first ratio, and the target difference is the difference between the first quantity and the second quantity; The step of obtaining, based on the video decoding capability of the terminal device, a target download address of a to-be-played video having a video frame rate of a target frame rate from a video content server comprises: Sending a video request to the video content server, wherein the video request carries identification information of the video to be played; receiving at least one address to be downloaded indicated by the video content server, wherein each address to be downloaded is a download address of the video to be played at a video frame rate; determining a target frame rate based on frame rate information supported by the video decoding capability of the terminal device; and determining, from the at least one address to be downloaded, an address to be downloaded corresponding to the target frame rate as the target download address.

7. A video playback control device, characterized in that: include: An information receiving unit, used for receiving a video request sent by a terminal device; an information processing unit, configured to determine, if the video request carries identification information and frame rate indication information of the video to be played, a target download address of the video to be played at a target frame rate according to the identification information of the video to be played and the frame rate indication information, and return the target download address to the terminal device; the frame rate indication information is determined based on frame rate information supported by the video decoding capability of the terminal device; the frame rate indication information includes the target frame rate or the frame rate information; The information processing unit is configured to return at least one video frame rate of the video to be played to the terminal device if the video request carries identification information of the video to be played, receive a target frame rate determined by the terminal device based on the at least one video frame rate, and determine a target download address of the video to be played with the target frame rate, and return the target download address to the terminal device; or indicate at least one address to be downloaded to the terminal device, each address to be downloaded being a download address of a video to be played with a video frame rate, so that the terminal device determines the target frame rate based on the frame rate information supported by the video decoding capability, determines the address to be downloaded corresponding to the target frame rate from the at least one address to be downloaded as the target download address, obtains and plays the video to be played with the target frame rate according to the target download address, and updates the screen refresh rate based on information of the terminal device, wherein the information includes at least one of power status, network environment, video playback mode, and screen refresh rate updated by a user; Updating the actual playback frame rate based on the video playback mode; Monitoring the actual playback frame rate and the screen refresh rate; If it is determined that the actual playback frame rate is greater than the screen refresh rate, a first ratio of the actual playback frame rate to the screen refresh rate is determined, a first quantity and a second quantity are determined based on the first ratio, and the first ratio is rounded to obtain a frame loss reference value, and frame loss processing is performed on the video to be played at the target frame rate based on the first quantity, the second quantity and the frame loss reference value, wherein a second ratio of the first quantity to the target difference is not less than the first ratio, and the target difference is the difference between the first quantity and the second quantity; wherein each address to be downloaded is a download address of a video to be played at a video frame rate, and the target frame rate is determined based on the frame rate information supported by the video decoding capability of the terminal device.

8. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 4 or 5 are implemented.

Citation Information

Patent Citations

  • Video downloading method and device, computer equipment, storage medium and terminal

    CN109729385A

  • Live broadcast data processing method and device, computer equipment and storage medium

    CN111918093A