Playing control method and device, equipment and storage medium

Abstract

The invention provides a playing control method and device, equipment and a storage medium, and the method comprises the steps: responding to a playing control request, and obtaining target video data corresponding to the playing control request, and video data information associated with the target video data; determining a video playing state of the target video data according to the target video data and the video data information; and adjusting a playing bandwidth parameter of the target video data according to the video playing state and a target playing control strategy to obtain a playing control result. According to the technical scheme, the playing network state of the target video data in the online playing process can be determined according to the target video data and the corresponding video data information, and then the playing bandwidth parameter is dynamically adjusted according to the playing network state, so that the multimedia playing effect is improved, the multimedia playing lagging probability is reduced, and the user experience is improved. And the film watching experience of users is improved.

Description

Technical Field

[0001] This application relates to the field of computer technology, and particularly to a playback control method, apparatus, device, and storage medium. Background Art

[0002] Currently, with the rapid development of Internet technology and multimedia technology, more and more users use the Internet to play multimedia data such as videos online. However, when playing multimedia data online currently, since the multimedia playback module and the network control module are independent sub-modules, the network control module cannot perceive the network status of the multimedia playback module. As a result, when the multimedia playback module plays multimedia data, less playback bandwidth may be allocated to the multimedia, leading to playback anomalies such as playback stuttering and low clarity, and unable to meet the multimedia playback needs of users. Summary of the Invention

[0003] Embodiments of this application provide a playback control method, apparatus, device, and storage medium, aiming to solve the technical problem that online playback of multimedia content is prone to stuttering and low clarity in the prior art.

[0004] On the one hand, embodiments of this application provide a playback control method, and the playback control method includes the following steps:

[0005] Respond to a playback control request, obtain the target video data corresponding to the playback control request, and the video data information associated with the target video data;

[0006] Determine the video playback status of the target video data according to the target video data and the video data information;

[0007] Adjust the playback bandwidth parameter of the target video data according to the video playback status and the target playback control strategy to obtain a playback control result.

[0008] In a possible implementation manner of this application, the determining the video playback status of the target video data according to the target video data and the video data information includes:

[0009] Obtain the current playback video frame of the target video data and the target playback information in the video data information;

[0010] Perform video recognition on the current playback video frame to obtain the current playback information of the current playback video frame;

[0011] Determine the video playback status of the target video data according to the current playback information and the target playback information.

[0012] In a possible implementation manner of the present application, the video recognition of the current playing video frame to obtain the current playing information of the current playing video frame includes:

[0013] Perform grayscale conversion on the current playing video frame to obtain a currently converted video frame;

[0014] Extract an object from the currently converted video frame to obtain video object features;

[0015] Extract text from the currently converted video frame to obtain video text features;

[0016] Determine the current playing information of the current playing video frame according to the video object features and the video text features.

[0017] In a possible implementation manner of the present application, the determining the video playing state of the target video data according to the current playing information and the target playing information includes:

[0018] Determine the current progress information of the target video data according to the video object features and video text features of the current playing video frame;

[0019] Obtain the target playing video frame in the target playing information and the target progress information of the target playing video frame;

[0020] Determine the video playing state of the target video data according to the current progress information and the target progress information.

[0021] In a possible implementation manner of the present application, the determining the video playing state of the target video data according to the current progress information and the target progress information includes:

[0022] If the current progress information is equal to the target progress information, determine that the video playing state of the target video data is a smooth playing state;

[0023] If the current progress information is less than the target progress information, determine that the video playing state of the target video data is a stuttering playing state.

[0024] In a possible implementation manner of the present application, the adjusting the playing bandwidth parameter of the target video data according to the video playing state and the target playing control strategy to obtain a playing control result includes:

[0025] If the video playing state is a stuttering playing state, determine that the target playing control strategy is a first playing control strategy;

[0026] Adjust the playback bandwidth parameter of the target video data according to the first playback control strategy, the current playback video frame, and the target playback video frame to obtain a playback control result.

[0027] In a possible implementation manner of the present application, the adjusting the playback bandwidth parameter of the target video data according to the first playback control strategy, the current playback video frame, and the target playback video frame to obtain a playback control result includes:

[0028] Calculate the playback delay frames according to the current playback video frame and the target playback video frame;

[0029] Determine the bandwidth adjustment parameter of the target video data according to the first playback control strategy and the playback delay frames;

[0030] Adjust the playback bandwidth parameter according to the bandwidth adjustment parameter to obtain a playback control result.

[0031] In a possible implementation manner of the present application, the adjusting the playback bandwidth parameter of the target video data according to the video playback state and the target playback control strategy to obtain a playback control result includes:

[0032] If the video playback state is a smooth playback state, determine that the target playback control strategy is the second playback control strategy;

[0033] Reduce the playback bandwidth parameter according to the second playback control strategy, the current playback information of the target video data, and the preset smooth playback information to obtain a playback control result.

[0034] On the other hand, the present application provides a playback control device, and the playback control device includes:

[0035] A data acquisition module, configured to respond to a playback control request, acquire the target video data corresponding to the playback control request, and the video data information associated with the target video data;

[0036] A playback recognition module, configured to determine the video playback state of the target video data according to the target video data and the video data information;

[0037] A playback control module, configured to adjust the playback bandwidth parameter of the target video data according to the video playback state and the target playback control strategy to obtain a playback control result.

[0038] On the other hand, the present application further provides a playback control device, and the playback control device includes:

[0039] One or more processors;

[0040] A memory; and

[0041] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the steps of the playback control method.

[0042] On the other hand, the present application also provides a computer-readable storage medium, on which a computer program is stored. The computer program is loaded by a processor to execute the steps in the playback control method.

[0043] In the present application, by responding to a playback control request, target video data corresponding to the playback control request and video data information associated with the target video data are obtained; the video playback state of the target video data is determined according to the target video data and the video data information; the playback bandwidth parameter of the target video data is adjusted according to the video playback state and a target playback control strategy to obtain a playback control result. It is realized that by obtaining the target video data being played and the video data information associated with the target video data, it is determined whether the target video data has a state such as card delay through the target video data and the video data information, the video playback state corresponding to the target video data is obtained, and a target playback control strategy is determined according to the video playback state. The playback bandwidth parameter of the target video data is adjusted according to the video playback state and the target playback control strategy to obtain a playback control result. It is realized to determine the playback network state during the online playback of the target video data according to the target video data and the corresponding video data information, and then dynamically adjust the playback bandwidth parameter according to the playback network state, so as to improve the multimedia playback effect, reduce the probability of multimedia playback card, and improve the user's movie viewing experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative efforts.

[0045] Figure 1 It is a schematic diagram of the scenario of the playback control method in the embodiment of the present application;

[0046] Figure 2 It is a schematic flowchart of an embodiment of the playback control method in the embodiment of the present application;

[0047] Figure 3 It is a schematic flowchart of an embodiment of determining the video playback state in the playback control method provided by the embodiment of the present application;

[0048] Figure 4 It is a schematic flowchart of an embodiment for performing playback control in the playback control method provided by an embodiment of this application;

[0049] Figure 5 It is a schematic structural diagram of an embodiment of the playback control device provided by an embodiment of this application;

[0050] Figure 6 It is a schematic structural diagram of an embodiment of the playback control device provided by an embodiment of this application. Detailed implementation manners

[0051] Next, the technical solutions in the embodiments of this application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative efforts fall within the protection scope of the present invention.

[0052] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus cannot be understood as a limitation of the present invention. In addition, the terms "current" and "target" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity of the indicated technical features. Thus, the features defined with "current" and "target" may explicitly or implicitly include one or more of the above-mentioned features. In the description of the present invention, "a plurality" means two or more, unless otherwise specifically defined.

[0053] In this application, the term "exemplary" is used to mean "serving as an example, illustration, or description". Any embodiment described as "exemplary" in this application is not necessarily to be construed as more preferred or more advantageous than other embodiments. In order for any person skilled in the art to implement and use the present invention, the following description is given. In the following description, details are set forth for purposes of explanation. It should be understood by those skilled in the art that the present invention can be implemented without these specific details. In other instances, well-known structures and processes are not described in detail to avoid unnecessary details from obscuring the description of the present invention. Therefore, the present invention is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed in this application.

[0054] At present, with the rapid development of Internet technology and multimedia technology, more and more users use the Internet to play multimedia data such as videos online. However, when playing multimedia data online currently, since the multimedia playback module and the network control module are independent sub-modules, the network control module cannot perceive the network status of the multimedia playback module. As a result, when the multimedia playback module plays multimedia data, less playback bandwidth may be allocated to the multimedia, leading to abnormal playback situations such as playback stuttering and low clarity, and unable to meet the multimedia playback needs of users.

[0055] Based on this, the present application proposes a playback control method, device, equipment, and computer-readable storage medium to solve the technical problems of easy stuttering and low clarity in online multimedia content playback in the prior art.

[0056] The playback control method in the embodiments of the present invention is applied to a playback control device. The playback control device is set in a playback control device, and in the playback control device, there are one or more processors, a memory, and one or more application programs. Among them, one or more application programs are stored in the memory and are configured to be executed by the processor to implement the playback control method; among them, the playback control device can be an intelligent display terminal capable of playing multimedia video content, such as a mobile phone, a tablet computer, a smart TV, a virtual reality device, an augmented reality device, a mixed reality device, a smart wearable device, and a smart computer, etc.

[0057] As Figure 1 shown, Figure 1 is a schematic diagram of the scenario of the playback control method in the embodiments of the present application. In the embodiments of the present invention, the playback control scenario includes a playback control device 100 (the playback control device 100 integrates a playback control device). In the playback control device 100, a computer-readable storage medium corresponding to the playback control method runs to execute the steps of the playback control method.

[0058] It can be understood that Figure 1 the playback control device in the playback control method scenario shown, or the device included in the playback control device does not constitute a limitation to the embodiments of the present invention. That is, the number of devices of the playback control device, the types of devices included in the playback control method scenario, or the number of devices and the types of devices included in each device do not affect the overall implementation of the technical solution in the embodiments of the present invention, and can all be regarded as equivalent replacements or derivatives of the technical solution required to be protected in the embodiments of the present invention.

[0059] In the embodiments of the present invention, the playback control device 100 is mainly used for: responding to a playback control request, obtaining the target video data corresponding to the playback control request, and the video data information associated with the target video data;

[0060] Determine the video playback status of the target video data according to the target video data and the video data information;

[0061] Adjust the playback bandwidth parameter of the target video data according to the video playback status and the target playback control policy to obtain a playback control result.

[0062] The playback control device 100 in the embodiments of the present invention may be an independent playback control device, such as intelligent terminals such as mobile phones, tablet computers, smart TVs, virtual reality devices, augmented reality devices, mixed reality devices, smart wearable devices, and smart computers, or may be a playback control network or a playback control cluster composed of multiple playback control devices.

[0063] The embodiments of the present application provide a playback control method, apparatus, device, and computer-readable storage medium, which will be described in detail below.

[0064] Those skilled in the art can understand that Figure 1 the application environment shown is only one of the application scenarios related to the solution of the present application, and does not constitute a limitation on the application scenario of the solution of the present application. Other application environments may also include more or fewer playback control devices than Figure 1 shown, or the playback control network connection relationship. For example Figure 1 only one playback control device is shown in. It can be understood that the scenario of this playback control method may also include one or more playback control devices, which are not specifically limited here; the playback control device 100 may also include a memory for storing target video data and other data.

[0065] It should be noted that Figure 1 the schematic diagram of the scenario of the playback control method shown is only an example. The scenario of the playback control method described in the embodiments of the present invention is for more clearly explaining the technical solution of the embodiments of the present invention, and does not constitute a limitation on the technical solution provided by the embodiments of the present invention.

[0066] Based on the scenario of the above playback control method, various embodiments of the playback control method disclosed in the present invention are proposed.

[0067] As Figure 2 shown, Figure 2 is a schematic flowchart of an embodiment of the playback control method in the embodiments of the present application. The playback control method includes the following steps 201 to step 203:

[0068] 201. Respond to a playback control request, obtain the target video data corresponding to the playback control request, and the video data information associated with the target video data;

[0069] The playback control method in this embodiment is applied to a playback control device. The types and quantities of the playback control devices are not specifically limited. That is, the playback control device can be one or more intelligent display terminals capable of playing multimedia videos online. In a specific embodiment, the playback control device is any one or more of intelligent display terminals such as mobile phones, tablet computers, smart TVs, virtual reality devices, augmented reality devices, mixed reality devices, intelligent wearable devices, and intelligent computers.

[0070] Among them, the target video data is the multimedia video data in the online playback state in the multimedia application of the playback control device. That is, the target video data is the streaming media video data selected by the user and played in the multimedia application.

[0071] Among them, the video data information is the target video playback information representing the video playback state corresponding to the target video data when the network state is good during the playback process of the multimedia application. That is, the video data information is the expected video playback information corresponding to the target playback data in the normal playback state when the network state is good during the playback of the target video data by the multimedia application. Optionally, in a specific embodiment, the video data information includes at least one or more of the target video frame rate, target video resolution, target video bit rate, and target video frame.

[0072] Specifically, during the operation of the playback control device, it responds to a playback control request. Among them, the playback control request is a control event that drives the playback control device to adjust the playback network parameters when playing the target video data in the multimedia application. Optionally, the triggering method of the playback control request is not specifically limited here. That is, the playback control request can be actively triggered by the user. For example, when the user uses the multimedia application to play the target video data, by clicking the playback control button in the multimedia application, the playback control request is actively triggered. In addition, the playback control request can also be automatically triggered by the playback control device. For example, there is a playback control process set in the playback control device. When the multimedia application plays the target video data, the playback control process is automatically used to trigger the playback control request for the target video data.

[0073] Specifically, after obtaining the playback control request, the playback control device obtains the target video data corresponding to the playback control request and obtains the video data information associated with the target video data. That is, after obtaining the playback control request, the playback control device obtains the video data that the multimedia application is playing or about to play, determines the video data that the multimedia application is playing or about to play as the target video data to be controlled for playback, and accesses the media asset database corresponding to the multimedia application to determine the video data information associated with the target video data. Optionally, in a specific embodiment, the media asset database may be the stream server of the multimedia application.

[0074] 202. Determine the video playback state of the target video data according to the target video data and the video data information;

[0075] Specifically, after obtaining the target video data and the video data information, the playback control device also determines the video playback state of the target video data according to the target video data and the video data information. Among them, the video playback state is a differential playback state representing the difference between the actual playback state of the target video data and the target playback state corresponding to the video data information. Optionally, in a specific embodiment, the video playback state includes a smooth playback state and a stuttering playback state.

[0076] Optionally, in one embodiment, the smooth playback state is a multimedia playback state indicating that the actual playback progress of the target video data is faster than or equal to the target playback progress corresponding to the video data information.

[0077] Optionally, in another embodiment, the smooth playback state may also be a multimedia playback state indicating that the actual playback clarity / actual playback frame rate and / or actual playback bit rate of the target video data is higher than or equal to the target playback clarity / target playback video frame rate and / or target playback bit rate corresponding to the video data information.

[0078] Optionally, in one embodiment, the stuttering playback state is a multimedia playback state indicating that the actual playback progress of the target video data is slower than the target playback progress corresponding to the video data information.

[0079] Optionally, in another embodiment, the stuttering playback state may also be a multimedia playback state indicating that the actual playback clarity / actual playback frame rate and / or actual playback bit rate of the target video data is lower than the target playback clarity / target playback video frame rate and / or target playback bit rate corresponding to the video data information.

[0080] Specifically, the playback control device can obtain the current playback video frame of the target video data and the target playback information associated with the current playback node in the video data information. The current playback video frame is the target video playback frame corresponding to the current playback node during the online playback of the target video data by the multimedia application in the playback control device. The target playback information is the playback parameter information representing the ideal playback state when the multimedia application in the playback control device is at the current playback node during the online playback of the target video data. Optionally, in a specific embodiment, the target playback information may be at least one or more of the target video frame rate, target video resolution, target video bit rate, target video frame, and target progress information, etc.

[0081] Optionally, the playback control device can capture the current playback image of the target video data during the online playback of the target video data by the multimedia application through a preset image acquisition tool, and determine the current playback image as the current playback video frame of the target video data. The image acquisition tool can be any screenshot tool or a preset camera module.

[0082] Specifically, after obtaining the current playback video frame, the playback control device also performs video recognition on the current playback video frame to obtain the current playback information of the current playback video frame. The current playback information is the playback parameter information representing the actual playback state when the multimedia application in the playback control device is at the current playback node during the online playback of the target video data. Optionally, in a specific embodiment, the current playback information includes any one or more of the current video frame rate, current video resolution, current video bit rate, and current progress information.

[0083] Optionally, in a specific embodiment, the playback control device can perform pixel extraction and / or video content extraction on the current playback video frame to obtain the video pixel information and / or video content information of the current playback video frame, and determine the current playback information of the current playback video frame according to the video pixel information and / or video content information. The video pixel information is the pixel information representing the video pixel values and the number of video pixels of the current playback video frame.

[0084] Optionally, after obtaining the current video frame, the playback control device can use the pixel extraction module to extract the pixel information of the current playback video frame, thereby obtaining the video pixel information of the current playback video frame, and use the video pixel information to determine the current playback information such as the current video resolution and current video bit rate of the current playback video frame. Optionally, in a specific embodiment, the pixel extraction module can be an openCV module.

[0085] Optionally, after obtaining the current video frame, the playback control device also uses the content extraction module to extract the video content of the current played video frame to obtain the video content information of the current played video frame, and determines the current progress information of the current played video frame according to the video content information.

[0086] Specifically, after obtaining the current playback information of the current played video frame, the playback control device also determines the video playback state of the target video data according to the current playback information and the target playback information. That is, the playback control device compares the current playback information with the target playback information to determine whether abnormal playback problems such as playback jitter and poor playback effect occur during the actual online playback of the target video data, so as to determine the video playback state of the target video data.

[0087] Optionally, the playback control device can obtain any one of the current video frame rate, current video resolution, and current video bit rate in the current played video information, and compare it with any corresponding item of the target video frame rate, target video resolution, and target video bit rate in the target playback information, so as to determine the video playback state of the target played video. That is, if the playback control device determines that the current video frame rate, current video resolution, and current video bit rate are lower than the corresponding target video frame rate, target video resolution, and target video bit rate, it determines that the playback video state of the target video data is a jitter playback state.

[0088] Optionally, the playback control device can also obtain the current progress information in the current played video information and the target progress information in the target playback information, and determine the video playback state of the target video data according to the current progress information and the target progress information.

[0089] 203. Adjust the playback bandwidth parameter of the target video data according to the video playback state and the target playback control strategy to obtain a playback control result.

[0090] Specifically, after determining the video playback state of the target video data, the playback control device dynamically adjusts the playback bandwidth parameter of the target video data according to the video playback state and the target playback control strategy to obtain a playback control result. Wherein, the playback bandwidth parameter is a network bandwidth representing the online playback of the target video data.

[0091] Specifically, the playback control device is pre-set with a playback control strategy for dynamically adjusting the playback bandwidth parameter corresponding to different video playback states of the target video data. Wherein, the playback control strategy includes a first playback control strategy and a second playback control strategy.

[0092] Wherein, the first playback control strategy is a playback control strategy for dynamically increasing the playback bandwidth parameter when the video playback state is a jitter playback state.

[0093] The second playback control policy is a playback control policy that represents dynamically reducing the playback bandwidth parameter without affecting the video playback state when the video playback state is a smooth playback state.

[0094] Optionally, in a specific embodiment, after obtaining the video playback state of the target video data, the playback control device determines that the current progress information corresponding to the video playback state is the same as the target progress information, determines that the video playback state is a smooth playback state, determines that the current target playback control policy for the target video data is the second playback control policy, uses the second playback control policy to determine the bandwidth adjustment parameter according to the current playback information and the smooth playback information, and uses the bandwidth adjustment parameter to reduce the playback bandwidth parameter, so as to appropriately reduce the playback bandwidth parameter of the target video data without affecting the smooth playback of the target video data, thereby saving network resources.

[0095] Optionally, in a specific embodiment, after the playback control device determines that the target playback control policy of the target video data is the second playback control policy, and determines that a large amount of bandwidth resources are occupied in the current playback state, the playback control device calculates the bandwidth resources required for the smooth playback of the target video data according to the second playback control policy, and then, without affecting the smooth playback of the target video data, reclaims some bandwidth resources. That is, the playback control device accesses a preset bandwidth evaluation model, inputs the current playback information (such as playback parameters such as resolution, frame rate, and bit rate) corresponding to the target video data and the smooth playback information in the smooth playback state into the bandwidth evaluation model, so as to use the bandwidth evaluation model to determine the standard bandwidth parameter corresponding to the smooth playback information, calculates the bandwidth parameter difference between the playback bandwidth parameter and the standard bandwidth parameter, determines the bandwidth parameter difference as the bandwidth adjustment parameter, and uses the bandwidth adjustment parameter to correspondingly reduce the playback bandwidth parameter of the target video data to obtain a target bandwidth parameter that can keep the target video data playing smoothly according to the smooth playback information. Among them, the smooth playback information is the playback parameter information for ensuring that the target video data is played in a preset smooth playback state (such as at a preset resolution, bit rate, and frame rate).

[0096] Optionally, in other specific embodiments, the playback control device can also obtain the preset bandwidth reduction level in the second playback control policy, and use the bandwidth reduction level to gradually reduce the playback bandwidth parameter corresponding to the target video data until the playback information of the target video data is updated to the smooth playback information, then stop reducing the playback bandwidth parameter corresponding to the target video data, obtain the target bandwidth parameter, and allocate playback resources for the target video data according to the target bandwidth parameter.

[0097] Optionally, in another specific embodiment, after obtaining the video playback state of the target video data, if the playback control device determines that the video playback state is a stuttering playback state, it uses the first playback control strategy to determine a bandwidth adjustment parameter based on the current playback information and the target playback information, and increases the playback bandwidth parameter according to the bandwidth adjustment parameter, thereby improving the playback fluency and playback effect of the target video data.

[0098] In this embodiment, the playback control device obtains the target video data corresponding to the playback control request and the video data information associated with the target video data by responding to the playback control request; determines the video playback state of the target video data according to the target video data and the video data information; and adjusts the playback bandwidth parameter of the target video data according to the video playback state and the target playback control strategy to obtain a playback control result. It is realized by obtaining the target video data being played, obtaining the video data information associated with the target video data, determining whether the target video data has a state such as stuttering delay through the target video data and the video data information, obtaining the video playback state corresponding to the target video data, determining the target playback control strategy according to the video playback state, and adjusting the playback bandwidth parameter of the target video data according to the video playback state and the target playback control strategy to obtain a playback control result. It is realized to determine the playback network state of the target video data during online playback according to the target video data and the corresponding video data information, and then dynamically adjust the playback bandwidth parameter according to the playback network state, thereby improving the multimedia playback effect, reducing the probability of multimedia playback stuttering, and improving the user's viewing experience.

[0099] As Figure 3 shown, Figure 3 It is a schematic flowchart of an embodiment for determining the video playback state in the playback control method provided by the embodiment of the present application. As Figure 3 shown, in this embodiment, the playback control method further includes steps 301 to 303:

[0100] 301. Determine the current progress information of the target video data according to the video object feature and video text feature of the current playback video frame;

[0101] 302. Obtain the target playback video frame in the target playback information and the target progress information of the target playback video frame;

[0102] 303. Determine the video playback state of the target video data according to the current progress information and the target progress information.

[0103] Based on the above embodiments, in this embodiment, after obtaining the target video data and video data information, the playback control device further determines the video playback state of the target video data according to the target video data and video data information. Wherein, the video playback state is a differential playback state representing the difference between the actual playback state of the target video data and the target playback state corresponding to the video data information. Optionally, in a specific embodiment, the video playback state includes a smooth playback state and a stuttering playback state.

[0104] Specifically, the playback control device can perform video recognition on the current playback video frame in the target video data to determine the video object features and video text features in the current playback information, and then determine the current progress information of the target video data according to the video object features and video text features in the current playback information.

[0105] Specifically, after obtaining the current playback video frame, the playback control device performs grayscale conversion on the current playback video frame to obtain a current converted video frame, and performs object extraction and text extraction according to the current converted video frame, so as to obtain the video object features and video text features associated with the current converted video frame.

[0106] Specifically, the playback control device can use a preset object extraction model to perform object extraction on the current converted video frame, that is, the playback control device can select a corresponding object extraction model according to the video type of the target video data, and use the object extraction model to extract the target object features in the current converted video frame to obtain the video object features in the current converted video frame. Wherein, the object extraction model can be a face recognition model, and the video object features can be portrait object features.

[0107] Specifically, the playback control device can also use a preset text extraction model to perform text extraction on the current converted video frame, that is, the playback control device can use the text extraction model to perform text extraction on the subtitle information, voiceover information, etc. in the current converted video frame to obtain video text features.

[0108] Specifically, after obtaining the video object features and video text features, the playback control device determines the current playback information of the current playback video frame according to the video object features and the video text features. That is, after obtaining the video object features and video text features, the playback control device matches the video object features and video text features with the target object features and target text features corresponding to each video progress node in the target video data, so as to determine the video progress node corresponding to the current playback video frame, and determine the video progress node as the current progress information of the current playback video frame.

[0109] Optionally, in other embodiments, the playback control device can also determine the current progress information of the current played video frame based on the timestamp information carried by the current played video frame.

[0110] Specifically, after obtaining the current progress information, the playback control device also obtains the target played video frame in the target playback information, and the target progress information corresponding to the target video frame. Among them, the target played video frame is the played video frame representing the ideal playback progress that should be played in the current playback node of the target video data. The target progress information is the ideal progress information that the target played video frame should actually be played.

[0111] Specifically, after obtaining the target progress information, the playback control device compares the target progress information with the current progress information, so as to determine whether there are abnormal playback problems such as playback jams during the online playback of the target video data.

[0112] Optionally, if the playback control device determines that the current progress information is equal to the target progress information, that is, the playback control device determines that the current played video frame actually played during the online playback of the target video data is the same as the target played video that should be played, then it is determined that the video playback state of the target video data is a smooth playback state.

[0113] Optionally, if the playback control device determines that the current progress information is less than the target progress information, that is, the playback control device determines that the current played video frame actually played during the online playback of the target video data is before the target played video frame that should be played, that is, there is a jam delay in the actual playback process during the playback of the target video data, resulting in the difference between the current video frame actually played and the target played video frame that should be played, and the video progress is later than the video progress of the target played video frame, it is determined that the video playback state of the target video data is a jammed playback state.

[0114] Specifically, after determining that the video playback state of the target video data is a jammed playback state, the playback control device uses the first playback control strategy to determine the bandwidth adjustment parameter according to the current playback information and the target playback information, and increases the playback bandwidth parameter according to the bandwidth adjustment parameter, so as to improve the playback smoothness and playback effect of the target video data.

[0115] In this embodiment, the playback control device determines the current progress information of the target video data according to the video object characteristics and video text characteristics of the current played video frame; obtains the target played video frame in the target playback information and the target progress information of the target played video frame; and determines the video playback state of the target video data according to the current progress information and the target progress information. This realizes accurately judging the playback state during the online playback of the target video data, provides data support for subsequent video control, and improves the accuracy of video control.

[0116] As Figure 4 shown, Figure 4 FIG. is a schematic flowchart of an embodiment of performing playback control in the playback control method provided by an embodiment of the present application. Specifically, in this embodiment, the playback control method further includes steps 401 to 402:

[0117] 401. If the video playback state is a stuttering playback state, determine that the target playback control strategy is the first playback control strategy;

[0118] 402. Adjust the playback bandwidth parameter of the target video data according to the first playback control strategy, the current played video frame, and the target played video frame to obtain a playback control result.

[0119] Based on the above embodiment, in this embodiment, after the playback control device obtains the video playback state of the target video data and determines that the video playback state is a stuttering playback state, it uses the first playback control strategy to determine the bandwidth adjustment parameter according to the current playback information and the target playback information, and increases the playback bandwidth parameter according to the bandwidth adjustment parameter, thereby improving the playback fluency and playback effect of the target video data.

[0120] Specifically, after the playback control device determines that the video playback state of the target video data is a stuttering playback state, it determines the first playback control strategy as the target playback control strategy of the target video data, and uses the first playback control strategy, the current played video frame, and the target played video frame to adjust the playback bandwidth parameter of the target video data to increase the playback bandwidth parameter and optimize the playback network environment of the target video data to obtain a playback control result.

[0121] Specifically, after the playback control device determines that it is necessary to adjust the playback bandwidth parameter of the target video data using the first playback control strategy, it also calculates the playback delay number of frames of the target video data according to the current played video frame and the target played video frame. The playback delay number of frames is the difference in the number of frames of delay between the actual playback progress and the ideal playback progress of the target video data. That is, the playback control device calculates the difference in the number of video frames between the current played video frame and the target played video frame and determines the difference in the number of video frames as the playback delay number of frames.

[0122] Specifically, after obtaining the number of video frames with playback delay, the playback control device determines the bandwidth adjustment parameter of the target video data according to the number of video frames with playback delay and the first playback control strategy, where the bandwidth adjustment parameter is the bandwidth amplitude value to be adjusted for the playback bandwidth parameter. That is, the playback control device obtains the initial amplitude value in the first playback control strategy, calculates the playback delay weight corresponding to the number of video frames with playback delay, and weights the initial amplitude value with the playback delay weight to obtain a bandwidth adjustment parameter suitable for the video playback state of the target video data.

[0123] Specifically, after obtaining the bandwidth adjustment parameter, the playback control device performs an increase adjustment on the playback bandwidth parameter according to the bandwidth adjustment parameter to obtain an updated target playback bandwidth, and plays the target video data using the target playback bandwidth to obtain a playback control result. That is, the playback control device calculates the sum of the bandwidth adjustment parameter and the playback bandwidth parameter to obtain the target playback bandwidth required for the online playback of the target playback video, and allocates the target playback bandwidth to the multimedia application for online playback of the target playback video to obtain a playback control result.

[0124] In this embodiment, when the playback control device determines that the video playback state is a stuttering playback state, it determines that the target playback control strategy is the first playback control strategy; and adjusts the playback bandwidth parameter of the target video data according to the first playback control strategy, the current playback video frame, and the target playback video frame to obtain a playback control result. When it is determined that the online playback of the target video data is stuttering, the bandwidth adjustment amplitude is calculated according to the actually played current playback video frame and the target playback video frame that should be played, and then the playback bandwidth parameter during the online playback of the target video data is adaptively adjusted using the bandwidth adjustment amplitude to reduce the stuttering of the online video playback and improve the smoothness of the online video playback.

[0125] To better implement the playback control method in the embodiments of the present application, on the basis of the playback control method, an embodiment of the present application also provides a playback control device, as Figure 5 shown, Figure 5 is a schematic structural diagram of an embodiment of the playback control device provided by the embodiment of the present application. Specifically, the playback control device 500 includes:

[0126] A data acquisition module 501, configured to respond to a playback control request, acquire the target video data corresponding to the playback control request, and the video data information associated with the target video data;

[0127] A playback recognition module 502, configured to determine the video playback state of the target video data according to the target video data and the video data information;

[0128] The playback control module 503 is configured to adjust the playback bandwidth parameter of the target video data according to the video playback state and the target playback control policy, and obtain a playback control result.

[0129] In a possible implementation manner of the present application, the playback control device determines the video playback state of the target video data according to the target video data and the video data information, including:

[0130] Obtain the current playback video frame of the target video data and the target playback information in the video data information;

[0131] Perform video recognition on the current playback video frame to obtain the current playback information of the current playback video frame;

[0132] Determine the video playback state of the target video data according to the current playback information and the target playback information.

[0133] In a possible implementation manner of the present application, the playback control device performs video recognition on the current playback video frame to obtain the current playback information of the current playback video frame, including:

[0134] Perform grayscale conversion on the current playback video frame to obtain a current converted video frame;

[0135] Perform object extraction on the current converted video frame to obtain video object features;

[0136] Perform text extraction on the current converted video frame to obtain video text features;

[0137] Determine the current playback information of the current playback video frame according to the video object features and the video text features.

[0138] In a possible implementation manner of the present application, the playback control device determines the video playback state of the target video data according to the current playback information and the target playback information, including:

[0139] Determine the current progress information of the target video data according to the video object features and video text features of the current playback video frame;

[0140] Obtain the target playback video frame in the target playback information and the target progress information of the target playback video frame;

[0141] Determine the video playback state of the target video data according to the current progress information and the target progress information.

[0142] In a possible implementation manner of the present application, the playback control device determines the video playback state of the target video data according to the current progress information and the target progress information, including:

[0143] If the current progress information is equal to the target progress information, it is determined that the video playback state of the target video data is a smooth playback state;

[0144] If the current progress information is less than the target progress information, it is determined that the video playback state of the target video data is a stuttering playback state.

[0145] In a possible implementation manner of the present application, the playback control device adjusts the playback bandwidth parameter of the target video data according to the video playback state and the target playback control strategy to obtain a playback control result, including:

[0146] If the video playback state is a stuttering playback state, it is determined that the target playback control strategy is the first playback control strategy;

[0147] According to the first playback control strategy, the current played video frame and the target played video frame, the playback bandwidth parameter of the target video data is adjusted to obtain a playback control result.

[0148] In a possible implementation manner of the present application, the playback control device adjusts the playback bandwidth parameter of the target video data according to the first playback control strategy, the current played video frame and the target played video frame to obtain a playback control result, including:

[0149] Calculate the playback delay frames according to the current played video frame and the target played video frame;

[0150] Determine the bandwidth adjustment parameter of the target video data according to the first playback control strategy and the playback delay frames;

[0151] Adjust the playback bandwidth parameter according to the bandwidth adjustment parameter to obtain a playback control result.

[0152] In a possible implementation manner of the present application, the playback control device adjusts the playback bandwidth parameter of the target video data according to the video playback state and the target playback control strategy to obtain a playback control result, including:

[0153] If the video playback state is a smooth playback state, it is determined that the target playback control strategy is the second playback control strategy;

[0154] Reduce the playback bandwidth parameter according to the second playback control strategy, the current playback information of the target video data and the preset smooth playback information to obtain a playback control result.

[0155] In this embodiment, the playback control device responds to a playback control request to obtain the target video data corresponding to the playback control request and the video data information associated with the target video data; determines the video playback state of the target video data according to the target video data and the video data information; and adjusts the playback bandwidth parameter of the target video data according to the video playback state and the target playback control strategy to obtain a playback control result. By obtaining the target video data being played and the video data information associated with the target video data, it is possible to determine whether the target video data has a state such as stuttering or delay through the target video data and the video data information, obtain the video playback state corresponding to the target video data, determine the target playback control strategy according to the video playback state, and adjust the playback bandwidth parameter of the target video data according to the video playback state and the target playback control strategy to obtain a playback control result. It is possible to determine the playback network state during the online playback of the target video data according to the target video data and the corresponding video data information, and then dynamically adjust the playback bandwidth parameter according to the playback network state, thereby improving the multimedia playback effect, reducing the probability of multimedia playback stuttering, and enhancing the user's viewing experience.

[0156] An embodiment of the present invention also provides a playback control device, as Figure 6 shown Figure 6 is a schematic structural diagram of an embodiment of the playback control device provided in the embodiments of the present application.

[0157] The playback control device integrates any one of the playback control devices provided in the embodiments of the present invention. The playback control device includes:

[0158] One or more processors;

[0159] A memory; and

[0160] One or more applications, where the one or more applications are stored in the memory and configured to be executed by the processor to perform the steps in the playback control method described in any one of the embodiments of the above playback control method.

[0161] Specifically: The playback control device may include a processor 601 with one or more processing cores, a memory 602 with one or more computer-readable storage media, a power supply 603, an input unit 604, and other components. Those skilled in the art can understand that Figure 6 the structure of the playback control device shown in

[0162] The processor 601 is the control center of the playback control device, connecting various parts of the entire playback control device through various interfaces and circuits. By running or executing software programs and / or modules stored in the memory 602, and by calling the data stored in the memory 602, it executes various functions of the playback control device and processes data, thereby monitoring the playback control device as a whole. Optionally, the processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor. Among them, the application processor mainly processes the operating system, user interface, application programs, etc., and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor may not be integrated into the processor 601 either.

[0163] The memory 602 can be used to store software programs and modules. The processor 601 executes various functional applications and data processing by running the software programs and modules stored in the memory 602. The memory 602 mainly includes a program storage area and a data storage area. Among them, the program storage area can store the operating system, application programs required for at least one function (such as the sound playback function, image playback function, etc.); the data storage area can store the data created according to the use of the playback control device. In addition, the memory 602 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices. Correspondingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602.

[0164] The playback control device further includes a power supply 603 for supplying power to each component. Preferably, the power supply 603 can be logically connected to the processor 601 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system. The power supply 603 may also include any components such as one or more DC or AC power supplies, a recharge system, a power failure detection circuit, a power converter or inverter, and a power status indicator.

[0165] The playback control device may further include an input unit 604, which can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls.

[0166] Although not shown, the playback control device may further include a display unit, etc., which will not be elaborated here. Specifically, in this embodiment, the processor 601 in the playback control device will load the executable files corresponding to the processes of one or more application programs into the memory 602 according to the following instructions, and the processor 601 will run the application programs stored in the memory 602 to achieve various functions as follows:

[0167] In response to a playback control request, obtain the target video data corresponding to the playback control request and the video data information associated with the target video data;

[0168] Determine the video playback state of the target video data according to the target video data and the video data information;

[0169] Adjust the playback bandwidth parameter of the target video data according to the video playback state and the target playback control policy to obtain a playback control result.

[0170] For this reason, an embodiment of the present invention provides a computer-readable storage medium, which may include: read-only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), a magnetic disk or an optical disc, etc. A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps in any of the playback control methods provided by the embodiments of the present invention. For example, when the computer program is loaded by the processor, the following steps may be executed:

[0171] In response to a playback control request, obtain the target video data corresponding to the playback control request and the video data information associated with the target video data;

[0172] Determine the video playback state of the target video data according to the target video data and the video data information;

[0173] Adjust the playback bandwidth parameter of the target video data according to the video playback state and the target playback control policy to obtain a playback control result.

[0174] In the above embodiments, the descriptions of the respective embodiments have their own emphases. For parts not detailed in a certain embodiment, reference may be made to the detailed descriptions of other embodiments above, and details will not be repeated here.

[0175] During specific implementation, the above-mentioned respective units or structures may be implemented as independent entities, or may be combined arbitrarily to be implemented as the same or several entities. For the specific implementation of the above-mentioned respective units or structures, reference may be made to the method embodiments above, and details will not be repeated here.

[0176] For the specific implementation of the above respective operations, reference may be made to the foregoing embodiments, and details will not be repeated here.

[0177] The above has introduced in detail a playback control method provided by an embodiment of the present application. In this article, specific embodiments are used to elaborate on the principle and implementation manner of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to the present invention.

Claims

1. A playback control method, characterized in that: The playback control method comprises: In response to the playback control request, obtaining target video data corresponding to the playback control request and video data information associated with the target video data; Determine the video playback state of the target video data according to the target video data and the video data information; The playback bandwidth parameter of the target video data is adjusted according to the video playback state and the target playback control strategy to obtain a playback control result.

2. The playback control method according to claim 1, characterized in that: The determining the video playback state of the target video data according to the target video data and the video data information includes: Acquire the currently played video frame of the target video data and the target play information in the video data information; Performing video recognition on the currently playing video frame to obtain current playing information of the currently playing video frame; The video playback state of the target video data is determined according to the current playback information and the target playback information.

3. The playback control method according to claim 2, characterized in that: The performing video recognition on the currently playing video frame to obtain current playing information of the currently playing video frame includes: Performing grayscale conversion on the currently playing video frame to obtain a currently converted video frame; Performing object extraction on the current converted video frame to obtain video object features; Performing text extraction on the current converted video frame to obtain video text features; The current playing information of the currently playing video frame is determined according to the video object feature and the video text feature.

4. The playback control method according to claim 2, characterized in that: The determining the video playback state of the target video data according to the current playback information and the target playback information includes: Determine the current progress information of the target video data according to the video object features and the video text features of the currently playing video frame; Obtaining a target playback video frame in the target playback information and target progress information of the target playback video frame; The video playback status of the target video data is determined according to the current progress information and the target progress information.

5. The playback control method according to claim 4, characterized in that: The determining the video playback state of the target video data according to the current progress information and the target progress information includes: If the current progress information is equal to the target progress information, determining that the video playback state of the target video data is a smooth playback state; If the current progress information is less than the target progress information, it is determined that the video playback state of the target video data is a stuck playback state.

6. The playback control method according to any one of claims 1 to 5, characterized in that: The step of adjusting the playback bandwidth parameter of the target video data according to the video playback state and the target playback control strategy to obtain a playback control result includes: If the video playback state is a stuck playback state, determining that the target playback control strategy is a first playback control strategy; The playback bandwidth parameter of the target video data is adjusted according to the first playback control strategy, the current playback video frame and the target playback video frame to obtain a playback control result.

7. The playback control method according to claim 6, characterized in that: The step of adjusting the playback bandwidth parameter of the target video data according to the first playback control strategy, the current playback video frame, and the target playback video frame to obtain a playback control result includes: Calculate the number of playback delay frames according to the currently played video frame and the target played video frame; Determining a bandwidth adjustment parameter of the target video data according to the first playback control strategy and the number of playback delay frames; The playback bandwidth parameter is adjusted according to the bandwidth adjustment parameter to obtain a playback control result.

8. The playback control method according to any one of claims 1 to 5, characterized in that: The step of adjusting the playback bandwidth parameter of the target video data according to the video playback state and the target playback control strategy to obtain a playback control result includes: If the video playback state is a smooth playback state, determining that the target playback control strategy is a second playback control strategy; The playback bandwidth parameter is reduced according to the second playback control strategy, the current playback information of the target video data, and the preset smooth playback information to obtain a playback control result.

9. A playback control device, characterized in that: The playback control device comprises: A data acquisition module is configured to respond to a playback control request and acquire target video data corresponding to the playback control request and video data information associated with the target video data; a play identification module, configured to determine a video play status of the target video data according to the target video data and the video data information; The playback control module is configured to adjust the playback bandwidth parameter of the target video data according to the video playback state and the target playback control strategy to obtain a playback control result.

10. A playback control device, characterized in that: The playback control device comprises: one or more processors; Memory; and One or more applications, wherein the one or more applications are stored in the memory and are configured to be executed by the processor to implement the steps of the playback control method according to any one of claims 1 to 8.

11. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps of the playback control method according to any one of claims 1 to 8.

Images