Resource adjustment method and device, computer equipment and computer readable storage medium

By acquiring decoding information and playback scenario information of audio and video data, and adjusting resources in conjunction with resource usage information, the stuttering problem in audio and video playback on smart terminal devices was solved, resulting in a smoother playback experience.

CN121309871APending Publication Date: 2026-01-09SHENZHEN TCL NEW-TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202511292741.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-09-10
Publication Date
2026-01-09

AI Technical Summary

Technical Problem

Smart terminal devices often experience stuttering during media audio and video playback, and existing technologies are unable to effectively alleviate this problem.

Method used

By acquiring decoding information and playback scenario information of audio and video data, it is determined whether there is playback stuttering, and resource adjustments are made based on playback scenario information and current resource usage information, including dynamic adjustments of CPU, memory, network bandwidth, and disk IP resources.

Benefits of technology

The system promptly identifies and mitigates stuttering during audio and video data playback, improving playback smoothness and user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121309871A_ABST
    Figure CN121309871A_ABST
Patent Text Reader

Abstract

The invention discloses a resource adjustment method and device, computer equipment and a computer readable storage medium. The method comprises the steps that decoding information and playing scene information corresponding to audio and video data are acquired; based on the decoding information and the playing scene information, determining whether playing lagging exists in the audio and video data; and if the audio and video data is not paused in playing, resource adjustment is carried out based on the playing scene information corresponding to the audio and video data and the current resource use information. By adopting the method provided by the invention, resource adjustment can be carried out in time when the audio and video data playing process has a lagging risk, so that the lagging phenomenon in the audio and video playing process is relieved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of multimedia technology, specifically to a resource adjustment method, apparatus, computer equipment, and computer-readable storage medium. Background Technology

[0002] With the widespread adoption of smart devices, they have become indispensable entertainment tools in people's daily lives, with media audio and video playback being one of the core application scenarios. However, in practical applications, smart TVs, smartphones, and other smart devices often experience stuttering or buffering when playing media audio and video. Summary of the Invention

[0003] This application provides a resource adjustment method, apparatus, computer device, and computer-readable storage medium, which can alleviate stuttering during audio and video data playback.

[0004] The technical solution adopted by this invention to solve the problem is as follows:

[0005] Firstly, this application provides a resource adjustment method, including:

[0006] Obtain the decoding information and playback scene information corresponding to the audio and video data;

[0007] Based on decoding information and playback scenario information, determine whether there is playback stuttering in the audio and video data;

[0008] If there are playback stutters in the audio and video data, resource adjustments will be made based on the playback scenario information and current resource usage information corresponding to the audio and video data.

[0009] In some implementations of this application, based on decoding information and playback scenario information, it is determined whether there is playback stuttering in the audio and video data, including:

[0010] Determine the threshold information based on the playback scenario information;

[0011] Based on decoding information and threshold information, it is determined whether there are playback stutters in the audio and video data.

[0012] In some embodiments of this application, the decoding information includes decoder initialization time, decoding processing time, decoding average frame rate and decoding frame interval time, and the threshold information includes a first threshold corresponding to decoder initialization time, a second threshold corresponding to decoding processing time, a third threshold corresponding to decoding average frame rate, a fourth threshold corresponding to decoding frame interval time and a fifth threshold corresponding to decoding frame interval time;

[0013] Based on decoding information and threshold information, determine whether there are playback stutters in the audio and video data, including:

[0014] If the decoder initialization time is greater than the first threshold, and / or the decoding processing time is greater than the second threshold, and / or the average decoding frame rate is less than the third threshold, and / or the decoding frame interval time is greater than the fourth threshold, it is determined that there is playback stuttering in the audio and video data.

[0015] If the decoder initialization time is greater than the first threshold, and / or the decoding processing time is greater than the second threshold, and / or the average decoding frame rate is less than the third threshold, and / or the decoding frame interval time is less than the fifth threshold, it is determined that there is playback stuttering in the audio and video data.

[0016] In some embodiments of this application, the threshold information includes a third threshold corresponding to the average decoding frame rate, a fourth threshold corresponding to the decoding frame interval time, and a fifth threshold corresponding to the decoding frame interval time.

[0017] Based on playback scene information, threshold information is determined, including:

[0018] Based on the playback scene information, determine the target frame rate and the target frame interval time;

[0019] The target frame rate and the first proportional value are multiplied to obtain the third threshold;

[0020] The target frame interval time and the second proportional value are multiplied to obtain the fourth threshold.

[0021] The target frame interval time and the third ratio value are multiplied to obtain the fifth threshold.

[0022] In some implementation schemes of this application, resource adjustments are made based on playback scene information and current resource usage information corresponding to the audio and video data, including:

[0023] Input the playback scene information corresponding to the audio and video data into the target prediction model, and output the current resource demand information through the target prediction model;

[0024] Adjust resources based on current resource usage and current resource demand information.

[0025] In some embodiments of this application, the current resource usage information includes the current remaining CPU resource information, the current remaining memory resource information, the current remaining network bandwidth resource information, and the current remaining disk IP resource information; the current resource demand information includes the current CPU resource demand information, the current memory resource demand information, the current network bandwidth resource demand information, and the current disk IP resource demand information.

[0026] Resource adjustments are made based on current resource usage and demand information, including:

[0027] Based on the current remaining CPU resources and the current CPU resource demand, determine the current CPU resource demand.

[0028] Based on the current remaining memory resource information and the current memory resource demand information, determine the current memory resource demand;

[0029] Based on the current remaining network bandwidth resources and the current network bandwidth resource demand, determine the current network bandwidth resource demand.

[0030] Based on the current remaining disk IP resource information and the current disk IP resource demand information, determine the current disk IP resource demand;

[0031] Adjust resources based on current CPU resource requirements, current memory resource requirements, current network bandwidth resource requirements, and current disk IP resource requirements.

[0032] In some implementation schemes of this application, resource adjustments are made based on current CPU resource requirements, current memory resource requirements, current network bandwidth resource requirements, and current disk IP resource requirements, including:

[0033] Output first resource adjustment information and second resource adjustment information, and receive user selection operation for the first resource adjustment information and second resource adjustment information; the first resource adjustment information is used to indicate automatic resource adjustment, and the second resource adjustment information is used to indicate manual resource adjustment;

[0034] If the user selects the first resource adjustment information, resource adjustments will be made based on the current CPU resource requirements, current memory resource requirements, current network bandwidth resource requirements, and current disk IP resource requirements.

[0035] If the user selects the second resource adjustment information, optimization suggestions will be output based on the current CPU resource requirements, current memory resource requirements, current network bandwidth resource requirements, and current disk IP resource requirements; the optimization suggestions include multiple optimization suggestions;

[0036] It receives user selections from multiple optimization suggestions and adjusts resources based on the selected suggestions.

[0037] Secondly, embodiments of the present invention also provide a resource adjustment device, comprising:

[0038] The information acquisition module is used to acquire decoding information and playback scene information corresponding to audio and video data;

[0039] The stuttering determination module is used to determine whether there is stuttering in the audio and video data based on decoding information and playback scene information;

[0040] The resource adjustment module is used to adjust resources based on the playback scenario information and current resource usage information of the audio and video data if there is playback stuttering.

[0041] Thirdly, this application also provides a computer device, which includes:

[0042] One or more processors;

[0043] Memory; and

[0044] One or more applications, wherein the applications are stored in memory and configured to be executed by a processor to implement the resource adjustment method of any of the first aspects.

[0045] Fourthly, this application also provides a computer-readable storage medium having a computer program stored thereon, the computer program being loaded by a processor to perform the steps of the resource adjustment method of any of the first aspects.

[0046] The beneficial effects of this invention are as follows: By acquiring the decoding information and playback scene information corresponding to the audio and video data, and based on the decoding information and playback scene information, it is determined whether there is playback stuttering in the audio and video data. If there is playback stuttering in the audio and video data, resource adjustments are made based on the playback scene information and current resource usage information corresponding to the audio and video data. This allows for timely resource adjustments when there is a risk of stuttering during the playback of audio and video data, thereby alleviating the stuttering phenomenon during the playback of audio and video data. Attached Figure Description

[0047] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0048] Figure 1 This is a schematic diagram of a scenario for the resource adjustment system provided in an embodiment of the present invention;

[0049] Figure 2 This is a schematic flowchart of an embodiment of the resource adjustment method provided by the present invention;

[0050] Figure 3 This is a schematic diagram of a specific embodiment of the process for determining whether there is playback stuttering in audio and video data, provided by an embodiment of the present invention;

[0051] Figure 4This is a schematic diagram of a specific embodiment of the present invention for adjusting resources based on playback scene information and current resource usage information;

[0052] Figure 5 This is an overall software framework diagram of the resource adjustment method provided in the embodiments of the present invention;

[0053] Figure 6 This is a schematic diagram of the interface for providing output lag prompt information according to an embodiment of the present invention;

[0054] Figure 7 This is a schematic diagram of the interface for outputting first resource adjustment information and second resource adjustment information provided in an embodiment of the present invention;

[0055] Figure 8 This is a schematic diagram of the interface for outputting resource adjustment progress information provided in an embodiment of the present invention;

[0056] Figure 9 This is a schematic diagram of the interface for providing output optimization suggestion information according to an embodiment of the present invention;

[0057] Figure 10 This is a schematic diagram of the interface providing the output optimization completion prompt information according to an embodiment of the present invention;

[0058] Figure 11 This is a schematic diagram of one embodiment of the resource adjustment device provided in this invention;

[0059] Figure 12 This is a schematic diagram of an embodiment of the computer device provided in this invention. Detailed Implementation

[0060] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0061] In the description of this application, the terms "first," "second," "third," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined with "first," "second," "third," etc., may explicitly or implicitly include one or more features.

[0062] In this application, the term "exemplary" is used to mean "used as an example, illustration, or description." Any embodiment described as "exemplary" in this application is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is provided to enable any person skilled in the art to make and use this application. Details are set forth in the following description for purposes of explanation. It should be understood that those skilled in the art will recognize that this application can be made without using these specific details. In other instances, well-known structures and processes are not described in detail to avoid obscuring the description of this application with unnecessary detail. Therefore, this application is not intended to be limited to the embodiments shown, but is consistent with the broadest scope of the principles and features disclosed in this application.

[0063] It should be noted that since the method in this application embodiment is executed in a computer device, the processing objects of each computer device exist in the form of data or information, such as time, which is essentially time information. It is understood that if size, quantity, position, etc. are mentioned in subsequent embodiments, they are all corresponding data that exist so that the computer device can process them. Specific details will not be elaborated here.

[0064] This application provides a resource adjustment method, apparatus, computer device, and computer-readable storage medium, which will be described in detail below.

[0065] The resource adjustment method provided in this application is applied to a resource adjustment system. Please refer to [link / reference]. Figure 1 , Figure 1 This is a schematic diagram of a resource adjustment system provided in an embodiment of this application. The resource adjustment system may include a computer device 100, such as... Figure 1 Computer equipment in the country.

[0066] In some embodiments, the computer device 100 is mainly used to acquire decoding information and playback scene information corresponding to audio and video data; based on the decoding information and playback scene information, determine whether there is playback stuttering in the audio and video data; if there is playback stuttering in the audio and video data, adjust resources based on the playback scene information and current resource usage information corresponding to the audio and video data, so that resource adjustment can be made in a timely manner when there is a risk of stuttering during the playback of audio and video data, thereby alleviating the stuttering phenomenon during the playback of audio and video data.

[0067] In this embodiment, the computer device 100 can be a standalone server, a server network, or a server cluster. For example, the computer device 100 described in this embodiment includes, but is not limited to, a computer, a network host, a single network server, a set of multiple network servers, or a cloud server composed of multiple servers. The cloud server is composed of a large number of computers or network servers based on cloud computing.

[0068] It is understood that the computer device 100 used in the embodiments of this application can be a device that includes both receiving and transmitting hardware, that is, a device having receiving and transmitting hardware capable of performing bidirectional communication on a bidirectional communication link. Such a device may include: cellular or other communication devices having a single-line display, a multi-line display, or a cellular or other communication device without a multi-line display. Specifically, the computer device 100 may be a desktop terminal or a mobile terminal, and may also be one of the following: an augmented reality (AR) device, a mobile phone, a tablet computer, a laptop computer, etc.

[0069] Those skilled in the art will understand that Figure 1 The application environment shown is merely one application scenario of the solution in this application and does not constitute a limitation on the application scenario of the solution in this application. Other application environments may include those that are more specific to this application. Figure 1 The number of computer devices shown is more or less, for example Figure 1 Only one computer device is shown in the document. It is understood that the resource adjustment system may also include one or more other services, which are not limited here.

[0070] In addition, the resource adjustment system may also include a memory for storing data, such as decoding information, such as decoder initialization time, decoding processing time, etc., and threshold information, such as first threshold, second threshold, etc.

[0071] It should be noted that, Figure 1 The schematic diagram of the resource adjustment system shown is merely an example. The resource adjustment system and scenario described in this application are intended to more clearly illustrate the technical solutions of this application and do not constitute a limitation on the technical solutions provided in this application. As those skilled in the art will know, with the evolution of resource adjustment systems and the emergence of new business scenarios, the technical solutions provided in this application are also applicable to similar technical problems.

[0072] like Figure 2 The diagram shown is a flowchart of an embodiment of the resource adjustment method in this application. The resource adjustment method may include the following steps S201 to S203, as detailed below:

[0073] Step S201: Obtain the decoding information and playback scene information corresponding to the audio and video data.

[0074] In this embodiment, the audio and video data is the media audio and video data currently being played by the terminal device. The audio and video data is a set of binary data formed by processing sound and image information through digital technologies such as sampling and encoding. The audio and video data covers composite information of audio (such as voice and music) and video (such as images and frame sequences). It can be stored or transmitted in real time through compression algorithms and is the core information carrier supporting multimedia entertainment, communication, virtual reality and other scenarios.

[0075] Furthermore, playback scenario information refers to the specific context in which a user plays audio and video data through a terminal device. Playback scenario information includes one or more of the following: playback method of the audio and video data, attribute information of the audio and video data, device information of the terminal device playing the audio and video data, and network status information during playback. Specifically, the playback method of the audio and video data includes one or more of the following: playing audio and video data from local storage, playing audio and video data from a USB external device, playing audio and video data from a network NAS (Network Attached Storage) streaming media device, and playing video through a VOD (Video on Demand) application. The attribute information of the audio and video data includes one or more of the following: resolution, frame rate, and video encoding format. The device information of the terminal device includes the device type of the terminal device (e.g., tablet, mobile phone, TV, etc.), and the network status information includes network type information (e.g., local area network, mobile network, etc.).

[0076] Furthermore, the decoding information is used to characterize the performance status of audio and video data during the decoding process. The decoding information includes one or more of the following: decoder initialization time, decoding processing time, average decoding frame rate, and decoding frame interval time. Specifically, the decoder initialization time characterizes the time interval between the start and completion of decoder initialization; the decoding processing time characterizes the time interval between the start and end of decoding each frame of audio and video; the average decoding frame rate characterizes the number of frames decoded per second; and the decoding frame interval time characterizes the time difference between two adjacent frames of audio and video.

[0077] Optionally, the decoding information and playback scene information corresponding to the audio and video data can be directly obtained from the local computer device, or they can be obtained from other computer devices via network, Bluetooth, infrared, or other means. For example, when the resource adjustment method of this application is applied to terminal devices such as tablets, mobile phones, and televisions, the terminal device can directly obtain the decoding information and playback scene information corresponding to the audio and video data from its local device; when the resource adjustment method of this application is applied to a server, the server can obtain the decoding information and playback scene information corresponding to the audio and video data from the terminal device playing the audio and video data via network, Bluetooth, infrared, or other means.

[0078] In some embodiments, the decoding information includes the decoder initialization time. The steps of obtaining the decoding information corresponding to the audio and video data specifically include: obtaining the decoder start initialization time and the decoder initialization end time; subtracting the decoder initialization end time from the decoder start initialization time to obtain the decoder initialization time.

[0079] In some embodiments, the decoding information includes decoding processing time. The steps of obtaining the decoding information corresponding to the audio and video data specifically include: obtaining the start time of decoding for each frame of audio and video and the end time of decoding for each frame of audio and video; subtracting the end time of decoding for each frame of audio and video from the start time of decoding for that frame of audio and video to obtain the decoding processing time.

[0080] In some embodiments, the decoding information includes the average decoding frame rate. The steps for obtaining the decoding information corresponding to the audio and video data specifically include: obtaining the total number of decoded frames and the total decoding time; dividing the total number of decoded frames and the total decoding time to obtain the average decoding frame rate. The process of determining the average decoding frame rate can be expressed as: S1 = N1 / T1, where S1 represents the average decoding frame rate, N1 represents the total number of decoded frames, and T1 represents the total decoding time.

[0081] In some embodiments, the decoding information includes the decoding frame interval time. The steps for obtaining the decoding information corresponding to the audio and video data specifically include: obtaining the timestamp information corresponding to the current decoding frame and the timestamp information corresponding to the previous decoding frame; subtracting the timestamp information corresponding to the current decoding frame and the timestamp information corresponding to the previous decoding frame to obtain the decoding frame interval time. The process of determining the decoding frame interval time can be expressed as: S2 = T2 - T3, where S2 represents the decoding frame interval time, T2 represents the timestamp information corresponding to the current decoding frame, and T3 represents the timestamp information corresponding to the previous decoding frame.

[0082] S202. Based on decoding information and playback scenario information, determine whether there is playback stuttering in the audio and video data.

[0083] In this embodiment, playback stuttering refers to the phenomenon that the audio and video data stops playing, the sound is intermittent, or the playback is not smooth during playback. This application determines whether there is playback stuttering in the audio and video data based on decoding information and playback scenario information. When there is a risk of stuttering in the audio and video data, resources can be adjusted in real time to alleviate the stuttering problem during audio and video data playback.

[0084] In some embodiments, the decoding information includes one or more of the following: decoder initialization time, decoding processing time, average decoding frame rate, and decoding frame interval time. This embodiment can determine whether there is playback stuttering in the audio and video data based on any one of the following: decoder initialization time, decoding processing time, average decoding frame rate, and decoding frame interval time, and playback scenario information. Alternatively, it can determine whether there is playback stuttering in the audio and video data based on multiple of the following: decoder initialization time, decoding processing time, average decoding frame rate, and decoding frame interval time, and playback scenario information.

[0085] In some embodiments, refer to Figure 3 As shown, step S202 above, which determines whether there is playback stuttering in the audio and video data based on decoding information and playback scene information, may include steps S301 to S302, as detailed below:

[0086] S301. Determine threshold information based on playback scene information.

[0087] In this embodiment of the application, the threshold information is used to measure whether there is stuttering in the audio and video data. The decoding information includes one or more of the following: decoder initialization time, decoding processing time, decoding average frame rate, and decoding frame interval time. The threshold information includes one or more of the following: a first threshold corresponding to the decoder initialization time, a second threshold corresponding to the decoding processing time, a third threshold corresponding to the decoding average frame rate, a fourth threshold corresponding to the decoding frame interval time, and a fifth threshold corresponding to the decoding frame interval time.

[0088] In some embodiments, the threshold information includes a first threshold corresponding to the decoder initialization time. The step of determining the threshold information based on playback scene information specifically includes: determining the first threshold based on the playback scene information and first association information. The first association information is used to characterize the correspondence between the playback scene information and the first threshold. For example, playback scene information A corresponds to first threshold A, playback scene information B corresponds to first threshold B, and playback scene information C corresponds to first threshold C. If the playback scene information corresponding to the audio / video data is playback scene information B, then the first threshold is first threshold B.

[0089] In some embodiments, the threshold information includes a second threshold corresponding to the decoding processing time. The step of determining the threshold information based on playback scene information specifically includes: determining the second threshold based on the playback scene information and the second association information. The second association information is used to characterize the correspondence between the playback scene information and the second threshold. For example, the second threshold corresponding to audio / video data with a frame rate of 30 FPS is 33 ms, the second threshold corresponding to audio / video data with a frame rate of 40 FPS is 25 ms, and the second threshold corresponding to audio / video data with a frame rate of 25 FPS is 40 ms. If the playback scene information corresponding to the audio / video data is 30 FPS, then the second threshold is 33 ms.

[0090] In some embodiments, the threshold information includes a third threshold corresponding to the average decoding frame rate. The step of determining the threshold information based on the playback scene information specifically includes: determining the target frame rate based on the playback scene information; multiplying the target frame rate and a first proportional value to obtain the third threshold. Optionally, the first proportional value can be set according to actual needs, where 0 < first proportional value < 100%, for example, the first proportional value = 85%.

[0091] Optionally, the step of determining the target frame rate based on playback scene information specifically includes: determining the target frame rate based on playback scene information and third association information. The third association information is used to characterize the correspondence between playback scene information and the target frame rate. For example, playback scene information A corresponds to target frame rate A, playback scene information B corresponds to target frame rate B, and playback scene information C corresponds to target frame rate C. If the playback scene information corresponding to the audio / video data is playback scene information B, then the target frame rate is target frame rate B.

[0092] In some embodiments, the threshold information includes a fourth threshold corresponding to the decoding frame interval time and a fifth threshold corresponding to the decoding frame interval time. The step of determining the threshold information based on the playback scene information specifically includes: determining the target frame interval time based on the playback scene information; multiplying the target frame interval time by a second proportional value to obtain the fourth threshold; and multiplying the target frame interval time by a third proportional value to obtain the fifth threshold. Optionally, the second and third proportional values ​​can be set according to actual needs, where 100% < second proportional value < 200%, and 0 < third proportional value < 100%. For example, the second proportional value = 150%, and the third proportional value = 50%.

[0093] Optionally, the step of determining the target frame interval based on playback scene information specifically includes: determining the target frame interval based on the playback scene information and the fourth association information. The fourth association information is used to characterize the correspondence between the playback scene information and the target frame interval. For example, playback scene information A corresponds to target frame interval A, playback scene information B corresponds to target frame interval B, and playback scene information C corresponds to target frame interval C. If the playback scene information corresponding to the audio / video data is playback scene information B, then the target frame interval is target frame interval B.

[0094] S302. Based on decoding information and threshold information, determine whether there is playback stuttering in the audio and video data.

[0095] In this embodiment, the decoding information includes any one or more of the following: decoder initialization time, decoding processing time, average decoding frame rate, and decoding frame interval time. The threshold information includes any one or more of the following: a first threshold corresponding to the decoder initialization time, a second threshold corresponding to the decoding processing time, a third threshold corresponding to the average decoding frame rate, a fourth threshold corresponding to the decoding frame interval time, and a fifth threshold corresponding to the decoding frame interval time. When determining whether playback stuttering exists in audio and video data based on the decoding information and threshold information, the determination can be made based on any one of the following: decoder initialization time, decoding processing time, average decoding frame rate, and decoding frame interval time, and the corresponding threshold. Alternatively, it can be made based on multiple of the following: decoder initialization time, decoding processing time, average decoding frame rate, and decoding frame interval time, and the corresponding threshold.

[0096] In some embodiments, the decoding information includes decoder initialization time, decoding processing time, average decoding frame rate, and decoding frame interval time. The threshold information includes a first threshold corresponding to the decoder initialization time, a second threshold corresponding to the decoding processing time, a third threshold corresponding to the average decoding frame rate, a fourth threshold corresponding to the decoding frame interval time, and a fifth threshold corresponding to the decoding frame interval time. The steps for determining whether playback stuttering exists in audio and video data based on the decoding information and threshold information specifically include: if the decoder initialization time is greater than the first threshold, and / or, the decoding processing time is greater than the second threshold, and / or, the average decoding frame rate is less than the third threshold, and / or, the decoding frame interval time is greater than the fourth threshold, then playback stuttering exists in the audio and video data; if the decoder initialization time is greater than the first threshold, and / or, the decoding processing time is greater than the second threshold, and / or, the average decoding frame rate is less than the third threshold, and / or, the decoding frame interval time is less than the fifth threshold, then playback stuttering exists in the audio and video data. Thus, the decoder initialization time, decoding processing time, average decoding frame rate, and decoding frame interval time can be combined to comprehensively determine whether playback stuttering exists in audio and video data, improving the accuracy of playback stuttering judgment.

[0097] S203. If there is playback stuttering in the audio and video data, resource adjustments will be made based on the playback scenario information and current resource usage information corresponding to the audio and video data.

[0098] In this embodiment, current resource usage information is used to characterize the current resource usage of the terminal device playing audio and video data. This information includes one or more of the following: current remaining CPU resources, current remaining memory resources, current remaining network bandwidth resources, and current remaining disk IP resources. This embodiment determines whether playback stuttering exists in the audio and video data based on decoding information and playback scenario information. When playback stuttering is detected, resource adjustments are made based on the corresponding playback scenario information and current resource usage information. This allows for timely resource adjustments to mitigate stuttering during audio and video data playback when there is a risk of playback stuttering.

[0099] In some embodiments, refer to Figure 4 As shown, the resource adjustment in step S203 above, based on the playback scene information and current resource usage information corresponding to the audio and video data, may include steps S401 to S402, as detailed below:

[0100] S401. Input the playback scene information corresponding to the audio and video data into the target prediction model, and output the current resource demand information through the target prediction model.

[0101] In this embodiment, the target prediction model is a pre-trained network model used to predict current resource demand information based on playback scene information corresponding to audio and video data. The target prediction model can be constructed based on Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), Random Forest, or similar models. This embodiment uses the target prediction model to determine current resource demand information based on playback scene information corresponding to audio and video data, which can improve the accuracy and efficiency of determining the current resource demand information.

[0102] In some embodiments, the target prediction model is obtained by training the first network model based on training sample data. The target prediction model and the first network model have the same structure. The difference between the target prediction model and the first network model is that the model parameters of the target prediction model are the trained model parameters, while the model parameters of the first network model are the initial model parameters.

[0103] In some embodiments, the training sample data includes playback scene information corresponding to the sample audio and video data and real resource demand information corresponding to the sample audio and video data. The target prediction model is trained through the following steps: inputting the playback scene information corresponding to the sample audio and video data into the first network model, and outputting the predicted resource demand information corresponding to the sample audio and video data through the first network model; determining the loss value based on the real resource demand information, the predicted resource demand information, and the loss function of the first network model; if the loss value does not converge or the number of training iterations of the first network model does not reach the threshold, adjusting the model parameters of the first network model based on the first learning rate, and continuing to execute the steps of inputting the playback scene information corresponding to the sample audio and video data into the first network model and outputting the predicted resource demand information corresponding to the sample audio and video data through the first network model, until the loss value converges or the number of training iterations of the first network model reaches the threshold.

[0104] S402. Adjust resources based on current resource usage information and current resource demand information.

[0105] In some embodiments, the current resource usage information includes current remaining CPU resource information, current remaining memory resource information, current remaining network bandwidth resource information, and current remaining disk IP resource information. The current resource demand information includes current CPU resource demand information, current memory resource demand information, current network bandwidth resource demand information, and current disk IP resource demand information. The steps for adjusting resources based on the current resource usage information and current resource demand information specifically include: determining the current CPU resource demand based on the current remaining CPU resource information and current CPU resource demand information; determining the current memory resource demand based on the current remaining memory resource information and current memory resource demand information; determining the current network bandwidth resource demand based on the current remaining network bandwidth resource information and current network bandwidth resource demand information; determining the current disk IP resource demand based on the current remaining disk IP resource information and current disk IP resource demand information; and adjusting resources based on the current CPU resource demand, current memory resource demand, current network bandwidth resource demand, and current disk IP resource demand.

[0106] In this embodiment, the current CPU resource requirement is used to characterize the current CPU resource shortage. In some embodiments, the step of determining the current CPU resource requirement based on the current remaining CPU resource information and the current CPU resource requirement information specifically includes: subtracting the current remaining CPU resource information from the current CPU resource requirement information to obtain the current CPU resource requirement. For example, if the current remaining CPU resource information is 15% and the current CPU resource requirement information is 25%, then the current CPU resource requirement is 10%.

[0107] Furthermore, the current memory resource requirement is used to characterize the current memory resource shortfall. In some embodiments, the step of determining the current memory resource requirement based on the current remaining memory resource information and the current memory resource requirement information specifically includes: subtracting the current remaining memory resource information from the current memory resource requirement information to obtain the current memory resource requirement. For example, if the current remaining memory resource information is 300MB and the current memory resource requirement information is 300MB, then the current memory resource requirement is 0MB.

[0108] In this embodiment of the application, the current network bandwidth resource demand is used to characterize the current network bandwidth resource gap. In some embodiments, the step of determining the current network bandwidth resource demand based on the current remaining network bandwidth resource information and the current network bandwidth resource demand information specifically includes: subtracting the current remaining network bandwidth resource information and the current network bandwidth resource demand information to obtain the current network bandwidth resource demand.

[0109] Furthermore, the current disk IP resource demand is used to characterize the current disk IP resource gap. In some embodiments, the step of determining the current disk IP resource demand based on the current remaining disk IP resource information and the current disk IP resource demand information specifically includes: subtracting the current remaining disk IP resource information from the current disk IP resource demand information to obtain the current disk IP resource demand.

[0110] In some embodiments, when adjusting resources based on current CPU resource requirements, current memory resource requirements, current network bandwidth resource requirements, and current disk IP resource requirements, the decoder can be adjusted, and the network service thread can be a high-priority thread to ensure faster acquisition of CPU and memory resources. Media critical threads can also be bound to specific CPU cores to reduce context switching overhead. Thread pools can also be used to manage background tasks of media playback-related processes to avoid frequent creation and destruction of important threads.

[0111] In some embodiments, when adjusting resources based on current CPU resource requirements, current memory resource requirements, current network bandwidth resource requirements, and current disk IP resource requirements, the memory usage of non-media-related processes can be dynamically adjusted, and processes that may leak memory can be cleaned up in a timely manner to ensure that media-critical threads have sufficient memory.

[0112] In some embodiments, when adjusting resources based on the current CPU resource requirements, current memory resource requirements, current network bandwidth resource requirements, and current disk IP resource requirements, the CPU operating frequency can be adjusted according to the system load to avoid the CPU frequency being too low and affecting performance. It can also limit the resource usage of background tasks to prevent too many background tasks from consuming CPU and memory resources.

[0113] like Figure 5 The diagram shown illustrates the overall software architecture of the resource adjustment method provided in this application. The overall software architecture of the resource adjustment method provided in this embodiment includes a kernel, a service layer, a framework layer, and an application layer. Among these, the media service in the service layer is the core service for audio and video data playback, which can determine whether there is playback stuttering in the audio and video data based on decoding information and playback scenario information.

[0114] Furthermore, the fault reporting service in the framework layer is responsible for collecting and processing fault information. This service includes an exception capture interface and an event listening interface. The exception capture interface supports capturing audio / video playback stuttering exceptions from the media service, while the event listening interface reports the stuttering event to the multi-task resource management service when the stuttering event is audio / video playback stuttering. The multi-task resource management service includes a scene recognition service and an intelligent resource scheduling service. The scene recognition service identifies the playback scene information corresponding to the audio / video data, while the intelligent resource scheduling service determines the current resource requirements based on the playback scene information and adjusts the framework layer resources and kernel resources dynamically based on the current resource usage and resource requirements.

[0115] In some embodiments, after determining whether there is playback stuttering in the audio and video data based on decoding information and playback scenario information, the process includes: if playback stuttering exists, outputting stuttering prompt information; the stuttering prompt information is used to characterize the existence of playback stuttering in the audio and video data. This embodiment outputs stuttering prompt information when playback stuttering exists in the audio and video data, allowing users to understand the video playback status and the cause of the stuttering in real time, and to make timely resource adjustments. For example, refer to... Figure 6 As shown, if there is playback stuttering in the audio and video data, the message "Video playback stuttering detected, optimization recommended" will be output.

[0116] Optionally, the terminal device can output a stuttering notification message through its own configured screen, or it can output a stuttering notification message through other devices. For example, refer to... Figure 6 As shown, the terminal device can display "Video playback stuttering detected, optimization recommended" in the upper right corner of its own configured screen. The terminal device can also transmit the stuttering prompt information to the user's mobile phone via email, and display "Video playback stuttering detected, optimization recommended" on the user's mobile phone.

[0117] In some embodiments, the steps of adjusting resources based on current CPU resource requirements, current memory resource requirements, current network bandwidth resource requirements, and current disk IP resource requirements specifically include: outputting first resource adjustment information and second resource adjustment information, and receiving a user's selection operation on the first resource adjustment information and the second resource adjustment information; if the user selects the first resource adjustment information, adjusting resources based on the current CPU resource requirements, current memory resource requirements, current network bandwidth resource requirements, and current disk IP resource requirements; if the user selects the second resource adjustment information, outputting optimization suggestion information based on the current CPU resource requirements, current memory resource requirements, current network bandwidth resource requirements, and current disk IP resource requirements; the optimization suggestion information includes multiple optimization suggestions; receiving a user's selection operation on multiple optimization suggestions, and adjusting resources based on the selected optimization suggestion. This embodiment adjusts resources based on the user's selection operation on the first resource adjustment information and the second resource adjustment information, allowing users to actively participate in optimizing video playback performance, and enabling resource adjustments to be made according to user needs, thus improving the accuracy of resource adjustments.

[0118] In this embodiment of the application, the first resource adjustment information is used to characterize automatic resource adjustment, and the second resource adjustment information is used to characterize manual resource adjustment. For example, referring to... Figure 7 As shown, the first resource adjustment information is "automatic optimization," and the second resource adjustment information is "manual optimization." Furthermore, the terminal device can output the first and second resource adjustment information through its own configured screen, and it can also output these information through other devices. When the terminal device outputs the first and second resource adjustment information through other devices, those other devices can provide feedback on the user-selected resource adjustment information to the terminal device. For example, refer to... Figure 7 As shown, the terminal device can display "Automatic Optimization" and "Manual Optimization" in the upper right corner of its own configured screen. The terminal device can also display "Automatic Optimization" and "Manual Optimization" through the user's mobile phone. When the user selects the "Automatic Optimization" option on the user's mobile phone, the user's mobile phone will send the selected "Automatic Optimization" to the terminal device via email, so that the terminal device can make resource adjustments based on the resource adjustment information selected by the user.

[0119] Furthermore, after adjusting resources based on current CPU resource requirements, current memory resource requirements, current network bandwidth resource requirements, and current disk IP resource requirements, the process also includes: outputting resource adjustment progress information. This progress information characterizes the progress of the resource adjustment and can be output in one or more combinations of text, numbers, progress bars, etc. For example, refer to... Figure 8As shown, the terminal device can display the message "Automatic optimization in progress, please wait" in the upper right corner of its configured screen.

[0120] In this embodiment of the application, the optimization suggestion information includes multiple optimization suggestions, for example, referring to Figure 9 As shown, the optimization suggestions include multiple options such as "CPU load optimization" and "network bandwidth optimization." Terminal devices can output these suggestions via their own configured screen, or they can output them through other devices. For example, refer to... Figure 9 As shown, the terminal device can display optimization suggestions such as "CPU load optimization" and "network bandwidth optimization" in the upper right corner of its screen. Alternatively, the terminal device can transmit these optimization suggestions to the user's mobile phone, allowing the user to remotely adjust the terminal device's resources to resolve stuttering issues in audio and video playback.

[0121] In some embodiments, the resource adjustment method further includes: outputting a confirmation dialog box; the confirmation dialog box is used to confirm whether the user has made resource adjustments, so that resource adjustments can be made only after the user has selected confirmation, avoiding accidental user operation. Optionally, the terminal device can output the confirmation dialog box on its own configured screen, or the terminal device can output the confirmation dialog box through other devices, for example, continuing to refer to... Figure 9 As shown, the terminal device displays a confirmation dialog box in the upper right corner of its configured screen.

[0122] In some embodiments, after the above-described steps of adjusting resources based on current CPU resource requirements, current memory resource requirements, current network bandwidth resource requirements, and current disk IP resource requirements, the method further includes: outputting an optimization completion notification message. The optimization completion notification message indicates that the resource adjustment process is complete, allowing the user to intuitively understand the completion status of the resource adjustment. Optionally, the terminal device can output the optimization completion notification message on its own configured screen, or it can output the optimization completion notification message through other devices, for example, continuing to refer to... Figure 10 As shown, the terminal device displays a "Video playback optimized" completion message in the upper right corner of its screen.

[0123] To better implement the resource adjustment method in the embodiments of this application, a resource adjustment device is also provided in the embodiments of this application, such as... Figure 11 As shown, the resource adjustment device 600 includes:

[0124] The information acquisition module 610 is used to acquire the decoding information and playback scene information corresponding to the audio and video data;

[0125] The stuttering determination module 620 is used to determine whether there is stuttering in the audio and video data based on decoding information and playback scene information;

[0126] The resource adjustment module 630 is used to adjust resources based on the playback scene information and current resource usage information corresponding to the audio and video data if there is playback stuttering.

[0127] In this embodiment, by obtaining the decoding information and playback scene information corresponding to the audio and video data, it is determined whether there is playback stuttering in the audio and video data based on the decoding information and playback scene information. If there is playback stuttering in the audio and video data, resource adjustments are made based on the playback scene information and current resource usage information corresponding to the audio and video data. This allows for timely resource adjustments when there is a risk of stuttering during the playback of audio and video data, thereby alleviating the stuttering phenomenon during the playback of audio and video data.

[0128] In some embodiments of this application, the decoding information includes the average decoding frame rate and the decoding frame interval time. The information acquisition module 610 is specifically used for:

[0129] Get the total number of decoded frames, the total decoding time, the timestamp information of the current decoded frame, and the timestamp information of the previous decoded frame;

[0130] Divide the total number of decoded frames by the total decoding time to obtain the average decoding frame rate;

[0131] The timestamp information corresponding to the current decoded frame is subtracted from the timestamp information corresponding to the previous decoded frame to obtain the decoding frame interval time.

[0132] In some embodiments of this application, the stuttering determination module 620 is specifically used for:

[0133] Determine the threshold information based on the playback scenario information;

[0134] Based on decoding information and threshold information, it is determined whether there are playback stutters in the audio and video data.

[0135] In some embodiments, the decoding information includes decoder initialization time, decoding processing time, average decoding frame rate, and decoding frame interval time; the threshold information includes a first threshold corresponding to the decoder initialization time, a second threshold corresponding to the decoding processing time, a third threshold corresponding to the average decoding frame rate, a fourth threshold corresponding to the decoding frame interval time, and a fifth threshold corresponding to the decoding frame interval time. The stuttering determination module 620 is further configured to:

[0136] If the decoder initialization time is greater than the first threshold, and / or the decoding processing time is greater than the second threshold, and / or the average decoding frame rate is less than the third threshold, and / or the decoding frame interval time is greater than the fourth threshold, it is determined that there is playback stuttering in the audio and video data.

[0137] If the decoder initialization time is greater than the first threshold, and / or the decoding processing time is greater than the second threshold, and / or the average decoding frame rate is less than the third threshold, and / or the decoding frame interval time is less than the fifth threshold, it is determined that there is playback stuttering in the audio and video data.

[0138] In some embodiments, the threshold information includes a third threshold corresponding to the average decoding frame rate, a fourth threshold corresponding to the decoding frame interval time, and a fifth threshold corresponding to the decoding frame interval time. The stuttering determination module 620 is further configured to:

[0139] Based on the playback scene information, determine the target frame rate and the target frame interval time;

[0140] The target frame rate and the first proportional value are multiplied to obtain the third threshold;

[0141] The target frame interval time and the second proportional value are multiplied to obtain the fourth threshold.

[0142] The target frame interval time and the third ratio value are multiplied to obtain the fifth threshold.

[0143] In some embodiments, the resource adjustment module 630 is specifically used for:

[0144] Input the playback scene information corresponding to the audio and video data into the target prediction model, and output the current resource demand information through the target prediction model;

[0145] Adjust resources based on current resource usage and current resource demand information.

[0146] In some embodiments, the current resource usage information includes current remaining CPU resource information, current remaining memory resource information, current remaining network bandwidth resource information, and current remaining disk IP resource information; the current resource demand information includes current CPU resource demand information, current memory resource demand information, current network bandwidth resource demand information, and current disk IP resource demand information; the resource adjustment module 630 is further configured to:

[0147] Based on the current remaining CPU resources and the current CPU resource demand, determine the current CPU resource demand.

[0148] Based on the current remaining memory resource information and the current memory resource demand information, determine the current memory resource demand;

[0149] Based on the current remaining network bandwidth resources and the current network bandwidth resource demand, determine the current network bandwidth resource demand.

[0150] Based on the current remaining disk IP resource information and the current disk IP resource demand information, determine the current disk IP resource demand;

[0151] Adjust resources based on current CPU resource requirements, current memory resource requirements, current network bandwidth resource requirements, and current disk IP resource requirements.

[0152] In some embodiments, the resource adjustment module 630 is further configured to:

[0153] Output first resource adjustment information and second resource adjustment information, and receive user selection operation for the first resource adjustment information and second resource adjustment information; the first resource adjustment information is used to indicate automatic resource adjustment, and the second resource adjustment information is used to indicate manual resource adjustment;

[0154] If the user selects the first resource adjustment information, resource adjustments will be made based on the current CPU resource requirements, current memory resource requirements, current network bandwidth resource requirements, and current disk IP resource requirements.

[0155] If the user selects the second resource adjustment information, optimization suggestions will be output based on the current CPU resource requirements, current memory resource requirements, current network bandwidth resource requirements, and current disk IP resource requirements; the optimization suggestions include multiple optimization suggestions;

[0156] It receives user selections from multiple optimization suggestions and adjusts resources based on the selected suggestions.

[0157] This application also provides a computer device that integrates any of the resource adjustment devices provided in this application. The computer device includes:

[0158] One or more processors;

[0159] Memory; and

[0160] One or more applications, wherein the applications are stored in memory and configured to be executed by a processor from the steps of the resource adjustment method in any of the embodiments described above.

[0161] This application also provides a computer device that integrates any of the resource adjustment devices provided in this application. For example... Figure 12 As shown, it illustrates a structural schematic diagram of the computer device involved in the embodiments of this application, specifically:

[0162] The computer device may include components such as a processor 801 with one or more processing cores, a memory 802 with one or more computer-readable storage media, a power supply 803, and an input unit 804. Those skilled in the art will understand that... Figure 12 The computer device structure shown does not constitute a limitation on the computer device and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein:

[0163] The processor 801 is the control center of the computer device. It connects various parts of the computer device via various interfaces and lines. By running or executing software programs and / or modules stored in the memory 802, and by calling data stored in the memory 802, it performs various functions of the computer device and processes data, thereby providing overall monitoring of the computer device. Optionally, the processor 801 may include one or more processing cores; preferably, the processor 801 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 801.

[0164] The memory 802 can be used to store software programs and modules. The processor 801 executes various functional applications and data processing by running the software programs and modules stored in the memory 802. The memory 802 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 802 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 802 may also include a memory controller to provide the processor 801 with access to the memory 802.

[0165] The computer device also includes a power supply 803 that supplies power to the various components. Preferably, the power supply 803 can be logically connected to the processor 801 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 803 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0166] The computer device may also include an input unit 804, which can be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0167] Although not shown, the computer device may also include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 801 in the computer device loads the executable files corresponding to the processes of one or more application programs into the memory 802 according to the following instructions, and the processor 801 runs the application programs stored in the memory 802 to realize various functions, as follows:

[0168] Obtain the decoding information and playback scene information corresponding to the audio and video data;

[0169] Based on decoding information and playback scenario information, determine whether there is playback stuttering in the audio and video data;

[0170] If there are playback stutters in the audio and video data, resource adjustments will be made based on the playback scenario information and current resource usage information corresponding to the audio and video data.

[0171] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0172] Therefore, embodiments of this application provide a computer-readable storage medium, which may include: read-only memory (ROM), random access memory (RAM), a magnetic disk, or an optical disk, etc. A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps in any of the resource adjustment methods provided in embodiments of this application. For example, the computer program loaded by the processor can execute the following steps:

[0173] Obtain the decoding information and playback scene information corresponding to the audio and video data;

[0174] Based on decoding information and playback scenario information, determine whether there is playback stuttering in the audio and video data;

[0175] If there are playback stutters in the audio and video data, resource adjustments will be made based on the playback scenario information and current resource usage information corresponding to the audio and video data.

[0176] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the detailed descriptions of other embodiments above, which will not be repeated here.

[0177] In practice, each of the above units or structures can be implemented as an independent entity or can be arbitrarily combined to be implemented as the same or several entities. For the specific implementation of each of the above units or structures, please refer to the previous method embodiments, which will not be repeated here.

[0178] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0179] The resource adjustment method, apparatus, computer device, and computer-readable storage medium provided in the embodiments of this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A resource adjustment method, characterized in that, include: Obtain the decoding information and playback scene information corresponding to the audio and video data; Based on the decoding information and the playback scene information, determine whether there is playback stuttering in the audio and video data; If the audio and video data experiences playback stuttering, resource adjustments are made based on the playback scenario information and current resource usage information corresponding to the audio and video data.

2. The resource adjustment method according to claim 1, characterized in that, The step of determining whether there is playback stuttering in the audio and video data based on the decoding information and the playback scene information includes: Based on the playback scene information, the threshold information is determined; Based on the decoding information and the threshold information, it is determined whether there is playback stuttering in the audio and video data.

3. The resource adjustment method according to claim 2, characterized in that, The decoding information includes decoder initialization time, decoding processing time, average decoding frame rate, and decoding frame interval time. The threshold information includes a first threshold corresponding to the decoder initialization time, a second threshold corresponding to the decoding processing time, a third threshold corresponding to the average decoding frame rate, a fourth threshold corresponding to the decoding frame interval time, and a fifth threshold corresponding to the decoding frame interval time. The step of determining whether there is playback stuttering in the audio and video data based on the decoding information and the threshold information includes: If the decoder initialization time is greater than the first threshold, and / or the decoding processing time is greater than the second threshold, and / or the average decoding frame rate is less than the third threshold, and / or the decoding frame interval time is greater than the fourth threshold, it is determined that the audio and video data has playback stuttering. If the decoder initialization time is greater than the first threshold, and / or the decoding processing time is greater than the second threshold, and / or the average decoding frame rate is less than the third threshold, and / or the decoding frame interval time is less than the fifth threshold, it is determined that the audio and video data has playback stuttering.

4. The resource adjustment method according to claim 2, characterized in that, The threshold information includes a third threshold corresponding to the average decoding frame rate, a fourth threshold corresponding to the decoding frame interval time, and a fifth threshold corresponding to the decoding frame interval time. The step of determining the threshold information based on the playback scene information includes: Based on the playback scene information, the target frame rate and target frame interval time are determined; The target frame rate and the first ratio value are multiplied to obtain the third threshold; The target frame interval time and the second ratio value are multiplied to obtain the fourth threshold. The target frame interval time and the third ratio value are multiplied to obtain the fifth threshold.

5. The resource adjustment method according to claim 1, characterized in that, The resource adjustment based on the playback scene information and current resource usage information corresponding to the audio and video data includes: The playback scene information corresponding to the audio and video data is input into the target prediction model, and the current resource demand information is output through the target prediction model. Resource adjustments are made based on the current resource usage information and the current resource demand information.

6. The resource adjustment method according to claim 5, characterized in that, The current resource usage information includes the current remaining CPU resource information, the current remaining memory resource information, the current remaining network bandwidth resource information, and the current remaining disk IP resource information; the current resource demand information includes the current CPU resource demand information, the current memory resource demand information, the current network bandwidth resource demand information, and the current disk IP resource demand information. The resource adjustment based on the current resource usage information and the current resource demand information includes: Based on the current remaining CPU resource information and the current CPU resource demand information, determine the current CPU resource demand. Based on the current remaining memory resource information and the current memory resource demand information, determine the current memory resource demand. Based on the current remaining network bandwidth resource information and the current network bandwidth resource demand information, the current network bandwidth resource demand is determined; Based on the current remaining disk IP resource information and the current disk IP resource demand information, determine the current disk IP resource demand. Resource adjustments are made based on the current CPU resource requirements, the current memory resource requirements, the current network bandwidth resource requirements, and the current disk IP resource requirements.

7. The resource adjustment method according to claim 6, characterized in that, The resource adjustment based on the current CPU resource requirement, the current memory resource requirement, the current network bandwidth resource requirement, and the current disk IP resource requirement includes: Output first resource adjustment information and second resource adjustment information, and receive user selection operations for the first resource adjustment information and the second resource adjustment information; the first resource adjustment information is used to indicate automatic resource adjustment, and the second resource adjustment information is used to indicate manual resource adjustment; If the user selects the first resource adjustment information, resource adjustments are made based on the current CPU resource requirements, the current memory resource requirements, the current network bandwidth resource requirements, and the current disk IP resource requirements; If the user selects the second resource adjustment information, optimization suggestion information is output based on the current CPU resource requirement, the current memory resource requirement, the current network bandwidth resource requirement, and the current disk IP resource requirement; the optimization suggestion information includes multiple optimization suggestions; The system receives the user's selection of multiple optimization suggestions and adjusts resources based on the selected optimization suggestions.

8. A resource adjustment device, characterized in that, include: The information acquisition module is used to acquire decoding information and playback scene information corresponding to audio and video data; The stuttering determination module is used to determine whether there is playback stuttering in the audio and video data based on the decoding information and the playback scene information; The resource adjustment module is used to adjust resources based on the playback scenario information and current resource usage information corresponding to the audio and video data if there is playback stuttering in the audio and video data.

9. A computer device, characterized in that, The computer device includes: One or more processors; Memory; and One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the resource adjustment method of any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, It stores a computer program, which is loaded by a processor to perform the steps of the resource adjustment method according to any one of claims 1 to 7.