Video code rate determination method and device and related equipment

Abstract

The invention provides a video code rate determination method and device and related equipment, and relates to the technical field of video processing. The method comprises the following steps: acquiring network state information and cache information; in response to the condition that the to-be-transmitted video fragment meets the code rate adjustment condition, according to the network state information and the cache information, predicting transmission delay information of the to-be-transmitted video fragment under the plurality of video code rates; predicting experience quality information of the to-be-transmitted video fragment under the plurality of video code rates according to the transmission delay information of the to-be-transmitted video fragment under the plurality of video code rates; and determining a target video code rate of the to-be-transmitted video fragment from the plurality of video code rates according to the experience quality information of the to-be-transmitted video fragment under the plurality of video code rates. Through the method, the target video code rate for balancing the video quality and the transmission delay can be selected, and the method is suitable for application scenes with high video transmission delay requirements.

Description

Technical Field

[0001] The present disclosure relates to the field of video processing technology, and in particular to a method for determining a video bit rate, an apparatus for determining a video bit rate, an electronic device, a computer-readable storage medium, and a computer program product. Background Art

[0002] In the audio and video data transmission scenario, since the user's network environment is constantly changing, in order to ensure the smooth playback of audio and video content and maintain the user's viewing experience, the video bit rate is selected according to the real-time network bandwidth conditions. Based on this demand, Adaptive Bitrate (ABR) control technology came into being. This technology can select the appropriate video bit rate according to the user's current network conditions.

[0003] However, the ABR control method in the related art does not consider the control of video transmission delay when constructing the user experience quality (Quality of Experience, QoE) optimization model. This limitation is particularly prominent in application scenarios with high requirements for video transmission delay, such as real-time interactive live broadcast, online games or remote collaboration, which seriously affects the user experience.

[0004] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0005] The present disclosure provides a method for determining a video bit rate, an apparatus for determining a video bit rate, an electronic device, a computer-readable storage medium, and a computer program product, so as to overcome the above problems or at least partially solve the above problems.

[0006] According to one aspect of an embodiment of the present disclosure, a method for determining a video bit rate is provided, the method comprising: acquiring network status information and cache information; in response to a video segment to be transmitted satisfying a bit rate adjustment condition, predicting, based on the network status information and the cache information, transmission delay information of the video segment to be transmitted at multiple video bit rates; predicting, based on the transmission delay information of the video segment to be transmitted at multiple video bit rates, experience quality information of the video segment to be transmitted at multiple video bit rates; and determining, from multiple video bit rates, a target video bit rate of the video segment to be transmitted based on the experience quality information of the video segment to be transmitted at multiple video bit rates.

[0007] In some embodiments of the present disclosure, the cache information includes: first cache information of a terminal device and second cache information of a server; wherein, predicting the transmission delay information of the video segment to be transmitted at multiple video bit rates based on the network status information and the cache information includes: for each of the multiple video bit rates, predicting the transmission bandwidth information of the video segment to be transmitted at the video bit rate based on the network status information; determining the first transmission delay information of the video segment to be transmitted at the video bit rate based on the first cache information and the transmission bandwidth information; determining the second transmission delay information of the video segment to be transmitted at the video bit rate based on the second cache information and the transmission bandwidth information; and obtaining the transmission delay information of the video segment to be transmitted at the video bit rate based on the first transmission delay information and the second transmission delay information.

[0008] In some embodiments of the present disclosure, determining the first transmission delay information of the video segment to be transmitted at the video bit rate based on the first cache information and the transmission bandwidth information includes: predicting the data amount of the video segment to be transmitted at the video bit rate based on the transmission bandwidth information; determining the transmission delay duration of the video segment to be transmitted at the video bit rate based on a preset cache duration threshold and based on the first cache information, the transmission bandwidth information and the data amount; and using the transmission delay as the first transmission delay information.

[0009] In some embodiments of the present disclosure, determining the second transmission delay information of the video segment to be transmitted at the video bit rate based on the second cache information and the transmission bandwidth information includes: predicting the remaining cache information of the server based on the second cache information and the transmission bandwidth information; the remaining cache information is the cache information after the server sends the video segment to be transmitted; in response to the remaining cache information being greater than a preset value, using the remaining cache information as the second transmission delay information; in response to the remaining cache information being less than or equal to a preset value, determining that the second transmission delay information is the preset value.

[0010] In some embodiments of the present disclosure, predicting the experience quality information of the video fragment to be transmitted at multiple video bit rates based on the transmission delay information of the video fragment to be transmitted at multiple video bit rates includes: for each video bit rate in the multiple video bit rates, predicting the quality information of the video fragment to be transmitted at the video bit rate and the quality fluctuation information of the video fragment to be transmitted at the video bit rate; based on the quality information of the video fragment to be transmitted at the video bit rate, the quality fluctuation information of the video fragment to be transmitted at the video bit rate and the transmission delay information of the video fragment to be transmitted at the video bit rate, obtaining the experience quality information of the video fragment to be transmitted at the video bit rate.

[0011] In some embodiments of the present disclosure, after determining the target video bit rate of the video fragment to be transmitted from multiple video bit rates based on the experience quality information of the video fragment to be transmitted at multiple video bit rates, the method also includes: in response to the target video bit rate being the same as the current video bit rate, transmitting the video fragment to be transmitted according to the current video bit rate; in response to the target video bit rate being different from the current video bit rate, searching for a key video frame corresponding to the video fragment to be transmitted; based on the key video frame, switching the current video bit rate to the target video bit rate, and transmitting the video fragment to be transmitted according to the target video bit rate.

[0012] In some embodiments of the present disclosure, the to-be-transmitted video segments satisfy the bit rate adjustment condition, including: the segment information or the transmission time of the to-be-transmitted video segments reaches a preset bit rate adjustment period.

[0013] According to another aspect of an embodiment of the present disclosure, a device for determining a video bit rate is provided, the device comprising: an information acquisition module, configured to acquire network status information and cache information; a quality prediction module, configured to predict, in response to a video segment to be transmitted satisfying a bit rate adjustment condition, transmission delay information of the video segment to be transmitted at multiple video bit rates according to the network status information and the cache information; predict experience quality information of the video segment to be transmitted at multiple video bit rates according to the transmission delay information of the video segment to be transmitted at multiple video bit rates; a bit rate determination module, configured to determine a target video bit rate of the video segment to be transmitted from multiple video bit rates according to the experience quality information of the video segment to be transmitted at multiple video bit rates.

[0014] In some embodiments of the present disclosure, the cache information includes: first cache information of a terminal device and second cache information of a server; wherein the quality prediction module is further configured to: for each of the multiple video bit rates, predict the transmission bandwidth information of the video segment to be transmitted at the video bit rate according to the network status information; determine the first transmission delay information of the video segment to be transmitted at the video bit rate according to the first cache information and the transmission bandwidth information; determine the second transmission delay information of the video segment to be transmitted at the video bit rate according to the second cache information and the transmission bandwidth information; and obtain the transmission delay information of the video segment to be transmitted at the video bit rate based on the first transmission delay information and the second transmission delay information.

[0015] In some embodiments of the present disclosure, the quality prediction module is further configured to: predict the data volume of the video segment to be transmitted at the video bit rate based on the transmission bandwidth information; determine the transmission delay duration of the video segment to be transmitted at the video bit rate based on a preset cache duration threshold and according to the first cache information, the transmission bandwidth information and the data volume; and use the transmission delay as the first transmission delay information.

[0016] In some embodiments of the present disclosure, the quality prediction module is further configured to: predict the remaining cache information of the server based on the second cache information and the transmission bandwidth information; the remaining cache information is the cache information after the server sends the video fragment to be transmitted; in response to the remaining cache information being greater than a preset value, using the remaining cache information as the second transmission delay information; in response to the remaining cache information being less than or equal to a preset value, determining that the second transmission delay information is the preset value.

[0017] In some embodiments of the present disclosure, the quality prediction module is further configured to: for each video bit rate among the multiple video bit rates, predict the quality information of the video segment to be transmitted at the video bit rate and the quality fluctuation information of the video segment to be transmitted at the video bit rate; based on the quality information of the video segment to be transmitted at the video bit rate, the quality fluctuation information of the video segment to be transmitted at the video bit rate and the transmission delay information of the video segment to be transmitted at the video bit rate, obtain the experience quality information of the video segment to be transmitted at the video bit rate.

[0018] In some embodiments of the present disclosure, the device also includes a video transmission module, which is configured to: in response to the target video bit rate being the same as the current video bit rate, transmit the video fragment to be transmitted according to the current video bit rate; in response to the target video bit rate being different from the current video bit rate, search for a key video frame corresponding to the video fragment to be transmitted; based on the key video frame, switch the current video bit rate to the target video bit rate, and transmit the video fragment to be transmitted according to the target video bit rate.

[0019] In some embodiments of the present disclosure, the to-be-transmitted video segments satisfy the bit rate adjustment condition, including: the segment information or the transmission time of the to-be-transmitted video segments reaches a preset bit rate adjustment period.

[0020] According to another aspect of an embodiment of the present disclosure, an electronic device is provided, including: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute the executable instructions to implement the above-mentioned method for determining a video bit rate.

[0021] According to another aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device can execute the above-mentioned method for determining a video bit rate.

[0022] According to another aspect of an embodiment of the present disclosure, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the above-mentioned method for determining a video bit rate is implemented.

[0023] In the method for determining the video bit rate provided by the embodiment of the present disclosure, the network status information and the cache information are monitored, and when it is determined that the video segment to be transmitted meets the bit rate adjustment conditions, the transmission delay information of the video segment to be transmitted at multiple video bit rates is predicted based on the network status information and the cache information, and then the predicted transmission delay information is used to further predict the experience quality information of the video segment to be transmitted at multiple video bit rates, and finally, based on the predicted experience quality information, a target video bit rate suitable for the video segment to be transmitted is selected from multiple video bit rates. This method predicts the transmission delay of the video segment to be transmitted at different video bit rates, and selects the target video bit rate that can balance the video quality and transmission delay accordingly, which solves the limitation that the ABR control method does not consider the control of video transmission delay, is suitable for application scenarios with high requirements for video transmission delay, and performs data transmission based on the target video bit rate, which can effectively reduce the delay of data transmission and improve the real-time transmission capability of data, thereby bringing users a smoother and non-stuttering viewing and interactive experience.

[0024] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.

[0026] Figure 1 A schematic diagram showing an exemplary system architecture to which the method for determining a video bit rate according to an embodiment of the present disclosure can be applied;

[0027] Figure 2 A flow chart of a method for determining a video bit rate according to an embodiment of the present disclosure is shown;

[0028] Figure 3 A flow chart of predicting transmission delay information in a method for determining a video bit rate according to an embodiment of the present disclosure is shown;

[0029] Figure 4 A flow chart showing data transmission based on a target video bit rate according to an embodiment of the present disclosure is shown;

[0030] Figure 5 A block diagram of a device for determining a video bit rate according to an embodiment of the present disclosure is shown;

[0031] Figure 6 A schematic structural diagram of an electronic device according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0032] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in many forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be comprehensive and complete and will fully convey the concepts of the example embodiments to those skilled in the art. The same reference numerals in the figures represent the same or similar parts, and thus their repeated description will be omitted.

[0033] The features, structures or characteristics described in the present disclosure may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced while omitting one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known methods, devices, implementations or operations are not shown or described in detail to avoid blurring the various aspects of the present disclosure.

[0034] The collection, collection, updating, analysis, processing, use, transmission, storage and other aspects of the user personal information involved in this disclosure are in compliance with the relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. Necessary measures are taken for user personal information to prevent illegal access to user personal information data and maintain the security of user personal information, network security and national security.

[0035] The accompanying drawings are only schematic diagrams of the present disclosure, and the same reference numerals in the drawings represent the same or similar parts, so their repeated description will be omitted. Some block diagrams shown in the accompanying drawings do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in at least one hardware module or integrated circuit, or implemented in different networks and / or processor devices and / or microcontroller devices.

[0036] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and steps, nor must they be executed in the order described. For example, some steps can be decomposed, and some steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0037] In this specification, the terms "a", "an", "the", "said" and "at least one" are used to indicate the presence of at least one element / component / etc.; the term "plurality" refers to two or more; the terms "comprising", "including" and "having" are used to express an open-ended inclusion and mean that additional elements / components / etc. may exist in addition to the listed elements / components / etc.; the terms "first", "second" and "third" etc. are used only as labels and are not intended to limit the quantity of their objects.

[0038] Figure 1 A schematic diagram showing an exemplary system architecture to which the method for determining a video bit rate according to an embodiment of the present disclosure can be applied is shown.

[0039] like Figure 1As shown, the system architecture may include a server 101, a network 102 and a terminal device 103. The network 102 is used to provide a medium for a communication link between the terminal device 103 and the server 101. The network 102 may include various connection types, such as wired, wireless communication links or optical fiber cables.

[0040] In an exemplary embodiment, the terminal device 103 for data transmission with the server 101 may include but is not limited to mobile devices such as smart phones, tablet computers, and laptop computers, as well as terminal devices with specific functions or forms such as smart speakers, digital assistants, AR (Augmented Reality) devices, VR (Virtual Reality) devices, and smart wearable devices. Alternatively, the terminal device 103 may also be a personal computer, such as a laptop computer and a desktop computer. Optionally, the operating system running on the electronic device may include but is not limited to Android, IOS, Linux, Windows, etc.

[0041] Server 101 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. In some practical applications, server 101 can also be a server of a network platform, which can be, for example, a trading platform, a live broadcast platform, a social platform, or an audio platform, etc., which is not limited in the embodiments of the present disclosure. Among them, the server can be a single server or a cluster formed by multiple servers, and the present disclosure does not limit the specific architecture of the server.

[0042] In addition, it should be noted that Figure 1 What is shown is only one application environment of the method for determining the video bit rate provided by the present disclosure. Figure 1 The number of terminal devices 103, networks 102 and servers 101 is merely illustrative, and any number of terminal devices, networks and servers may be provided according to actual needs.

[0043] Figure 2 A flow chart of a method for determining a video bit rate according to an embodiment of the present disclosure is shown. Figure 2 In the embodiment, the execution subject of the method can be any electronic device with data processing and transmission capabilities, such as Figure 1 The server 101 in the embodiment is also as follows Figure 1In the embodiment, the server 101 and the terminal device 103 jointly implement the method for determining the video bit rate, but the present disclosure is not limited thereto. Figure 2 , the determination of the video bit rate provided by the embodiment of the present disclosure includes the following steps.

[0044] Step S210, obtaining network status information and cache information.

[0045] In the disclosed embodiments, the network status information is the status information of the transmission link between the server and the terminal device, which may include parameters such as network throughput, delay, jitter, etc., reflecting the transmission capacity of the current network, which is crucial for predicting the delay of video transmission, evaluating the fluctuation of video quality, etc. The cache information is used to characterize the cache status of the server and the terminal device, which is important for evaluating the efficiency of video transmission and user experience.

[0046] In some embodiments, the server may monitor network status information and cache information in real time, wherein the terminal device may regularly report its cache information to the server so that the server may determine the video bit rate based on the cache information of the terminal device.

[0047] Step S220 , in response to the to-be-transmitted video segment satisfying the bit rate adjustment condition, predicting the transmission delay information of the to-be-transmitted video segment at multiple video bit rates according to the network state information and the cache information.

[0048] A video can be considered as a collection of multiple video segments, each of which contains a part of the video content, and these segments can be reassembled into a complete video in sequence when played. Each video segment is further composed of one or more video frames, which are the basic components of a video and contain video images and sound information.

[0049] In the embodiment of the present disclosure, the video segment is a basic unit in video transmission, which is used to realize the step-by-step transmission and reception of video data. The video segment to be transmitted refers to the video segment that currently needs to perform data transmission.

[0050] In the disclosed embodiment, multiple video bit rates refer to pre-set bit rates, and different bit rates correspond to different video resolutions. For example, multiple video bit rates include but are not limited to 360Kbps, 550Kbps, 1200Kbps, or 2000Kbps, etc., and the corresponding video resolutions are, for example, smooth, standard definition, high definition, or 2k, etc. Transmission delay information refers to information used to characterize the transmission delay between the slave server and the terminal device.

[0051] In step S220, it is determined whether the video segment to be transmitted meets the bit rate adjustment condition. If the video segment to be transmitted meets the bit rate adjustment condition, the transmission delay information of the video segment to be transmitted at multiple video bit rates is predicted according to the network state information and the cache information. The transmission delay information of the video segment to be transmitted at multiple video bit rates refers to the transmission delay information of the video segment to be transmitted at each video bit rate among the multiple video bit rates.

[0052] Among multiple video bit rates, each bit rate corresponds to a different data transmission rate and compression efficiency. Therefore, transmitting the video segment to be transmitted at different video bit rates will generate different transmission delay information. By predicting these transmission delay information, the transmission performance of the video segment to be transmitted at different video bit rates can be evaluated.

[0053] In some embodiments of the present disclosure, the video segments to be transmitted meet the bit rate adjustment condition, including: the segment information or the transmission time of the video segments to be transmitted reaches a preset bit rate adjustment period.

[0054] In the disclosed embodiment, the segment information of the video segment to be transmitted refers to data information related to the video segment, such as the serial number of the video segment. In an exemplary embodiment, the preset bit rate adjustment period can be a quantity threshold for triggering the bit rate adjustment mechanism. For example, it is set that each video segment triggers the bit rate adjustment mechanism, that is, for each video segment to be transmitted, before the data of the video segment to be transmitted is transmitted, the bit rate adjustment mechanism will be triggered to determine an optimal target video bit rate for the video segment to be transmitted.

[0055] In a possible implementation, the video fragment to be transmitted includes a video frame, and the fragment information of the video fragment to be transmitted is the frame number of the video frame. That is to say, before data transmission is performed on each video frame of the video frame, it is determined whether the preset bit rate adjustment period has been reached according to the frame number of the video frame. In this case, the preset bit rate adjustment period can be a quantity threshold for triggering the bit rate adjustment mechanism. For example, the bit rate adjustment mechanism is set to be triggered every 10 video frames. Before data transmission is performed on the video frame with the frame number 8, it is determined that the bit rate adjustment mechanism will not be triggered. Before data transmission is performed on the video frame with the frame number 11, the bit rate adjustment mechanism will be triggered, and the video frame determines an optimal target video bit rate.

[0056] In an exemplary embodiment, the preset bit rate adjustment period may be a time interval for triggering the bit rate adjustment mechanism. For example, the bit rate adjustment mechanism is set to be triggered every 5 minutes. During the video transmission process, every time a 5-minute time interval passes, the bit rate adjustment of the current video segment to be transmitted is determined.

[0057] In the method for determining the video bit rate of the embodiment of the present disclosure, the segment information or transmission time of the video segment to be transmitted is analyzed, and based on this, it is determined whether a preset bit rate adjustment period (which can be a threshold based on quantity or a time interval) is reached, thereby intelligently triggering a bit rate adjustment mechanism. This mechanism can ensure that the optimal target video bit rate is selected for the video segment to be transmitted according to the video transmission requirements during the video transmission process.

[0058] Step S230: predicting the experience quality information of the video fragments to be transmitted at multiple video bit rates according to the transmission delay information of the video fragments to be transmitted at multiple video bit rates.

[0059] In the disclosed embodiment, after the transmission delay information of the video segments to be transmitted at multiple video bit rates is predicted, the experience quality information of the video segments to be transmitted at multiple video bit rates is further predicted based on the transmission delay information.

[0060] The experience quality information is a comprehensive indicator that takes into account multiple factors, such as transmission delay, video quality (such as resolution, frame rate), quality fluctuation, freeze rate, etc. The experience quality information of the video fragment to be transmitted at multiple video bit rates refers to the experience quality information of the video fragment to be transmitted at each video bit rate among the multiple video bit rates.

[0061] Step S240: determining a target video bit rate of the video segment to be transmitted from the multiple video bit rates according to the experience quality information of the video segment to be transmitted at the multiple video bit rates.

[0062] In the embodiment of the present disclosure, the experience quality information of the video segment to be transmitted at each video bit rate among multiple video bit rates is used to indicate the quality of viewing experience that a user may obtain under the transmission condition of the video segment to be transmitted at the bit rate. The experience quality information of the video segment to be transmitted at each video bit rate among multiple video bit rates is compared and analyzed, and the optimal target video bit rate is selected for the video segment to be transmitted from the multiple video bit rates.

[0063] In an exemplary embodiment, the experience quality information is a quality score value, and the maximum value is selected from the quality score values ​​of the video fragment to be transmitted at various video bit rates, and the video bit rate corresponding to the maximum value is determined as the target video bit rate of the video fragment to be transmitted.

[0064] In the method for determining the video bit rate provided by the embodiment of the present disclosure, the network status information and the cache information are monitored, and when it is determined that the video segment to be transmitted meets the bit rate adjustment conditions, the transmission delay information of the video segment to be transmitted at multiple video bit rates is predicted based on the network status information and the cache information, and then the predicted transmission delay information is used to further predict the experience quality information of the video segment to be transmitted at multiple video bit rates, and finally, based on the predicted experience quality information, a target video bit rate suitable for the video segment to be transmitted is selected from multiple video bit rates. This method predicts the transmission delay of the video segment to be transmitted at different video bit rates, and selects the target video bit rate that can balance the video quality and transmission delay accordingly, which solves the limitation that the ABR control method does not consider the control of video transmission delay, is suitable for application scenarios with high requirements for video transmission delay, and performs data transmission based on the target video bit rate, which can effectively reduce the delay of data transmission and improve the real-time transmission capability of data, thereby bringing users a smoother and non-stuttering viewing and interactive experience.

[0065] Figure 3 A flow chart of predicting transmission delay information in a method for determining a video bit rate according to an embodiment of the present disclosure is shown. Figure 3 The embodiment shows a process of determining transmission delay information of a video segment to be transmitted at each video bit rate, which may include the following steps.

[0066] Step S310: for each video bit rate among a plurality of video bit rates, predict the transmission bandwidth information of the video fragment to be transmitted at the video bit rate according to the network status information.

[0067] In the disclosed embodiment, the transmission bandwidth information refers to the capacity or rate of the data transmission channel, which determines the speed at which data is transmitted from the sending end to the receiving end. For each video bit rate, based on the network status information, the transmission bandwidth that the video segment to be transmitted can obtain when the video bit rate is selected is predicted.

[0068] In an exemplary embodiment, the transmission bandwidth information of the video segment to be transmitted at each video bit rate can be predicted based on the network status information and combined with the analysis of the transmission data volume, transmission time and other information of the historical video segments. The historical video segments refer to the video segments transmitted before the video segment to be transmitted, such as the previous video segment of the video segment to be transmitted.

[0069] Step S320: determining first transmission delay information of the to-be-transmitted video fragment at the video bit rate according to the first buffer information and the transmission bandwidth information.

[0070] In the disclosed embodiment, the cache information includes first cache information of the terminal device, which is used to indicate the cache status of the terminal device. In step S320, the first transmission delay information of the video segment to be transmitted at the video bit rate is determined based on the first cache information and the transmission bandwidth information. Since the first transmission delay information reflects the cache status of the terminal device, the first transmission delay information can also be referred to as the transmission delay information of the terminal device side at the video bit rate, that is, the transmission delay information of the receiving end at the video bit rate.

[0071] In some embodiments of the present disclosure, first transmission delay information of a video segment to be transmitted at a video bit rate is determined based on first cache information and transmission bandwidth information, including: predicting the data volume of the video segment to be transmitted at the video bit rate based on the transmission bandwidth information; determining the transmission delay duration of the video segment to be transmitted at the video bit rate based on a preset cache duration threshold and based on the first cache information, transmission bandwidth information and data volume; and using the transmission delay as the first transmission delay information.

[0072] In the embodiment of the present disclosure, the video fragments to be transmitted include K video frames, the transmission bandwidth information of the video fragments to be transmitted at the video bit rate includes the transmission bandwidth when each video frame is transmitted at the video bit rate, and the data volume of the video fragments to be transmitted at the video bit rate includes the data volume when each video frame is transmitted at the video bit rate.

[0073] In the disclosed embodiment, the first cache information is the buffer occupancy when the terminal device receives the video fragments to be transmitted, and may include the buffer occupancy when the terminal device receives each video frame.

[0074] The calculation formula of the first transmission delay information of the video segment to be transmitted at the video bit rate is as follows:

[0075]

[0076] In formula (1), QoE_1 represents the first transmission delay information of the video segment to be transmitted at the video bit rate R, C k+1 is the transmission bandwidth information of the k+1th video frame at the video bit rate R, d(R k+1 ) is the data volume of the k+1th video frame at the video bit rate R, B k+1 The target_jitter_buf is the preset buffer duration threshold, that is, the minimum buffer duration of the terminal device. The threshold is set to prevent the terminal device from freezing when receiving data.

[0077] In formula (1), This corresponds to the calculation process of the transmission delay duration when the k+1th video frame is transmitted at the video bit rate R, where: Indicates the time required from the current buffer state to receiving the k+1th video frame. The absolute value after subtracting target_jitter_buf represents the deviation from the preset cache duration threshold.

[0078] In the embodiment of the present disclosure, by comprehensively considering factors such as transmission bandwidth, data volume, buffer occupancy (first cache information) and preset cache duration threshold, the transmission delay that may be generated by the terminal device in the process of receiving video fragments at the video bit rate is quantitatively described, thereby accurately characterizing the transmission delay of the terminal device at the video bit rate.

[0079] Step S330: Determine second transmission delay information of the video segment to be transmitted at the video bit rate according to the second buffer information and the transmission bandwidth information.

[0080] In the disclosed embodiment, the cache information includes second cache information of the server, which is used to indicate the cache status of the server. In step S330, second transmission delay information of the video segment to be transmitted at the video bit rate is determined according to the second cache information and the transmission bandwidth information. Since the second transmission delay information reflects the cache status of the server, the second transmission delay information can also be referred to as the transmission delay information on the server side, that is, the transmission delay information on the sending end.

[0081] In some embodiments of the present disclosure, second transmission delay information of the video segment to be transmitted at the video bit rate is determined based on the second cache information and the transmission bandwidth information, including: predicting the remaining cache information of the server based on the second cache information and the transmission bandwidth information, the remaining cache information being the cache information after the server sends the video segment to be transmitted; in response to the remaining cache information being greater than a preset value, using the remaining cache information as the second transmission delay information; in response to the remaining cache information being less than or equal to the preset value, determining the second transmission delay information to be the preset value.

[0082] In the embodiment of the present disclosure, the video fragment to be transmitted includes K video frames, and the transmission bandwidth information of the video fragment to be transmitted at the video bit rate includes the transmission bandwidth when each video frame is transmitted at the video bit rate. The calculation formula of the second transmission delay information of the video fragment to be transmitted at the video bit rate is as follows:

[0083]

[0084] In formula (2), QoE_2 represents the second transmission delay information of the video segment to be transmitted at the video bit rate R, C k+1 is the transmission bandwidth information of the k+1th video frame at the video bit rate R, b(R k+1,C k+1 ) is the server with the video bit rate R and transmission bandwidth C k+1 The cache information consumed when sending the k+1th video frame, b now is the current cache of the server, b(R k+1 ,C k+1 )+b now Indicates the remaining cache information after the server sends the k+1th video frame.

[0085] It can be seen from formula (2) that the preset value is set to 0. If it is predicted that the remaining cache information after the server sends the k+1th video frame is less than 0, the second transmission delay information corresponding to the k+1th video frame is directly set to 0, that is, it is no longer included in the transmission delay information.

[0086] In the disclosed embodiment, the remaining cache information (non-negative value) after the server sends the video frame at the video bit rate is used as a measurement indicator of the second transmission delay information. The lower the value, the smaller the transmission delay. It quantitatively describes the transmission delay that may be generated by the server in the process of sending video fragments at the video bit rate, thereby accurately characterizing the transmission delay of the server at the video bit rate.

[0087] Step S340: Based on the first transmission delay information and the second transmission delay information, transmission delay information of the video segment to be transmitted at the video bit rate is obtained.

[0088] In the disclosed embodiment, the first transmission delay information is the first transmission delay information of the video segment to be transmitted at the video bit rate, that is, the transmission delay information on the terminal device side, and the second transmission delay information is the second transmission delay information of the video segment to be transmitted at the video bit rate, that is, the transmission delay information on the server side. The first transmission delay information and the second transmission delay information are combined to obtain the overall transmission delay information of the video segment to be transmitted at the video bit rate, so that the overall transmission delay information covers the transmission delay information of the receiving end and the delay information of the sending end.

[0089] In some embodiments of the present disclosure, based on the transmission delay information of the video fragments to be transmitted at multiple video bit rates, the experience quality information of the video fragments to be transmitted at multiple video bit rates is predicted, including: for each video bit rate in the multiple video bit rates, predicting the quality information of the video fragment to be transmitted at the video bit rate and the quality fluctuation information of the video fragment to be transmitted at the video bit rate; based on the quality information of the video fragment to be transmitted at the video bit rate, the quality fluctuation information of the video fragment to be transmitted at the video bit rate and the transmission delay information of the video fragment to be transmitted at the video bit rate, obtaining the experience quality information of the video fragment to be transmitted at the video bit rate.

[0090] In the embodiment of the present disclosure, when analyzing each video bit rate to predict the experience quality information at the video bit rate, in addition to considering the transmission delay information at the video bit rate, the quality information and quality fluctuation information at the video bit rate are also considered, and the calculation formula is as follows:

[0091]

[0092] In formula (3), represents the experience quality information of the video segment to be transmitted at the video bit rate R, q(R k+1 ) is the quality information of the k+1th video frame at the video bit rate R, |q(R k+1 )-q(R k )|The quality change amplitude of the k+1th video frame and the kth video frame at the video bit rate R, that is, the quality fluctuation information, QoE_1 represents the first transmission delay information of the video segment to be transmitted at the video bit rate R, and QoE_2 represents the second transmission delay information of the video segment to be transmitted at the video bit rate R.

[0093] In formula (3), λ, μ, η are non-negative weighted parameters corresponding to video quality change, receiving end transmission delay, and sending end transmission delay, respectively, and their values ​​can be set according to specific requirements or empirical values.

[0094] In the method for determining the video bit rate provided in the embodiment of the present disclosure, in the process of calculating the experience quality information at each video bit rate, the quality information, quality fluctuation information, transmission delay information of the receiving end and the transmission delay information of the sending end at the video bit rate are taken into consideration, so that the experience quality information can comprehensively and flexibly evaluate and predict the user's experience when watching the video, thereby providing a more accurate evaluation result.

[0095] Figure 4 FIG. 4 is a flowchart showing data transmission based on a target video bit rate according to an embodiment of the present disclosure. Figure 4 , data transmission based on the target video bit rate may include the following steps.

[0096] Step S410, determining whether the target video bit rate is the same as the current video bit rate.

[0097] Step S420: If the target video bit rate is the same as the current video bit rate, the video segment to be transmitted is transmitted according to the current video bit rate.

[0098] Step S430: if the target video bit rate is different from the current video bit rate, searching for key video frames corresponding to the video fragments to be transmitted.

[0099] Step S440: based on the key video frame, switch the current video bit rate to the target video bit rate, and transmit the video segment to be transmitted according to the target video bit rate.

[0100] In the disclosed embodiment, the current video bit rate refers to the bit rate used by the currently transmitted video. After determining the target video bit rate of the video segment to be transmitted, it is determined whether the target video bit rate is the same as the current video bit rate. If they are the same, it means that there is no need to switch the bit rate, and the video segment to be transmitted continues to be transmitted at the current video bit rate. If they are different, it means that the bit rate needs to be switched. In order to achieve a smooth transition, the key video frame in the video segment to be transmitted is searched, and the bit rate switch is performed when the next key video frame arrives, and the video segment to be transmitted is transmitted at the target video bit rate.

[0101] When transmitting data for the video segments to be transmitted, by judging whether the target video bit rate is the same as the current video bit rate, smooth bit rate switching based on key video frames can be performed in different situations, which can optimize video transmission efficiency, ensure video quality and adapt to different network conditions.

[0102] It can be understood that the same / similar parts between the various embodiments of the above method in this specification can refer to each other, and each embodiment focuses on the differences from other embodiments. For related points, please refer to the description of other method embodiments.

[0103] Figure 5 FIG. 4 is a block diagram of a device for determining a video bit rate according to an embodiment of the present disclosure. Figure 5 As shown, the device 500 includes: an information acquisition module 510, a quality prediction module 520 and a bit rate determination module 530.

[0104] The information acquisition module 510 is configured to: acquire network status information and cache information. The quality prediction module 520 is configured to: in response to the video segment to be transmitted meeting the bit rate adjustment condition, predict the transmission delay information of the video segment to be transmitted at multiple video bit rates according to the network status information and cache information; predict the experience quality information of the video segment to be transmitted at multiple video bit rates according to the transmission delay information of the video segment to be transmitted at multiple video bit rates. The bit rate determination module 530 is configured to: determine the target video bit rate of the video segment to be transmitted from multiple video bit rates according to the experience quality information of the video segment to be transmitted at multiple video bit rates.

[0105] In some embodiments of the present disclosure, the cache information includes: first cache information of the terminal device and second cache information of the server. The quality prediction module 520 is further configured to: for each of the multiple video bit rates, predict the transmission bandwidth information of the video segment to be transmitted at the video bit rate according to the network status information; determine the first transmission delay information of the video segment to be transmitted at the video bit rate according to the first cache information and the transmission bandwidth information; determine the second transmission delay information of the video segment to be transmitted at the video bit rate according to the second cache information and the transmission bandwidth information; and obtain the transmission delay information of the video segment to be transmitted at the video bit rate based on the first transmission delay information and the second transmission delay information.

[0106] In some embodiments of the present disclosure, the quality prediction module 520 is further configured to: predict the data volume of the video segment to be transmitted at the video bit rate based on the transmission bandwidth information; determine the transmission delay duration of the video segment to be transmitted at the video bit rate based on a preset cache duration threshold and according to the first cache information, the transmission bandwidth information and the data volume; and use the transmission delay as the first transmission delay information.

[0107] In some embodiments of the present disclosure, the quality prediction module 520 is further configured to: predict the remaining cache information of the server based on the second cache information and the transmission bandwidth information; the remaining cache information is the cache information after the server sends the video fragments to be transmitted; in response to the remaining cache information being greater than a preset value, using the remaining cache information as the second transmission delay information; in response to the remaining cache information being less than or equal to the preset value, determining that the second transmission delay information is the preset value.

[0108] In some embodiments of the present disclosure, the quality prediction module 520 is further configured to: for each video bit rate among multiple video bit rates, predict the quality information of the video segment to be transmitted at the video bit rate and the quality fluctuation information of the video segment to be transmitted at the video bit rate; based on the quality information of the video segment to be transmitted at the video bit rate, the quality fluctuation information of the video segment to be transmitted at the video bit rate and the transmission delay information of the video segment to be transmitted at the video bit rate, obtain the experience quality information of the video segment to be transmitted at the video bit rate.

[0109] In some embodiments of the present disclosure, Figure 5 As shown, the device 500 also includes a video transmission module 540, which is configured to: in response to the target video bit rate being the same as the current video bit rate, transmit the video fragment to be transmitted according to the current video bit rate; in response to the target video bit rate being different from the current video bit rate, search for key video frames corresponding to the video fragment to be transmitted; based on the key video frames, switch the current video bit rate to the target video bit rate, and transmit the video fragment to be transmitted according to the target video bit rate.

[0110] In some embodiments of the present disclosure, the video segments to be transmitted meet the bit rate adjustment condition, including: the segment information or the transmission time of the video segments to be transmitted reaches a preset bit rate adjustment period.

[0111] Regarding the device in the above embodiment, the specific manner in which each unit performs the operation has been described in detail in the embodiment of the method, and will not be elaborated here.

[0112] Figure 6 FIG. 1 is a schematic diagram showing the structure of an electronic device according to an embodiment of the present disclosure. It should be noted that: Figure 6 The electronic device 600 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0113] like Figure 6 As shown, the electronic device 600 is in the form of a general computing device. The components of the electronic device 600 may include but are not limited to: at least one processing unit 610, at least one storage unit 620, and a bus 630 connecting different system components (including the storage unit 620 and the processing unit 610).

[0114] The storage unit stores program codes, which can be executed by the processing unit 610, so that the processing unit 610 performs the steps according to various exemplary embodiments of the present invention described in the above “Exemplary Method” section of this specification. For example, the processing unit 610 can perform the following steps: Figure 2 Follow the steps shown in .

[0115] The storage unit 620 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 6201 and / or a cache memory unit 6202 , and may further include a read-only memory unit (ROM) 6203 .

[0116] The storage unit 620 may also include a program / utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0117] Bus 630 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0118] The electronic device 600 may also communicate with one or more external devices 700 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 600, and / or communicate with any device that enables the electronic device 600 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 650. Furthermore, the electronic device 600 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) via a network adapter 640. As shown, the network adapter 640 communicates with other modules of the electronic device 600 via a bus 630. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0119] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of the present specification is stored. In some possible implementations, various aspects of the present invention can also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary embodiments of the present invention described in the above "Exemplary Method" section of the present specification.

[0120] The program product for implementing the above method according to the embodiment of the present invention may adopt a portable compact disk read-only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto, and in this document, a readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, apparatus, or device.

[0121] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0122] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0123] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

[0124] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0125] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.

[0126] In addition, although the steps of the method in the present disclosure are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps, etc.

[0127] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a mobile terminal, or a network device, etc.) to execute the method according to the implementation of the present disclosure.

[0128] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any modification, use or adaptation of the present disclosure, which follows the general principles of the present disclosure and includes common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the appended claims.

[0129] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for determining a video bit rate, characterized in that: The method comprises: Get network status information and cache information; In response to the to-be-transmitted video segment satisfying the bit rate adjustment condition, predicting transmission delay information of the to-be-transmitted video segment at multiple video bit rates according to the network state information and the cache information; Predicting experience quality information of the video fragment to be transmitted at multiple video bit rates according to the transmission delay information of the video fragment to be transmitted at multiple video bit rates; According to the experience quality information of the video fragment to be transmitted at multiple video bit rates, a target video bit rate of the video fragment to be transmitted is determined from the multiple video bit rates.

2. The method according to claim 1, characterized in that The cache information includes: first cache information of the terminal device and second cache information of the server; The predicting, according to the network status information and the cache information, the transmission delay information of the video segment to be transmitted at multiple video bit rates includes: For each video bit rate among the multiple video bit rates, predicting, according to the network state information, transmission bandwidth information of the to-be-transmitted video fragment at the video bit rate; Determine, according to the first cache information and the transmission bandwidth information, first transmission delay information of the to-be-transmitted video fragment at the video bit rate; Determine, according to the second cache information and the transmission bandwidth information, second transmission delay information of the to-be-transmitted video fragment at the video bit rate; Based on the first transmission delay information and the second transmission delay information, transmission delay information of the to-be-transmitted video fragment at the video bit rate is obtained.

3. The method according to claim 2, characterized in that The determining, according to the first cache information and the transmission bandwidth information, first transmission delay information of the to-be-transmitted video fragment at the video bit rate includes: Predicting, according to the transmission bandwidth information, the data volume of the to-be-transmitted video fragment at the video bit rate; Based on a preset cache duration threshold, and according to the first cache information, the transmission bandwidth information, and the data volume, determining a transmission delay duration of the to-be-transmitted video segment at the video bit rate; The transmission delay is used as the first transmission delay information.

4. The method according to claim 2, characterized in that: The determining, according to the second cache information and the transmission bandwidth information, second transmission delay information of the to-be-transmitted video fragment at the video bit rate includes: Predicting the remaining cache information of the server according to the second cache information and the transmission bandwidth information; the remaining cache information is the cache information after the server sends the video segment to be transmitted; In response to the remaining buffer information being greater than a preset value, using the remaining buffer information as the second transmission delay information; In response to the remaining buffer information being less than or equal to a preset value, determining that the second transmission delay information is a preset value.

5. The method according to any one of claims 1 to 4, characterized in that: The predicting, according to the transmission delay information of the video fragment to be transmitted at multiple video bit rates, the experience quality information of the video fragment to be transmitted at multiple video bit rates includes: For each of the multiple video bit rates, predicting quality information of the to-be-transmitted video fragment at the video bit rate and quality fluctuation information of the to-be-transmitted video fragment at the video bit rate; Based on the quality information of the video fragment to be transmitted at the video bit rate, the quality fluctuation information of the video fragment to be transmitted at the video bit rate and the transmission delay information of the video fragment to be transmitted at the video bit rate, the experience quality information of the video fragment to be transmitted at the video bit rate is obtained.

6. The method according to claim 1, characterized in that After determining the target video bit rate of the video segment to be transmitted from the multiple video bit rates according to the experience quality information of the video segment to be transmitted at the multiple video bit rates, the method further includes: In response to the target video bit rate being the same as the current video bit rate, transmitting the to-be-transmitted video fragment according to the current video bit rate; In response to the target video bit rate being different from the current video bit rate, searching for a key video frame corresponding to the video segment to be transmitted; based on the key video frame, switching the current video bit rate to the target video bit rate, and transmitting the video segment to be transmitted according to the target video bit rate.

7. The method according to claim 1, characterized in that The to-be-transmitted video segments satisfy the bit rate adjustment condition, which includes: the segment information or the transmission time of the to-be-transmitted video segments reaches a preset bit rate adjustment period.

8. A device for determining a video bit rate, characterized in that: The device comprises: An information acquisition module, configured to acquire network status information and cache information; The quality prediction module is configured to predict, in response to the to-be-transmitted video fragments satisfying the bit rate adjustment condition, the transmission delay information of the to-be-transmitted video fragments at multiple video bit rates according to the network state information and the cache information; and predict the experience quality information of the to-be-transmitted video fragments at multiple video bit rates according to the transmission delay information of the to-be-transmitted video fragments at multiple video bit rates; The bit rate determination module is configured to determine a target video bit rate of the video segment to be transmitted from multiple video bit rates according to the experience quality information of the video segment to be transmitted at multiple video bit rates.

9. An electronic device, characterized in that: include: processor; A memory for storing the processor executable instructions; wherein the processor is configured to execute the executable instructions to implement the method for determining the video bit rate according to any one of claims 1 to 7.

10. A computer-readable storage medium, when instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method for determining a video bit rate as claimed in any one of claims 1 to 7.

11. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instruction is executed by a processor, the method for determining the video bit rate according to any one of claims 1 to 7 is implemented.

Images