Adaptive code rate video transmission method and system based on reinforced learning

A video transmission system and adaptive bit rate technology, applied in the field of video transmission, to improve service quality, save configuration and debugging time, and improve video quality experience

Active Publication Date: 2018-05-22
SHENZHEN NAIFEI TECH CO LTD
View PDF5 Cites 46 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Adaptive bit rate algorithm is the main method used by content providers to optimize video quality. The existing mainstream adaptive bit rate algorithm selects bit rate by estimating network throughput and combining control rules, which requires a lot of tuning work and is difficult Generalization under different network and quality of service objectives

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Adaptive code rate video transmission method and system based on reinforced learning
  • Adaptive code rate video transmission method and system based on reinforced learning
  • Adaptive code rate video transmission method and system based on reinforced learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0047] Embodiment 1 discloses a reinforcement learning-based adaptive code rate video transmission method, which includes:

[0048] S100. Input the state space corresponding to the video block to be downloaded into the code rate prediction neural network, and the code rate prediction neural network outputs a code rate policy. Wherein, the code rate policy is specifically the probability of an optional code rate of the video block to be downloaded.

[0049]In this embodiment, the code rate prediction neural network is composed of an Actor network and a Critic network. The Critic network is used to learn the video quality experience index obtained by selecting different code rates under different network conditions, and the Actor network uses the Critic network. Optimization objectives to maximize the benefits of video bitrate selection. The actor network uses the output of the critic network as the training target, and the critic network uses the returned video playback qualit...

Embodiment 2

[0076] Based on the same inventive concept, the present invention also discloses an adaptive code rate video transmission system based on reinforcement learning, including:

[0077] The input acquisition unit is used to collect raw data before each video block is downloaded, and generate a state space according to the collected raw data; wherein, the state space includes: the throughput of the latest k video blocks, the latest k video blocks The download time, the optional bit rate of the video block to be downloaded, the current remaining cache size, the number of remaining video blocks, and the download bit rate of the latest video block, where k is a positive integer.

[0078] The input control unit is used for inputting the state space corresponding to the video block to be downloaded into the code rate prediction neural network after the code rate prediction neural network is trained.

[0079] The video downloading unit is used for downloading the video blocks to be downl...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an adaptive code rate video transmission method and an adaptive code rate video transmission system based on reinforced learning. The method comprises the steps of inputting astate space corresponding to a video block needing to be downloaded into a code rate prediction neural network, and outputting a code rate strategy by the code rate prediction neural network; downloading the video block needing to be downloaded according to the code rate strategy output by the code rate prediction neural network; after each video block is completely downloaded, computing a video playing quality index corresponding to each video block and returning the video playing quality index back to the code rate prediction neural network; and performing training by the code rate prediction neural network according to the returned video playing quality index and the state space corresponding to the completely downloaded video block. According to the method and the system provided by the invention, the algorithm well adapts to multiple different network conditions while the quality of service is improved, the labor time cost of rule setting and parameter optimization is greatly reduced, the efficiency problem caused by artificial feature selection and rule setting is avoided, and the video quality experience is also greatly improved while the configuration and debug time is saved.

Description

technical field [0001] The present invention relates to the field of video transmission, in particular to a reinforcement learning-based adaptive code rate video transmission method and system. Background technique [0002] With the development of wireless networks in recent years, video applications based on the HTTP protocol have become more and more abundant. What follows is that users' demand for video quality is also constantly increasing. If the video quality is not good, users will quickly give up watching. Therefore, how to provide high-quality videos to users has become a key issue for operators of major video platforms. one of the research fields. [0003] Adaptive bit rate algorithm is the main method used by content providers to optimize video quality. The existing mainstream adaptive bit rate algorithm selects bit rate by estimating network throughput and combining control rules, which requires a lot of tuning work and is difficult Generalization under differe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/2662H04N21/647H04N17/00
CPCH04N17/004H04N21/2662H04N21/64723H04N21/64738
Inventor 马骁张桐
Owner SHENZHEN NAIFEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products