An Efficient Reinforcement Learning Training Method for Video Coding Optimization

Abstract

The invention discloses an efficient reinforcement learning training method for video coding optimization, which is used to solve the problems of slow convergence speed and unstable training of reinforcement learning in the training process of optimizing video coding. The present invention obtains a better initial strategy by first adopting an evolutionary algorithm, and then adopts a supervised learning method to initialize reinforcement learning network parameters, thereby reducing the problem of slow convergence in the initial stage of training caused by random initialization. In the reinforcement learning training process, better strategies are saved, and good strategies are randomly sampled with a certain probability, reducing the problem of too many bad strategies caused by the blindness of reinforcement learning in the exploration process, and improving the convergence speed and stability of training sex. After a certain period of reinforcement learning training, the system may fall into a local optimum, resulting in limited improvement in video coding compression efficiency. The invention performs small-scale random disturbance on the specific parameters of the policy network at regular intervals, increases the range of system exploration, and further improves the compression efficiency of video coding.

Description

technical field [0001] The present invention relates to video coding and reinforcement learning, in particular to an efficient reinforcement learning training method for video coding optimization Background technique [0002] With the continuous development of multimedia digital video applications and the continuous improvement of people's demand for video cloud computing, the data volume of the original video source makes the existing transmission network bandwidth and storage resources unbearable. Therefore, the compression of video signal has become one of the hot spots of academic research and industrial application at home and abroad. Video compression, also known as video coding, aims to eliminate redundant information between video signals. So far, domestic and foreign standardization organizations have successively formulated a variety of different video coding standards. Since the H.261 video coding standard, the mainstream video coding standards have adopted the ...

AI Technical Summary

Problems solved by technology

The invention solves the problem that the traditional method cannot obtain the global optimal solution, and the machine learning method is difficult to generate labels for training

Aiming at the problem that traditional reinforcement learning converges very slowly when there are many network parameters, this invention proposes a pre-training method to speed up the convergence of the algorithm

Images