The invention discloses a learning-based high efficiency video coding method. The method comprises the following steps: coding a
video sequence by a high efficiency video coder, and extracting feature vectors corresponding to coding unit blocks; inputting the extracted feature vectors and an optimal coding
unit size into a three-value-output
learning machine, and building a learning model; adding an early-abort strategy structure into a selection process of coding unit sizes in the high efficiency video coder, executing a
skip mode current block and a merge mode current block firstly, and extracting feature vectors corresponding to corresponding current coding; inputting the feature vectors into a learned
learning machine model, outputting a prediction value, and executing the current coding
unit size according to the corresponding early-abort strategy structure till all coding unit
layers in coding tree units are coded; and performing repeated execution till the coding tree units in all video frames are coded. By adoption of the method, an optimal coding process can be output correspondingly according to a rate-
distortion cost and calculation complexity; the learning performance and classifying performance of a classifier are improved; and the coding efficiency of video coding is increased.