The invention provides a quick inter-frame prediction mode selection method for AVS-M video coding. Algorithms can be classified according to the distribution situation of inter-frame coding modes and are arranged according to processing priority, different types are judged sequentially, possible modes are compared selectively, and the number of modes to be judged is reduced. Early termination judgment is utilized to carry out priority judgment on an SKIP mode, and whether other modes are early termination is judged through threshold value judgment. If threshold value judgment conditions are met, the SKIP mode is directly utilized to code. If the threshold value judgment conditions are not met, an Inter4*4 mode, an Inter 8*8 mode and an Inter 16*16 mode are used as initial modes. A part of macro block modes are removed according to whether rate-distortion cost meets monotony, and accordingly useless block mode search processes are reduced. Compared with a full-mode selection algorithm, the calculating times is reduced by 52.5% to 85.8%, and the calculating complexity of inter-frame forecasting modules is reduced.