An image self-adaptation down-sampling method depending on interpretation relates to image and video processing, and solves a problem that the current down-sampling and up-sampling are always independent, but image and video processing always needs both the down-sampling and the up-sampling synchronously. The method comprises the steps as follows: steps I, on a given input image, a down-sampling image is generated, and the down-sampling image interpolates an up-sampling image; steps II, adopting a down-sampling method based on a block, the quality of sampled images is improved; steps III, whether the images is related to content or not is judged, if so, a step IV is executed, and otherwise, a step V is executed; steps IV, for down-sampling is not related to the content, interpretation coefficient forms a interpretation matrix, a down-sampling image is obtained via the inversion of an interpretation process; and steps V, if not related to the content, initial coefficient is provided, an initial down-sampling image is obtained by using a method not related to the content, new interpretation coefficient is trained according to obtained images, and the down-sampling image is obtained via iteration. The method is applicable to the image and video processing.