Provided is a single-image super-resolution reconstruction method based on edge difference constraint. The method includes following three steps: step 1, extracting a texture principal direction characteristic of a training image through a Gabor filter, and performing a principal component analysis dictionary training to obtain a training dictionary; step 2, constructing a reconstruction model by employing the dictionary, and obtaining an initial reconstruction high-resolution image with a good edge structure through iterative threshold shrinkage; and step 3, describing an operator, a spatial distance, a pixel intensity, and edge orientation information by employing a histogram of oriented gradients between image blocks, establishing a non-local structure tensor optimization model, further optimizing and processing the initial reconstruction high-resolution image, and obtaining a final reconstruction high-resolution image with a substantial edge structure and abundant detail information. According to the method, by considering the difference between the initial reconstruction high-resolution image and an original clear image, the post-processing optimization method is further proposed, and the detail information of image edges and textures is abundant.