The invention relates to an image super resolution rebuilding method based on sparse representation and various residual. The image super resolution rebuilding method based on sparse representation and various residual includes the steps: first, calculating residual between images formed after the existing
high resolution image and a
low resolution image are amplified through an interpolation and calculating a
high frequency portion and a
low frequency portion of the residual; second, building a sample pair through
low resolution image sample characteristic and corresponding the
high frequency portion and
low frequency portion of the image residual, utilizing a texture
meta structure to classify the samples by regarding the
low resolution sample as a standard and utilizing a
singular value decomposition (KSVD) method to
train each type of a sample to obtain a dictionary pair of the low resolution sample, the
high frequency portion and
low frequency portion of the image residual; finally, choosing the dictionary pair and
combing the final image residual with the interpolation result of the low resolution image to obtain a
high resolution image according to the texture
meta structure type of the test samples. The image super resolution rebuilding method based on sparse representation and various residual just needs to rebuild the image residual, combines the interpolation image to rebuild the
high resolution image and improves a rebuilding result of the
high resolution image.