The invention provides a Criminisi image restoration method based on HSV color space, comprising the following steps: 1, judging whether there is an image damaged area to be repaired; 2, taking the pixel point p of the damaged edge, calculating the confidence value C according to the pixel value in the square area of 9*9 centered on the point p, judging the size thereof, and if the confidence value C is great than the threshold value K, calculating the priority value P of the square area block according to the priority function; 3, according to that matching principle, the b matching block inthe undamaged region is searched by comparing the difference value of the hue H and the luminance V in the HSV color space; 4, filling the searched best matching block into the pixel block to be repaired, and making the central pixel points coincide; 5, updating that boundary information of the repair area, and simultaneously updating the confidence value of pixel point of the repair completed area; 6, repeating that above steps until all pixel block are repaired. The invention makes up for the defects of inaccuracy of priority function in Criminisi restoration algorithm and degradation of image quality after restoration, and has excellent performance.