The invention discloses a fabric image recoloring method, wherein the method comprises the steps: step 1, segmenting a foreground image and a background image of a fabric pattern, and segmenting the foreground and the background of the fabric pattern by using a color feature coding algorithm, an edge structure image extraction algorithm and a multi-region fuzzy competition image segmentation model; step 2, coloring the background image of the fabric pattern, and coloring the background of the fabric pattern by adopting a coloring algorithm based on a grayscale image; and step 3, coloring the foreground image of the fabric pattern, for the foreground of the fabric pattern, reconstructing the foreground of the fabric by adopting a color offset field model based on intrinsic image decomposition, obtaining a color center vector and a color offset field of the foreground pattern of the fabric, and for the reconstructed foreground image, replacing the original color center vector of the foreground pattern with a given new color center vector, and reconstructing a new fabric pattern by using a color offset field. The invention further comprises a fabric image recoloring system.