The invention provides a colorful animal image retrieval method based on content and a colorful animal image retrieval system based on content. The method comprises the following steps: step 1, inputting an inquiry image which serves as a retrieval object; step 2, extracting the color, grain and framework characteristic descriptions of interested content in the inquiry image based on the guidance of a characteristic template library, and performing normalization processing, wherein the characteristic descriptions, which are different in animal color, grain and framework and are formed on the basis of sample statistics, are stored in the characteristic template library; step 3, performing retrieval based on an R-tree index structure on the characteristic descriptions extracted in the step 2, performing search calculation on image characteristic indexes in a characteristic index library, and extracting a corresponding image from an image database according to the matching result. The method and the system can be used for overcoming the influence of illumination changes on image retrieval judgment to a certain extent, describing the angle and posture semantic information of an inquiry animal according to the framework characteristic analysis during retrieval, and generating a retrieval result consistent with the human visual perception.