The invention provides a method for recognizing different artistic expressions of an object based on a specific data set. The method mainly comprises an ArtData data set, an annotation transfer way and artistic image retrieval, and comprises the steps of firstly, measuring the degree about which knowledge of the object in a medium can be applied to other medium, then comparing the emotion and different features and using styles of medium classes to consider the style and aesthetics so as to improve the aesthetic prediction task on other artistic data set, and finally, constructing a search engine specific to the task in combination with an experiment of learning feature space, wherein the search engine can be used for searching an image according to the content, emotion or medium similarity. The method breaks through the limitation of image retrieval only on daily photography, and improves the generality of image retrieval; and besides daily photography scenes, different artistic expressions can also be recognized and extracted, so that the cognition degrees of computers on arts field and aesthetics are improved, and the view field of machine vision is expanded to other fields.