The invention discloses a GIF short video emotion recognition method and a GIF short video emotion recognition system fusing text information. The method firstly extracts the sequence features in theGIF short video by using a 3D convolutional neural network, and simultaneously extracts the image visual features in the sequence by using the convolutional neural network. Then the high-level semantic features are decoded by using convolution long-short memory recurrent neural network technology, and the probability distribution matrix of emotion classification is calculated, and the emotion scores of the video part are obtained by interval mapping. Then, the vocabulary which contains emotional information is selected from the words in the annotated text, and the emotional score is calculatedby the emotional scoring tool. Finally, the video emotion score and the text emotion score are given different weights to add and do the validity judgment, and the GIF short video emotion classification. The invention can effectively pay attention to the emotional information of images in the GIF video, simultaneously taking into account the temporal characteristics of the video stream, and fusesthe text information and the video information, thereby improving the accuracy and robustness of the emotional classification of the GIF video.