The invention relates to an auxiliary entertainment system for video chatting. The system can be used for adding cartoon expression pictures for video images of a user undergoing video chatting in real time so as to increase the chatting pleasure for the user. According to the system, cartoonlized expression patterns are located and drawn on various body parts, such as the face, fingers and the like, of a user in the video by using a mode recognition technology, and a specific expression pattern can also be drawn at an appointed position of the user in a video picture. The patterns can be changed according to the changes on pleasure, anger, sorrow, joy and other emotions selected by the user, and can also be changed by automatically recognizing the expressions and actions of the user according to mode recognition. Meanwhile, the system can also be compatible with the expression patterns, in general formats, used in word chatting software, and can be used for drawing the expression patterns in the video according to user settings. All the cartoon drawings are completed in real time, and a modified video stream is provided for any video chatting system used by the user in a virtual camera manner.