The invention relates to a method of quickly segmenting a moving target in a non-restrictive scene based on a full convolution network, which belongs to the technical field of video object segmentation. The method comprises steps: firstly, framing is carried out on the video, and a result after framing is used for making a Ground Truth set S for a sample image; a full convolution neural network trained through a PASCAL VOC standard library is adopted to predict a target in each frame of the video, a deep feature estimator for an image foreground target is acquired, target maximum intra-class likelihood mapping information in all frames is obtained hereby, and initial prediction on the foreground and the background in the video frames is realized; and then, through a Markov random field, deep feature estimators for the foreground and the background are refined, and thus, segmentation on the video foreground moving target in the non-restrictive scene video can be realized. The information of the moving target can be effectively acquired, high-efficiency and accurate segmentation on the moving target can be realized, and the analysis precision of the video foreground-background information is improved.