The invention, which belongs to the technical field of the video image, discloses an infrared-panorama-pick-up-head-based abnormal behavior identification method of elderly people living alone. The method comprises: step one, an infrared panorama pick-up head is used for carrying out infrared shooting, thereby obtaining a video image signal; step two, an infrared panoramic picture is unfolded by using a fast approximate unfolding method; step three, an indoor grid semantic map in a home environment is constructed; step four, on the basis of an improved hybrid Gaussian model algorithm, modeling of a human body target is carried out, a target block mass is identifier, block mass information is obtained, the target block mass is tracked in real time, and a human body track feature is obtained; step five, a human body moving track is extracted by using a hybrid Gaussian clustering method; step six, the human body track is segmented; and step seven, a convolutional neural network is trained by using the track after human body motion segmentation in the home environment as a training sample, feature extraction is carried out on a human body behavior track in the home environment, and classification is carried out by using evidence reasoning; and if an abnormal situation occurs, alarming is carried out.