The invention discloses a combined expression positioning and recognition method and device based on aggregation features and double anchoring, and aims at the requirement of single-face fine-grained
expression analysis in a first-view video, an end-to-end
deep learning framework is constructed, and unified positioning and recognition of
macro expressions and micro expressions are achieved. The method comprises the following steps: firstly, extracting multi-scale features and generating an AU code from acquired single face video data through a frame-by-frame AU identification network for aggregating local and global features by combining the advantages of a
convolutional neural network and a visual Transform; the spatial-temporal features are fused by using an AU coding-assisted double-flow 3D convolutional network, a multi-
scale sliding window strategy and a feature
pyramid network are combined, and a double anchoring mechanism is proposed to jointly position an expression interval; and finally, video clips are intercepted based on a positioning result, and classification is completed through an expression positioning and recognition network. Through local-global
feature aggregation, a double-flow 3D convolutional network and a double anchoring strategy, the problems of coexistence of multiple expressions in a video, large
duration time difference, difficulty in micro-expression detection and the like are effectively solved, and the precision and robustness of expression positioning and recognition are remarkably improved.