The invention discloses an action detection method based on asymmetric multi-
stream, which comprises the following steps: extracting an
RGB image and an optical
stream from a prior video, and training to obtain a trained
RGB image single-
stream network and an optical stream single-
stream network; extracting
image flow characteristic information and
optical flow characteristic information of each frame in the priori video, and training an asymmetric double-flow network by combining an action
label; respectively extracting
image flow characteristic information and
optical flow characteristic information of each frame in the target video to be detected through the trained
RGB image single-flow network and
optical flow single-flow network, obtaining segment characteristics of the target video, inputting the segment characteristics into the trained asymmetric double-flow network, and calculating to obtain a video classification vector; selecting potential actions from the video classification vectors to obtain an
action recognition sequence of the potential actions; and completing the action detection is completed through the
action recognition sequence. According to the action detection method, the
asymmetry between the
image flow and the optical flow is considered, and the accuracy of
action recognition and action detection can be improved.