The invention discloses an improved ST-GCN-based
pedestrian intention recognition method for an automatic driving vehicle, and particularly relates to a method which is based on a space-time graph convolutional network ST-GCN, introduces an improved adaptive graph convolutional network in a spatial dimension, enhances a dependency relationship between arms and legs of a
pedestrian, and enhances extraction of effective spatial features in
pedestrian actions. According to the pedestrian intention recognition method, in the time dimension, multi-
branch time
convolution is adopted, the remote dependency relationship of pedestrian intentions is captured, the attention of a model to pedestrian channel information is improved, and the time change relation of the model to pedestrian actions is enhanced. The invention aims to quickly and accurately identify the
street crossing intention of pedestrians, so that an advanced auxiliary driving
system or an automatic driving vehicle can provide
sufficient time for a driver to make a response or directly intervene in driving to prevent collision. The method is realized by the following steps of: 1, capturing a pedestrian video
stream in a
traffic scene through a vehicle-mounted
monocular camera; 2, predicting pedestrian key points by using a
human body posture
estimation network, extracting coordinates of the pedestrian key points, and generating a pedestrian 2D skeleton
structure chart; and step 3, fusing the adaptive graph
convolution network and the multi-
branch time
convolution with the ST-GCN network to realize pedestrian intention recognition of the automatic driving vehicle. The method is suitable for
pedestrian crossing intention recognition in an automatic driving vehicle scene.