The invention provides a panorama-based outdoor movement augmented reality method for accurately marking a POI. A panorama is generated on line at the current site where a user is located, and a POI template image which is placed in a server side in advance is matched to the panorama generated on line through a template matching algorithm; meanwhile, the POI template image is roughly positioned in the panorama by calculating the azimuth angle between the current position and the POI in the process, and the searching range of the template matching algorithm is effectively decreased; after recognition is finished, the user can select an interesting area in the generated panorama, personalized augmented reality labels such as words, sounds and a GPS are added to the interesting area, and the interesting area is uploaded to a server to be used as POI information base expansion. According to the panorama-based outdoor movement augmented reality method for accurately marking the POI, the brand-new implementation way is provided for outdoor movement augmented reality, and the user can visually obtain the augmented reality information and deepen the understanding of the surrounding environment by accurately marking POI information on the panorama of the current position where the user is located.