The invention discloses an augmented reality technology Implementation method based on physical detection and tracking algorithm. The method comprises the following steps that a local marker file is generated, an augmented reality system is initialized, an image of a real scene is acquired, the edge of the image is extracted and optimized, template match is conducted on the edge of the image, and if the matching succeeds, a decision window in the region is generated, a position matrix corresponding to the template is imported, the position matrix is conducted to fine adjust and amend, the special effect of the augmented reality is rendered according to the amended position matrix, corners are extracted in the decision window, appropriate tracking algorithms are chosen according to the number of the corners, If the number of the corners is larger than the threshold value, the system enters the feature point tracking algorithm. If the number of the corners is smaller than the threshold value, the system enters the edge tracking algorithm, animation effects of the augmented reality are updated according to the tracking algorithms, different tracking algorithms are adopted according to the number of the corners, then the detection and tracking for three-dimensional physicals are achieved when rich feature points do not exist or without feature points.