The application relates to the technical field of vocational
education training systems and methods, in particular to a
post training and cultivating
system and method based on AR virtual vision, which adopts AR
virtual reality, innovatively adopts dynamic environment binding technology, and through real-time scanning of a training scene such as a laboratory or a factory
workstation by an RGB-D camera, a 3D environment
point cloud map is constructed by adopting a SLAM
algorithm, virtual equipment is automatically aligned with a real desktop coordinate
system, the virtual equipment can be placed on the real desktop, and is constrained by physical shielding relationship, such as automatically hiding a shielded part when a hand passes through the virtual equipment, compared with traditional AR projection technology, the
system is more real, has stronger substitution and training feeling, the training of students is further effective, and the period of adapting to a post is shorter; a multi-
modal operation evaluation mechanism is adopted, operation tracks are dynamically compared with standard paths, and a deviation
heat map is generated in real time; operation steps are decomposed into three stages of preparation, execution and
verification, and are respectively scored, and training scoring is further realized.