AR interaction-based immersive safety education practical training system and method

Abstract

The invention discloses an AR interaction-based immersive safety education practical training system and method. The method comprises the following steps that a graphic workstation outputs a virtual safety scene to a 3D projector so as to display the virtual safety scene on an appointed surface of a practical training space; the graphic workstation controls the single-chip microcomputer to outputa preset interaction medium pattern at a first preset position; an Android terminal is set to scan the interactive medium pattern, the Android terminal is connected to a cloud server to obtain a three-dimensional model corresponding to the interactive medium pattern, and the AR stereo imaging is carried out at a second preset position of the practical training space to obtain an image of the interactive medium; the plurality of action capture cameras capture actions of the teacher and output the actions to the graphic workstation; and the graphic workstation judges whether the 6Dof pose information of the teacher is intersected with the coordinate system of the preset image interaction point of the AR stereo imaging or not. According to the invention, by separating an immersive scene froma display mode of a man-machine interaction setting point, the intelligent virtual and reality synchronization is realized, the interaction can be more natural, and the cost of safety education practical training teaching is reduced.

Description

technical field [0001] The present invention relates to the field of AR technology, in particular to an immersive safety education and training system and method based on AR interaction. Background technique [0002] At present, the immersive safety education training room is mainly based on head-mounted VR. Although safety education can be immersed in experience, it cannot be satisfied with safety education training and teaching. The existing one-person experience cannot teach in real time, the human-computer interaction is too simple, and the experiencer and the teacher cannot interact in real time. These are the points that need to be improved. Contents of the invention [0003] The purpose of the present invention is to overcome the deficiencies of the existing technology, and propose an immersive safety education training system and method based on AR interaction, and realize intelligent virtual and reality by separating immersive scenes and display methods of human-c...

AI Technical Summary

Problems solved by technology

[0002] At present, the immersive safety education training room is mainly based on head-mounted VR. Although safety education can be immersed in experience, it cannot be satisfied with safety education training and teaching.

The existing single-person experience cannot teach in real time, the human-computer interaction is too simple, and the experiencer and the teacher cannot interact in real time. These are the points that need to be improved.

Images