Virtual filling collaborative training system based on multi-mixed reality equipment

Abstract

The invention discloses a virtual filling cooperative training system based on multi-mixed reality equipment. A hardware facility mainly comprises a server, a plurality of computers, a plurality of pieces of mixed reality intelligent glasses, a control handle and a wireless router. According to the method, a virtual filling equipment three-dimensional model with a high simulation degree is constructed, a filling operation three-dimensional physical simulation motion engine is established, and the filling operation three-dimensional physical simulation motion engine is projected to each piece of mixed reality intelligent glasses through a core computer and wireless network equipment. When the model performs simulation motion, according to the system, a coordinate synchronization algorithm and an indoor SLAM calibration technology are utilized to determine a unified world coordinate system taking a three-dimensional model as a reference, accurate calculation of a local coordinate systemof the mixed reality equipment is carried out, and the effect that the three-dimensional model is observed by all the mixed reality equipment from the orientation and the angle of the mixed reality equipment is achieved; And each user can carry out virtual collaborative training by means of operating handles, gestures, voice operation and the like.

Description

technical field [0001] The method is related to mixed reality technology, human-computer interaction and virtual simulation, and specifically relates to a virtual filling collaborative training system based on multiple mixed reality devices. technical background [0002] Mixed reality technology (MR) is a further development of virtual reality technology. This technology presents virtual scene information in real scenes, and builds an interactive feedback information loop between the real world, virtual world and users to enhance the authenticity of user experience. sense; [0003] Traditional loading training requires the main operator to use the joystick to perform a series of operations on the model parts: translation, rotation, telescopic, pick and place, rigid-flexible conversion, etc., and the auxiliary operator manually unlocks and unlocks the model at the operation console . This traditional loading training has to be carried out outdoors because it takes up a larg...

AI Technical Summary

Problems solved by technology

The subjectivity of the coach's evaluation during the loading training process is too strong, resulting in the lack of a scientific evaluation method for the training

At the same time, due to the high cost of loading equipment, some training can only be carried out by a single person and a single machine, resulting in low training efficiency

The interaction between the operator and the filling equipment is completely through manipulating the console, resulting in a single interaction mode for the operator and inflexible operation

Unpredictable accidents may occur during the training process, which can cause damage to the filling equipment and, in severe cases, cause injury to the operator

Images