A virtual assembly method based on augmented reality and mobile interaction

Abstract

The invention provides a virtual assembly method based on augmented reality and mobile interaction. This method uses Leap Motion to obtain the hand gesture data, and projects it into the virtual environment to interact with the virtual model. IKF and IPF are used to estimate the position and direction of the hand. The position of human body is located by the joint data of human body acquired by Kinect, and the virtual 3D assembly robot and the model of assembly parts are projected in front of human body by AR technology. Magnetic force feedback uses the electromagnetic force to make the operator feel the interaction force between the parts in the assembly process. The present invention utilizes AR technology to allow an operator to view a part without dead angle of 360 degrees, The immersion feeling in the virtual assembly process is improved, and the electromagnetic force feedback makes the operator feel the interaction between the parts more clearly, so that the fitness between the parts can be known, the situation of the real assembly is closer, and the operation is more natural and convenient.

Description

technical field [0001] The invention relates to a virtual assembly technology, in particular to a virtual assembly method based on augmented reality and mobile interaction. Background technique [0002] In the traditional assembly process, due to the lack of digital assembly verification and actual assembly simulation in the initial stage of the assembly process and the design of assembly tooling, often in the actual product assembly stage, interference between parts and unreasonable assembly sequences often occur Or the inconvenient phenomenon of assembly tools and equipment, and the quality hidden dangers of many parts in the manufacturing stage or the rationality of assembly tools and equipment are only revealed in the actual assembly process. Therefore, the assembly cycle of the product is very long, the rework rate is high, the assembly quality is unstable, and the first-time success rate of assembly is reduced, which seriously restricts the improvement of production ca...

AI Technical Summary

Problems solved by technology

Part of the current virtual assembly technology is realized by using computer simulation technology. The virtual assembly realized by this method is not convenient for the operator to observe the assembled parts. The angle of observation is fixed and the scope of observation is limited. Therefore, in the assembly process problems may arise in

The other part is realized based on virtual reality, but the virtual assembly in virtual reality, the user's sense of immersion is insufficient

At the same time, there is another problem in the above two technologies. In the process of virtual assembly, the user cannot feel the interaction force between the assembled parts, so it is possible that there may be problems in the assembly process that the user cannot perceive. The actual assembly is to cause some damage to the parts

Images