Three-dimensional virtual-real fusion experiment system

Abstract

The invention discloses a three-dimensional virtual-real fusion experiment system, and the system comprises: an object tracking device which is used for recognizing the type of a real experiment object and positioning the three-dimensional space coordinates of the real experiment object in real time, and obtaining the type of the real experiment object and the corresponding real-time three-dimensional space coordinates; a hand tracking device which is used for identifying the joint points of the operating hand and positioning the three-dimensional space coordinates of the joint points of the operating hand in real time to obtain the real-time three-dimensional space coordinates of the joint points of the operating hand; and a virtual-real fusion processing device which is used for generating a corresponding virtual-real fusion image according to the type of the real experimental object, the corresponding real-time three-dimensional space coordinates of the real experimental object andthe real-time three-dimensional space coordinates of the operating hand joint points. According to the invention, the advantages of the virtual-real fusion technology are fully utilized, the virtual object and the real experimental object are fused, the real experimental object can be tracked and cultivated in real time while a user naturally moves the real experimental object, the experimental operation ability and learning interest of the user are cultivated, and the experimental risk is reduced.

Description

technical field [0001] The invention relates to the technical field of virtual-real fusion and the field of education, in particular to an experimental operation platform capable of naturally interacting with three-dimensional virtual-real fusion. Background technique [0002] With the advancement of computer technology, virtual-real fusion technology has begun to develop continuously, and its application scenarios are becoming more and more extensive. Virtual-real fusion is usually divided into two parts: the first is virtual simulation, which simulates and generates 3D virtual scenes and phenomena according to the set parameters and methods; the second is 3D registration, which specifically calculates virtual scenes based on the position of the monitor and the position of actual objects in the scene The positional relationship with the real scene, and superimpose and fuse the two. The virtual reality fusion technology can combine the visual channel of the virtual scene wi...

AI Technical Summary

Problems solved by technology

[0005] The technical problem to be solved by the present invention is that the existing virtual-real fusion experimental products or systems applied to the field of education still need the traditional mouse or handle peripherals for the interactive operation between the user and the experiment, which cannot achieve the purpose of natural interaction and is not suitable for cultivating Students' Experiment Operation Ability and Experiment Operation Standard Awareness

Images