Training system based on mixed reality technology and method thereof

Abstract

The invention discloses a training system based on a mixed reality technology and a method thereof, and provides a training system based on a mixed reality technology, which realizes virtual interactive training on the premise of low cost and is more interesting, vivid and immediacy in training. The training system based on the mixed reality technology comprises a processor unit, a video capture module, a virtual object production module, an MR fusion module, a semantic separation module, a motion posture calculation module, a motion interaction feedback module and an MR display module. The cost is relatively lower, electron radiation can be effectively reduced, damage to body health caused by radiation is avoided, and the health is not damaged; a real trainer in the real world, an environment background and a digital virtual scene are mutually fused, real training drives virtual interaction, and the virtual interaction synchronously feeds back the trainer, so that the system is more interesting, more vivid and more realistic, and has a sense of immediacy, and the user experience is relatively better.

Description

technical field [0001] The invention relates to the field of mixed reality training, in particular to a training system and method based on mixed reality technology. Background technique [0002] Virtual Reality: [0003] The so-called virtual reality, as the name suggests, is the combination of virtual and reality. In theory, virtual reality technology (VR) is a computer simulation system that can create and experience a virtual world. It uses a computer to generate a simulated environment and immerses users in the environment. Virtual reality technology is to use the data in real life, through the electronic signal generated by computer technology, combine it with various output devices to transform it into a phenomenon that people can feel. These phenomena can be real objects in reality. , it can also be a substance invisible to our naked eyes, which is represented by a three-dimensional model. Because these phenomena are not what we can see directly, but the real worl...

AI Technical Summary

Problems solved by technology

[0013] However, the high cost of the existing HMD makes the cost of sports and fitness products based on VR, AR or MR technology also increase, and the higher cost is not conducive to the marketing and popularization of the product; long-term use of the HMD will bring sports trainers Discomfort such as dizziness and vomiting, resulting in poor user experience and low product viscosity

In addition, HMD electronic equipm

Images