3D Motion Tracking With Virtual Posture Alignment for Mixed Reality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The provision of insufficient physical objects for teaching due to cost constraints leads to inadequate learning experiences and reduced teaching quality.
Innovation Solution
A three-dimensional positioning and motion-detecting system using a camera, virtualization computing device, and virtual-and-real display device for mixed reality, enabling gesture recognition and spatial alignment of virtual posture models with physical environment images to enhance teaching efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If a small amount of physical objects is provided to assist teaching due to cost considerations, then teaching cost is reduced, but learning effect and teaching quality deteriorate
Solution Approach 1:
The patent creates virtual copies of physical teaching objects (anatomy models, teaching dolls) in the mixed reality environment. These virtual objects can be instantiated unlimited times without additional cost, allowing every student to have their own interactive copy while maintaining realistic appearance and functionality through 3D rendering and gesture-based interaction.
Solution Approach 2:
The patent transitions from purely physical 3D objects to virtual 3D objects in a mixed reality space, adding the digital dimension to the teaching environment. This allows objects to be replicated infinitely in the virtual space while students interact with them through spatial gestures, effectively resolving the scarcity issue without compromising educational value.
2Quantity of substance
If a small amount of physical objects is provided for assisting teaching, then teaching cost is reduced, but student participation and hands-on learning opportunities are limited
Solution Approach 1:
The virtual teaching objects in the mixed reality system serve multiple students simultaneously. A single virtual anatomy model can be interacted with by multiple students at the same time, each performing different operations (dissection, rotation, measurement) without interfering with others, thereby maximizing the utility of each teaching resource and improving overall teaching efficiency.
Solution Approach 2:
By creating virtual replicas of expensive physical teaching objects, the system enables unlimited student access to hands-on learning experiences. Each student can manipulate their own copy of the teaching object through gesture recognition, ensuring full participation and practical skill development without the constraints of physical object availability.
3Measurement precision
If virtual posture models are aligned with physical environment images through gesture recognition, then interaction accuracy is improved, but system complexity increases
Solution Approach 1:
The patent introduces posture model positioning points in the physical environment and corresponding aligning points on virtual objects as intermediaries for alignment. These discrete reference points serve as mediators between the physical and virtual spaces, enabling precise registration through gesture-based manipulation without requiring complex full-object matching algorithms, thus balancing accuracy with system simplicity.
Data Source
AI summary
A three-dimensional positioning and motion-detecting system for human body and object status in mixed reality and a method thereof are disclosed. A virtualization computing device performs gesture recognition for scaling, moving or 3D rotating a virtual posture model, to make posture model aligning points of the virtual posture model correspond to the posture model positioning points one by one, a virtual-and-real display device displays the adjusted virtual posture model in real time, when the virtual posture model is fixed, the virtualization computing device recognizes a hand position on the physical environment image, and detects a motion on the hand position based on the posture model positioning points, to generate operating position information and hand motion information. The virtual-and-real display device displays virtual-and-real integration of operating position information, hand motion information and a physical space.