Virtual User Device Mirroring Real-World Pose via Tracking Markers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual reality systems lack the ability to accurately track and replicate the position, orientation, and motion of real-world devices within a virtual environment, limiting immersive interactions between real-world and virtual user devices.
Innovation Solution
The system captures real-world images of tracking markers displayed by user devices, processes them to estimate the device's pose, and generates a virtual user device with similar position, orientation, and motion, using computer vision and machine learning techniques to render a synchronized virtual representation in a virtual environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If virtual reality systems use traditional tracking methods, then basic virtual environment rendering is achieved, but accurate tracking and replication of real-world device position, orientation, and motion is not achieved
Solution Approach 1:
The patent introduces tracking markers as intermediary objects that facilitate precise tracking. These markers are displayed by real-world user devices and captured by cameras in the virtual reality system. The markers serve as mediators between the physical device and its virtual representation, enabling accurate estimation of position, orientation, and motion without requiring complex direct sensing hardware in the VR system
Solution Approach 2:
The patent creates a virtual copy (avatar) of the real-world user device that replicates its position, orientation, and motion characteristics. This virtual representation is generated by processing camera images of tracking markers and mapping the real device's spatial characteristics to the virtual environment, enabling accurate replication without physically replicating the entire device system
2Measurement precision
If the system captures and processes real-world images to estimate device pose, then accurate virtual representation is achieved, but processing time and computational resources increase
Solution Approach 1:
The patent pre-processes and stores characteristic information from tracking markers during calibration phases. The system establishes predetermined relationships between marker patterns and device pose parameters in advance. During actual tracking, the system only needs to match captured images against these pre-established patterns, significantly reducing real-time computational requirements while maintaining high accuracy
Solution Approach 2:
The patent uses simple, computationally inexpensive tracking markers with distinct visual patterns that can be rapidly processed. These markers are designed to be easily detectable and distinguishable, allowing for quick image processing and pose estimation. The system trades off using simple visual patterns rather than complex sensor data, enabling fast processing with adequate precision
Data Source
AI summary
Systems, methods, and apparatuses can access one or more real-world images, also referred to as video, of one or more real-world user devices within a real-world environment. These systems, methods, and apparatuses can capture one or more real-world images, also referred to as video, of one or more tracking markers being displayed by the one or more real-world user devices. These systems, methods, and apparatuses can estimate position, orientation, for example, roll, pitch, and/or yaw, and/or motion of the one or more real-world devices in the real-world environment based upon the one or more tracking markers. These systems, methods, and apparatuses can render one or more virtual user devices to have substantially similar positions, substantially similar orientations, for example, rolls, pitches, and/or yaws, and/or substantially similar motions as the one or more real-world devices in the real-world environment. These systems, methods, and apparatuses can display the one or more virtual user devices in a virtual environment.