3D AR Interaction Mapping for Accurate Gesture Trajectory Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing human-machine interaction technologies are limited to two-dimensional spaces, restricting their application range and limiting their use in scenarios beyond simple game interactions.
Innovation Solution
A method and apparatus for interaction in a three-dimensional space, where a real three-dimensional space is rasterized into real cells and a virtual three-dimensional space is rasterized into virtual cells, with a mapping relationship between them, allowing for interaction operations to be determined based on the movement trajectory of objects in the real space and their corresponding virtual space representation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If interaction is performed in two-dimensional space using existing systems like Kinect or Wii, then the system is simple to operate and understand, but the application range is limited and cannot support complex three-dimensional scenarios
Solution Approach 1:
The patent transitions from two-dimensional interaction planes to three-dimensional space by dividing the real space into depth units and mapping them to virtual space units. This dimensional expansion enables applications in education, training, and simulation beyond simple games, while maintaining operational simplicity through natural gesture-based control in 3D environment.
2Measurement precision
If three-dimensional space is divided into fine depth units for precise interaction, then interaction accuracy is improved, but the computational complexity and data processing requirements increase
Solution Approach 1:
The patent segments three-dimensional space into discrete depth units along the viewing direction, creating a rasterized representation where each depth unit corresponds to a specific distance range from the camera. This segmentation enables precise depth measurement and interaction while managing computational complexity through structured grid organization and mapping relationships between real and virtual spaces.
Data Source
AI summary
Provided are a method and apparatus for interaction in a three-dimensional space. The method includes: displaying a target augmented reality three-dimensional picture on a target augmented reality device, and displaying a target virtual interaction object in a virtual three-dimensional space in the target augmented reality three-dimensional picture, wherein the real three-dimensional space is rasterized and the virtual three-dimensional space is rasterized, and there is a mapping relationship therebetween; acquiring a target movement trajectory of a target object in the real three-dimensional space; determining a real cell set through which the target movement trajectory passes; determining a passing first virtual cell set corresponding to the passing real cell set; and determining whether the target movement trajectory triggers a target interaction operation of the target virtual interaction object according to the position relationship between the first virtual cell set and a second virtual cell set.