3D Virtual Object Mapping for Real-World Scene Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems lack the ability to effectively manipulate and integrate virtual 3D objects within real-world environments, limiting user interaction and customization.
Innovation Solution
A system and method for mapping and manipulating virtual objects in a three-dimensional real-world scene using client devices, enabling users to place, interact with, and modify virtual objects in real-time based on user inputs and environmental context.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual 3D objects are integrated into real-world environments using existing AR systems, then user interaction capability is limited, but system complexity is reduced
Solution Approach 1:
The patent transitions from traditional 2D touchscreen interaction to 3D spatial interaction by mapping virtual objects into the real-world environment's three-dimensional space. Users can manipulate objects from multiple angles and positions, adding spatial depth to the interaction paradigm. This dimensional expansion enables gestures like reaching, grabbing, and rotating objects in 3D space, fundamentally enhancing interaction versatility beyond flat screen limitations.
Solution Approach 2:
The system introduces computer-generated graphics content as an intermediary layer between the user and the real world. This virtual layer acts as a mediator that bridges physical and digital domains, allowing users to interact with virtual objects that are anchored to real-world surfaces and environments. The intermediary virtual content enables complex interactions without requiring direct manipulation of physical objects.
2Productivity
If virtual objects are manipulated in real-time based on user inputs, then user engagement is enhanced, but processing requirements increase
Solution Approach 1:
The system performs preliminary actions by pre-processing and analyzing the real-world environment before virtual object manipulation begins. Environmental features, surfaces, and spatial relationships are captured and processed in advance using the device's camera and sensors. Virtual objects are pre-configured with interaction parameters and physics properties. This preliminary preparation reduces real-time processing demands during actual user interaction, as the system only needs to update and render changes rather than compute entire scenes from scratch.
Data Source
AI summary
Among other things, embodiments of the present disclosure improve the functionality of computer imaging software and systems by facilitating the manipulation of virtual content displayed in conjunction with images of real-world objects and environments. Embodiments of the present disclosure allow virtual objects to be moved relative to a real-world environment and manipulated in other ways.