3D Virtual Object Manipulation Through Touchscreen Gestures
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems lack the ability to effectively manipulate and integrate virtual 3D objects within real-world environments, limiting the interactive and immersive experience.
Innovation Solution
A system and method for mapping and manipulating virtual objects within a real-world scene using a mobile computing device, allowing users to place, reposition, and modify virtual objects in three-dimensional space in conjunction with real-world imagery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual 3D objects are integrated into augmented reality environments, then interactivity and immersion are enhanced, but system complexity increases
Solution Approach 1:
The system segments the manipulation process into distinct phases: selection phase (identifying virtual objects), transformation phase (applying gestures to modify objects), and placement phase (positioning objects in 3D space). This segmentation allows complex 3D manipulation to be achieved through simple, familiar 2D touchscreen gestures, reducing system complexity while maintaining interactivity.
Solution Approach 2:
The system uses touchscreen gestures as an intermediary between the user and virtual 3D objects. Instead of requiring direct 3D interaction mechanisms, the patent maps 2D touchscreen gestures to 3D object manipulations, serving as a mediator that simplifies the interaction model while enabling rich 3D control.
2Adaptability or versatility
If virtual objects are manipulated in three-dimensional space, then user immersion is improved, but ease of operation decreases
Solution Approach 1:
Instead of requiring users to think in 3D space to manipulate virtual objects, the system inverts the approach by allowing users to interact through familiar 2D touchscreen gestures that automatically translate to 3D manipulations. This inversion maintains ease of operation while achieving full 3D manipulation capability.
Solution Approach 2:
The system changes the parameter space of interaction by mapping 2D touchscreen coordinates and gestures to 3D spatial parameters. Touchscreen gestures that operate in 2D parameter space are transformed to control virtual objects in 3D parameter space, making manipulation easier while maintaining versatility.
3Reliability
If existing augmented reality systems are used, then basic display functionality is provided, but manipulation and integration of virtual objects is limited
Solution Approach 1:
The system implements multi-functionality by enabling a single touchscreen interface to perform multiple operations: selecting virtual objects, transforming them through gestures, positioning them in 3D space, and integrating them with the augmented reality environment. This universal interface replaces multiple specialized controls, enhancing versatility while maintaining reliability.
Data Source
AI summary
Among other things, embodiments of the present disclosure improve the functionality of computer imaging software and systems by facilitating the manipulation of virtual content displayed in conjunction with images of real-world objects and environments. Embodiments of the present disclosure allow virtual objects to be moved relative to a real-world environment and manipulated in other ways.