Volumetric AR Perspective Switching by User Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional volumetric content systems are limited to presenting a single perspective of a three-dimensional scene, lacking the ability to dynamically switch between multiple perspectives based on user interaction with volumetric representations.
Innovation Solution
A system and method for providing a multi-perspective augmented reality experience by using a client device with a transparent display and a networked server system to track user interactions, allowing switching between different perspectives of volumetric representations based on conditions such as spatial overlap, proximity, and gaze direction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a single perspective is presented in volumetric content systems, then the system complexity is reduced, but the user engagement and immersion are limited
Solution Approach 1:
The system dynamically switches between single-perspective and multi-perspective modes based on user interaction. When a user enters a volumetric representation, the system automatically transitions to presenting multiple perspectives, and reverts to a single perspective when interaction ceases. This dynamic adaptation resolves the contradiction by making the system simple during normal operation and complex only when needed for enhanced user engagement.
Solution Approach 2:
The system changes the perspective parameter from a fixed single viewpoint to a variable multi-viewpoint configuration based on spatial conditions. When specific parameters such as spatial overlap, proximity, or gaze direction are detected, the perspective parameter is modified to include additional viewpoints, thereby increasing adaptability without permanently increasing system complexity.
2Adaptability or versatility
If multiple perspectives are always presented, then user engagement is enhanced, but the computational resources and system complexity increase
Solution Approach 1:
The system employs periodic evaluation of user interaction conditions to determine when to activate multi-perspective mode. Rather than continuously maintaining multiple perspectives, the system periodically checks spatial overlap, proximity, and gaze direction parameters, switching to multi-perspective only when conditions are met, thereby reducing overall computational resource consumption while maintaining engagement when needed.
Solution Approach 2:
The system implements partial multi-perspective presentation by selectively activating additional perspectives only when user interaction conditions are satisfied. Instead of always presenting all possible perspectives, the system provides just enough additional viewpoints to enhance engagement during interactive moments, optimizing the balance between user experience and resource consumption.
Data Source
AI summary
A volumetric video of a three-dimensional space is captured. The volumetric video of the three-dimensional space includes a volumetric representation of a first user within the three-dimensional space. The volumetric video is displayed by a display device worn by a second user, and the second user sees the volumetric representation of the first user within the three-dimensional space. Input indicative of an interaction (e.g., entering or leaving) of the second user with the volumetric representation of the first user is detected. Based on detecting the input indicative of the interaction, the display device switches to a display of a recorded perspective of the first user. Thus, by interacting with a volumetric representation of the first user in a volumetric video, the second user views the first user's perspective of the three-dimensional space.