AR Representation Toggling via Depth Camera Field of View
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality technologies fail to provide a seamless representation of users during video calls when they move out of the camera's field of view, resulting in a disrupted or incomplete 3D image rendering experience.
Innovation Solution
A method and system that automatically toggle between a real image and a virtual avatar of a user based on their position relative to the camera's field of view, using depth camera data to determine visibility and render appropriate representations on an augmented reality display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional augmented reality technologies are used for video calls, then users can be represented in real-time, but the representation becomes disrupted or incomplete when users move out of the camera's field of view
Solution Approach 1:
The patent creates a virtual avatar as a copy of the real user to maintain representation when the user moves out of the camera's field of view. The system detects when the user is no longer visible in the real image feed and automatically switches to displaying the pre-generated virtual avatar, ensuring continuous representation without interruption.
Solution Approach 2:
The system dynamically switches between two representation modes (real image and virtual avatar) based on the user's position relative to the camera's field of view. This dynamic adaptation allows the system to maintain reliable representation while accommodating user movement freedom, resolving the contradiction between representation continuity and user movement freedom.
2Reliability
If the camera field of view is restricted to ensure complete user visibility, then the representation remains complete, but the user's movement freedom is limited
Solution Approach 1:
The virtual avatar serves as an intermediary representation that takes over when the real image becomes incomplete. This allows the user to move freely beyond the camera's field of view while the system maintains a complete representation through the virtual avatar, resolving the contradiction between representation completeness and user movement freedom.
Solution Approach 2:
By creating and utilizing a virtual copy of the user, the system enables the user to move freely in physical space while the virtual copy maintains a complete and consistent representation in the augmented reality display, even when the user exits the camera's field of view.
3Measurement precision
If the system continuously monitors user position to maintain accurate representation, then the representation accuracy is improved, but the computational complexity increases
Solution Approach 1:
The system dynamically adjusts its monitoring and switching behavior based on user position. Rather than continuously processing complex spatial relationships, the system activates position monitoring and avatar switching only when needed (when the user moves out of the camera view), thereby maintaining measurement precision while reducing overall computational complexity.
Solution Approach 2:
The system uses feedback from camera field of view detection to trigger avatar switching. When the camera detects that the user is no longer visible, this feedback triggers the transition to virtual avatar mode, maintaining representation accuracy without requiring continuous complex computational monitoring of user position.
Data Source
AI summary
One embodiment provides a method comprising determining a spatial relationship between an augmented reality (AR) device and a camera-equipped device. The AR device is worn by a user. The camera-equipped device is positioned within proximity of the user. The method further comprises determining a position of the user relative to a field of view of the camera-equipped device, and providing a representation of the user for display. The representation automatically switches between a real image of the user and a virtual avatar of the user based on the position of the user.