Gaze-Adjusted Display for Natural Telepresence Scale
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional telepresence and virtual reality applications often feel unnatural due to the need for sensors and warped images, leading to perceptions of unnatural communication and scale distortions, especially with larger display screens.
Innovation Solution
The system determines the viewer's location and gaze direction using sensors like cameras to display graphical objects with accurate scale and orientation, mimicking a window view, allowing for natural interaction and perspective changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If conventional display techniques are used with large display screens, then the display area is increased, but the scale and orientation of displayed objects become distorted and unnatural
Solution Approach 1:
The system dynamically adjusts the scale and orientation of displayed objects based on real-time tracking of viewer position and gaze direction. As the viewer moves or changes gaze, the displayed objects transform accordingly to maintain accurate scale and orientation relative to the viewer's perspective, preventing distortion on large display screens.
Solution Approach 2:
The system changes display parameters including scale factor and orientation angle based on viewer location and gaze direction. By continuously adjusting these parameters, the system maintains visual verisimilitude and accurate object representation regardless of display screen size or viewer position.
2Ease of operation
If cameras are displaced from the display screen in telepresence applications, then the display can show the other participant, but the perception of natural communication is lost
Solution Approach 1:
The system uses feedback from gaze tracking and position monitoring to dynamically adjust the displayed video feed. The video is transformed based on viewer location and gaze direction, creating the perception that the other participant is looking back at the viewer through the display screen, thereby restoring natural communication perception.
Solution Approach 2:
The system introduces an intermediary transformation layer between the camera feed and the display. This intermediary processes the video feed by applying scale and orientation adjustments based on viewer position and gaze, creating a mediated representation that restores natural interaction perception.
3Adaptability or versatility
If sensors are attached to the user's head or body, then motion detection is enabled, but the virtual environment feels unnatural
Solution Approach 1:
Instead of using sensors attached to the user, the system creates a virtual copy or representation of the user's position and gaze direction. This virtual avatar or representation tracks user movement and orientation without requiring physical sensors on the user's body, maintaining the naturalness of the virtual environment while preserving motion detection capability.
Data Source
AI summary
Described herein are technologies relating to display of a representation of an object on a display screen with visual verisimilitude to a viewer. A location of eyes of the viewer relative to a reference point on the display screen is determined. Additionally, a direction of gaze of the eyes of the viewer is determined. Based upon the location and direction of gaze of the eyes of the viewer, the representation of the object can be displayed at a scale and orientation such that it appears with visual verisimilitude to the viewer.