Head-Tracked Off-Axis Rendering for Directional 3D Imagery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video conferencing systems lack directionality, leading to a lack of co-presence and increased fatigue due to the absence of motion parallax, and require users to wear cumbersome headsets for virtual reality solutions.
Innovation Solution
A system and method that tracks a user's head location using sensors to apply motion parallax in rendering pipelines, simulating self-induced motion parallax without stereoscopic depth, allowing directionality on standard 2D screens.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If virtual reality solutions are used to provide 3D interactions, then directionality and co-presence are improved, but users must wear cumbersome headgear which reduces ease of operation
Solution Approach 1:
The patent extracts the essential function of head tracking from the VR headset context and implements it using standalone sensors (camera, accelerometer, gyroscope) that can be integrated into普通 devices without requiring specialized headgear. This separates the directionality function from the cumbersome headset requirement.
Solution Approach 2:
The system copies the visual information from the user's perspective by capturing images through a camera and rendering them to match the tracked head orientation. This creates a virtual view that replicates what the user would see in reality, providing directionality without physical VR headsets.
2Ease of operation
If 2D screen displays are used for video conferencing, then ease of operation is maintained, but directionality and co-presence are lost leading to increased fatigue
Solution Approach 1:
The patent makes the 2D screen display dynamic by rendering images that change according to the user's head orientation. The displayed view rotates and shifts to match the user's perspective, creating a dynamic experience that restores directionality and co-presence while maintaining the simplicity of a standard screen.
Solution Approach 2:
The system creates an asymmetric rendering where the displayed image is specifically transformed based on the user's unique head orientation and position. This asymmetric transformation provides directional cues that enhance co-presence, making each user's experience tailored to their specific viewing angle rather than a fixed frontal view.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Reinstates directionality and co-presence in video conferencing by using motion parallax, eliminating the need for headgear and enhancing communication efficiency.
Implementation Method 1
receiving sensor data capturing eye location of a user
Implementation Method 2
determining an updated rendering of the onscreen imagery using off-axis projective geometry based on the tracked location of the eyes of the user to simulate an angled viewpoint
Data Source
AI summary
There is provided a system and method for reinstating directionality of onscreen displays of three-dimensional (3D) imagery using sensor data capturing eye location of a user. The method can include: receiving the sensor data capturing the eye location of the user; tracking the location of the eyes of the user relative to a screen using the captured sensor data; determining an updated rendering of the onscreen imagery using off-axis projective geometry based on the tracked location of the eyes of the user to simulate an angled viewpoint of the onscreen imagery from the perspective of the location of the user; and outputting the updated rendering of the onscreen imagery on a display screen.