See-Through Display Frustum Projection for User-Aligned AR Views
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
AR technology applied to large, fixed displays fails to align scene content with user needs due to neglecting the relative positional relationship between the user and the display, leading to obstructed viewing of important scene objects.
Innovation Solution
A see-through display system utilizing two image sensors and a processor to capture user and scene images, determine user and scene position information in a shared three-dimensional coordinate system, and generate a display frame based on a viewing frustum to align displayed content with the actual scene, adjusting in response to user movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If AR technology is applied to large fixed displays without considering user position, then the display can show scene content, but the scene content becomes misaligned with user needs and important objects are obstructed
Solution Approach 1:
The system dynamically adjusts the display content based on real-time user position detection. The processor determines user position information from captured images and continuously updates the display frame to maintain proper alignment between virtual AR elements and real scene objects, ensuring that important objects remain visible and properly positioned relative to the user's viewing angle
Solution Approach 2:
The system implements a feedback loop where the processor continuously monitors user position through image capture and position information acquisition, adjusts the display frame accordingly, and maintains optimal viewing alignment. This closed-loop control ensures that AR content remains properly aligned with real-world objects as user position changes
2Ease of operation
If the display shows fixed scene content without user position tracking, then the system is simpler, but the user cannot view scene objects of interest
Solution Approach 1:
The system divides the display into multiple display frames, each corresponding to different viewing angles or regions of interest. The processor selectively generates and displays appropriate frames based on user position, allowing the user to view specific scene objects of interest without requiring the entire display to be complex or require full-screen AR overlay
Data Source
AI summary
A see-through display method and a see-through display system are disclosed. The method includes the following steps. A user image is captured toward the front side of a display through a first image sensor, and a scene image is captured toward the rear side of the display through a second image sensor. User position information associated with the three-dimensional reference coordinate system is obtained according to the user image. Scene position information associated with the three-dimensional reference coordinate system is obtained according to the scene image. A viewing frustum is determined based on the user position information and a physical size of the display. A projection matrix of the viewing frustum is used to generate a display frame projected on the display plane of the display according to the scene position information. The display frame is output through the display to show the scene behind the display.