Optical Display Layout for Eye-Contact Teleconferencing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current immersive teleconferencing systems face challenges in achieving direct eye contact and immersion due to camera placement, which blocks display content and results in lower brightness, contrast, or resolution, and static cameras fail to respond to display content or viewer input.
Innovation Solution
The system integrates optical and computational methods to eliminate stray light from camera images while maintaining immersion, using optical components like polarizers and semi-reflectors, and computational modules to filter out stray light, allowing simultaneous display and eye-contact imaging.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a physical camera is placed over the display content to capture the viewer, then eye contact imaging is achieved, but the camera blocks some of the display image resulting in lower brightness, contrast, or resolution
Solution Approach 1:
The patent transitions from a single-plane obstruction problem to a multi-dimensional optical path solution by implementing a beam splitter that separates the optical paths for display and camera capture. The display content and camera view are directed along different spatial dimensions, allowing simultaneous operation without mutual obstruction. This resolves the contradiction by adding a dimensional layer to the optical architecture.
Solution Approach 2:
The beam splitter acts as an intermediary optical element that mediates between the display content and the camera. It selectively directs light from the display to the viewer while simultaneously directing light from the viewer to the camera, enabling both functions to coexist without interference. This intermediary component resolves the contradiction by facilitating dual optical paths through a single optical interface.
2Device complexity
If a static camera is used to capture the viewer, then device complexity is reduced, but the camera cannot respond to display content or viewer input resulting in poor adaptability
Solution Approach 1:
The system implements feedback mechanisms where the camera captures viewer images, and these images are processed and displayed in real-time to create the eye contact effect. The system continuously monitors and adjusts the displayed content based on viewer position and orientation, enabling dynamic adaptation without requiring complex mechanical camera adjustments. This feedback loop provides adaptability while maintaining a relatively simple static camera structure.
Solution Approach 2:
While the camera itself remains static, the system achieves dynamic adaptability through real-time image processing and display updates. The captured viewer images are dynamically processed to create the eye contact effect, and the display content is continuously updated based on viewer input. This dynamic processing approach provides versatility without requiring the camera to be mechanically dynamic.
3Adaptability or versatility
If the display and camera share the same optical path to achieve immersion, then eye contact imaging is possible, but stray light from the display content enters the camera resulting in degraded image quality
Solution Approach 1:
The beam splitter implements local quality control by selectively directing different types of light along different paths. It allows display light to pass through to the viewer while reflecting viewer light to the camera. This selective directional control ensures that stray light from the display does not enter the camera path, maintaining image quality while enabling the shared optical path for immersion and eye contact capability.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enhances immersion by enabling direct eye contact and maintaining image quality, with improved brightness, contrast, and resolution in teleconferencing, education, and simulation applications.
Implementation Method 1
an optical subsystem including an aperture optic and a semi-reflector, the semi-reflector positioned to direct the light through the aperture optic
Implementation Method 2
a reflection removal module to (i) transmit ambient light incident on the reflection removal module and to (ii) remove at least a portion of stray light incident on the reflection removal module, the stray light from the display and having an optical property
Implementation Method 3
an imaging sensor (i) to receive the ambient light transmitted through the reflection removal module and (ii) to generate a captured image from the received ambient light
Data Source
AI summary
Systems and methods are described for immersive teleconferencing applications using a display system and a camera or camera system. In some embodiments, a display and optical system produces a virtual image for a viewer to view, ambient light (reflected) from the viewer entering the optical system is captured by a camera. A reflection removal module optically or computationally removes stray light from the camera image. In some embodiments, a plurality of cameras computationally produces a fused image of a viewer or viewer's environment.