Dual-Function Display Screen for Multi-Perspective Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing wearable systems with head-mounted cameras struggle to capture multi-perspective images of a user and their environment in a realistic manner, as the camera is typically outside the display area, requiring complex hardware and post-processing for 3D view reconstruction.
Innovation Solution
A dual-function display and image capturing system with a passive screen that functions as both a display unit and an image capturing device, using a high-resolution camera and projector assembly integrated into a head-mountable device, where the passive screen's imaging layer with optical elements captures and projects multi-perspective views, allowing the user to be the direct object of the scene.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a head-mounted camera is positioned outside the display area, then the camera can capture the user's field of view, but the camera cannot capture the user directly with eye contact
Solution Approach 1:
The patent merges the display screen and camera into a co-located integrated unit, where the camera is positioned at the same location as the display. This allows the camera to capture the user's face and eyes directly while the display shows content to the user, enabling both field of view capture and direct eye contact capture simultaneously without requiring separate positioning
2Adaptability or versatility
If multiple cameras are used to capture multi-perspective images, then the user can be captured from different angles, but the hardware complexity and post-processing requirements increase substantially
Solution Approach 1:
The display screen is designed to serve dual functions: it acts as both the display device for showing content to the user and as the imaging surface for capturing images. By placing the camera at the display location and using the display as the imaging plane, the system achieves multi-perspective capture capability with a single camera-unit combination, eliminating the need for multiple cameras and complex arrays
3Measurement precision
If an array of cameras is deployed for 3D view reconstruction, then comprehensive scene coverage is achieved, but the system requires fixed installations and substantial post-detection processing
Solution Approach 1:
Instead of using multiple physical cameras to capture different views, the system uses a single camera positioned at the display location that captures images of the display screen itself. The display screen acts as an optical element that presents different views to the camera, effectively creating virtual camera positions through optical copying rather than physical camera arrays
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables realistic multi-perspective image capture and display, reducing the need for multiple cameras and complex hardware, while providing a more intuitive and efficient method for telepresence and teleconferencing applications.
Implementation Method 1
a passive screen with an imaging layer having a two-dimensional array of optical elements forms, in optical communication with a single image capturing device, at least one view of a scene
Implementation Method 2
a projector assembly projects images on a display layer of the passive screen
Data Source
AI summary
A system is preferably in the form of a wearable system combined with a double-function image display and image capturing screen. The system is intended to be used to display projected images on the screen and capture the 3D ambient using the image formations from the screen by means of a camera. The system more particularly relates to a display and imaging system comprising an image capturing device, a projector assembly and a passive screen, said image capturing device capturing at least one view being formed by the said passive screen in optical communication therewith.