Transmissive Display Apparatus for Diminished Reality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented and diminished reality technologies face challenges in seamlessly combining video objects with real-world scenes, leading to image distortion and a loss of presence due to the need to convert real-world scenes into videos, which is difficult to implement in transmissive display devices like head-mounted displays.
Innovation Solution
A transmissive display apparatus that includes a beam splitter, image sensor, light modulator, and control and projection image generation unit, which splits and processes light from the real-world scene to generate a masking image and projection image, allowing for the natural removal of objects from the scene by blocking the foreground and passing the background, thereby reducing distortion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If real world scene is converted into video to be combined with video object, then combination capability is improved, but image distortion increases and sense of presence is lost
Solution Approach 1:
The patent segments the real-world light into two portions: one portion is reflected to the image sensor for video capture, while the other portion is transmitted to the user's eye. This segmentation allows the real-world scene to be captured for combination purposes while maintaining the original optical path for the user, thereby enabling video object combination without degrading the real scene quality and preserving sense of presence.
Solution Approach 2:
The patent introduces a beam splitter as an intermediary component that divides the incident light from the real world into reflected and transmitted portions. This intermediary enables the real scene to serve dual purposes: being captured by the image sensor for video combination while simultaneously being transmitted to the user's eye in its original form, thus avoiding image distortion and maintaining presence.
2Adaptability or versatility
If video-based technique is used to combine video object with real world scene, then combination flexibility is improved, but sense of presence is lost
Solution Approach 1:
The beam splitter segments the incident light into two separate paths: one path directs light to the image sensor for video capture and processing, while the other path transmits the original real-world light directly to the user's eye. This segmentation preserves the authentic real-world optical information for the user while enabling flexible video object combination through image processing, thus maintaining sense of presence despite the use of video-based techniques.
Solution Approach 2:
The beam splitter acts as an intermediary that separates the real-world light path from the video processing path. This allows the system to apply flexible video-based combination techniques to the captured image while the user receives the original real-world scene through the transmitted light path, preventing loss of sense of presence.
3Adaptability or versatility
If object removal is implemented in transmissive display device, then diminished reality capability is improved, but device complexity increases
Solution Approach 1:
The beam splitter serves multiple functions: it enables the real-world scene to be captured by the image sensor for video processing and combination, while simultaneously transmitting the original real-world light to the user's eye. This multi-functionality allows the transmissive display device to implement diminished reality capability without requiring separate complex optical paths or additional components, thus improving capability while limiting complexity increase.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables intuitive and realistic diminished reality with a high sense of presence by using image inpainting to delete objects, providing a more realistic experience by naturally combining projection images with real-world scenes without significant distortion.
Implementation Method 1
a beam splitter configured to split a light incident from a real space scene in front of the display apparatus to transmit a first portion of the incident light from the real space scene and reflects a second portion of the incident light from the real space scene
Implementation Method 2
a light modulator having a transmittance that is variable for each pixel according to a masking image and configured to pass at least a part of the first portion of the incident light according to the transmittance
Data Source
AI summary
Provided is a transmissive display apparatus capable of naturally combining a projection image on a real space scene. A beam splitter splits a light incident from a real space scene into first and second portions. An image sensor generates a real space image according to the second portion of the incident light. A light modulator passes at least a part of the first portion of the incident light according to a masking image. A control and projection image generation unit selects a target object and generates the masking image based on a target object area to cause a light modulator to block a foreground of the real space scene and pass a background of the real space scene. A projection unit generates a projection image light corresponding to the projection image combines the projection image light with a part of the first portion of the incident light.