Composite Image Display System for Depth-Aware Remote Presence
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image display systems fail to accurately reflect the movement and depth changes of a conversation partner, leading to a mismatch between the displayed image and the actual visual perception, resulting in a lack of realism and presence in remote conversations.
Innovation Solution
An image display system that acquires and composites images of a user and their background, adjusting the display position and size based on the movement and depth changes detected by an infrared sensor, to create a more realistic and immersive visual experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the displayed image rotates about the vertical axis when the user moves rightward/leftward, then the depth distance of portions in the displayed image changes, but the displayed image becomes different from the actual appearance of the conversation partner
Solution Approach 1:
The patent segments the displayed image into two distinct components: the conversation partner's image and the background image. By applying different transformation rules to each component (the partner's image translates horizontally while the background rotates), the system preserves the accurate appearance of the conversation partner while still providing depth perception through background movement.
2Ease of manufacture
If both the image of the person and the image of the background rotate by the same rotation amount, then the processing is simplified, but the image of the conversation partner does not reflect the actual appearance when the user faces the conversation partner
Solution Approach 1:
The patent divides the image processing into separate operations for the conversation partner and the background. The partner's image undergoes horizontal translation only, while the background undergoes rotation. This segmentation allows each component to be processed according to its specific requirements, maintaining appearance fidelity while managing complexity through modular processing.
3Measurement precision
If the display size of the conversation partner changes according to the depth distance, then the optical characteristics are accurately represented, but the conversation partner appears to change size when the depth distance changes, which is different from actual visual perception
Solution Approach 1:
The patent changes the display size parameter of the conversation partner's image to maintain a constant size regardless of depth distance changes. This parameter adjustment compensates for the natural optical effect of size change with distance, ensuring that the conversation partner maintains a consistent appearance that matches human visual perception, while the background still provides depth cues through its size changes.
Data Source
AI summary
When a user viewing an image of a conversation partner displayed on a display moves, a displayed image is more easily switched to an image reflecting a position of the user after the movement. When an image of a first user is displayed on a display of a second user, the image of the first user taken by an imaging device and an image of a background taken by the imaging device are acquired, and the acquired images are composited with each other, thereby displaying on the display a composite image in which the first user is positioned in front of the background. Moreover, when a movement of the face of the second user with respect to the display is detected, transition processing of causing the composite image displayed on the display to transition from a state before the detection of the movement of the face is carried out.