Perspective-Dependent Video Views for Non-Verbal Cues
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video conferencing systems fail to effectively convey non-verbal cues such as eye gaze and pointing, as all participants see the same view of the remote speaker, making it difficult for individuals to determine who is being addressed.
Innovation Solution
The system provides perspective-dependent views by generating multiple video streams of a remote participant from different angles, which are displayed to local participants at unique viewing angles, using cameras and multiple view display devices with lenticular lenses to ensure each participant sees a distinct perspective of the remote participant.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the same video stream is displayed to all local participants, then the system complexity is low and ease of operation is maintained, but the ability to convey non-verbal cues such as eye gaze and pointing is lost
Solution Approach 1:
The patent segments the single video stream into multiple perspective-dependent video streams, each captured from different camera angles. Each local participant receives a customized video stream that shows the remote speaker's perspective relative to that participant's position, enabling them to see eye gaze and pointing cues that are relevant to them.
Solution Approach 2:
The patent applies local quality by providing each local participant with a customized video stream tailored to their specific viewing position. Instead of a uniform video stream for all participants, each participant receives video content with quality and perspective optimized for their location, allowing them to see non-verbal cues directed at them.
2Loss of information
If multiple video streams from different angles are provided to each participant, then the ability to interpret non-verbal cues is improved, but the device complexity and bandwidth requirements increase
Solution Approach 1:
The patent implements dynamics by dynamically selecting and providing different video streams to different local participants based on their positions. The system adapts the video content in real-time, assigning specific perspective-dependent video streams to participants based on where they are seated in the conference room, rather than providing the same static stream to everyone.
Solution Approach 2:
The patent introduces an intermediary component (the conference system with position tracking and stream assignment logic) that mediates between the multiple camera feeds and the participants. This intermediary automatically matches participants with appropriate video streams based on their positions, eliminating the need for participants to manually select or configure video sources.
3Productivity
If perspective-dependent views are provided to enhance communication clarity, then the effectiveness of video conferencing is improved, but the bandwidth consumption and processing requirements increase
Solution Approach 1:
The patent applies universality by designing a video conferencing system that handles multiple functions: it captures video from multiple angles, tracks participant positions, selects appropriate video streams, and delivers customized content to each participant. This multi-functional system consolidates what would otherwise require separate systems into a unified platform.
Solution Approach 2:
The patent changes parameters by adjusting which video stream is provided to each participant based on their position parameters. The system modifies the video content parameters (which stream to display) dynamically based on participant location, rather than providing all streams to all participants, thereby optimizing bandwidth usage.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows local participants to more easily interpret non-verbal cues, enhancing the realism and effectiveness of video conferencing by ensuring each participant can see the remote speaker's focus, thereby improving communication clarity.
Implementation Method 1
A first video stream is displayed on a display at a first viewing angle that only allows a local participant to see the first view of the remote participant from a first region. A second video stream is displayed on the display at a second viewing angle that only allows the local participant to see the second view of the remote participant from a second region
Data Source
AI summary
During a video conference between a local endpoint and a remote endpoint, a display at the local endpoint may be configured to provide perspective-dependent views to local video conference participants. A local endpoint may receive a plurality of video streams and identify a first video stream that provides a first view of a remote participant and a second video stream that provides a second view of that participant taken concurrently from a different angle. A display at the local endpoint may display the first video stream at a first viewing angle that only allows the first view of the remote participant to be seen from a first region. The display may also concurrently display the second video stream at a second viewing angle that only allows the second view of the remote participant to be seen from a second region different than the first region.