2D Video Conferencing Parallax via Backgroundless Video and Face Pose
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional 2D video-conferencing systems lack the ability to provide a parallax effect, which results in a lack of depth perception and realism for viewing participants.
Innovation Solution
Implementing a parallax effect in 2D video-conferencing by capturing a backgroundless video of a remote speaker, detecting the viewer's face pose using a second camera, and reorienting the video and background image accordingly to simulate depth as the viewer moves.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a 2D video is displayed without depth information, then the video can be transmitted and displayed easily, but the viewing participant cannot perceive depth or realism
Solution Approach 1:
The patent applies dimensionality change by taking a 2D video and creating multiple 2D images from different virtual camera positions, then displaying these images in a stereoscopic format. This transforms the flat 2D video into a 3D-like experience by adding depth perception through parallax effects, allowing viewers to perceive depth information that was not present in the original 2D video.
2Reliability
If multiple cameras are used to capture different views for parallax effect, then depth perception is improved, but the device complexity and cost increase
Solution Approach 1:
The patent uses virtual camera positions to generate synthetic views of the video content. Instead of physically placing multiple cameras at different locations, the system creates virtual copies of the video feed from different perspectives using image processing and perspective transformation. This achieves the parallax effect required for depth perception without the complexity of a multi-camera physical setup.
3Reliability
If the background is removed to create a backgroundless video, then the parallax effect can be applied more effectively, but the processing complexity and computational requirements increase
Solution Approach 1:
The patent extracts the foreground subject from the original video by removing the background, creating a backgroundless video. This extraction process separates the main subject from its original context, allowing the subject to be composited onto different virtual backgrounds from different camera positions. This enables the parallax effect to be applied more effectively to the subject while maintaining processing efficiency through selective background removal rather than full scene reconstruction.
Data Source
AI summary
A video-conferencing system that simulates depth in a two-dimensional video of a remote speaker via a parallax effect. The background of the video of the remote speaker is removed and the resulting backgroundless video is combined with a background image according to poses of a viewing participant face captured by a camera. As the poses change, the orientation of the backgroundless video and the background image are changed proportionally to yield a parallax effect. The video or the backgroundless video and the background image are transferred to a client device of the viewing participant via separate channels.