Video Perspective Shifting for Obscured Background Elements
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video conferencing systems do not allow viewers to easily manage the presentation of foreground and background content elements captured by far-end devices, requiring manual adjustments to view obscured background elements.
Innovation Solution
Implementing a system that identifies foreground and background elements in a video stream and modifies the stream based on viewing conditions at the receiving terminal, allowing for perspective shifts to reveal obscured background elements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If devices operate autonomously without regard to viewer perspectives, then device independence and simplicity are maintained, but viewers cannot see background content elements obscured by foreground objects
Solution Approach 1:
The patent introduces an intermediary video processing system that receives video streams from autonomous devices and applies perspective shifting transformations. This intermediary layer enables viewers to see obscured background elements without requiring the capturing devices to become complex or lose their autonomous operation. The processing system acts as a mediator between the simple autonomous devices and the viewer's perspective needs.
Solution Approach 2:
The patent applies perspective shifting that transforms the video stream from a fixed 2D perspective to a dynamically adjustable viewpoint that simulates 3D spatial relationships. By shifting the foreground element relative to the background based on simulated camera position changes, the system enables viewers to see background elements that would normally be obscured, effectively adding a dimensional perspective control capability without physical camera movement.
2Productivity
If manual adjustments are required to view obscured background elements, then system simplicity is maintained, but viewing efficiency and user experience deteriorate
Solution Approach 1:
The patent implements a system where the video processing automatically adjusts the perspective based on detected foreground and background elements without requiring manual viewer intervention. The system self-adjusts by identifying occluded background elements and applying appropriate perspective shifts to reveal them, thereby improving viewing efficiency while maintaining system simplicity.
Solution Approach 2:
The patent incorporates feedback mechanisms where the system continuously analyzes the video stream to detect foreground elements that obscure background content. Based on this feedback about what is obscured, the system automatically applies perspective shifting transformations to reveal the hidden background elements, creating a closed-loop system that improves viewing efficiency without manual intervention.
3Adaptability or versatility
If perspective shifting is implemented to reveal background elements, then viewer engagement and depth perception are improved, but video processing complexity and computational requirements increase
Solution Approach 1:
The patent segments the video content into distinct foreground elements and background elements through image processing and object detection. This segmentation enables selective manipulation of different depth layers, allowing perspective shifting to be applied specifically to reveal background elements while maintaining foreground integrity. The segmentation approach makes the complex processing task more manageable and targeted.
Solution Approach 2:
The patent implements dynamic perspective shifting where the degree and direction of foreground element displacement are adjusted in real-time based on the detected spatial relationships between foreground and background elements. This dynamic adjustment allows the system to adapt to different scenes and viewing conditions, providing versatile perspective control while optimizing computational resources by only processing what is necessary for each frame.
Data Source
AI summary
Embodiments of the present disclosure provide systems and methods for perspective shifting in a video conferencing session. In one exemplary method, a video stream may be generated. A foreground element may be identified in a frame of the video stream and distinguished from a background element of the frame. Data may be received representing a viewing condition at a terminal that will display the generated video stream. The frame of the video stream may be modified based on the received data to shift of the foreground element relative to the background element. The modified video stream may be displayed at the displaying terminal.