Immersive Teleconferencing Shared Scene Environment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Substantial differences in broadcasting devices and environments during teleconferencing can break immersion, reducing the quality of the teleconferencing experience and leading to inefficiencies, such as increased reliance on in-person meetings.
Innovation Solution
A computing system determines scene data including lighting, acoustic, and perspective characteristics of a shared environment and modifies participant streams based on their position within that environment, creating a consistent and immersive teleconferencing experience across varying devices and environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If participants broadcast from varying environments using different devices, then teleconferencing accessibility is improved, but immersion quality deteriorates
Solution Approach 1:
The patent introduces a shared scene environment as an intermediary layer between participants and their diverse broadcasting devices. This virtual common ground mediates the differences in hardware capabilities and environmental conditions, allowing participants to interact within a standardized spatial context rather than directly confronting the variability of their individual setups.
Solution Approach 2:
The system dynamically adjusts visual and spatial parameters of the shared scene environment based on participant positions, camera perspectives, and environmental conditions. By continuously modifying parameters such as camera angles, lighting conditions, and spatial relationships, the system maintains immersion quality despite variations in input device capabilities and broadcasting environments.
2Reliability
If participant streams are modified to match a shared scene environment, then immersion quality is improved, but processing complexity increases
Solution Approach 1:
The patent segments the stream modification process into distinct operational phases: scene environment establishment, participant positioning, individual stream processing, and composition. This segmentation allows complex modifications to be handled systematically and efficiently, reducing overall processing burden by breaking down the task into manageable components that can be processed in parallel.
Solution Approach 2:
The system performs preliminary actions by pre-establishing the shared scene environment and pre-calculating spatial relationships before actual teleconferencing begins. Participant positions and camera configurations are determined in advance, allowing stream modifications to be applied more efficiently during the meeting without requiring real-time complex computations.
3Reliability
If streams are normalized to a shared scene environment, then teleconferencing quality is improved, but computational resources are consumed
Solution Approach 1:
The patent applies partial modifications to streams only where necessary to achieve the shared scene environment effect, rather than uniformly processing all visual and audio data. By selectively applying transformations only to portions of the stream that require normalization, the system reduces overall computational resource consumption while maintaining teleconferencing quality.
Data Source
AI summary
Methods, systems, and apparatus are described for immersive videoconferencing teleconferencing streams from multiple endpoints within shared scene environment. The method includes receiving a plurality of streams for presentation at a teleconference, wherein each of the plurality of streams represents a participant of a respective plurality of participants of the teleconference. The method includes, determining scene data descriptive of a scene environment, the scene data comprising at least one of lighting characteristics, acoustic characteristics, or perspective characteristics of the scene environment. The method includes, for each of the plurality of participants of the teleconference, determining a position of the participant within the scene environment and, based at least in part on the scene data and the position of the participant within the scene environment, modifying the stream that represents the participant.