3D Virtual Environment Zone Control for Videoconference Audio and Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional videoconferencing technologies face challenges such as loss of social interaction, audio overlap issues, and performance degradation with multiple participants, leading to a lack of immersive experience and effective communication.
Innovation Solution
A system that utilizes a three-dimensional virtual environment to control audio and video streams based on user positioning, enabling or disabling streams based on proximity and security settings, and implementing access control to manage user interactions and resource allocation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If all video streams from multiple participants are transmitted in a virtual conference, then complete visual information is provided to all users, but system performance degrades due to bandwidth and computing limitations
Solution Approach 1:
The system applies different quality levels of video streaming to different users based on their spatial position relative to each participant. Users closer to a participant receive higher quality or active video streams, while users farther away receive lower quality or inactive streams. This selective approach maintains essential visual information for each user while reducing the total bandwidth and computing resources required across the entire system.
2Loss of information
If audio streams from all participants are mixed equally in virtual conferences, then all voices are heard by participants, but audio clarity deteriorates due to overlapping speeches
Solution Approach 1:
The system provides different audio mixing quality to different users based on their spatial position. Users positioned closer to certain participants receive prioritized or clearer audio streams from those nearby participants, while audio from distant participants is reduced or excluded. This spatially-aware audio mixing prevents overlapping speech confusion for each user while maintaining complete audio information coverage across all participants.
3Loss of information
If video streams are transmitted to all users regardless of position, then all users have access to all visual content, but network bandwidth is wasted on unnecessary transmissions
Solution Approach 1:
The system transmits only a partial set of video streams to each user, specifically those from participants within the user's field of view or proximity. Instead of transmitting all video streams to all users, the system calculates which streams are necessary for each user based on spatial relationships, transmitting only those that contribute to the user's current visual context. This reduces network bandwidth consumption while ensuring users receive all visually relevant content.
4Adaptability or versatility
If computing devices process video streams from many participants, then comprehensive video conferencing is achieved, but device performance slows down
Solution Approach 1:
Each computing device processes only a subset of video streams corresponding to participants that are relevant to the current user's spatial position and orientation. The system dynamically determines which participant streams require processing on each device based on real-time spatial calculations, ensuring comprehensive conferencing capability while minimizing the processing load on individual devices to maintain performance.
Data Source
AI summary
Disclosed herein is a web-based videoconference system that allows for video avatars to navigate within the three-dimensional virtual environment. The system and methods provided include those for: (1) using zones in a three-dimensional virtual environment for limiting audio and video, (2) access control using zones, (3) access control of the three-dimensional virtual environment itself, and (4) controlling user connections in a three dimensional virtual environment.