Omnidirectional Camera Depth Sensing for Audiovisual Noise Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing synchronous communication technologies, such as voice and video services, often suffer from distractions and a lack of inclusiveness due to audio and visual noise, which can hinder collaboration among participants in dispersed locations.
Innovation Solution
The use of 360-degree 3D cameras that capture a panoramic view, enabling features like background removal, gesture control, and depth sensing, which allow for more immersive and focused interactions by reducing distractions and enhancing the sense of togetherness among participants.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Object-affected harmful factors
If traditional voice and video services are used for synchronous communication, then participants can connect with each other, but audio and visual noise create distractions that reduce collaboration and inclusiveness
Solution Approach 1:
The patent extracts and removes distracting audio and visual elements from the communication feed while preserving the core communication content. Background noise, irrelevant visual elements, and distracting sounds are filtered out to create a cleaner, more focused communication experience that enhances collaboration.
Solution Approach 2:
The patent applies different quality levels to different parts of the audio-visual feed. Important foreground elements (speakers, key visual content) are maintained at high quality, while background elements that cause distraction are reduced or removed, creating a differentiated quality structure that improves overall collaboration effectiveness.
2Area of stationary object
If traditional cameras are used for video transmission, then participants can see each other, but the field of view is limited and does not provide comprehensive environmental context
Solution Approach 1:
The patent transitions from traditional 2D video feeds to 360-degree omnidirectional imaging, adding a dimensional aspect that captures the entire environment. This allows participants to view communications from any angle and see the complete context of the remote location, significantly expanding the effective field of view.
Solution Approach 2:
The patent employs omnidirectional cameras that perform multiple functions: capturing 360-degree video, providing 3D depth information, enabling gesture recognition, and supporting various viewing angles simultaneously. This multi-functional approach consolidates what would otherwise require multiple separate camera systems.
3Productivity
If omnidirectional cameras with 360-degree view are deployed, then immersive experience and collaboration are improved, but device complexity and processing requirements increase
Solution Approach 1:
The patent divides the omnidirectional camera system into multiple individual camera units arranged in a specific geometry. Each camera captures a portion of the 360-degree view, and the system processes these segmented feeds separately before combining them. This segmentation reduces the processing complexity of each individual unit while achieving the overall omnidirectional effect.
Solution Approach 2:
The patent introduces intermediate processing layers that manage the complexity between the raw omnidirectional camera data and the final displayed output. These intermediaries include algorithms for stitching multiple camera feeds, extracting relevant information, and presenting simplified views to users, thereby mediating the complexity transition.
Data Source
AI summary
In one example method, a computing device scans an environment via an omnidirectional camera, detects objects in the environment, and captures depth information of the environment and the objects in the environment via 3D imaging of the omnidirectional camera. The computing device makes adjustments to audiovisual (AV) transmissions based on the detected objects and the depth information captured of the environment and the objects.