Telepresence System with Speaker Detection and BYOD Integration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current teleconferencing solutions face high costs and low functionality, particularly in providing effective audio/visual collaboration for remote participants, often relying on a single shared display device that can be cumbersome and limit user engagement.
Innovation Solution
A system and method that utilizes a 'bring your own device' architecture, incorporating a data processing apparatus, audio/visual capture device with a microphone and camera, and detection modules to identify speakers, allowing participants to use their own mobile devices for video and content sharing, while supporting wireless connectivity and advanced features like 360-degree video capture and intelligent video stream selection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single shared display device is used for teleconferencing, then device complexity is reduced, but user engagement and collaboration effectiveness deteriorate
Solution Approach 1:
The system divides the display function from the computing function by allowing participants to use their own personal devices for display while a separate system handles video capture and streaming. This segmentation enables each participant to have full control over their own display experience without requiring a complex shared display infrastructure.
Solution Approach 2:
Each participant uses their own personal device (smartphone, tablet, or laptop) to display video content and control their own viewing experience. The system automatically detects which participant is speaking and routes the video stream to each device individually, eliminating the need for manual configuration or shared display management.
2Reliability
If personal devices are allowed for video capture, then video quality and user engagement improve, but network traffic and system complexity increase
Solution Approach 1:
The system performs preliminary detection of which participant is speaking before streaming video content. The detection module analyzes audio inputs from all participants and identifies the active speaker in advance, allowing the system to pre-select and stream only the relevant video feed to each participant's device, reducing unnecessary network traffic.
Solution Approach 2:
The system provides different video quality levels to different participants based on their needs and the detected speaking status. The active speaker's video is streamed in high quality to all participants, while inactive participants receive lower quality or no video stream, optimizing network bandwidth utilization while maintaining overall video quality where needed.
3Productivity
If audio detection is implemented to identify speakers, then collaboration effectiveness improves, but device complexity and processing requirements increase
Solution Approach 1:
The system introduces an intermediary detection module that sits between the audio input devices and the video streaming system. This module analyzes audio signals from all participants, identifies who is speaking, and provides this information to the video routing system, which then automatically selects and streams the appropriate video feed without requiring complex processing at the endpoint devices.
Data Source
AI summary
Disclosed is system and method for interactive telepresence that includes at least one data processing apparatus, at least one database, an audio/visual capture device that is configured with at least one microphone and camera. A detection module is provided to detect one of the plurality of participants who is speaking during the meeting, and a display module that is configured to display video that is generated.