Live Streaming Audio Switching via Scene Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Manual switching of audio input and output in live streaming devices is cumbersome, timeliness, and unreliable, especially when transitioning between far-field and near-field scenes, disrupting the live streaming experience for both streamers and audiences.
Innovation Solution
A method and device that automatically switch audio input and output based on the determination of the live scene by analyzing the live stream image, using a main control component to generate switching instructions for the audio processor, thereby adjusting the audio settings accordingly between far-field and near-field scenarios.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual switching of audio input and output is used, then the live streamer can control audio settings, but the operation becomes cumbersome and timeliness deteriorates
Solution Approach 1:
The system automatically detects the live scene type through image analysis and autonomously switches audio input and output settings without requiring manual intervention from the live streamer. The audio processing device serves itself by making switching decisions based on automated scene recognition, thereby eliminating the cumbersome manual operation while maintaining timely responses to scene changes.
2Ease of operation
If manual switching of audio input and output is used, then the live streamer can control audio settings, but reliability deteriorates
Solution Approach 1:
The system continuously monitors the live stream image and uses image recognition technology to detect the current scene type. This feedback mechanism ensures that the audio switching decisions are based on accurate, real-time scene identification. The automated closed-loop control eliminates human error in switching decisions, thereby improving reliability while removing the need for manual operation.
3Loss of time
If automated scene detection is implemented, then switching timeliness improves, but device complexity increases
Solution Approach 1:
The main control component of the live streaming device performs multiple functions: it manages video processing, audio processing, and now scene detection for automated audio switching. By making the main control component multi-functional, the system avoids adding separate dedicated hardware for scene detection, thereby improving switching timeliness while minimizing the increase in overall device complexity.
Data Source
AI summary
Embodiments of the present provide a method of switching audio input and output applied to live streaming and a live streaming device, including: obtaining a live stream image of an live streamer during live streaming, and determining a live scene of the live streamer according to the live stream image, the live scene including a far-field scene and a near-field scene; in response to a change of the live scene, switching audio input and output of a live streaming device according to the change of the live scene.