Video Frame Selection for Bandwidth-Constrained Conferencing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video conferencing technologies face issues with network bandwidth limitations, leading to frozen or poor-quality video transmissions due to the inability to effectively select and transmit optimal image frames, especially in conditions like low bandwidth or connectivity issues.
Innovation Solution
A system that includes a processor and storage, capable of selecting and transmitting a prioritized image frame from multiple frames received during video conferencing based on conditions such as face visibility, gaze direction, smile detection, and connectivity issues, while adjusting frame rates dynamically to optimize network resource usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If all image frames are transmitted during video conferencing, then video quality is improved, but network bandwidth consumption increases and causes freezing or connectivity issues
Solution Approach 1:
The patent segments the continuous video stream into individual image frames and selectively transmits only certain frames based on quality metrics. Instead of transmitting all frames, the system divides the video content into discrete units (frames) and applies selection criteria to each unit, thereby reducing overall bandwidth consumption while maintaining perceived video quality.
Solution Approach 2:
The patent applies local quality enhancement by selecting and transmitting only high-quality frames that meet specific criteria (sharpness, proper exposure, correct focus). Rather than uniformly transmitting all frames at the same quality level, the system identifies and prioritizes transmission of locally superior frames, optimizing the balance between video quality and bandwidth usage.
2Speed
If frame transmission rate is increased to improve video smoothness, then video fluency is improved, but network bandwidth requirements increase and exacerbate connectivity issues
Solution Approach 1:
The patent implements dynamic frame rate adjustment based on network conditions and frame quality. The system continuously monitors network bandwidth availability and adapts the transmission rate accordingly, transmitting frames at variable rates rather than a fixed high rate. This dynamic approach allows the system to maintain video smoothness when bandwidth permits while reducing transmission rate when network conditions deteriorate.
Solution Approach 2:
The patent applies partial action by transmitting only a subset of captured frames rather than all frames. The system selects frames that meet quality thresholds and transmits them at an optimized rate, rather than transmitting every frame at maximum rate. This partial transmission strategy reduces overall bandwidth consumption while maintaining adequate video fluency for the user experience.
3Manufacturing precision
If image processing and selection is performed on each frame, then video quality is improved, but computational complexity and processing time increase
Solution Approach 1:
The patent applies preliminary action by performing image quality assessment and frame selection in advance of transmission. The system evaluates each captured frame for quality metrics (sharpness, exposure, focus) before committing to transmission, allowing preprocessing and filtering to occur before the transmission bottleneck. This preliminary selection reduces the burden during actual transmission and network delivery.
Solution Approach 2:
The patent extracts only the essential quality-determining features from each frame (sharpness, exposure, focus metrics) rather than processing and transmitting the entire frame data for evaluation. By extracting only the critical quality indicators, the system reduces computational complexity while still maintaining the ability to make informed selection decisions about which frames to transmit.
4Loss of information
If all frames are transmitted to ensure complete video information, then video completeness is improved, but network bandwidth consumption increases and causes freezing
Solution Approach 1:
The patent uses copying by creating and transmitting only the essential visual information through selected representative frames rather than transmitting the complete continuous video stream. The system identifies key frames that capture important moments or quality states and transmits copies of these specific frames, providing sufficient video information for the conferencing purpose without the bandwidth overhead of complete transmission.
Data Source
AI summary
In one aspect, a first device may include at least one processor and storage accessible to the at least one processor. The storage may include instructions executable by the at least one processor to, during video conferencing and based on at least one identified condition (such as an issue with a network being used for the video conferencing), select a first image from plural images received from a camera. The plural images may be associated with the video conferencing. The instructions may also be executable to provide the first image to a second device different from the first device but decline to provide at least a second image from the plural images.