Video Stream Layouts for Aspect-Ratio Adaptive Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing communication systems face inefficiencies due to poor user interface layouts that distract users and waste computing resources when participants join or leave a session, leading to missed content and increased resource usage.
Innovation Solution
A system that dynamically configures communication video stream arrangements based on the aspect ratio of an available display area, using a target aspect ratio to optimize the position, size, and shape of video streams, minimizing movement and distractions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If video stream arrangements are fixed in position, then user focus is maintained, but adaptability to different display areas is reduced
Solution Approach 1:
The system dynamically adjusts video stream arrangements based on the aspect ratio of available display areas. When participants join or leave, the layout automatically reconfigures to maintain optimal positioning, transforming the static fixed-position approach into a dynamic adaptive system that responds to changing conditions while preserving user focus.
Solution Approach 2:
The system changes layout parameters such as grid dimensions, stream positions, and sizing based on the detected aspect ratio of the display area. By adjusting these parameters dynamically, the system adapts to different display configurations while maintaining stable, focused viewing positions for video streams.
2Productivity
If video streams are rearranged when participants join or leave, then all participants are displayed, but user distraction and loss of focus occurs
Solution Approach 1:
The system applies different positioning strategies to different video streams based on their importance and the current display configuration. Primary streams maintain stable positions while secondary streams are arranged in complementary positions, allowing complete participant display without causing distraction to the main viewing focus.
Solution Approach 2:
The system pre-establishes a grid-based layout framework that anticipates participant additions and removals. By having predetermined positioning rules ready, the system can smoothly integrate new participants or remove left participants without causing disruptive rearrangements, maintaining user focus while ensuring complete participant display.
3Ease of operation
If manual interaction is required to adjust video layouts, then precise control is achieved, but workflow efficiency is reduced
Solution Approach 1:
The system automatically detects the aspect ratio of the available display area and self-adjusts the video stream arrangements without requiring manual user intervention. The layout engine autonomously configures the grid-based positioning, allowing precise adaptive control while eliminating workflow disruptions caused by manual adjustments.
Data Source
Figure 1A
Figure 1B
Figure 1C
AI summary
The provided techniques improve user engagement and more efficient use of computing resources by dynamically configuring video stream arrangements based on an aspect ratio of an available display area (401) and a target aspect ratio (410). Such techniques provide dynamically optimized user interface arrangements that accommodate any given shape of an available display area. The techniques can also help viewers maintain focus on the salient content of a multi-stream display when users resize a display window, move a window to a random shape, rotate a device, join a communication session, leave a communication session, present content streams, remove content streams, etc. A target aspect ratio can be utilized in a process to recursively divide a display area horizontally or vertically to accommodate any number of stream renderings. An adjustment of the target aspect can allow for an optimal display any number of video stream renderings for any shape of a display screen.