Dynamic Video Aspect Ratio Adjustment for Interactive UI Preservation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for adjusting video aspect ratios, such as pan-and-scan and boxing, are inadequate for videos with interactive components and multiple videos of different aspect ratios, as they either lose parts of the image or require manual user selection and may not provide an optimal viewing experience.

Innovation Solution

A method and system for dynamically adjusting video aspect ratios by automatically determining the display area based on user interface elements, active areas, or central areas within the video, and re-encoding videos with added mattes to match the display screen's aspect ratio, ensuring seamless playback and maintaining visual integrity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If pan-and-scan method is used to adjust aspect ratio, then the screen is entirely filled with the image, but a part of the image is lost or not displayed

Engineering Contradiction:
Improvescreen filling areaVSAvoidimage content loss
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

The patent applies dynamics by making the aspect ratio adjustment adaptive rather than static. The system dynamically determines the display area based on UI element positions and video content characteristics, allowing the solution to adapt to different video types and screen orientations automatically, resolving the contradiction between filling the screen and preserving image content

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system performs self-service by automatically detecting UI element positions and determining the optimal display area without requiring manual user configuration. The aspect ratio adjustment is performed autonomously based on analyzed video metadata and content characteristics, eliminating the need for manual pan-and-scan configuration while preserving important image content

Inventive Principle:
Principle #25Self-service

2Loss of information

If boxing method (letterboxing/pillarboxing) is used to adjust aspect ratio, then the entire image is fit inside the screen boundaries, but remaining space is filled with mattes reducing screen utilization

Engineering Contradiction:
Improveimage content preservationVSAvoidscreen utilization area
Core Design Contradiction:
Loss of informationVSArea of stationary object

Solution Approach 1:

The patent applies local quality by treating different regions of the video frame differently. Instead of uniformly applying boxing or pan-and-scan to the entire image, the system identifies specific regions containing UI elements and preserves those areas while allowing other regions to be adjusted or filled with mattes, optimizing both content preservation and screen utilization locally

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system dynamically adjusts the degree of boxing applied based on the detected UI element positions and video content. Rather than consistently applying full letterboxing or pillarboxing, the aspect ratio adjustment is adapted in real-time to minimize matte areas while preserving UI elements, resolving the contradiction between content preservation and screen utilization

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If manual user selection is required for aspect ratio adjustment, then user control is provided, but the process becomes complex and time-consuming

Engineering Contradiction:
Improveuser control capabilityVSAvoidconfiguration time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs self-service by automatically analyzing video metadata, detecting UI element positions, and determining the optimal aspect ratio configuration without requiring manual user input. This autonomous operation eliminates configuration time while the system preserves user control through automatic selection of the best display mode based on video characteristics

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements feedback by analyzing video content characteristics and UI element positions, then using this information to automatically adjust the aspect ratio. The feedback loop continuously monitors video metadata and content features to make intelligent adjustments, eliminating manual configuration while maintaining optimal display quality

Inventive Principle:
Principle #23Feedback

4Adaptability or versatility

If videos with interactive components and multiple aspect ratios are displayed using conventional methods, then display compatibility is achieved, but the user experience is degraded

Engineering Contradiction:
Improvedisplay compatibilityVSAvoiduser experience quality
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent applies dynamics by making the aspect ratio adjustment adaptive rather than static. The system dynamically determines the display area based on UI element positions and video content characteristics, allowing the solution to adapt to different video types and screen orientations automatically, resolving the contradiction between filling the screen and preserving image content

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies local quality by treating different regions of the video frame differently. Instead of uniformly applying boxing or pan-and-scan to the entire image, the system identifies specific regions containing UI elements and preserves those areas while allowing other regions to be adjusted or filled with mattes, optimizing both content preservation and screen utilization locally

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11490047B2Systems and methods for dynamically adjusting video aspect ratios
Publication Date: 2022.11.01 JBF INTERLUDE 2009
  • US11490047B2 patent drawing
  • US11490047B2 patent drawing
  • US11490047B2 patent drawing

AI summary

Described herein are systems and methods for dynamically adjusting an aspect ratio of a video. Exemplary methods can include receiving (i) a video having an original aspect ratio and at least one user interface (UI) element configured to be selected by a user of the video and (ii) an aspect ratio of a display screen for presenting the video. The methods can include automatically determining a display area of the video to be presented based on (i) the default position of the at least one UI element in the video, (ii) an active area in the video, and/or (iii) a central area in the video, the display area having an aspect ratio equal to the aspect ratio of the display screen; and presenting the video display area in the display screen with the at least one UI element for at least the portion of the video.