Media Item Adaptation via Scalable Bitstreams and Aspect Ratio Segmentation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing content delivery systems face inefficiencies in adapting media items to various aspect ratios, leading to suboptimal use of display space and increased computational resources, as they often require storing and transmitting multiple versions of content items for different formats, which can result in redundant data and increased processing loads.

Innovation Solution

The use of scalable bitstreams, comprising a base layer and an enhancement layer, allows for efficient delivery and display of media items by enabling dynamic resizing and retargeting, where less important areas are represented with fewer resources, and adaptive warping techniques like seam carving are employed to fit content to target aspect ratios without removing critical regions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple versions of content items are stored and transmitted for different aspect ratios, then the content can be displayed at various target display formats, but the system experiences increased computational resources, redundant data, and increased processing loads

Engineering Contradiction:

Improvecontent display format adaptabilityVSAvoiddata redundancy

Core Design Contradiction:

Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent segments the content item into multiple versions corresponding to different aspect ratios (e.g., first version for 16:9, second version for 9:16). The segmentation manager divides the original content into these segmented versions, allowing the system to transmit only the necessary segment based on the target display format, thereby reducing data redundancy while maintaining adaptability across different devices

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent creates multiple versions of the content item that can serve universal display purposes across different aspect ratios. Rather than storing completely separate content for each format, the system generates alternative versions from a single source, enabling one content item to fulfill multiple display requirements efficiently

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Adaptability or versatility

Engineering Contradiction:

Improvecontent display format adaptabilityVSAvoidprocessing efficiency

Core Design Contradiction:

Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent performs preliminary segmentation of the content item into different aspect ratio versions before transmission. The segmentation manager pre-processes the content to create ready-to-use segments for various display formats, so that the client device receives pre-segmented content that requires minimal additional processing, thereby improving overall processing efficiency while maintaining format adaptability

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent extracts only the necessary portion of the content item based on the target display format. Rather than processing and transmitting complete content for all possible formats, the system extracts and transmits only the relevant segment matching the client's display capabilities, reducing processing loads while preserving adaptability

Inventive Principle:

Principle #2Taking out (Extraction)

3Area of stationary object

If content items are adapted for different aspect ratios, then display space utilization improves, but computational resources increase

Engineering Contradiction:

Improvedisplay space utilizationVSAvoidcomputational resource consumption

Core Design Contradiction:

Area of stationary objectVSUse of energy by moving object

Solution Approach 1:

The patent applies local quality by segmenting the content item into region-specific versions optimized for different aspect ratios. Each segment is processed and transmitted with quality appropriate for its intended display format, allowing efficient use of computational resources by focusing processing on specific regions rather than uniformly processing entire content items at multiple resolutions

Inventive Principle:

Principle #3Local quality

Data Source

PatentUS20240373090A1Adapting content items to target delivery formats

Publication Date: 2024.11.07 GOOGLE LLC

AI summary

A method includes receiving, by a user device, a first bitstream. The first bitstream includes data corresponding to a media item. The first bitstream includes data for display at a first aspect ratio. The method further includes receiving a second bitstream including data corresponding to the media item for display at a second aspect ratio. The method further includes providing the first bitstream to a first bitstream decoder and the second bitstream to a second bitstream decoder. Operations of the first bitstream decoder and operations of the second bitstream decoder overlap in time. The method further includes determining whether to display the media item at the first or the second aspect ratio. The method further includes generating a composited media item based on the first bitstream and the second bitstream. The method further includes displaying the composited media item.