Dynamic Video Tiling Streaming for Bandwidth-Constrained Mobile Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Bandwidth and resource constraints in mobile devices limit the ability to provide a full-featured web browsing experience and efficiently transmit video content, as existing client-server architectures struggle to adjust to these limitations, leading to unsatisfactory user experiences due to poor interactivity and inability to handle feature-rich websites and video transmission.
Innovation Solution
A system that partitions video content into tiles, each with index data describing relationships between tiles, allowing clients to reconstruct content and cache non-visible tiles for efficient retrieval, using encoding standards like H.264 for transmission, ensuring that only tiles within the viewport are uncompressed for display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If video content is transmitted in full resolution to mobile devices, then display quality is improved, but bandwidth consumption increases and device resources are overwhelmed
Solution Approach 1:
The video content is divided into multiple tiles, where only the tiles within the current viewport are transmitted in full resolution. Other tiles are transmitted at lower resolutions or compressed formats. This segmentation allows the system to maintain high display quality for visible content while significantly reducing overall bandwidth consumption by not transmitting full-resolution data for all content areas.
2Speed
If all video tiles are transmitted and cached on mobile devices, then content retrieval speed is improved, but device storage and memory resources are exceeded
Solution Approach 1:
The system implements differential caching where tiles within the viewport are cached in uncompressed format for immediate display, while tiles outside the viewport are cached in compressed format or not cached at all. This local quality approach ensures fast retrieval for visible content while conserving device storage resources by applying different caching strategies based on the tile's visibility status.
3Quantity of substance
If compressed video formats are used for transmission, then bandwidth efficiency is improved, but decompression processing power requirements increase mobile device load
Solution Approach 1:
The system dynamically adjusts the compression level and format based on the tile's importance and visibility. Viewport tiles use higher quality formats with less compression to ensure display quality, while non-viewport tiles use more aggressive compression. The client device also dynamically manages decompression priorities, focusing processing power on tiles that need to be displayed immediately while allowing less critical tiles to decompress in the background or at lower priority.
4Productivity
If viewport-associated tiles are kept in uncompressed format, then display performance is improved, but memory usage increases
Solution Approach 1:
The system applies uncompressed format selectively only to the minimum necessary tiles - those currently within the viewport - rather than uncompressed all tiles. This partial action approach ensures adequate display performance for visible content while avoiding the excessive memory usage that would result from keeping all tiles uncompressed. The system accepts that some tiles may be displayed with slight compression artifacts rather than maintaining uncompressed quality across the entire content set.
Data Source
AI summary
A system and a method for communicating video data associated with content across a network are disclosed. A server partitions the content into a plurality of tiles where each tile includes a subset of the content and index data describing a relationship between a tile and one or more adjacent tiles. Each tile is then encoded as a video frame, for example each tile is encoded according to the H.264 standard. The plurality of tiles are then transmitted to a client which combines the plurality of tiles using the index data to locally recreate the content. The client associates a predetermined viewport tile with a client viewport representing the area of the content that is visible in a client display device to allow viewing of the content while tiles not associated with the client viewport are cached to expedite subsequent retrieval.