Tile-Based Video Encoding for Packet Loss Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional distributed refresh methods for video transmission require complex control of inter-frame references, making them difficult to implement simply, especially in scenarios with limited bandwidth for real-time or low-latency video transmission.
Innovation Solution
An encoding apparatus that partitions images into tiles, prohibits out-of-tile references for motion compensation within a partial region, and restricts transmission to only the tiles within this region upon detection of lost encoded information, allowing for simpler implementation and stable video decoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional distributed refresh methods are used to handle packet loss, then decoding recovery is achieved, but device complexity and implementation difficulty increase due to complicated control on inter-frame references
Solution Approach 1:
The image is divided into multiple tiles, and the refresh operation is segmented to be performed on individual tiles rather than the entire image. This allows selective refresh of only the tiles affected by packet loss, reducing the complexity of inter-frame reference control while maintaining decoding recovery capability.
Solution Approach 2:
Different refresh strategies are applied to different regions (tiles) of the image based on their specific needs. Tiles that experienced packet loss undergo refresh with intra-prediction only, while other tiles can continue using inter-frame prediction, thus reducing overall control complexity while ensuring reliable recovery where needed.
2Reliability
If I picture transmission is performed for refresh to recover from decoding failure, then normal decoding is restored, but transmission delay occurs due to large amount of codes required
Solution Approach 1:
The refresh operation is segmented to apply intra-prediction only to specific tiles that require recovery from packet loss, rather than refreshing the entire image. This segmentation significantly reduces the total amount of code data that needs to be transmitted, thereby reducing transmission delay while still achieving decoding recovery for the affected regions.
Solution Approach 2:
Instead of performing a complete refresh of the entire image with intra-prediction, the patent applies partial refresh only to the necessary tiles that experienced packet loss. This partial action approach minimizes the code amount and transmission time while providing sufficient recovery for the affected areas.
3Quantity of substance
If distributed refresh over multiple frames is implemented, then code amount increase during refresh is suppressed, but ease of operation deteriorates due to complicated control requirements
Solution Approach 1:
The patent segments the image into tiles and applies refresh operations at the tile level rather than requiring complex distributed refresh across multiple frames. This segmentation simplifies the control logic while still achieving code amount efficiency by limiting intra-prediction to only the necessary tiles.
Solution Approach 2:
Instead of using the conventional approach of distributed refresh across multiple frames with complex control, the patent inverts the approach by performing refresh within a single frame at the tile level. This inversion simplifies the control mechanism while achieving similar or better code efficiency.
Data Source
AI summary
The present invention provides an encoding apparatus including a setting section that partitions each of images included in a video to be encoded into a plurality of tiles and sets a partial region including one or more of the plurality of tiles for the image, an encoding section that encodes each image on a per-tile basis to generate an encoded stream, and a transmission control section that controls transmission of the encoded stream to a decoding apparatus that decodes the video. The setting section sets out-of-tile reference for motion compensation for the tiles within the partial region to be prohibited, and the transmission control section restricts, upon detection of a loss or an absence of encoded information at the decoding apparatus, the transmission such that only an encoded stream corresponding to the tiles within the partial region is transmitted.