Image Slice Transforming Method for Video Streaming Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In video streaming, the need to wait for all image slices of a frame to be outputted by the encoder leads to increased latency, as subsequent processes like decoding and rendering cannot proceed until all slices are received, even when using encoding standards like H.264.
Innovation Solution
An image slice transforming method that modifies the slice header of each image slice to transform it into a sub-frame, allowing individual decoding and rendering, thereby reducing the dependency on receiving all slices before processing can begin.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all image slices of a frame are received before decoding, then decoding completeness is ensured, but latency increases
Solution Approach 1:
The image frame is divided into multiple independent image slices that can be decoded separately. Each slice contains sufficient information (through header modification) to be decoded independently without waiting for other slices, thus reducing latency while maintaining decoding completeness.
Solution Approach 2:
The slice header is pre-modified to include necessary information for independent decoding before the slices are transmitted or processed. This preliminary action ensures that each slice can be decoded immediately upon receipt without requiring all slices to be present first.
2Productivity
If image slices are processed in parallel, then processing speed increases, but synchronization complexity increases
Solution Approach 1:
The modified slice header acts as an intermediary that carries synchronization and identification information. By embedding necessary control data in the header, the system enables parallel processing of slices while maintaining synchronization through the header information, avoiding complex external synchronization mechanisms.
Data Source
AI summary
The embodiments of the disclosure provide an image slice transforming method and an electronic device. The method includes: receiving an i-th image slice outputted by an image encoder, wherein the i-th image slice belongs to N image slices divided from an image frame, i is an index, and N is an integer; obtaining a slice header of the i-th image slice; transforming the i-th image slice into an i-th sub-frame by modifying the slice header of the i-th image slice.