Sub-Frame Video Encoding for Ultra-Low Latency Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding technologies fail to achieve ultra-low latency end-to-end video transmission, which is crucial for 5G applications requiring hyper-connectivity and ultra-low latency.
Innovation Solution
An apparatus and method that includes video sources, encoders, and casters for real-time encoding and transmission, allowing partial frame encoding and Peer-to-Peer (P2P) or relay stream transmission, with feedback-based encoding parameter adjustments and integrated video signal processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If video encoding is performed using related art technologies, then high resolution is secured, but ultra-low latency end-to-end video transmission cannot be achieved
Solution Approach 1:
The video frame is divided into multiple sub-frames, and encoding is performed on each sub-frame independently and sequentially. This allows the system to transmit partial frame data before the entire frame is fully encoded, significantly reducing the end-to-end transmission latency while maintaining the ability to encode high-resolution video content.
Solution Approach 2:
The encoder begins encoding and transmitting video data before the entire frame is captured or fully processed. By performing preliminary encoding on available sub-frames and transmitting them ahead of time, the system reduces waiting time and achieves ultra-low latency transmission without compromising final video resolution quality.
2Reliability
If complete frame encoding is performed before transmission, then video quality is maintained, but transmission latency increases
Solution Approach 1:
The video frame is segmented into multiple sub-frames that can be encoded and transmitted independently. This segmentation allows the system to maintain video quality through progressive refinement while reducing overall transmission time by sending data in chunks rather than waiting for complete frame encoding.
Solution Approach 2:
The encoding and transmission process continues continuously without waiting for complete frame processing. The encoder continuously processes sub-frames as they become available and transmits them without interruption, maintaining both video quality through ongoing encoding and low latency through continuous transmission.
3Device complexity
If centralized video processing is used, then system control is simplified, but transmission latency and network dependency increase
Solution Approach 1:
The video processing function is segmented and distributed to individual encoders at each video source location. Each encoder independently processes its own video stream, eliminating the need for centralized processing and reducing transmission latency while maintaining manageable system complexity through standardized encoder modules.
Solution Approach 2:
Each video source equipped with an encoder performs its own video encoding and transmission without requiring centralized processing control. This self-service approach reduces network dependency and transmission latency while keeping system control simple through autonomous encoder units that operate independently.
Data Source
AI summary
The present disclosure provides an apparatus and method for encoding a video with ultra-low latency, the apparatus including: one or a plurality of video sources configured to provide a video signal; an encoder configured to encode the video signal provided through the video source and provided for each of the video sources; and a caster configured to transmit video data encoded by the encoder to the outside through a network communication network.Accordingly, the present disclosure can transmit a video with ultra-low latency, so a video service is possible in real time anytime anywhere as long as the internet is connected, whereby there is the advantage that the present disclosure can be applied to various fields of 4th industry such as autonomous driving, unmanned drone operation, driving of unmanned heavy equipment, robot control, a remote medical service, VR/AR, an intelligent CCTV, a smart city⋅factory, provision of traffic information, etc.