Early Packet Loss Detection in Video Encoding Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Wireless local area networks (WLAN) face challenges in maintaining video quality due to transmission errors, which result in degraded video quality and prolonged error propagation, especially in real-time video applications like mobile video telephony, as existing systems rely on delayed feedback for packet loss detection.

Innovation Solution

Implementing a feedback-based coding system where a video encoding device detects packet loss early and generates error notifications, allowing for immediate retransmission of lost packets and adaptive encoding to prevent error propagation, using techniques like instantaneous decoder refresh (IDR) frames and rate-distortion optimization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If early packet loss detection is implemented at the MAC layer, then video quality is improved by reducing error propagation, but device complexity increases due to cross-layer feedback mechanisms

Engineering Contradiction:
Improvevideo qualityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements a feedback mechanism where the MAC layer detects packet loss and sends notifications to the video encoder through cross-layer interfaces. This feedback loop enables the encoder to adjust encoding parameters in real-time, preventing error propagation and maintaining video quality despite transmission errors in WLAN networks.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary packet loss detection at the MAC layer before the video encoder processes the data. By detecting lost packets early in the transmission chain and notifying the encoder in advance, the system allows the encoder to take preventive encoding actions (such as inserting reference frames or adjusting quantization parameters) before errors propagate through the video stream.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If real-time video applications are implemented over WLAN, then multimedia capabilities are enhanced, but transmission errors cause degraded video quality

Engineering Contradiction:
Improvemultimedia capabilityVSAvoidvideo quality
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements dynamic encoding adjustments based on real-time network conditions. The video encoder continuously adapts its parameters (such as quantization, frame rate, and resolution) in response to packet loss notifications from the MAC layer, allowing the system to maintain acceptable video quality under varying WLAN transmission conditions while supporting real-time multimedia applications.

Inventive Principle:
Principle #15Dynamics

3Device complexity

If delayed feedback is used for packet loss detection, then system complexity is reduced, but error propagation is prolonged

Engineering Contradiction:
Improvesystem complexityVSAvoiderror propagation time
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The patent establishes a feedback channel from the MAC layer to the video encoder that operates in real-time rather than relying on delayed end-to-end acknowledgments. This feedback mechanism enables the encoder to immediately respond to packet loss events, significantly reducing the time during which errors can propagate through the video stream compared to traditional delayed feedback approaches.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11824664B2Early packet loss detection and feedback
Publication Date: 2023.11.21 INTERDIGITAL VC HOLDINGS INC
  • US11824664B2 patent drawing
  • US11824664B2 patent drawing
  • US11824664B2 patent drawing

AI summary

A video encoding device (e.g., a wireless transmit/receive unit (WTRU)) may transmit an encoded frame with a frame sequence number using a transmission protocol. The video encoding device, an application on the video encoding device, and/or a protocol layer on the encoding device may detect a packet loss by receiving an error notification. The packet loss may be detected at the MAC layer. The packet loss may be signaled using spoofed packets, such as a spoofed NAM packet, a spoofed XR packet, or a spoofed ACK packet. A lost packet may be retransmitted at the MAC layer (e.g., by the encoding device or another device on the wireless path). Packet loss detection may be performed in uplink operations and/or downlink operations, and/or may be performed in video gaining applications via the cloud. The video encoding device may generate and send a second encoded frame based on the error notification.