Low-Latency FEC Datagram Matrix for Packet Recovery

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Forward Error Correction (FEC) technologies for low delay data transfer, such as those used in multimedia streaming, face limitations in ensuring high video quality and efficient packet recovery, particularly in scenarios requiring low latency and high reliability like camera remote control and gaming.

Innovation Solution

The proposed solution involves an improved FEC system that uses a combination of XOR and RS code systems for encoding and decoding, with a focus on two-dimensional XOR systems and dynamic FEC system switching based on bit rates and data compression status to optimize packet recovery and reduce latency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If FEC encoding is used to ensure packet recovery and video quality, then reliability is improved, but transmission delay increases

Engineering Contradiction:
Improvepacket recovery rateVSAvoidtransmission delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent dynamically switches between XOR-based FEC and RS-based FEC encoding schemes based on real-time network conditions. When network conditions are good, XOR encoding is used for low delay; when conditions deteriorate, RS encoding provides stronger error correction. This dynamic adaptation resolves the contradiction by adjusting the level of protection based on actual needs.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the FEC encoding parameter (encoding scheme type) based on network conditions and packet loss patterns. By monitoring network state and switching between different encoding parameters (XOR vs RS), the system optimizes the balance between reliability and delay, using stronger encoding only when necessary.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If strong FEC encoding (RS code) is used to improve packet recovery, then reliability is improved, but processing complexity increases

Engineering Contradiction:
Improveerror correction capabilityVSAvoidencoding complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements dynamic switching between XOR and RS encoding based on monitored network conditions and packet loss patterns. XOR encoding is used during normal conditions for simplicity, while RS encoding is activated only when packet loss exceeds thresholds or patterns indicate its necessity, thus managing complexity dynamically rather than statically.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Instead of always applying the strongest (most complex) RS encoding, the system applies it partially—only when network conditions warrant it. During normal operation, simpler XOR encoding suffices, and RS encoding is reserved for exceptional conditions, avoiding unnecessary complexity while maintaining adequate protection.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If FEC datagrams are transmitted interleaved with media datagrams, then packet recovery efficiency is improved, but transmission order complexity increases

Engineering Contradiction:
Improvepacket recovery efficiencyVSAvoidtransmission order management
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the transmission stream into alternating sequences of media datagrams and FEC datagrams. This segmentation allows the receiver to process media packets and FEC packets separately and in parallel, improving recovery efficiency without requiring complex reordering, as each segment maintains its own sequence integrity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary organization of datagrams into alternating media-FEC sequences before transmission. By pre-structuring the transmission order, the receiver can efficiently process packets in sequence without requiring complex real-time reordering operations, thus improving recovery efficiency while keeping transmission order management manageable.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3029870B1Information processing device, information processing method, and program
Publication Date: 2022.07.20 SONY GROUP CORP
  • EP3029870B1 patent drawingFigure 1
  • EP3029870B1 patent drawingFigure 2
  • EP3029870B1 patent drawingFigure 3A~3B

AI summary

[Object] To provide a new and improved information processing apparatus, information processing method, and program, capable of improving technology related to FEC for achieving low delay transfer. [Solution] Provided is an information processing apparatus including: an arrangement unit configured to arrange datagrams in a number of a predetermined matrix size or less in at least a portion of the matrix of the predetermined size, by repeating arrangement of the datagrams in order along a first direction according to a second direction; and a generation unit configured to generate a redundant datagram for forward error correction for each of the datagrams belonging to one row, and for each of the datagrams belonging to one column of the matrix arranged by the arrangement unit.