Aggregator Hardware Error Recovery for XR Sensor Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Extended reality (XR) systems face challenges in achieving low latency and robust error recovery due to transmission errors in sensor data, which can lead to user experience degradation and increased latency, particularly when errors are handled by software, causing delays and potential nausea or motion sickness.

Innovation Solution

An apparatus and method for error recovery in XR systems that utilizes aggregator hardware to multiplex sensor data, detect transmission errors, and replace corrupted data with dummy values without software involvement, allowing for seamless recovery and minimal latency by generating a single aggregator output stream and using error correction codes to handle packet data corruption and image control errors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If software is used to handle transmission errors in sensor data, then error recovery can be implemented, but latency increases and user experience degrades

Engineering Contradiction:
Improveerror recoveryVSAvoidlatency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent replaces software-based error handling with hardware-based error correction mechanisms. Specifically, it uses error correction codes (ECC) and error detection codes (EDC) implemented in hardware circuits within the sensor interfaces and aggregator. This substitution of mechanical/software systems with hardware systems enables automatic, low-latency error correction without the processing delays associated with software intervention, directly resolving the contradiction between reliable error recovery and minimal latency.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent implements preliminary error detection and correction measures by incorporating ECC and EDC mechanisms that operate continuously in the background of sensor data transmission. These error correction codes are pre-computed and stored, allowing immediate correction of errors as they occur during transmission, rather than detecting and correcting errors after they have caused latency. This preliminary preparation enables fast, automatic error recovery without delaying the main data processing workflow.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If error recovery is implemented to maintain user experience, then reliability improves, but device complexity increases

Engineering Contradiction:
Improveuser experienceVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges error detection and correction functions directly into the existing sensor interface hardware and aggregator architecture. Rather than adding separate, complex error handling systems, the ECC and EDC mechanisms are integrated into the data transmission pathways themselves. This merging approach allows error recovery functionality to be achieved through existing hardware components performing their normal functions, thereby improving reliability without proportionally increasing device complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent implements self-service error correction where the hardware circuits automatically detect and correct transmission errors without requiring external intervention or complex control logic. The ECC and EDC mechanisms operate autonomously within the sensor interfaces and aggregator, using built-in correction capabilities to fix errors independently. This self-service approach simplifies the overall system architecture by eliminating the need for complex software-based error handling procedures, thus improving reliability while keeping device complexity manageable.

Inventive Principle:
Principle #25Self-service

3Reliability

If robust error correction is applied to all sensor data, then transmission reliability improves, but processing speed decreases

Engineering Contradiction:
Improvetransmission reliabilityVSAvoidprocessing speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies local quality by implementing error correction measures selectively at specific critical points in the data transmission pathway rather than uniformly across all data processing operations. The ECC and EDC mechanisms are deployed locally within the sensor interfaces and aggregator hardware, where they provide robust error correction for the transmission portion of the pipeline. This localized application of error correction maintains high processing speeds in other parts of the system while ensuring reliable transmission, thus resolving the contradiction between transmission reliability and processing speed.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent substitutes software-based error correction with hardware-based correction mechanisms that operate parallel to the main data processing workflow. The hardware circuits perform error detection and correction simultaneously with data transmission, rather than sequentially. This parallel processing capability allows robust error correction to be applied without significantly impacting overall processing speed, as the error correction operations occur in the same time window as data transmission rather than adding additional processing steps.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20250023659A1Extended reality aggregator low latency robust error recovery
Publication Date: 2025.01.16 QUALCOMM INC
  • US20250023659A1 patent drawing
  • US20250023659A1 patent drawing
  • US20250023659A1 patent drawing

AI summary

Aspects of the disclosure are directed to error recovery. In accordance with one aspect, an apparatus includes a plurality of sensors configured to generate a plurality of sensor data; a plurality of sensor interfaces, wherein each one of the plurality of sensor interfaces is coupled to each one of the plurality of sensors; and an aggregator, coupled to the plurality of sensor interfaces, the aggregator configured a) to multiplex the plurality of sensor data into a single aggregator output stream, b) to detect a transmission error in the plurality of sensor data, and c) to recover the transmission error using an aggregator hardware without software involvement.