XR Image Blending Across Multiple Application Streams

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing XR streaming systems struggle to handle the increasing complexity of XR applications, particularly in fields like mechanical and electrical engineering, by failing to effectively blend and display XR images from multiple sources without conflicts or display errors.

Innovation Solution

An XR streaming method that blends XR images from multiple application instances on an XR device using positional blending, priority-based merging, alpha data, depth data, and reprojecting techniques to ensure seamless and conflict-free display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple XR application instances stream XR images to the XR device, then the diversity and complexity of XR applications are improved, but conflicts and display errors occur between multiple XR image streams

Engineering Contradiction:
Improvediversity of XR applicationsVSAvoiddisplay error rate
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent introduces an intermediary mechanism (blending module) that receives multiple XR image streams from different application instances and combines them into a unified output. This mediator resolves conflicts between multiple streams by applying blending algorithms that prioritize certain streams or merge them seamlessly, preventing display errors while maintaining support for diverse applications.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent merges multiple XR image streams from different application instances into a single blended output stream. By combining the streams using weighted blending or priority-based merging, the system maintains reliable display operation while supporting multiple diverse applications simultaneously, resolving the contradiction between versatility and reliability.

Inventive Principle:
Principle #5Merging (Combining)

2Adaptability or versatility

If XR images from multiple application instances are streamed simultaneously, then the functionality of XR streaming system is expanded, but the system complexity increases

Engineering Contradiction:
Improvefunctionality of XR streaming systemVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a universal blending module that handles multiple XR image streams from different application instances through a unified interface and standardized processing pipeline. This multi-functional approach allows the system to support diverse applications while maintaining a consistent, manageable architecture, preventing complexity from escalating despite expanded functionality.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If XR images are blended from multiple sources, then the user experience is improved by avoiding conflicts, but additional processing requirements increase system load

Engineering Contradiction:
Improveuser experience qualityVSAvoidprocessing energy consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The patent applies local quality blending by assigning different weights or priorities to different regions or elements within the XR image streams. This allows critical content from certain applications to be displayed with higher fidelity while less critical content receives lower processing priority, improving user experience for important functions while reducing overall processing energy consumption through selective quality adjustment.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12620168B2System for blending extended reality images streamed from a plurality of application instances to an extended reality device
Publication Date: 2026.05.05 HOLO LIGHT GMBH
  • US12620168B2 patent drawing
  • US12620168B2 patent drawing

AI summary

An extended reality (XR) streaming method of streaming XR images between a plurality of XR application instances and an XR device is described. The XR streaming method comprises streaming, with a first XR application instance first XR images to the XR device, wherein the first XR images streamed by the first XR application instance are associated with a first XR application. Streaming, by means of a second XR application instance, second XR images to the XR device, wherein the second XR images streamed by the second XR application instance are associated with a second XR application. Blending, by means of the XR device, the first XR images received from the first XR application instance with the second XR images received from the second XR application instance to obtain blended XR images for display on the XR device.