Unified XR Rendering Pipeline for VR and AR Mode Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality (VR) and augmented reality (AR) technologies require separate rendering methods and applications, leading to compatibility issues and increased data storage needs, as VR converts all objects and backgrounds into virtual objects, while AR only renders a target object, making it difficult for VR applications to interpret AR images and vice versa.

Innovation Solution

An integrated rendering method that loads extended reality (XR) scene content, allowing users to select between VR and AR modes, maintaining or converting rendering options for virtual objects, and rendering XR images based on the selected mode, including detecting augmented target objects and adjusting background and object visibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If separate rendering methods and applications are used for VR and AR, then each mode can be optimized for its specific requirements, but data storage requirements increase and compatibility issues arise

Engineering Contradiction:
Improverendering accuracyVSAvoiddata storage
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent combines separate VR and AR rendering methods into a single unified rendering system. The rendering apparatus processes both VR scene contents (requiring full rendering of all objects) and AR scene contents (requiring selective rendering of target objects) through the same rendering pipeline, eliminating the need for separate applications and reducing data storage requirements while maintaining rendering accuracy for both modes

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The rendering apparatus is designed with multi-functionality to handle different extended reality modes. It can selectively execute VR rendering processes or AR rendering processes based on the type of scene content received, allowing a single system to perform multiple rendering functions without requiring separate dedicated systems for each mode

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If VR application renders all objects and backgrounds, then complete virtual environment is achieved, but processing complexity and data requirements increase

Engineering Contradiction:
Improvevirtual environment completenessVSAvoidrendering process
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the rendering process based on scene content type. The rendering apparatus divides processing into different pathways: one for VR scene contents where all objects and backgrounds are rendered to create complete virtual environments, and another for AR scene contents where only target objects are selectively rendered. This segmentation allows the system to adjust processing complexity according to the specific mode requirements

Inventive Principle:
Principle #1Segmentation

3Productivity

If AR application renders only target objects, then processing efficiency improves, but compatibility with VR mode decreases

Engineering Contradiction:
Improverendering efficiencyVSAvoidmode compatibility
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The rendering apparatus implements dynamic adaptability by automatically adjusting its rendering strategy based on the input scene content type. When receiving AR scene contents, it activates selective rendering of target objects for improved efficiency. When receiving VR scene contents, it switches to full rendering mode. This dynamic behavior enables the system to maintain both high productivity in AR mode and full compatibility with VR mode through a single unified apparatus

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11361523B2Integrated rendering method for various extended reality modes and device having thereof
Publication Date: 2022.06.14 KOREA INST OF SCI & TECH
  • US11361523B2 patent drawing
  • US11361523B2 patent drawing
  • US11361523B2 patent drawing

AI summary

Relating to an the integrated rendering method for various extended reality modes and a device having thereof, loading an XR-scene content including at least one virtual object content representing an extended reality image from a storage and representing a virtual object included in the extended reality image; inputting a selection, from a user, of any one extended reality mode among a plurality of extended reality modes including a virtual reality mode and an augmented reality mode; and maintaining or converting a property of each of a plurality of rendering options for at least one virtual object content according to the selected extended reality mode, and rendering at least one virtual object content having the maintained or converted property. Therefore, a virtual reality image and an augmented reality image can be generate from one XR-scene content.