Extended Reality Virtual Screen Reflection Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Extended reality technologies, such as virtual reality, augmented reality, and mixed reality, fail to provide a user experience that accurately replicates the display effects of images and videos as seen in the real world, leading to an insufficient immersive experience.

Innovation Solution

A method and apparatus that display a virtual environment and virtual screen in an extended reality space, where the light of played content is rendered into a rendering region to simulate a reflection effect, improving the user experience by mimicking the real-world reflection of screen content on surrounding objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If extended reality technology displays images and videos in the extended reality space, then the user can experience virtual content, but the display effects are different from the real world resulting in insufficient user experience

Engineering Contradiction:
Improveuser experience authenticityVSAvoidrendering system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent copies the optical reflection characteristics of the real world into the virtual environment. By rendering light from played content into the virtual environment to create reflections on surrounding objects, the system replicates real-world display effects, thereby improving user experience authenticity without requiring complex hardware changes

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent changes the rendering parameters by introducing light rendering from played content into the virtual environment. This parameter change enables the simulation of reflection effects on surrounding objects, transforming the display from a flat 2D presentation to a spatially-aware 3D experience that mimics real-world optical behavior

Inventive Principle:
Principle #35Parameter changes

2Reliability

If light of played content is rendered into the rendering region to simulate reflection, then the user experience is improved, but the rendering complexity increases

Engineering Contradiction:
Improvedisplay effect authenticityVSAvoidrendering process complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies local quality by rendering light reflections only in specific rendering regions where surrounding objects are located, rather than uniformly across the entire virtual environment. This targeted approach simulates reflection effects on relevant surfaces while avoiding unnecessary rendering computations in irrelevant areas, thus balancing authenticity with rendering efficiency

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances the user experience by creating a more authentic and immersive environment through the simulation of diffuse reflection effects, making the virtual experience more akin to real-world interactions with screens.

Implementation Method 1

rendering a light of the played content into a rendering region of the virtual environment to present a reflection of the played content

Methodology Applied
Scientific EffectDiffuse reflection: Reflection

Data Source

PatentUS20240153159A1Method, apparatus, electronic device and storage medium for controlling based on extended reality
Publication Date: 2024.05.09 BEIJING ZITIAO NETWORK TECH CO LTD
  • US20240153159A1 patent drawing
  • US20240153159A1 patent drawing
  • US20240153159A1 patent drawing

AI summary

This disclosure provides a method, apparatus, electronic device, and storage medium for controlling based on extended reality. In some embodiments, this disclosure provides a method of controlling based on extended reality, including: displaying a virtual environment and a virtual screen located in the virtual environment in an extended reality space; and in response to displaying a played content on the virtual screen, rendering a light of the played content into a rendering region of the virtual environment to present a reflection of the played content in the rendering region of the virtual environment.