Retro-Reflective AR Display Calibration via Software

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality (AR) and virtual reality (VR) systems require physical calibration for inter-pupil distance (IPD) and sizing differences, leading to poor visual quality and user experience due to the need for optical element adjustments, and existing display systems face limitations in size and transparency in retro-reflective materials.

Innovation Solution

A display system using a projector combined with a retro-reflective screen that employs non-physical, real-time software-based methods for calibration and adjustment, allowing for immersive experiences and large-area displays with customizable content and transparency, enabling glasses-free 3D viewing and simultaneous individual content streams.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If physical calibration and adjustment of optical elements are performed for each user, then visual quality and stereoscopic effect are improved, but device complexity and ease of operation deteriorate

Engineering Contradiction:
Improvevisual qualityVSAvoidcalibration complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical/optical calibration system with a software-based virtual calibration system. Instead of physically adjusting optical elements and display surfaces, the system uses software algorithms to calculate and adjust virtual camera positions and orientations, thereby eliminating complex physical adjustments while maintaining visual quality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the calibration parameters from physical dimensions (optical element positions, display surface locations) to virtual parameters (camera positions, orientations, and projection parameters). This allows calibration to be performed through software parameter adjustments rather than physical modifications.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If physical calibration and adjustment of optical elements are performed for each user, then visual quality is improved, but ease of operation deteriorates

Engineering Contradiction:
Improvevisual qualityVSAvoiduser setup ease
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent replaces the mechanical/optical calibration system with a software-based virtual calibration system. Instead of physically adjusting optical elements and display surfaces, the system uses software algorithms to calculate and adjust virtual camera positions and orientations, thereby eliminating complex physical adjustments while maintaining visual quality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Illumination intensity

If flat-panel displays with LCD pixels and LED backlighting are used, then display quality is maintained, but screen size is limited to below 80 inches due to nonlinear cost increases and high power consumption

Engineering Contradiction:
Improvedisplay qualityVSAvoidscreen size
Core Design Contradiction:
Illumination intensityVSArea of stationary object

Solution Approach 1:

The patent introduces a retro-reflective screen as an intermediary between the projector and the viewer. The projector displays content, which is then reflected back to the viewer by the retro-reflective screen. This intermediary system enables large-screen displays without the limitations of direct LCD or plasma panels.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the direct emission display system (LCD/LED) with a projection-based system using a retro-reflective screen. This substitution allows for much larger display areas while reducing power consumption and cost, as projectors are more efficient for large screens compared to direct-emission technologies.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Area of stationary object

If projection-based displays are used to increase screen size, then display area is improved, but brightness decreases and power consumption increases

Engineering Contradiction:
Improvescreen sizeVSAvoidbrightness
Core Design Contradiction:
Area of stationary objectVSIllumination intensity

Solution Approach 1:

The patent introduces a retro-reflective screen as an intermediary between the projector and the viewer. The projector displays content, which is then reflected back to the viewer by the retro-reflective screen. This intermediary system enables large-screen displays without the limitations of direct LCD or plasma panels.

Inventive Principle:
Principle #24Intermediary (Mediator)

5Illumination intensity

If traditional retro-reflective sheeting is used, then display size can be increased with high brightness levels, but transparency and semi-transparency cannot be implemented

Engineering Contradiction:
ImprovebrightnessVSAvoidtransparency capability
Core Design Contradiction:
Illumination intensityVSAdaptability or versatility

Solution Approach 1:

The patent changes the optical parameters of the retro-reflective screen by incorporating transparent or semi-transparent materials. This allows the screen to simultaneously provide retro-reflection for brightness and transparency for seeing through the display, enabling new application scenarios such as see-through AR displays and multi-user viewing.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution provides improved visual quality and user experience by eliminating the need for physical adjustments, enabling larger and more transparent displays for multiple users with customized content, and enhancing the immersion and flexibility of AR/VR experiences.

Implementation Method 1

a retro-reflective screen configured to reflect incident light along a direction that is different than a direction of propagation of the incident light

Methodology Applied
Scientific EffectRetro-reflection: Retroreflector

Data Source

PatentUS10775625B2Real time algorithmic calibration and compensation of virtual and augmented reality systems and optimized semi-transparent and transparent retroreflective display systems and methods
Publication Date: 2020.09.15 MIRRAVIZ INC
  • US10775625B2 patent drawing
  • US10775625B2 patent drawing
  • US10775625B2 patent drawing

AI summary

The present disclosure provides systems and methods to enable significant improvements in display systems utilizing projectors and a retro-reflective (RR) screen through use of transparent or semi-transparent RR material. An aspect of the present disclosure provides methods for optimization of optical properties of the RR material to achieve desired optical transparency parameters. Another aspect of the present disclosure provides methods for specific use cases for flexible, transparent and semi-transparent RR display systems.