AR Optical Lens Distortion Correction via Coordinate Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current display technologies face challenges in effectively aligning and physicallyizing three-dimensional virtual content with physical scenes in augmented reality, particularly in achieving accurate stereoscopic displays due to optical distortions and coordinate system alignment issues.

Innovation Solution

A method and system for a terminal device that determines target space coordinates of a physical marker, converts them into rendering coordinates, acquires and renders virtual object data, and corrects optical distortions to project left-eye and right-eye display content onto optical lenses, ensuring alignment and undistorted stereoscopic display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If virtual content is displayed using optical lenses for stereoscopic display, then three-dimensional display effect is improved, but optical distortion causes misalignment with physical objects

Engineering Contradiction:
Improvestereoscopic display capabilityVSAvoidalignment accuracy
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by pre-distorting the virtual content in the opposite direction of the expected optical distortion before rendering. This pre-distortion compensates for the lens-induced distortion, ensuring that when the distorted virtual content is projected through the optical lenses, it aligns accurately with the physical scene. The conversion parameters are calculated in advance based on the optical distortion characteristics, allowing the virtual content to be pre-adjusted to counteract the upcoming distortion from the lenses.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If coordinate conversion is performed between physical space and virtual space, then alignment between virtual and physical objects is improved, but calculation complexity increases

Engineering Contradiction:
Improvecoordinate alignment accuracyVSAvoidcoordinate conversion complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by establishing a conversion parameter set that maps coordinates from the physical space coordinate system to the virtual space coordinate system. These conversion parameters include translation, rotation, and scaling factors that transform the coordinate representation. By changing the coordinate parameters through this conversion relationship, the system achieves accurate alignment between virtual and physical objects while managing computational complexity through optimized parameter calculations.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enables accurate alignment and stereoscopic display of virtual content with physical objects, correcting optical distortions to provide a seamless and undistorted virtual image alignment, enhancing the augmented reality experience.

Implementation Method 1

the first optical lens and the second optical lens respectively reflect the left-eye display content and the right-eye display content to a user's eyes

Methodology Applied
Scientific EffectOptical projection and reflection: Reflection

Data Source

PatentUS11380063B2Three-dimensional distortion display method, terminal device, and storage medium
Publication Date: 2022.07.05 XIMMERSE LTD
  • US11380063B2 patent drawing
  • US11380063B2 patent drawing
  • US11380063B2 patent drawing

AI summary

A three-dimensional display method is provided and comprises: acquiring target space coordinates of a target marker in a physical space; converting the target space coordinates into rendering coordinates in a virtual space; acquiring data of a virtual object to be displayed, and rendering, based on the data of the virtual object and the rendering coordinates, the virtual object to obtain a left-eye display content and a right-eye display content of the virtual object; and displaying the left-eye display content and the right-eye display content. The left-eye display content is projected onto a first optical lens, the right-eye display content is projected onto a second optical lens, and the first optical lens and the second optical lens respectively reflect the left-eye display content and the right-eye display content to human eyes. The method can achieve alignment display of the virtual object with the target marker, and a stereoscopic display.