Rasterization Distortion Function Estimation for HMDs

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing display technologies, such as head-mounted displays (HMDs), face challenges in presenting rasterized images due to distortions caused by non-uniform pixel density, which can be exacerbated by lens distortions in virtual reality applications, making it difficult to achieve intuitive and efficient mapping of flexible scale rasterization (FSR) functions to distortion properties.

Innovation Solution

A technique is developed to iteratively fit a rasterization distortion function to the distortion properties of a display by moving control points of the FSR function along the curve until the longest portion satisfying a value is identified, allowing for optimized image presentation on displays with unknown distortion properties, using methods like binary search and checkerboard pattern analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If FSR function is used to control pixel density, then non-uniform pixel spacing is achieved, but mapping FSR function to arbitrary distortion becomes time-consuming and challenging

Engineering Contradiction:

Improveease of mapping FSR function to distortionVSAvoidtime required to map FSR function to distortion

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The system automatically detects distortion properties from the rendered image and self-adjusts the FSR function control points without requiring manual developer input or configuration, enabling the system to adapt to any distortion type autonomously

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent dynamically adjusts the parameters of the FSR function by moving control points along the curve based on detected distortion characteristics, transforming the static FSR configuration into a dynamic adaptation process that matches the actual display distortion

Inventive Principle:

Principle #35Parameter changes

2Productivity

If FSR function with constant alpha is used, then rendering performance is maintained, but the distortion function may not be known to the developer

Engineering Contradiction:

Improverendering efficiencyVSAvoiddifficulty of knowing distortion function

Core Design Contradiction:

ProductivityVSDifficulty of detecting and measuring

Solution Approach 1:

The system captures the rendered image, detects distortion properties from it, and uses this feedback to automatically adjust the FSR function control points, creating a closed-loop system that adapts to unknown distortion characteristics without requiring prior developer knowledge

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent replaces manual developer configuration (mechanical process) with automated image-based detection and computation, substituting human expertise with computational analysis that extracts distortion properties from the rendered image itself

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Device complexity

If uniform pixel density is used in rasterized image, then rendering is simple, but lens distortion in VR HMD adversely affects visual presentation

Engineering Contradiction:

Improvesimplicity of rendering processVSAvoidlens distortion effect

Core Design Contradiction:

Device complexityVSObject-affected harmful factors

Solution Approach 1:

The system applies preliminary distortion detection and FSR function adjustment before the final rendering pass, pre-compensating for the harmful lens distortion effect by configuring the pixel density distribution to counteract the expected distortion characteristics

Inventive Principle:

Principle #9Preliminary anti-action

Data Source

PatentUS11915384B2Estimation of optimal rasterization distortion function from image distortion property

Publication Date: 2024.02.27 SONY INTERACTIVE ENTERTAINMENT LLC

AI summary

A technique iteratively fits a rasterization distortion function to a distortion property of a display such as a head-mounted display (HMD). The technique also features reconstructing a distortion function from a rendered image with unknown distortion property.