Head-Mounted Display Distorted Image Generation for Latency Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image display systems, particularly head-mounted displays, face challenges in maintaining responsiveness and image quality when the visual field changes and the displayed world moves, leading to potential loss of presence due to increased computational burdens and delayed image rendering.

Innovation Solution

An image generating device and method that includes a distorted image generating section, which calculates the displacement destination of pixels due to eyepiece lens distortion, specifies color information based on the viewpoint position, and uses this information as pixel values, enabling efficient and responsive image output.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If complex computations are performed to achieve realistic image rendering with increased resolution, then image quality is improved, but processing time increases and responsiveness deteriorates

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing distortion correction data in a lookup table before runtime. During actual image rendering, the system simply retrieves pre-computed pixel correspondence data based on viewpoint position, avoiding complex real-time distortion calculations while maintaining high image quality and responsiveness

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by creating a pre-computed lookup table that stores the correspondence between distorted and undistorted pixel positions. This lookup table is a simplified copy of the complex distortion transformation relationships, allowing the system to replace heavy computational operations with simple data retrieval and interpolation

Inventive Principle:
Principle #26Copying

2Manufacturing precision

If complex computations are performed for realistic image rendering, then image quality is improved, but device complexity increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system performs the complex distortion computation work beforehand and stores results in a lookup table. This shifts the computational burden from runtime processing to initialization phase, significantly reducing device complexity during actual operation while preserving image quality

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces complex computational logic with a pre-computed lookup table structure. This copying approach stores the essential distortion transformation data in an accessible format, eliminating the need for complex algorithms during rendering and simplifying device architecture

Inventive Principle:
Principle #26Copying

3Manufacturing precision

If traditional distortion correction methods are used, then image quality is maintained, but responsiveness and sense of presence deteriorate due to processing delays

Engineering Contradiction:
Improveimage qualityVSAvoidresponsiveness
Core Design Contradiction:
Manufacturing precisionVSSpeed

Solution Approach 1:

By pre-calculating pixel correspondence data for various viewpoint positions and storing it in a lookup table, the system eliminates real-time distortion computation delays. During runtime, only simple table lookups and interpolations are needed, achieving both high image quality and responsive performance for dynamic viewpoint changes

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a lookup table that copies the essential distortion transformation relationships into an easily accessible data structure. This allows the system to replace computationally intensive real-time distortion correction with rapid data retrieval operations, significantly improving responsiveness while maintaining image quality

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for both high responsiveness and image quality by directly rendering images with distortion, reducing delay times and memory requirements, and enhancing the sense of presence in dynamic visual environments.

Implementation Method 1

a distorted image generating section for rendering a display image having a distortion at a predetermined rate by acquiring a displacement destination of a target pixel on an image plane due to an image distortion caused by the eyepiece lens

Methodology Applied
Scientific EffectLens distortion: Lens

Data Source

PatentUS11960086B2Image generation device, head-mounted display, and image generation method
Publication Date: 2024.04.16 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11960086B2 patent drawing
  • US11960086B2 patent drawing
  • US11960086B2 patent drawing

AI summary

A distorted image generating section directly renders an image having a distortion such that a proper image can be seen when viewed through an eyepiece lens. Specifically, the distorted image generating section calculates which position a target pixel on a view screen will be displaced to by the lens, generates a ray of light that passes from a viewpoint through a pixel at a displacement destination, and uses color information obtained by ray tracing as a pixel value of the target pixel.