Adaptive Image Generation via Visual Adaptation Simulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional displays struggle to accurately reproduce the wide dynamic range of natural environments, leading to discomfort and unrealistic visual experiences due to limitations in bit-depth and brightness, and fail to engage luminance adaptation mechanisms of the human visual system effectively.

Innovation Solution

A system that computes and accumulates afterimages based on human visual adaptation effects, such as bleaching and local adaptation afterimages, into output images to simulate the effects of gaze and adaptation, incorporating phenomenological models of the human visual system to enhance perceived dynamic range.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional displays use standard bit-depth and brightness ranges, then device complexity and ease of manufacture are maintained, but the perceived dynamic range and visual realism are limited

Engineering Contradiction:
Improveperceived dynamic rangeVSAvoiddisplay system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary computational layer that processes standard display output to generate afterimage effects. This mediator layer simulates human visual system adaptation by computing cumulative afterimages from sequences of displayed images, effectively extending the perceived dynamic range without modifying the physical display hardware.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a computational copy of the human visual system's adaptation mechanisms. By modeling photoreceptor bleaching and neural adaptation processes in software, the system reproduces the visual effects of extended dynamic range viewing, allowing standard displays to simulate HDR-like perception through generated afterimage sequences.

Inventive Principle:
Principle #26Copying

2Loss of information

If displays increase maximum brightness and bit-depth to match natural environments, then perceived dynamic range improves, but viewer discomfort increases and manufacturing complexity rises

Engineering Contradiction:
Improvedynamic range reproductionVSAvoidviewer discomfort
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

Instead of increasing display brightness to match natural environments (the conventional approach), the patent inverts the problem by using standard brightness levels and computationally generating the perception of higher brightness through afterimage effects. The system produces the visual sensation of extended dynamic range while maintaining comfortable, standard display luminance levels.

Inventive Principle:
Principle #13The other way round (Inversion)

3Measurement precision

If displays attempt to reproduce extremely bright or dark scenes with proportional radiances, then dynamic range accuracy improves, but the visual system cannot adapt and discomfort increases

Engineering Contradiction:
Improveluminance accuracyVSAvoidvisual comfort
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent applies preliminary computational processing to generate afterimage effects that pre-adapt the viewer's visual system to extreme luminance conditions. By presenting sequences of images with progressively adjusted brightness levels and computing cumulative afterimages, the system prepares the visual system for extended dynamic range content before full viewing begins, reducing discomfort during actual viewing.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution effectively extends the perceived dynamic range of conventional displays by simulating secondary visual effects like bleaching afterimages and adaptation afterimages, providing a more realistic visual experience by accurately reproducing the human visual system's responses to varying illumination levels.

Implementation Method 1

The human visual system can operate in a wide range of illumination levels, due to several adaptation processes working in concert.

Methodology Applied
Scientific EffectLuminance adaptation:

Implementation Method 2

In bright light, these secondary effects include bleaching afterimages and adaptation afterimages

Methodology Applied
Scientific EffectBleaching afterimage:

Implementation Method 3

In dark conditions these include desaturation, loss of acuity, mesopic hue shift, and the Purkinje effect.

Methodology Applied
Scientific EffectPurkinje effect: Purkinje effect

Data Source

PatentUS9773473B2Physiologically based adaptive image generation
Publication Date: 2017.09.26 NVIDIA CORP
  • US9773473B2 patent drawing
  • US9773473B2 patent drawing
  • US9773473B2 patent drawing

AI summary

A system, computer-readable medium, and method are provided for generating images based on adaptations of the human visual system. An input image is received, an effect provoking change is received, and an afterimage resulting from a cumulative effect of human visual adaptation is computed based on the effect provoking change and a per-photoreceptor type physiological adaptation of the human visual system. The computed afterimage may include a bleaching afterimage effect and/or a local adaptation afterimage effect. The computed afterimage is then accumulated into an output image for display.