Perspective-Correct Rendering for Tilted Multi-Display Arrays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Perspective distortion occurs when rendering images on multiple displays, especially when peripheral displays are tilted, leading to an unsatisfying user experience due to image stretching and blurring, and existing solutions like using multiple GPUs increase hardware costs and complexity.

Innovation Solution

A method and apparatus for rendering perspective-correct images on multiple tilted displays by creating a common viewport for central and peripheral monitors, calculating scene data, rasterizing geometric primitives, and adjusting bitmaps based on the tilt angle to correct perspective distortion, using a single pass through a geometry engine to generate a projection that accounts for the tilt and distance from the camera.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple displays are arranged horizontally to widen field of view, then the field of view is expanded, but perspective distortion is greatly amplified

Engineering Contradiction:
Improvefield of viewVSAvoidimage distortion
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The rendering process is segmented into multiple passes: a first pass generates a preliminary image without perspective correction, and a second pass applies perspective correction specifically to peripheral regions. This segmentation allows the system to maintain wide field of view while correcting distortion in specific areas where it matters most.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Perspective correction is applied selectively to different regions of the display with different intensities. Peripheral regions that exhibit more distortion receive stronger correction, while central regions receive minimal or no correction. This local quality approach ensures distortion correction where needed without degrading image quality in regions that already display well.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If a discreet graphics processing unit is used for each display to correct perspective distortion, then image quality is improved, but hardware cost and complexity increase

Engineering Contradiction:
Improveimage qualityVSAvoidhardware cost
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

Multiple rendering operations are merged into a single unified rendering process. Instead of using separate GPUs for each display, the invention combines perspective correction rendering with standard rendering into one integrated process that operates on a single GPU, reducing hardware requirements while maintaining image quality.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The invention creates a corrected version of the image by copying and transforming the preliminary rendered image. A perspective correction transform is applied to generate a corrected image that compensates for distortion, allowing high-quality output without requiring additional expensive hardware.

Inventive Principle:
Principle #26Copying

3Ease of operation

If peripheral displays are tilted inward to enhance user immersion, then user experience is improved, but perspective distortion is further exacerbated

Engineering Contradiction:
Improveuser immersionVSAvoidperspective distortion
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The rendering system performs preliminary perspective correction calculations based on the known tilt angles of peripheral displays. By pre-calculating the appropriate perspective transforms according to the display geometry, the system can compensate for the tilted configuration before rendering, ensuring that images appear correct even when displays are tilted to enhance immersion.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10503457B2Method and apparatus for rendering perspective-correct images for a tilted multi-display environment
Publication Date: 2019.12.10 NVIDIA CORP
  • US10503457B2 patent drawing
  • US10503457B2 patent drawing
  • US10503457B2 patent drawing

AI summary

Techniques for rendering images on multiple tilted displays concurrently to mitigate perspective distortion are disclosed herein. According to one described approach, viewports are assigned to a center monitor and two peripheral monitors. Scene data for the viewports is calculated, and geometric primitives are generated for the viewports based on the scene data. Image transformation is performed based on a modified perspective value to modify geometry of the geometric primitives based on tilt angles of the displays, and the geometric primitives are rasterized using the modified geometry.