Mirroring Edge Pixels in 2D VR Representations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Virtual reality content generation often results in 2D representations with sharp edges between display and non-display pixels, leading to visual artifacts during playback due to insufficient encoding of high spatial frequencies at these transitions.

Innovation Solution

Modifying non-display pixels adjacent to display pixels by replicating or averaging their values, thereby softening edges within the 2D representation before encoding, which can be performed by a stitcher or encoder.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If sharp edges are preserved between display and non-display pixels in the 2D representation, then encoding accuracy is maintained, but visual artifacts occur during playback

Engineering Contradiction:
Improveencoding accuracyVSAvoidvisual artifacts
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent applies preliminary action by modifying the pixel values at edges between display and non-display regions before the encoding process. This preprocessing step softens the sharp transitions that would otherwise cause visual artifacts during playback, allowing the encoder to work with already-optimized data without losing essential image quality.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent employs preliminary anti-action by preemptively counteracting the formation of visual artifacts through pixel value modification. By adjusting the pixel values at transition edges before encoding, the harmful visual artifacts are prevented from occurring in the first place, rather than attempting to correct them after encoding or during playback.

Inventive Principle:
Principle #9Preliminary anti-action

2Object-affected harmful factors

If pixel values at edges are modified to soften transitions, then visual artifacts are reduced, but encoding precision may be compromised

Engineering Contradiction:
Improvevisual artifactsVSAvoidencoding precision
Core Design Contradiction:
Object-affected harmful factorsVSMeasurement precision

Solution Approach 1:

The patent applies local quality by modifying pixel values only at specific locations—namely, at the edges between display and non-display regions—while leaving the rest of the image pixels unchanged. This localized modification approach softens transitions where needed without compromising the overall precision and quality of the encoded image data.

Inventive Principle:
Principle #3Local quality

3Productivity

If standard encoding is applied to 2D representations with sharp edges, then encoding speed is maintained, but visual quality deteriorates

Engineering Contradiction:
Improveencoding speedVSAvoidvisual quality
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The patent performs preliminary pixel value modification before the standard encoding process, preparing the data in advance to prevent visual artifacts. This allows the subsequent encoding to proceed at standard speeds without requiring complex artifact-reduction algorithms, thus maintaining encoding productivity while improving visual quality.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10593122B1Mirroring edge pixels
Publication Date: 2020.03.17 AMAZON TECH INC
  • US10593122B1 patent drawing
  • US10593122B1 patent drawing
  • US10593122B1 patent drawing

AI summary

Techniques are described that enable a two-dimensional (2D) representation of three-dimensional (3D) virtual reality content to be generated and encoded. These techniques include modifying non-display pixels within the 2D representation to soften the transitions between display pixels and non-display pixels.