Selective Pixel Output for Artificial Reality Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing artificial reality systems face challenges in transmitting high-resolution display data at high update rates due to limited data bus bandwidth, often relying on data compression which leads to information loss and suboptimal display quality.

Innovation Solution

The system organizes pixels into valid and invalid tiles based on displaying content, transmitting only valid tiles' data while skipping invalid tiles, along with tile-validity metadata to downstream devices, allowing for uncompressed data transmission and reducing bandwidth requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If data compression is used to transmit display data through limited bandwidth, then bandwidth efficiency is improved, but information loss occurs and display quality deteriorates

Engineering Contradiction:
Improvedata transmission bandwidthVSAvoiddisplay information quality
Core Design Contradiction:
Quantity of substanceVSLoss of information

Solution Approach 1:

The patent extracts and transmits only the essential information (valid tile identifiers and their pixel data) while omitting redundant information (invalid tile data). By identifying and transmitting only valid tiles that contain actual display content, the system achieves efficient bandwidth utilization without data compression, thereby preventing information loss and maintaining high display quality.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of transmitting complete frame data, the patent transmits only the necessary portion (valid tiles) of the display data. This partial transmission approach sends exactly what is needed for rendering the current frame without the excess of transmitting entire frames or using compression algorithms, optimizing bandwidth usage while preserving complete display information.

Inventive Principle:
Principle #16Partial or excessive action

2Productivity

If all pixels are transmitted at high update rates, then display quality is maintained, but bandwidth requirements exceed available capacity

Engineering Contradiction:
Improvepixel update rateVSAvoiddata transmission volume
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent segments the display frame into multiple tiles and identifies which tiles are valid (contain display content) and which are invalid (black background). By processing and transmitting only valid tiles individually, the system dramatically reduces the total data volume that needs to be transmitted at high update rates, enabling high refresh rates within available bandwidth constraints.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transmits only the partial set of pixels contained in valid tiles rather than all pixels in the entire frame. This selective transmission approach maintains the necessary pixel update rate for high-quality display while reducing the total data transmission volume to fit within available bandwidth capacity.

Inventive Principle:
Principle #16Partial or excessive action

3Loss of information

If uncompressed display data is transmitted, then display quality is preserved, but bandwidth consumption increases beyond available capacity

Engineering Contradiction:
Improvedisplay information integrityVSAvoiddata transmission bandwidth
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The patent extracts only the valid tile identifiers and their corresponding pixel data from the complete frame, excluding invalid tiles entirely. This extraction approach transmits uncompressed data for valid tiles (preserving information integrity) while reducing the total data volume to match available bandwidth capacity by omitting redundant invalid tile data.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10950305B1Selective pixel output
Publication Date: 2021.03.16 META PLATFORMS TECHNOLOGIES LLC
  • US10950305B1 patent drawing
  • US10950305B1 patent drawing
  • US10950305B1 patent drawing

AI summary

In one embodiment, a computing system may write a first set of pixel values in a tile order into a first buffer with the pixel values organized into a first set of tiles. The system may generate first validity data for the first set of tiles. The first validity data may include a validity indicator for each tile to indicate if that tile is a valid tile. The system may read from the first buffer a first subset of pixel values in a pixel row order corresponding to pixel rows of the first set of tiles based on the valid data. The first subset of pixel values may be associated with valid tiles of the first set of tiles. The system may send the first subset of pixel values and the first validity data of the first set of tiles to a display via an output data bus.