Multisurface Display Protocol for Artificial Reality SoC

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional artificial reality systems require frequent and high-power video data communication to constantly refresh display buffers, leading to increased power consumption and reduced battery life, especially since not all surface textures need to be updated in every video frame.

Innovation Solution

Implementing a dual buffer system where the display buffer is controlled by the display SoC integrated circuit, with texture pointers switching between primary and secondary buffers for updated textures, and using a command mode for data transmission to reduce the amount of data sent from the central processing SoC to the display SoC, breaking surface textures into packets for efficient transmission.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If video data communication protocol is used to constantly refresh display buffers, then display refresh is maintained, but power consumption increases

Engineering Contradiction:

Improvedisplay refreshVSAvoidpower consumption

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic action by switching between video mode (for full buffer refresh) and command mode (for selective texture updates) based on whether texture changes are detected. The system periodically evaluates the need for full refresh versus selective updates, maintaining display reliability while reducing power consumption during static scenes.

Inventive Principle:

Principle #19Periodic action

Solution Approach 2:

The patent applies parameter changes by dynamically changing the communication protocol parameters between video mode and command mode. When textures are static, the system transitions to command mode with reduced data transmission parameters, thereby lowering power consumption while maintaining necessary display functionality.

Inventive Principle:

Principle #35Parameter changes

2Reliability

If all surface textures are transmitted every frame, then display completeness is ensured, but data transmission volume increases

Engineering Contradiction:

Improvedisplay completenessVSAvoiddata transmission volume

Core Design Contradiction:

ReliabilityVSQuantity of substance

Solution Approach 1:

The patent extracts only the changed portions of surface textures (delta updates) rather than transmitting complete texture data every frame. The texture update determination module identifies which textures have changed and transmits only those updates, significantly reducing data transmission volume while ensuring display completeness through the dual buffer system.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the display buffer into multiple texture regions and processes them independently. By dividing the texture update task into individual texture segments, the system can selectively update only changed segments rather than transmitting all texture data, reducing overall data transmission volume.

Inventive Principle:

Principle #1Segmentation

3Speed

If high-power video mode is used for data transmission, then transmission speed is maintained, but battery life decreases

Engineering Contradiction:

Improvetransmission speedVSAvoidbattery life

Core Design Contradiction:

SpeedVSDuration of action of moving object

Solution Approach 1:

The patent implements periodic switching between video mode (high speed, high power) and command mode (low speed, low power) based on texture change detection. During static scenes, the system operates in command mode to conserve battery life, while switching to video mode only when texture updates are required, thus extending battery life while maintaining necessary transmission speeds.

Inventive Principle:

Principle #19Periodic action

4Ease of operation

If display buffer is controlled by central processing SoC, then data control is centralized, but power consumption increases

Engineering Contradiction:

Improvedata controlVSAvoidpower consumption

Core Design Contradiction:

Ease of operationVSUse of energy by moving object

Solution Approach 1:

The patent introduces an intermediary texture update determination module that sits between the central processing SoC and display buffer. This intermediary evaluates texture changes and selectively triggers updates, reducing the frequency of high-power transmissions from the central processing SoC to the display buffer while maintaining centralized control capability.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS11430141B2Artificial reality system using a multisurface display protocol to communicate surface data

Publication Date: 2022.08.30 META PLATFORMS TECHNOLOGIES LLC

AI summary

This disclosure describes efficient communication of surface texture data between system on a chip (SOC) integrated circuits. An example system includes a first integrated circuit, and at least one second integrated circuit communicatively coupled to the first integrated circuit by a communication interface. The first integrated circuit, upon determining that surface texture data of a frame to be rendered for display by the second SoC integrated circuit is to be updated, (a) transmits the surface texture data in one or more update packets to the second integrated circuit using the communication interface, and (b) transmits a command to the second integrated circuit indicating that the surface texture data of the frame has been updated using the communication interface. The second integrated circuit, upon receipt of the command, (a) sets a pointer to a location in the display buffer storing the surface texture data of the frame, and (b) renders the surface texture data of the frame for display on a display device.