HMD Video Stream Frame Rate Alternation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head-mountable devices (HMDs) face challenges in managing heat and power consumption, as higher processing power and refresh rates lead to increased heat generation, which can degrade user experience and limit performance, especially when trying to conserve power and reduce thermal footprint.

Innovation Solution

The HMD generates separate video streams for each display portion at different frame rates and temporally shifts these streams to create a psycho-optic effect, maintaining a perceived higher frame rate while reducing power consumption and thermal footprint by alternating frame presentation between displays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the HMD increases processing power and refresh rate to maintain performance, then the user experience is improved, but heat generation and power consumption increase

Engineering Contradiction:
ImproveperformanceVSAvoidheat generation
Core Design Contradiction:
ReliabilityVSTemperature

Solution Approach 1:

The patent implements frame rate alternation between two displays, switching between different frame rates in a periodic manner. Display 1 operates at a first frame rate while Display 2 operates at a second frame rate, then they alternate. This periodic action allows the system to maintain acceptable performance while reducing the average processing load and heat generation compared to continuously operating both displays at high frame rates.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system dynamically adjusts frame rates for different displays based on operational conditions. The frame rates can be changed alternately over time, allowing the system to adapt processing power distribution to current performance requirements and thermal conditions, rather than maintaining fixed high frame rates that would generate excessive heat.

Inventive Principle:
Principle #15Dynamics

2Reliability

If the HMD increases processing power and refresh rate to maintain performance, then the user experience is improved, but power consumption increases

Engineering Contradiction:
ImproveperformanceVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent implements frame rate alternation between two displays, where Display 1 and Display 2 operate at different frame rates that alternate over time. This periodic switching reduces the average processing requirements and power consumption compared to maintaining both displays at continuously high frame rates, while still providing acceptable performance during each display's active period.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system dynamically adjusts frame rates for different displays based on operational conditions. By alternately changing frame rates between displays, the system optimizes power consumption according to current performance needs, reducing energy usage when full performance is not required while maintaining performance when needed.

Inventive Principle:
Principle #15Dynamics

3Use of energy by moving object

If the HMD limits hardware and software capabilities to reduce power consumption, then power consumption is reduced, but performance is hampered and user experience degrades

Engineering Contradiction:
Improvepower consumptionVSAvoidperformance
Core Design Contradiction:
Use of energy by moving objectVSReliability

Solution Approach 1:

The patent implements frame rate alternation between two displays, allowing the system to operate at lower average power consumption while maintaining performance during each display's active period. This periodic approach enables the HMD to provide acceptable user experience without requiring continuously high processing power that would exceed power budget constraints.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system dynamically adjusts frame rates for different displays based on operational conditions, allowing performance to be optimized when needed while reducing power consumption during other periods. This dynamic adjustment enables the HMD to adapt to power constraints without permanently limiting capabilities, maintaining performance reliability when required.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11706383B1Presenting video streams on a head-mountable device
Publication Date: 2023.07.18 APPLE INC
  • US11706383B1 patent drawing
  • US11706383B1 patent drawing
  • US11706383B1 patent drawing

AI summary

In various implementations, a method of presenting video streams at a head-mountable device (HMD) includes generating a first video stream at a first frame rate for a first display portion. In some implementations, the first frame rate indicates a rate at which frames are presented by the first display portion. In various implementations, the method includes generating a second video stream at a second frame rate for a second display portion. In some implementations, the second frame rate indicates a rate at which frames are presented by the second display portion. In some implementations, the second frame rate is within a threshold relative to the first frame rate. In various implementations, the method includes temporally shifting the second video stream relative to the first video stream so that a majority of refresh times of the first display portion are different from refresh times of the second display portion.