GPU Microcontroller Intermediate Frame Generation for HMD Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current head-mounted display (HMD) systems face challenges in providing immersive virtual reality (VR) and augmented reality (AR) experiences due to insufficient power in graphics chipsets, leading to frame drops, high judder rates, and tearing, with total motion-to-photon latency exceeding 18 milliseconds, which affects user immersion.
Innovation Solution
The implementation of an intermediate frame generation mechanism, where a graphics processing unit (GPU) microcontroller controls the scheduling of GPU workloads to preempt low-priority tasks and generate intermediate frames based on sensor data and display feedback, ensuring timely frame rendering and display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the GPU processes all graphical computation to maintain interactive frame rates, then frame rendering speed is improved, but power consumption increases and causes frame drops due to insufficient chipset power
Solution Approach 1:
The microcontroller preempts low-priority GPU workloads before they can consume excessive power, proactively managing power usage by interrupting non-critical rendering tasks when power thresholds are approached, thereby preventing frame drops while maintaining essential frame rendering performance
2Loss of time
If the system increases processing power to reduce motion-to-photon latency below 18 milliseconds, then user immersion is improved, but device complexity increases
Solution Approach 1:
A microcontroller is introduced as an intermediary between the sensor inputs and the GPU rendering pipeline. This intermediary manages and schedules GPU workloads, optimizing the rendering process to reduce motion-to-photon latency without requiring a complete overhaul of the graphics chipset architecture, thereby reducing overall system complexity
3Stability of the object's composition
If the GPU generates frames at high speed to eliminate judder, then frame rate stability is improved, but tearing occurs due to synchronization issues
Solution Approach 1:
The microcontroller implements feedback control by monitoring the rendering pipeline status and dynamically adjusting GPU workload scheduling. When it detects conditions that could lead to tearing, it preemptively interrupts non-critical workloads to maintain synchronization between frame generation and display refresh, eliminating tearing while preserving frame rate stability
Data Source
AI summary
Systems, apparatuses and methods may provide for technology that includes a microcontroller to control a workload of a graphics processor, to determine if at least one predetermined condition is met, and instruct, if the at least one predetermined condition is met, the graphics processor to transform an initial frame into an intermediate frame.