Head-Mounted Display Frame Rate Manager for Judder Mitigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head-mounted devices with fixed display frame rates often cause judder when playing cinematic content recorded at 24 frames per second, as the frame rate does not always divide evenly, leading to uneven motion pacing.

Innovation Solution

A frame rate manager adjusts the display frame rate based on user focus, content type, and device conditions, switching to a multiple of 24 fps for movie content to mitigate judder and reducing the frame rate to save power when not in use.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the display frame rate is fixed at the default rate, then power consumption is reduced and device complexity is minimized, but judder occurs during movie playback due to uneven motion pacing

Engineering Contradiction:
Improvemotion smoothnessVSAvoidframe rate management complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The display frame rate is made dynamic rather than fixed. The frame rate manager continuously monitors content type and adjusts the display frame rate accordingly - using a multiple of 24 fps for cinematic content to eliminate judder, and switching to a lower default frame rate for non-cinematic content to save power. This dynamic adjustment resolves the contradiction by adapting the frame rate to current usage conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The frame rate parameter is changed based on content type detection. When cinematic content is detected, the frame rate parameter is adjusted to a multiple of 24 fps; when non-cinematic content is detected, it reverts to the default frame rate. This parameter change enables the system to maintain motion smoothness for movies while avoiding unnecessary power consumption during other activities.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If the display frame rate is adjusted to a multiple of 24 fps for movie content, then judder is mitigated and motion smoothness is improved, but power consumption increases

Engineering Contradiction:
Improvemotion smoothnessVSAvoiddisplay power consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The frame rate adjustment is applied periodically and intermittently rather than continuously. The frame rate manager detects content type and applies the higher frame rate only during periods when cinematic content is being displayed. During other periods, the system reverts to the lower default frame rate. This periodic application of the higher frame rate eliminates judder when needed while minimizing overall power consumption.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The frame rate is dynamically adjusted based on real-time content detection. The system switches between two frame rate states - a higher multiple of 24 fps for cinematic content and a lower default frame rate for other content. This dynamic switching ensures motion smoothness during movie playback while conserving power during non-movie activities, resolving the energy-moion smoothness contradiction.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If the frame rate manager continuously monitors user focus and device conditions, then frame rate adjustment accuracy is improved, but device complexity and processing overhead increase

Engineering Contradiction:
Improveuser focus detection accuracyVSAvoidframe rate management system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The frame rate manager leverages existing multi-functional components already present in the head-mounted device - the eye tracking system originally designed for other purposes is repurposed to detect user focus for frame rate adjustment. By using existing sensors and processing capabilities for multiple functions, the system achieves accurate user focus detection without adding significant complexity or dedicated hardware.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12113955B2Head-mounted electronic device with adjustable frame rate
Publication Date: 2024.10.08 APPLE INC
  • US12113955B2 patent drawing
  • US12113955B2 patent drawing
  • US12113955B2 patent drawing

AI summary

A head-mounted device includes one or more displays configured to present media content. The media content may be presented in a user interface window. The head-mounted device may include a display controller configured to adjust a frame rate of the one or more displays and may include a frame rate management circuit configured to determine whether to adjust the frame rate of the one or more displays based on the type of the media content being presented in the user interface window and based on additional information such as a preferred frame rate associated with the media content, a size of the user interface window relative to the total display area of the one or more displays, point of gaze data, hand gestures data, head pose data, data associated with other body parts, audio information and other data.