Camera Display Frame Rate Synchronization for VR MR Transitions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Electronic devices with cameras and displays face challenges in transitioning between virtual reality and mixed reality modes, leading to unsatisfactory content display and visual artifacts.

Innovation Solution

The control circuitry in these devices adjusts the display and camera frame rates dynamically while transitioning between modes, synchronizing the camera and display frame rates to avoid latency and ensure smooth transitions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the device transitions between virtual reality and mixed reality modes, then the display content should switch between pure virtual content and mixed real-virtual content, but this transition causes visual artifacts and unsatisfactory display quality

Engineering Contradiction:
Improvemode switching capabilityVSAvoiddisplay quality
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent applies dynamics by making the camera frame rate adjustable and synchronized with the display frame rate during mode transitions. The system dynamically adapts the camera's operational parameters (frame rate) to match the display requirements, ensuring smooth transitions between VR and MR modes without visual artifacts. This resolves the contradiction by enabling versatile mode switching while maintaining high display quality through real-time parameter adjustment.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If the camera frame rate is changed during mode transition, then the camera can adapt to mixed reality mode requirements, but this change may cause latency issues and visible artifacts

Engineering Contradiction:
Improvecamera adaptabilityVSAvoidtransition smoothness
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements feedback by synchronizing the camera frame rate with the display frame rate during mode transitions. The control circuitry monitors the display frame rate and adjusts the camera frame rate accordingly, creating a closed-loop system that ensures the camera output matches the display requirements in real-time. This feedback mechanism prevents latency issues and visible artifacts, resolving the contradiction between camera adaptability and transition reliability.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent applies preliminary action by pre-synchronizing the camera frame rate to the display frame rate before and during mode transitions. The control circuitry proactively adjusts the camera parameters in advance of the actual mode switch, ensuring that the camera is already configured appropriately when the transition occurs. This prevents latency and artifacts by preparing the system in advance rather than reacting to transitions after they begin.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250148730A1Electronic Device With Coordinated Camera and Display Operation
Publication Date: 2025.05.08 APPLE INC
  • US20250148730A1 patent drawing
  • US20250148730A1 patent drawing
  • US20250148730A1 patent drawing

AI summary

An electronic device may have a camera and a display. The display may be configured to display virtual reality content for a user in which no real-world content from the camera is displayed or mixed reality content in which a combination of real-world content from the camera and overlaid virtual reality content is displayed. Control circuitry in the device may adjust the display and camera while transitioning between virtual reality and mixed reality modes. The control circuitry may reconfigure the camera to exhibit a desired frame rate immediately upon transitioning from virtual reality mode to mixed reality mode. Transitions between modes may be accompanied by smooth transitions between frame rates to avoid visible artifacts on the display. The camera frame rate may be synchronized to the display frame rate for at least part of the transition between the virtual reality and mixed reality modes.