Dynamic Frame Rate Adjustment for XR Camera Image Quality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing wearable devices face challenges in maintaining high-quality image capture and user experience due to environmental conditions such as low lighting, which can lead to blurry or noisy images and inefficient use of computational resources.

Innovation Solution

A system that includes an image capture device and processors to dynamically adjust the frame rate based on environmental conditions, such as lighting, to ensure optimal image quality and resource utilization. The system reduces the frame rate when environmental conditions are not suitable for high frame rates, allowing for better exposure and reduced power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If the frame rate is maintained at a high rate in low lighting conditions, then the temporal resolution is improved, but the image quality deteriorates due to insufficient exposure time causing blurry or noisy images

Engineering Contradiction:
Improveframe rateVSAvoidimage quality
Core Design Contradiction:
SpeedVSManufacturing precision

Solution Approach 1:

The system dynamically adjusts the frame rate of the image capture device based on real-time environmental conditions (lighting levels). When lighting conditions deteriorate below a threshold, the frame rate is reduced to allow sufficient exposure time for quality images. This dynamic adaptation resolves the contradiction by making the frame rate flexible rather than fixed, allowing the system to maintain image quality when needed while preserving temporal resolution when conditions permit.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the operational parameter (frame rate) in response to environmental parameter changes (lighting conditions). By monitoring lighting levels and adjusting the frame rate parameter accordingly, the system ensures that exposure time remains sufficient for quality image capture while maintaining high frame rates when lighting conditions are adequate.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If the frame rate is reduced to improve image quality in low lighting, then the image quality is improved, but the productivity of capturing images deteriorates

Engineering Contradiction:
Improveimage qualityVSAvoidimage capture rate
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The system employs dynamic frame rate adjustment that adapts to environmental conditions. The frame rate is reduced only when and where needed (in low lighting conditions) to maintain image quality, while maintaining high frame rates in adequate lighting. This selective dynamic adjustment resolves the contradiction by optimizing the balance between image quality and capture rate based on real-time conditions rather than using a fixed low frame rate.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system applies different frame rates to different temporal segments based on local environmental conditions. Rather than uniformly reducing the frame rate, the system adjusts the frame rate locally in time - maintaining high rates when conditions are good and reducing only when conditions deteriorate, thus preserving overall productivity while ensuring quality when needed.

Inventive Principle:
Principle #3Local quality

3Speed

If the frame rate is maintained at high rate regardless of conditions, then the temporal resolution is preserved, but the energy consumption increases

Engineering Contradiction:
Improveframe rateVSAvoidpower consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The system implements periodic monitoring of environmental conditions with corresponding periodic adjustment of the frame rate. Rather than continuously operating at maximum frame rate, the system periodically assesses lighting conditions and adjusts the frame rate accordingly, reducing power consumption during periods of inadequate lighting while maintaining high frame rates when conditions are favorable.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system dynamically adapts the frame rate to match environmental conditions, reducing power consumption by lowering the frame rate when lighting conditions deteriorate. This dynamic adjustment ensures that the system consumes minimal energy while still maintaining adequate temporal resolution when conditions permit, resolving the contradiction between energy efficiency and temporal resolution.

Inventive Principle:
Principle #15Dynamics

4Use of energy by moving object

If the frame rate is reduced to save power, then the energy efficiency is improved, but the temporal resolution deteriorates

Engineering Contradiction:
Improvepower consumptionVSAvoidframe rate
Core Design Contradiction:
Use of energy by moving objectVSSpeed

Solution Approach 1:

The system changes the frame rate parameter in response to environmental parameter changes (lighting conditions). By monitoring lighting levels and adjusting the frame rate accordingly, the system achieves energy efficiency through reduced frame rates only when necessary, while preserving high frame rates and temporal resolution when environmental conditions allow.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20250063252A1Multi-mode camera frame sharing algorithm for cv features in xr headsets
Publication Date: 2025.02.20 META PLATFORMS TECHNOLOGIES LLC
  • US20250063252A1 patent drawing
  • US20250063252A1 patent drawing
  • US20250063252A1 patent drawing

AI summary

Disclosed herein are systems and methods related to an image capture device and one or more processors. The image capture device can capture one or more images. The one or more processors can determine that a parameter, such as gain or exposure, of the one or more images satisfies a threshold and cause the image capture device to reduce a frame rate of detecting the one or more images responsive to the parameter satisfying the threshold.