Image Sensor Synchronization for Centroid Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional AR/VR systems face challenges in synchronizing image sensors with differing exposure durations, leading to misalignment of centroids and errors in computer vision computations, particularly in dynamic lighting environments and varying purposes like headset tracking and controller tracking.

Innovation Solution

An apparatus and method that include a data management component, synchronization component, and tracking component to receive and synchronize sensor data from image sensors with differing exposure durations, using techniques such as calculating blanking durations and shutter synchronization pulses to temporally center these exposures, allowing the same image sensor to alternate between exposure durations for different purposes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the beginning of exposure durations of multiple image sensors are aligned, then synchronization is achieved, but the center points (centroids) of the exposure durations become misaligned due to differing exposure lengths

Engineering Contradiction:
Improvesynchronization accuracyVSAvoidcentroid alignment accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The system performs preliminary calculation of blanking durations for each image sensor based on their respective exposure durations. Before capturing images, the controller determines the required blanking periods and configures each sensor accordingly, ensuring that exposure centers align rather than just starting edges. This preliminary configuration prevents centroid misalignment from occurring in the first place.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If multiple image sensors with differing exposure durations are used for different purposes (headset tracking vs controller tracking), then functional versatility is improved, but system complexity increases

Engineering Contradiction:
Improvesensor functional versatilityVSAvoidsynchronization system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent makes a single image sensor universal by enabling it to dynamically switch between different exposure durations based on the tracking task. The sensor can operate in short exposure mode for controller tracking and long exposure mode for headset tracking, eliminating the need for separate dedicated sensors for each function. This multi-functionality approach reduces overall system complexity while maintaining versatility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically adjusts the exposure duration of image sensors based on real-time tracking requirements. The controller can switch sensors between different exposure modes (short for controller tracking, long for headset tracking) as needed, making the system adaptable to varying functional demands without requiring fixed, dedicated hardware configurations for each purpose.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If multiple dedicated image sensors are used for different tracking purposes, then tracking accuracy for each function is improved, but system weight and cost increase

Engineering Contradiction:
Improvetracking accuracyVSAvoidheadset weight
Core Design Contradiction:
Measurement precisionVSWeight of moving object

Solution Approach 1:

The patent implements a universal image sensor approach where a single sensor performs multiple tracking functions by dynamically adjusting its exposure duration. The same sensor captures both controller tracking data (using short exposure) and headset tracking data (using long exposure), eliminating the need for separate dedicated sensors. This reduces headset weight while maintaining tracking accuracy through software-controlled exposure adjustment rather than hardware specialization.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11463628B1Systems and methods for synchronizing image sensors
Publication Date: 2022.10.04 META PLATFORMS TECHNOLOGIES LLC
  • US11463628B1 patent drawing
  • US11463628B1 patent drawing
  • US11463628B1 patent drawing

AI summary

This disclosure describes systems, methods, and devices related to the synchronization of image sensors with different exposure durations. In some embodiments, a system may include multiple image sensors, such as cameras, that have differing exposure durations. A data management component may be configured to receive sensor data from the image sensors. In addition, a synchronization component may be configured to transmit a shutter synchronization pulse to the image sensors. Finally, a tracking component may be configured to temporally center, based at least in part on the shutter synchronization pulse, the differing exposure durations of the image sensors. Various other systems and methods are also disclosed.