Synchronizing Rolling Shutter Image Sensors via Target Region Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In head-mounted display (HMD) systems using rolling shutter type image sensors, synchronization deviations between multiple image capturing units lead to inefficiencies and increased complexity, particularly due to the need for synchronized image capturing timings across overlapping regions, resulting in higher power consumption and processing inefficiencies.

Innovation Solution

A control apparatus that determines a target region for each image sensor and generates synchronization signals to ensure temporal synchronization of image capturing, using a region determination unit and signal determination unit to set the image capturing start timing, thereby simplifying the system and reducing data transmission and processing requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image capturing is performed in the entire region of each image sensor to ensure overlapping region coverage, then image processing accuracy is improved, but system complexity and power consumption increase

Engineering Contradiction:
Improveimage processing accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the image sensor region into a target region (overlapping region) and a non-target region. Image capturing is performed only in the target region, which is segmented from the entire sensor area. This segmentation reduces the amount of captured data while ensuring the overlapping region is covered, thereby reducing system complexity without compromising image processing accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts only the necessary target region from the entire image sensor region for image capturing. By taking out only the overlapping region where image processing is needed, the system avoids capturing and processing unnecessary data from non-overlapping regions, reducing system complexity and power consumption while maintaining processing accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

2Reliability

If image capturing is performed in the entire region of each image sensor, then complete image data is acquired, but data transmission and processing load increase

Engineering Contradiction:
Improveimage data completenessVSAvoidprocessing efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments the image sensor output into target region data and non-target region data, transmitting and processing only the target region data. This segmentation maintains reliability for the overlapping region while improving processing efficiency by eliminating unnecessary data handling.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts only the target region data from the complete image sensor output for transmission and processing. This extraction ensures that complete and accurate data for the overlapping region is acquired while reducing the overall data transmission and processing load, thereby improving productivity.

Inventive Principle:
Principle #2Taking out (Extraction)

3Manufacturing precision

If synchronization signals are adjusted for the entire region of image sensors, then temporal synchronization is achieved, but system complexity increases

Engineering Contradiction:
Improvesynchronization accuracyVSAvoidcontrol complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies synchronization signal adjustment locally to the target region rather than uniformly across the entire image sensor region. This local quality approach tailors the synchronization control to the specific needs of the overlapping region, achieving synchronization accuracy while reducing control complexity by avoiding unnecessary adjustments in non-target regions.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11546570B2Apparatus, apparatus control method, and recording medium, for synchronizing a plurality of imaging devices
Publication Date: 2023.01.03 CANON KK
  • US11546570B2 patent drawing
  • US11546570B2 patent drawing
  • US11546570B2 patent drawing

AI summary

A synchronization control apparatus includes a control unit configured to control a plurality of imaging devices that capture an image, and a determination unit configured to determine a target region from which an image is acquired from each of the plurality of imaging devices, and to determine a synchronization signal corresponding to the target region in each of the plurality of imaging devices, wherein the determination unit determines the synchronization signal and the target region in each of the plurality of imaging devices so as to temporally synchronize images acquired from the plurality of imaging devices.