ToF Signal Processing Device Pixel Group Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing signal processing technologies for time-of-flight (ToF) methods require complex control of charge accumulation periods for each pixel group in imaging devices, limiting their versatility in detecting distances between imaging devices and subjects.

Innovation Solution

A signal processing device and method that determine pairs of pixel groups based on controlled charge accumulation periods and light projection periods, enabling distance detection with high versatility without the need for specialized imaging devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a CMOS imaging device with charge distribution type pixel structure is used for ToF distance detection, then distance detection capability is achieved, but at least two memories per pixel are required increasing device complexity

Engineering Contradiction:
Improvedistance detection capabilityVSAvoidmemory structure complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies universality by enabling general-purpose CMOS imaging devices to perform ToF distance detection without requiring specialized charge distribution type pixel structures or multiple memories per pixel. The determination part synchronizes the charge accumulation period with the pulse light projection period, allowing standard imaging devices to achieve distance detection functionality.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Device complexity

If technology using two pixel groups with different charge accumulation periods is employed, then one memory per pixel is sufficient, but control of start time and end time of charge accumulation period for each pixel group is required increasing operational complexity

Engineering Contradiction:
Improvememory structureVSAvoidcontrol operation complexity
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The determination part automatically determines the pair of pixel groups and synchronizes their charge accumulation periods with the pulse light projection period based on timing information. This self-service mechanism eliminates the need for manual or complex external control of start and end times for each pixel group, reducing operational complexity while maintaining the simplified memory structure.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If general purpose CMOS imaging device is used without specialized control capability, then device versatility is improved, but automatic determination of pixel group pairing based on timing synchronization is required

Engineering Contradiction:
Improveimaging device compatibilityVSAvoidtiming control mechanism
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The determination part acts as an intermediary between the imaging device and the distance detection function. It receives timing information including the start time and end time of the pulse light projection period, automatically determines appropriate pixel groups, and synchronizes their charge accumulation periods accordingly. This intermediary mechanism enables general-purpose imaging devices to perform ToF detection without requiring specialized control capabilities built into the imaging device itself.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate and versatile distance detection between imaging devices and subjects using a general CMOS imaging device, improving detection accuracy and reducing the complexity of control requirements.

Implementation Method 1

The time of flight (ToF) method is a method of detecting the distance between an imaging device and a target object by taking a target object as a subject, projecting pulse light toward the subject, and measuring time until reflected light from the subject is received by the imaging device.

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 2

the distance between the subject and the imaging device can be detected, for example, by distributing and holding accumulated charges of a leading part and accumulated charges of a trailing part by the reflected light from the subject with respect to the projected pulse light, for each pixel

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS11585898B2Signal processing device, signal processing method, and program
Publication Date: 2023.02.21 SONY GROUP CORP
  • US11585898B2 patent drawing
  • US11585898B2 patent drawing
  • US11585898B2 patent drawing

AI summary

The present disclosure relates to a signal processing device that enables detection of the distance between an imaging device and a subject using an imaging device with high versatility, a signal processing method, and a program. A determination part classifies pixels to a plurality of pixel groups, and determines a pair of a first pixel group and a second pixel group using for detection of distance between the imaging device and the subject from a plurality of pixel groups on the basis of a charge accumulation period for each pixel group of the imaging device in which charge accumulation period is controlled, and a light projection period of pulse light projected toward the subject of the imaging device, for each pixel group. The present disclosure can be applied to, for example, a distance detection device or the like.