SPAD Sensor Photon Arrival Timing for Multi-Modal Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Multi-modal image sensors face a trade-off between the number of sensing modalities and resolution, where increasing modalities leads to sparse information making proper reconstruction challenging, and existing techniques for Time-of-Flight (ToF) system configuration are not optimally effective.
Innovation Solution
An electronic device and method that determine the times between photon arrivals at a pixel or within larger areas of an imaging sensor, converting these times into intensity signals, utilizing Single Photon Avalanche Diode (SPAD) technology to support high pixel counts for multi-modal capabilities like ToF, while reducing the compromise between modalities and resolution.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multi-modal image sensors allocate more pixels to different sensing modalities, then the number of sensing modalities increases, but the resolution of each modality decreases due to sparse information
Solution Approach 1:
The patent introduces a temporal dimension by measuring the time between photon arrivals at each pixel, adding a new dimension of information (time domain) to the traditional spatial and spectral modalities. This temporal information allows the system to distinguish between different light sources and reconstruct images with sufficient information density even when spatial pixels are shared across multiple modalities, thereby resolving the contradiction between multi-modality and resolution
Solution Approach 2:
The patent changes the measurement parameter from only spatial distribution of photons to temporal intervals between photon arrivals. By measuring the time delta between consecutive photon events at each pixel, the system extracts additional information from the same spatial pixel, enabling multiple sensing modalities without sacrificing resolution in any single modality
2Device complexity
If a single sensor is used for multi-modal acquisition, then device complexity is reduced, but the ability to capture multiple modalities simultaneously is limited
Solution Approach 1:
The patent makes a single imaging sensor perform multiple functions by enabling it to capture spatial information, spectral information, and temporal information (time between photon arrivals) simultaneously. The same pixel array serves for multiple modalities including intensity imaging, ToF, and spectral analysis, eliminating the need for separate sensors while maintaining full multi-modal capability
Solution Approach 2:
By adding temporal measurement capability to the single sensor, the patent enables the sensor to distinguish between photons from different sources and times, allowing simultaneous multi-modal acquisition without requiring multiple physical sensors. The temporal dimension provides the additional degree of freedom needed for multi-functionality
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for increased capturing modalities such as multi/hyper-spectral acquisition and ToF capabilities within a single sensor, enhancing image reconstruction quality by leveraging high pixel counts and asynchronous pixel processing.
Implementation Method 1
Avalanche photodiodes, and in particular single photon avalanche diodes (SPADs), are binary devices that output a signal when a photon is detected
Implementation Method 2
Avalanche photodiodes, and in particular single photon avalanche diodes (SPADs), are binary devices that output a signal when a photon is detected
Data Source
AI summary
An electronic device comprising circuitry configured to determine times that pass between photon arrivals at a pixel of an imaging sensor or within larger areas of the imaging sensor, and to convert these times into intensity signals.