Image Sensor Sub-pixel Temporal Multiplexing for Dual Sensing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional image sensors face a trade-off between image sensing and dynamic visual sensing, where implementing both functions simultaneously results in reduced image resolution and increased circuit configuration costs.

Innovation Solution

An image sensing device and method that utilizes a pixel array and readout circuit, where sensing sub-pixels are simultaneously exposed and read out during specific periods to store and retrieve signals, allowing for both image sensing and dynamic visual sensing within a single frame period without compromising resolution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If part of the sensing sub-pixels are used for image sensing and the other part for dynamic visual sensing, then both image sensing and dynamic visual sensing functions are implemented, but image resolution is reduced

Engineering Contradiction:
Improvedual sensing functionVSAvoidimage resolution
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The frame period is segmented into multiple distinct phases: first exposure period for image sensing, first readout periods for sequential readout of image signals, and dynamic visual sensing periods for motion detection. This temporal segmentation allows different sensing functions to operate at different times using the same physical sub-pixels, eliminating the need to divide sub-pixels spatially and thereby preserving full image resolution while enabling dual sensing capabilities

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic switching between different sensing modes within a single frame period. The sensing sub-pixels dynamically transition between image sensing mode (storing first sensing signals) and dynamic visual sensing mode (detecting motion events). This dynamic temporal multiplexing allows the system to adapt between different sensing functions without physical reconfiguration, resolving the contradiction between versatility and resolution

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If additional circuit configuration is added to implement both image sensing and dynamic visual sensing, then dual sensing functions are achieved, but device complexity increases

Engineering Contradiction:
Improvedual sensing functionVSAvoidcircuit configuration
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The same sensing sub-pixels and readout circuit are designed to perform multiple functions through temporal multiplexing. The sub-pixels can function as image sensing elements during the first exposure period and as dynamic visual sensing elements during the dynamic visual sensing periods. The readout circuit handles both image sensing signals and dynamic visual sensing signals using the same hardware infrastructure. This universal design eliminates the need for separate dedicated circuits for each sensing function, reducing overall device complexity while achieving dual sensing capabilities

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent employs periodic action by structuring the frame period into repeating cycles of exposure and readout phases. During each frame period, the system periodically alternates between image sensing exposure and dynamic visual sensing exposure. The readout circuit periodically reads out signals in designated first readout periods. This periodic temporal structure allows a single circuit configuration to handle multiple sensing functions through time-division multiplexing, avoiding the need for additional permanent circuitry

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables high-resolution image sensing and dynamic visual sensing during one frame period, improving image resolution and frame rate while maintaining low noise and high precision.

Implementation Method 1

the sensing sub-pixels are simultaneously exposed to respectively store multiple first sensing signals

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS11463643B2Image sensing device and image sensing method
Publication Date: 2022.10.04 GUANGZHOU TYRAFOS SEMICON TECH CO LTD
  • US11463643B2 patent drawing
  • US11463643B2 patent drawing
  • US11463643B2 patent drawing

AI summary

An image sensing device and an image sensing method are provided. The image sensing device includes a pixel array and a readout circuit. The pixel array includes multiple sensing sub-pixels arranged in an array. During a first exposure period of a frame period, the sensing sub-pixels are simultaneously exposed to respectively store multiple first sensing signals in multiple storage units of the sensing sub-pixels. During multiple first readout periods of the frame period, the readout circuit sequentially reads out the first sensing signals stored in the storage units during different periods. During each of multiple dynamic sensing periods of the frame period, all or part of the sensing sub-pixels are reset and then simultaneously exposed again, and the readout circuit then simultaneously reads out multiple second sensing signals of the sensing sub-pixels.