Continuous Time Imaging Sensor Eliminates Video Aliasing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional frame-based video technology suffers from aliasing errors and loss of information due to shutter opening and closing, which limits its ability to capture and display motion accurately, especially at high speeds, as it does not align with the human visual system's response.

Innovation Solution

The implementation of a continuous time imaging sensor array that captures photons without discontinuity, using a sigma delta modulator to produce continuous time binary analog signals, which are then aggregated to create a frame-free video stream, allowing for continuous time video processing and display without traditional frame boundaries.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If frame-based video with shutter is used, then video can be captured and displayed, but aliasing errors and loss of information occur due to shutter opening and closing

Engineering Contradiction:
Improveaccuracy of motion captureVSAvoidphotons lost during shutter operation
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent implements continuous exposure of the imaging sensor without periodic shutter closure, maintaining continuous integration of incident photons. This eliminates the information loss that occurs during shutter opening and closing operations in traditional frame-based video systems.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The patent applies a continuous low-pass filter to the video signal before display, pre-processing the signal to remove high-frequency aliasing components. This preliminary filtering prevents aliasing errors from manifesting in the final video output.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If frame rate is increased to reduce aliasing, then motion smoothness improves, but the fundamental aliasing problem persists due to periodic sampling

Engineering Contradiction:
Improvetemporal bandwidthVSAvoidaliasing errors
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent uses continuous exposure and continuous low-pass filtering instead of periodic sampling, eliminating the fundamental aliasing problem that persists even at high frame rates in traditional systems.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The patent introduces a continuous low-pass filter as an intermediary between the imaging sensor and display, which mediates the video signal to remove high-frequency components that would otherwise cause aliasing errors.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of manufacture

If traditional frame-based video is used, then video processing is simplified, but motion accuracy deteriorates due to discrete frame sampling

Engineering Contradiction:
Improvevideo processing simplicityVSAvoidmotion capture accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent implements continuous exposure and continuous filtering, providing accurate motion representation. While this approach is more complex than traditional framing, it delivers superior motion accuracy for high-speed applications.

Inventive Principle:
Principle #20Continuity of useful action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach eliminates aliasing errors, ensures no loss of photons, provides a more accurate representation of motion, and enhances the signal-to-noise ratio, resulting in improved realism and compatibility with human visual perception, suitable for applications requiring high dynamic range and fast motion handling.

Implementation Method 1

continuously capturing photons incident on pixels in an imaging array to produce respective continuous time analog signals

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS11558576B2Methods and systems for representing video in continuous time
Publication Date: 2023.01.17 SOLSONA MULTIMEDIA INC
  • US11558576B2 patent drawing
  • US11558576B2 patent drawing
  • US11558576B2 patent drawing

AI summary

The present invention encompasses methods and systems of representing video in continuous time. Photons incident on pixels in an imaging array are continuously captured using a continuous time imaging sensor array to produce respective continuous time analog signals without any discontinuity in time. At each pixel, the respective continuous time analog signal is modulated into respective continuous time binary analog signals. The continuous time binary analog signals from all pixels are aggregated to produce a frame free video. Each pixel may comprise a continuous time sigma delta modulator and a photodiode having a capacitance. At each pixel, the respective continuous time analog signal is modulated using the continuous time sigma delta modulator to produce the corresponding continuous time binary analog signal. The capacitance of the photodiode functions as a charge integrator.