Bio-inspired Retina-like Ghost Imaging for 360-Degree Panoramic Reconstruction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional panoramic imaging technologies face challenges such as high costs for non-visible light band imaging and difficulties in harsh environments like atmospheric turbulence and scattering media, with limited research on achieving high-resolution, real-time, and large field of view imaging.

Innovation Solution

An omnidirectional ghost imaging method based on the bio-inspired retina-like mechanism, utilizing logarithmic polar mapping to generate annular patterns for modulating light sources, which are reflected and correlated to reconstruct 360-degree images without distortion, combining with catadioptric panoramic imaging to expand the field of view.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional panoramic imaging technology is used, then imaging can be achieved, but the cost is high and imaging quality deteriorates in harsh environments such as atmospheric turbulence and scattering media

Engineering Contradiction:
Improveimaging quality in harsh environmentsVSAvoidatmospheric turbulence and scattering media effects
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent uses ghost imaging to create a copy of the target image through correlation calculation between bucket detector signals and reference light patterns, rather than direct imaging. This copying approach bypasses the harmful effects of atmospheric turbulence and scattering media that degrade conventional direct imaging quality in harsh environments.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent changes the imaging parameter from direct optical imaging to statistical correlation imaging. By measuring light intensity fluctuations and performing correlation calculations with reference patterns, the system achieves imaging that is insensitive to atmospheric turbulence and scattering media, thereby improving reliability in harsh environments.

Inventive Principle:
Principle #35Parameter changes

2Ease of manufacture

If conventional imaging methods are used, then imaging can be achieved, but the structure is complex and cost is high for non-visible light band imaging

Engineering Contradiction:
Improveimaging system structure and costVSAvoidimaging system structure
Core Design Contradiction:
Ease of manufactureVSDevice complexity

Solution Approach 1:

The patent extracts only the total light intensity information using a simple bucket detector, removing the need for complex array detectors and optical systems required for conventional non-visible light band imaging. This extraction approach simplifies the system structure and reduces manufacturing cost while maintaining imaging capability.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent replaces complex mechanical/optical imaging systems with a computational approach. Instead of using complex non-visible light band optical systems, the invention uses visible light with modulated patterns and performs correlation calculations computationally, thereby simplifying the physical system structure and reducing cost.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If ghost imaging is used to improve imaging quality and speed, then imaging resolution and anti-interference ability are improved, but the field of view is limited

Engineering Contradiction:
Improveimaging resolutionVSAvoidfield of view
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The patent introduces a temporal dimension to the ghost imaging process by using time-varying modulated light patterns and corresponding bucket detector measurements. This temporal dimension allows the system to achieve both high resolution through correlation calculation and large field of view through the catadioptric optical design, resolving the trade-off between resolution and field of view.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables high-quality, undistorted panoramic imaging with a simple structure, overcoming the limitations of conventional panoramic imaging by achieving 360-degree imaging with high resolution and speed, expanding the application fields of ghost imaging.

Implementation Method 1

the modulated light illuminates the target around the curved mirror, and the light after being reflected by the target

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

combining with catadioptric panoramic imaging method

Methodology Applied
Scientific EffectCatadioptric reflection: Reflection

Implementation Method 3

the modulated light illuminates curved minor. After being reflected by the target around the curved minor

Methodology Applied
Scientific EffectCurved mirror focusing: Lens

Implementation Method 4

According to the mapping characteristics of logarithmic polar coordinates of bio-inspired retina-like, the reconstructed image is transformed into logarithmic polar coordinates

Methodology Applied
Scientific EffectLogarithmic polar transformation:

Data Source

PatentUS12126911B2Omnidirectional ghost imaging method and system based on the mechanism of bio-inspired retina-like
Publication Date: 2024.10.22 BEIJING INST OF TECH
  • US12126911B2 patent drawing
  • US12126911B2 patent drawing
  • US12126911B2 patent drawing

AI summary

An omnidirectional ghost imaging system based on a mechanism of bio-inspired retina-like includes a projection system, a collimating lens, a spectroscope, a curved mirror, a bucket detector, a data acquisition card and an arithmetic system. According to the application, the logarithmic polar mapping characteristic of the bio-inspired retina-like structure is utilized to generate an annular pattern sequence of the bio-inspired retina-like, and the pattern sequence is utilized to modulate a light source. After being reflected by the target around the curved mirror, the light is projected onto the curved mirror and diffusely reflected. According to the reversible characteristics of the optical path, the light after diffuse reflection is reflected to the original light source by the half mirror and half lens, and the reflected light intensity with target information is received by the bucket detector.