Automated Fundus Montage via Offset Vector Triplet Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current fundus imaging techniques face challenges in producing accurate, consistent planar representations of the spherical fundus surface due to wide-angle lens distortions and the need for manual image stitching, which is time-consuming and prone to inaccuracies.

Innovation Solution

A device and method incorporating a local matching module for determining best offset vectors between overlapping images and a global matching module to align triplet images with zero offset vector sum, along with a projection and optimization module to create a consistent spherical montage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual image matching is used, then image alignment accuracy can be achieved, but time consumption increases significantly

Engineering Contradiction:
Improveimage alignment accuracyVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces manual mechanical image matching with an automated computer-based system that uses offset vector calculations and triplet matching algorithms to automatically align retinal images, eliminating the need for manual intervention while maintaining alignment accuracy

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs self-matching by automatically calculating offset vectors between overlapping images and identifying triplets with zero offset vector sum, enabling the montage process to complete itself without external manual operation

Inventive Principle:
Principle #25Self-service

2Area of stationary object

If wide angle lens is used to capture larger fundus area, then field of view increases, but image resolution deteriorates

Engineering Contradiction:
Improvefield of viewVSAvoidimage resolution
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent divides the fundus imaging into multiple separate images taken with a moderate field of view lens, then automatically stitches these segmented images together using offset vector matching to create a comprehensive montage that maintains both resolution and coverage

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from attempting to capture the entire fundus in a single two-dimensional image to creating a composite montage by combining multiple two-dimensional images through automated geometric matching and stitching algorithms

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Area of stationary object

If wide angle lens is used, then larger fundus area is captured, but image distortion increases

Engineering Contradiction:
Improvefundus coverage areaVSAvoidimage distortion
Core Design Contradiction:
Area of stationary objectVSShape

Solution Approach 1:

The patent replaces optical distortion correction with a computational approach, using automated offset vector calculations and triplet matching algorithms to geometrically align and stitch multiple images, thereby eliminating wide-angle distortion without sacrificing field of view

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Productivity

If automatic local matching of image pairs is implemented, then processing speed improves, but global consistency is lost

Engineering Contradiction:
Improveprocessing speedVSAvoidglobal consistency
Core Design Contradiction:
ProductivityVSStability of the object's composition

Solution Approach 1:

The patent merges multiple local image pairs into global triplets by identifying sets of three images where the offset vectors sum to zero, thereby combining the speed benefits of automatic local matching with the global consistency required for accurate fundus montages

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS8126289B2Device, method and system for automatic montage of segmented retinal images
Publication Date: 2012.02.28 MERATIVE US LP
  • US8126289B2 patent drawing
  • US8126289B2 patent drawing
  • US8126289B2 patent drawing

AI summary

Some embodiments of the present invention may relate to a device and a method of enabling an automatic global matching of a plurality of images to provide a substantially consistent planar representation of a fundus. According to some embodiments of the invention, a device for enabling an automatic global matching of a plurality of images to provide a substantially consistent planar representation of a fundus may include a local matching module and a global matching module. The local matching module may be adapted to locally match a pair of overlapping images. As part of locally matching the images, the local matching module may be adapted to provide a best offset vector for the images based upon a matching of features from overlapping portions of the images. The global matching module may be adapted to globally match at least a triplet of locally matching pairs of images whose best offset vector sum is substantially zero.