In-time Image Registration Using Augmented Reality Overlays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image registration methods for temporally separated acquisitions are ineffective in ensuring consistent camera and subject positioning, often requiring physical restraints that are cumbersome, expensive, and difficult to configure.

Innovation Solution

The use of augmented reality-capable image acquisition systems with non-contact position sensors and real-time feedback overlays allows for in-time registration of images without physical restraints, enabling accurate alignment of camera and subject positions between sessions using live view comparison and guide overlays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If physical structures (bars, boxes, platforms) are used to guide or hold the subject and camera, then the relative position and orientation between camera and subject can be maintained, but the device complexity and cost increase significantly

Engineering Contradiction:
Improveposition consistencyVSAvoidstructure complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces physical mechanical structures (bars, boxes, platforms) with a computational system consisting of image processing algorithms and computer vision techniques. The system uses feature detection, template matching, and coordinate transformation to achieve image registration without any physical guiding structures, thereby eliminating the complexity and cost of mechanical systems while maintaining position consistency.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a digital copy of the reference image and uses image processing techniques to transform and align it with the new image. By working with digital copies and mathematical transformations rather than physical structures, the system achieves precise registration without the complexity of mechanical guidance systems.

Inventive Principle:
Principle #26Copying

2Productivity

If traditional image registration approaches are used, then some image alignment can be achieved, but the registration accuracy deteriorates when there is appreciable change in position or orientation

Engineering Contradiction:
Improveimage acquisition speedVSAvoidregistration accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent performs preliminary actions by detecting key features and establishing coordinate transformations during the first image acquisition. By pre-processing and storing transformation parameters, the system can quickly register subsequent images with high accuracy even when position or orientation changes appreciably, without requiring time-consuming manual alignment.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent extends traditional 2D image registration to 3D spatial coordinate transformations. By incorporating depth information and three-dimensional transformation matrices, the system can accurately register images even when there are significant changes in camera position or orientation, overcoming the limitations of planar registration methods.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Reliability

If physical restraints are used to maintain camera and subject positioning, then image comparability is improved, but the ease of operation deteriorates due to cumbersome setup

Engineering Contradiction:
Improveimage comparabilityVSAvoidsetup ease
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent eliminates the need for physical restraints by replacing them with computational image registration methods. The system automatically calculates transformation parameters and aligns images through software processing, making the setup process simple and intuitive while maintaining high image comparability across different acquisition conditions.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10542225B2In-time registration of temporally separated images acquired with image acquisition system having three dimensional sensor
Publication Date: 2020.01.21 EPITOMYZE INC
  • US10542225B2 patent drawing
  • US10542225B2 patent drawing
  • US10542225B2 patent drawing

AI summary

Embodiments facilitate in-time registration of temporally separated image acquisition sessions to obtain highly comparable images without physical restraint of the camera and/or subject. For example, while displaying a live view being acquired of a subject in real time in a viewfinder window of an image acquisition system, a live position of the system can be measured, a real-time offset can be computed between the live position and a guide position (corresponding to a position from which a prior image of the subject was acquired at a prior acquisition time), and a guide can be overlaid on the viewfinder window to indicate a real-time positional offset between the live view and the prior image according to the real-time offset. A present image of the subject can be acquired when the guide indicates an in-time registration between the live view and the prior image.