Continuous Image Calibration for Projected Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image projection systems on complex, non-planar surfaces require manual calibration and frequent maintenance, leading to misalignment issues during operation, especially in applications with movement like flight simulators.

Innovation Solution

A system and method using registration devices like cameras to continuously calibrate images by detecting fiducial and reference markers, calculating geometric transformations, and applying image warps to maintain seamless displays on non-planar surfaces during normal operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If manual calibration is performed once in a time period from daily to yearly, then the calibration process is simple and requires minimal resources, but the images become misaligned during operation due to movement and vibration

Engineering Contradiction:
Improveimage alignment stabilityVSAvoidcalibration system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system continuously captures images of the screen during operation, detects fiducial markers and reference markers, compares their positions, and automatically adjusts the projected images to maintain alignment. This closed-loop feedback mechanism ensures images remain aligned despite movement or vibration, resolving the contradiction between reliability and complexity by automating the calibration process.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The calibration system performs self-calibration during normal operation without requiring external intervention. The registration device automatically detects marker positions, calculates geometric transformations, and applies image warps to correct alignment issues, allowing the system to maintain itself continuously during operation rather than requiring periodic manual calibration.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If separate maintenance or alignment sequence is required, then the calibration can be performed thoroughly, but it interrupts normal operation and requires additional time

Engineering Contradiction:
Improvecalibration accuracyVSAvoidsystem operational continuity
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The calibration process is integrated into the normal operation of the display system, allowing continuous calibration without interruption. The system performs calibration repeatedly or continually during image display, ensuring both high calibration accuracy and uninterrupted productivity by eliminating the need for separate maintenance sequences.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The system prepares for calibration by pre-defining fiducial markers on the screen and incorporating reference markers into the projected images before calibration begins. This preliminary setup enables the calibration process to proceed smoothly and accurately during operation without requiring interruption or additional preparation time.

Inventive Principle:
Principle #10Preliminary action

3Area of stationary object

If multiple projectors are used to create seamless images, then the coverage area increases, but alignment issues occur when projectors move due to vibration or motion platforms

Engineering Contradiction:
Improvedisplay coverage areaVSAvoidimage alignment reliability
Core Design Contradiction:
Area of stationary objectVSReliability

Solution Approach 1:

The system continuously monitors the positions of fiducial markers and reference markers from multiple projectors, detects any misalignment caused by movement or vibration, and automatically adjusts each projector's output in real-time. This feedback mechanism maintains reliable alignment across the entire display coverage area even when projectors are mounted on motion platforms or subjected to vibration.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The calibration system is designed to be dynamic, continuously adapting to changes in projector positions caused by vibration or motion. Rather than relying on static calibration, the system performs repeated calibrations during operation, allowing multiple projectors to maintain seamless alignment despite dynamic environmental conditions.

Inventive Principle:
Principle #15Dynamics

4Reliability

If fiducial markers are defined on the screen and reference markers are added to projected images, then continuous alignment can be achieved, but the system complexity increases

Engineering Contradiction:
Improvealignment stability during operationVSAvoidcalibration system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system automatically performs all calibration operations including detecting fiducial markers, detecting reference markers, calculating mappings, and applying image warps without external intervention. This automation justifies the added complexity by eliminating the need for manual calibration procedures and ensuring continuous alignment stability during operation.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The fiducial markers on the screen and reference markers in the projected images serve as intermediaries that facilitate the calibration process. These markers enable the registration device to accurately detect and measure alignment without directly interacting with the complex projection system, simplifying the measurement process while maintaining alignment stability.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables continuous alignment and blending of images on complex surfaces, preventing misalignment due to movement and reducing the need for separate calibration processes, ensuring accurate and stable image projection during operation.

Implementation Method 1

detecting, by a registration device, such as a camera, the plurality of fiducial markers in an image of the screen

Methodology Applied
Scientific EffectOptical detection: Photography

Data Source

PatentUS11375165B2Image calibration for projected images
Publication Date: 2022.06.28 PLEXSYS INTERFACE PROD INC
  • US11375165B2 patent drawing
  • US11375165B2 patent drawing
  • US11375165B2 patent drawing

AI summary

Systems, methods and apparatus to continuously calibrate images displayed on a screen or surface by one or more projection devices during display of the images are disclosed. The systems, methods and apparatus comprise defining a plurality of fiducial markers on the screen, detecting, by a registration device, such as a camera, the plurality of fiducial markers in an image of the screen, adding a plurality of reference markers to an image displayed on the screen, detecting, by the registration device, the plurality of reference markers in the displayed image, determining a mapping between positions of the reference markers on the screen to positions of the reference markers in the displayed images, calculating an image warp based on the mapping and a layout of the images to be displayed and applying the image warp to images from an image generator to produce geometrically corrected images for display on the screen.