Hybrid Image Decomposition for Multi-Projector Misalignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current multiple projector systems face challenges in achieving accurate image registration due to measurement errors, optical nonuniformity, thermal drift, and mechanical vibration, leading to image degradation when projecting high-resolution images, especially at 4K or higher resolutions, and digital pixel resampling limits the quality of superimposed images.

Innovation Solution

A hybrid image projection method that decomposes an input image into orthogonal or quasi-orthogonal components, allowing each projector to display less correlated image components, which are then superimposed to maintain image quality even with misalignment, and increases image intensity resolution by leveraging the number of projectors, enabling flexibility with heterogeneous projectors and improved brightness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If multiple projectors are used to superimpose images to increase brightness and reduce screen door effect, then image brightness and quality are improved, but image registration accuracy deteriorates due to measurement errors, optical nonuniformity, thermal drift, and mechanical vibration

Engineering Contradiction:
Improveimage brightnessVSAvoidimage registration accuracy
Core Design Contradiction:
Illumination intensityVSMeasurement precision

Solution Approach 1:

The input image is decomposed into multiple components (e.g., low-frequency and high-frequency components, or components with different spatial resolutions) that are then assigned to different projectors. This segmentation allows each projector to display a specific component rather than requiring perfect alignment of complete images, thereby reducing the impact of registration errors while maintaining overall image quality and brightness.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If warping engines are used to warp one projected image onto another to achieve alignment, then image registration is improved, but image quality deteriorates due to digital pixel resampling and high frequency information loss

Engineering Contradiction:
Improveimage registration accuracyVSAvoidhigh frequency information loss
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The high-frequency information is extracted and separated from the low-frequency information through image decomposition. The high-frequency components are then displayed by dedicated projectors without undergoing warping or resampling operations that would degrade their quality. This extraction approach preserves the sharp edges and fine details that would otherwise be lost in traditional warping-based alignment methods.

Inventive Principle:
Principle #2Taking out (Extraction)

3Illumination intensity

If more projectors are superimposed to increase dynamic brightness range, then brightness is improved, but alignment accuracy becomes more challenging and image degradation increases

Engineering Contradiction:
Improvedynamic brightness rangeVSAvoidalignment accuracy
Core Design Contradiction:
Illumination intensityVSReliability

Solution Approach 1:

The image decomposition divides the original image into multiple components that are inherently more robust to misalignment. When multiple projectors display these segmented components, the human visual system integrates them into a coherent image even with slight misalignments, allowing the system to scale to more projectors without proportionally increasing alignment difficulty or image degradation.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP3675481B1Hybrid image decomposition and projection
Publication Date: 2024.11.20 IMAX CORP
  • EP3675481B1 patent drawingFigure 1
  • EP3675481B1 patent drawingFigure 2
  • EP3675481B1 patent drawingFigure 3

AI summary

Hybrid image projection systems and methods can superimpose image components of an input image. An input image can be divided into smaller regions and at least one parameter of each region can be determined. The input image can be decomposed based on the parameter of each region into multiple, less correlated, orthogonal or quasi-orthogonal image components. Each projector can display respective image components so that the images projected may be optically superimposed on a screen. The superposition of orthogonal or quasi-orthogonal image components can result in superposition of images in an existing multi-projector image systems being more insensitive to inter-projector image misalignment. Superimposing orthogonal or quasi-orthogonal images can be used to avoid visible image degradation, and provide more robust image quality in a multiple projector system implementation.