3D-Calibrated Image Projection for Moving Object Surfaces

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing projection technologies struggle to project undistorted images on moving objects due to movement errors and require complex setups for high-speed, high-luminance projection, especially for full-color images, and calibration between visible and non-visible light projections.

Innovation Solution

An image projection system using separate infrared and visible light projection apparatuses with a calculation device for simultaneous measurement and calibration processing, employing a simple configuration to associate pixels between the two projections.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If separate infrared and visible light projection apparatuses are used to achieve high luminance and high-speed projection, then projection quality and speed are improved, but device complexity and calibration difficulty increase

Engineering Contradiction:
Improveprojection speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent combines the infrared projection apparatus and visible light projection apparatus into a single integrated projection device. The infrared light source and visible light source are merged into one projection system, allowing both measurement patterns and content images to be projected through a unified optical path and single DMD device, thereby reducing device complexity while maintaining high-speed projection capability

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The projection apparatus is designed with multi-functionality to perform both measurement projection (infrared patterns) and content image projection (visible light) using the same hardware components. The single DMD device and optical system serve dual purposes, eliminating the need for separate apparatuses and reducing overall system complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Device complexity

If one DMD is used for high-speed projection of four types of light, then device complexity is reduced, but projection speed and luminance are limited

Engineering Contradiction:
Improveoptical system complexityVSAvoidprojection speed
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent employs periodic time-division multiplexing where the single DMD alternates between projecting infrared measurement patterns and visible light content images at high speed. The DMD switches between different light sources and projection modes in periodic cycles, enabling both functions to be performed sequentially at maximum speed without requiring separate DMD devices, thus maintaining high projection speed while simplifying the optical system

Inventive Principle:
Principle #19Periodic action

3Measurement precision

If visible light projection stops for measurement processing, then measurement accuracy is improved, but image quality and continuity deteriorate

Engineering Contradiction:
Improvemeasurement accuracyVSAvoidvideo continuity
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system implements periodic time-division multiplexing where the single DMD alternates between projecting infrared measurement patterns and visible light content images at high speed. The switching occurs in periodic cycles so brief that human observers perceive continuous video, while the infrared measurement patterns are captured at sufficiently high frequency to maintain measurement accuracy

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent maintains continuous projection of visible light content images while interleaving infrared measurement patterns in the time domain. The projection process never fully stops; instead, both measurement and content projection occur continuously in alternating time slots, ensuring both measurement accuracy and video continuity are preserved

Inventive Principle:
Principle #20Continuity of useful action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables high-speed, high-luminance projection of undistorted images on moving objects by simplifying the calibration and measurement processes, reducing distortion and shift, and maintaining image quality without delay.

Implementation Method 1

a non-visible light projection apparatus for projecting a non-visible light pattern image toward the projection target... an imaging device for imaging the non-visible light pattern image projected by the non-visible light projection apparatus

Methodology Applied
Scientific EffectInfrared radiation reflection: Infrared Radiation

Implementation Method 2

a visible light projection apparatus for projecting a visible light pattern image toward the projection target... for executing calibration processing in which correspondence information is acquired between each pixel of the visible light pattern image projected by the visible light projection apparatus and each pixel of the captured visible light image

Methodology Applied
Scientific EffectVisible light projection: Light

Data Source

PatentEP4216541B1Image projection system and image projection method
Publication Date: 2026.04.01 PANASONIC PROJECTOR & DISPLAY CORPORATION
  • EP4216541B1 patent drawingFigure 1
  • EP4216541B1 patent drawingFigure 2
  • EP4216541B1 patent drawingFigure 3

AI summary

An image projection system includes an infrared ray projection apparatus that projects a pattern image for shape measurement toward a projection target, an imaging device that captures the pattern image, a calculation device that acquires three-dimensional shape information of the projection target based on the captured pattern image and converts a content image into a projection content image corresponding to the projection target based on the three-dimensional shape information, and a visible light projection apparatus that is disposed in a different position from the infrared ray projection apparatus and projects the projection content image toward the projection target, in which the calculation device, based on images of a visible light image projected by the visible light projection apparatus and a non-visible light image projected by the infrared ray projection apparatus, executes processing of associating each pixel of the non-visible light image with each pixel of the visible light image.