Projector Tracking Moving Objects via Camera Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing digital projection systems face challenges in accurately projecting images onto moving objects, as they require cumbersome adjustments and may result in distorted images due to relative motion between projectors and targets, especially when multiple moving objects are involved.

Innovation Solution

A system comprising one or more projectors and cameras, where the projector projects digital images onto a projection area, and the camera captures images to determine the position and orientation of objects, allowing the system to adjust the projection to match the object's movement, ensuring predetermined portions of the image remain static relative to the object.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single projector is used to project onto multiple moving objects, then device complexity is reduced, but the ability to accurately track and project onto each object independently deteriorates

Engineering Contradiction:
Improvenumber of projectorsVSAvoidtracking accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system segments the projection task by assigning different regions of a single projector's output to different objects. The projector divides its projection beam into multiple independent regions, each tracked and adjusted for a specific object, allowing one projector to serve multiple objects without compromising tracking accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system adds a spatial dimension to the projection by projecting different portions of images onto different objects simultaneously. Instead of requiring multiple projectors along the same axis, the solution utilizes spatial distribution of projection regions and objects, allowing independent tracking of multiple objects from a single projector position.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Manufacturing precision

If the projector moves to track moving objects, then projection accuracy is improved, but ease of operation deteriorates due to cumbersome adjustments

Engineering Contradiction:
Improveprojection accuracyVSAvoidsystem adjustability
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

Instead of moving the projector to track objects, the system inverts the approach by keeping the projector stationary and moving the projection content virtually. The system adjusts which portions of the projected image are assigned to which objects, effectively tracking objects through software rather than physical movement.

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The system replaces the mechanical movement of the projector with a computational system. Cameras detect object positions and a processor calculates the appropriate projection mappings, substituting physical adjustment mechanisms with digital image processing and coordinate transformation algorithms.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Manufacturing precision

If multiple projectors are used to track multiple moving objects independently, then projection accuracy for each object is improved, but device complexity increases

Engineering Contradiction:
Improveindividual object projection accuracyVSAvoidnumber of projectors
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The single projector is made multi-functional by enabling it to simultaneously serve multiple objects. The system configures the projector to divide its output into multiple independent projection regions, each dedicated to tracking and projecting onto a different object, allowing one device to perform the work of multiple projectors.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system creates virtual copies of projection content for each object. Instead of requiring physical copies (multiple projectors), the system generates multiple virtual projection images from a single source, with each virtual copy tailored to the position, orientation, and characteristics of a specific object.

Inventive Principle:
Principle #26Copying

4Ease of operation

If projection is performed on moving objects without tracking adjustments, then ease of operation is maintained, but image distortion increases

Engineering Contradiction:
Improvesystem simplicityVSAvoidimage quality
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The projection system performs self-adjustment through automatic feedback. Cameras continuously monitor object positions, the processor automatically calculates required projection adjustments, and the system dynamically reconfigures the projection without user intervention. This maintains ease of operation while preventing image distortion through real-time adaptive tracking.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements a feedback loop where cameras detect object motion, the processor analyzes position changes, and the projection parameters are adjusted accordingly. This continuous feedback mechanism maintains image quality on moving objects while keeping the system simple to operate, as the adjustments occur automatically based on detected conditions.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP2824923B1Apparatus, system and method for projecting images onto predefined portions of objects
Publication Date: 2017.03.01 CHRISTIE DIGITAL SYSTEMS USA INC
  • EP2824923B1 patent drawing
  • EP2824923B1 patent drawing
  • EP2824923B1 patent drawing

AI summary

Apparatus, systems and methods are provided for illuminating objects in a projection area. The system includes a computing device, a projector and a camera. The computing device stores a digital model of an object, and illumination data having lighting parameters and a reference to the digital model. The projector, or another light source, projects structured light onto the projection area, and the camera simultaneously captures an image of the projection area. The computing device receives the captured image, determines a position and orientation of the object by comparing the digital model to the captured image, and then generates a canvas image including a region matching the determined position and orientation of the object. The projector projects the canvas image onto the projection area. A predefined portion of the object corresponding to the reference in the illumination data is thereby illuminated according to the lighting parameters.