Projector Camera On-line Sensing via Corner Point Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for on-line sensing with moving images require synchronization of projector and camera projections, and often necessitate the use of specialized devices like IR light sources, limiting their applicability.
Innovation Solution
An image processing apparatus that generates a corrected image based on projector attitude estimation, detects image corner corresponding points, and estimates projector attitude without synchronization or specialized devices, using a correction unit, image corner correspondence detection unit, and attitude estimation unit.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If synchronization is used between projector and camera for moving images, then corresponding points can be detected accurately, but the system complexity increases and requires specialized devices
Solution Approach 1:
The patent extracts the synchronization requirement by using a still image (pattern image or still image picture) that is continuously projected, separating the correspondence detection function from the temporal synchronization function. This allows corresponding points to be detected without requiring complex synchronization mechanisms between projector and camera.
Solution Approach 2:
The patent makes the projector universal by enabling it to function both as a moving image projector and as a still image projector for on-line sensing. The same projector hardware can project either moving images or continuously projected still images depending on the application, eliminating the need for specialized IR projectors or dedicated sensing hardware.
2Ease of operation
If IR light source is used for on-line sensing without synchronizing, then synchronization is not required, but additional specialized devices are needed
Solution Approach 1:
The patent makes the standard projector universal by enabling it to project still images for on-line sensing in addition to its primary moving image function. This eliminates the need for specialized IR projectors or additional sensing devices, as the existing projector can serve dual purposes.
Solution Approach 2:
The system uses the projector's own output (the projected image) as the sensing target for the camera. The projector projects an image, the camera captures it, and corresponding points are detected from the captured image itself, without requiring external IR light sources or separate sensing mechanisms. The system serves itself using its existing components.
3Ease of operation
If still image is continuously projected, then corresponding points can be detected without synchronizing, but the application is limited to still images
Solution Approach 1:
The patent implements periodic action by having the projector continuously project the same still image pattern at regular intervals. This periodic projection of the still image allows the camera to capture the image at any timing without requiring synchronization, while the continuous repetition ensures that corresponding points can always be detected. The system alternates between moving image projection and still image projection for sensing.
Data Source
AI summary
The present disclosure relates to an image processing apparatus and a method capable of performing on-line sensing without synchronizing and without using a specialized device. An image corner corresponding point detection unit detects an image corner of an input image from a captured image captured by a camera, and associates four image corner points of a corrected image to be projected by a projector with four image corner points of the detected captured image, thereby detecting four image corner corresponding points. An attitude estimation unit estimates a relative attitude of the projector and the camera from the four image corner corresponding points. The present disclosure can be applied to, for example, a projection imaging device that projects an image with a projector, captures the image projected by the projector, and updates a presentation position.