Projection Mapping Camera Positioning and Shape Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing projection mapping techniques require expertise in imaging conditions, making it difficult for non-expert users to accurately project images onto three-dimensional objects, as they need to properly reflect a marker in the image for correction, which can be challenging without proper positioning and alignment.
Innovation Solution
An image generation method and system that displays a superimposed image with a user interface, allowing users to determine the camera position, and generates a corrected image by measuring the projection target object's shape using pattern images projected from the projector, enabling distortion correction and projection mapping without requiring expertise.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a marker-based correction technique is used for projection mapping, then the image correction accuracy is improved, but the operation complexity increases and requires specialized expertise
Solution Approach 1:
The patent extracts the marker detection function from the overall projection mapping process and replaces it with automatic corner detection algorithms. The system now detects corners directly from the projected pattern and captured image without requiring separate marker elements, thereby maintaining measurement precision while eliminating the need for specialized marker placement expertise
Solution Approach 2:
The system performs self-calibration by automatically detecting corners and computing distortion parameters without user intervention. The corner detection algorithm autonomously identifies feature points, and the distortion correction is automatically applied based on the geometric relationship between projected and captured images, making the process self-sufficient and eliminating the need for expert operation
2Manufacturing precision
If multiple captured images are used to measure the projection target object shape, then the manufacturing precision is improved, but the loss of time increases
Solution Approach 1:
The patent performs preliminary corner detection on all captured images simultaneously, identifying feature points in advance before the actual distortion correction computation. By pre-processing the images to extract corner coordinates and storing them for later use, the system reduces the computational burden during the correction phase, thereby maintaining high measurement precision while significantly reducing the overall processing time
Solution Approach 2:
The image processing is segmented into distinct stages: corner detection, coordinate storage, and distortion correction. This segmentation allows the system to process multiple images efficiently by handling corner detection independently for each image and then performing batch correction computations, optimizing the balance between measurement accuracy and processing time
Data Source
AI summary
An information processing apparatus causes a display apparatus to display a superimposed image obtained by superimposing a material image applied with transmission processing on a captured image obtained by imaging a projection target object, which is a projection target of an image from a projector, with a camera and a user interface image for receiving an input for determining a position of the camera. The information processing apparatus generates projection image data representing a projection image by correcting the material image according to a three-dimensional shape measured based on a captured image obtained by imaging, from the determined position, with the camera, the projection target object onto which a pattern image for three-dimensional measurement is projected from the projector and outputs the projection image data to the projector.