Projector-Camera Augmented Reality for Non-Planar Surfaces
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems struggle to create a compelling augmented reality experience on uneven or non-uniform surfaces by compensating for variations in surface geometry, leading to image distortion.
Innovation Solution
A system comprising a projector, camera, and processing computing device that recognizes the underlying surface geometry, registers a scene within a three-dimensional coordinate system, and controls the projector to display the scene undistorted onto the arbitrary surface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If an image is projected onto an uneven or non-uniform surface without compensation, then the projection process is simple, but the image suffers from distortion and the augmented reality experience is compromised
Solution Approach 1:
The system performs preliminary actions by capturing images of the target surface and computing a distortion compensation map before projection. The processor analyzes the surface geometry in advance and pre-calculates the undistorted image that should be projected, allowing the projection to achieve high accuracy without real-time complex computations during the actual projection process.
Solution Approach 2:
The patent introduces an intermediary distortion compensation map between the original image and the projected image. This intermediate representation contains the pre-computed geometric transformations needed to correct for surface unevenness, acting as a mediator that translates the flat image into a surface-appropriate projection pattern without requiring complex real-time adjustments.
2Manufacturing precision
If the surface geometry is not recognized, then the system operation is simpler, but the projected image becomes distorted on arbitrary surfaces
Solution Approach 1:
The system creates a digital copy or representation of the physical surface geometry by capturing images with the camera and processing them to generate a distortion map. This digital model of the surface allows the system to understand and compensate for geometric variations without requiring direct physical measurement or complex sensing of the actual surface.
3Measurement precision
If high-resolution undistorted imagery is projected onto non-planar surfaces, then the augmented reality experience is compelling, but the projection system becomes more complex
Solution Approach 1:
The patent transitions from two-dimensional image projection to three-dimensional surface adaptation by incorporating depth information and surface geometry into the projection process. The system maps the 2D image onto the 3D surface coordinates, allowing high-resolution imagery to be accurately projected onto non-planar surfaces by accounting for the additional spatial dimension of surface variation.
Data Source
AI summary
An augmented reality scene may be registered onto an arbitrary surface. A camera may capture an image of the arbitrary surface. The camera may analyze the surface geometry of the arbitrary surface. In some embodiments, a processing computing device may analyze data captured by the camera and an adjacent camera to reconstruct the surface geometry of the arbitrary surface. A scene may be registered to a three dimensional coordinate system corresponding to the arbitrary surface. A projector may project the scene onto the arbitrary surface according to the registration so that the scene may not display as being distorted.