Digital Image Overlay Using 3D Space Models and Occlusion Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing signage systems, especially in public spaces, face challenges in efficiently overlaying digital information onto captured images without the need for marker surfaces or complex camera calibration, and struggle to accurately detect occluding objects.
Innovation Solution
A system that uses a 3D model of the real world space to position and overlay digital information onto captured images, employing camera parameters for calibration and detecting occluding objects based on image properties, allowing for the creation of an output image without the necessity of marker surfaces or extensive camera calibration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If marker surfaces are used to define object location in television pictures, then measurement precision is improved, but device complexity and ease of manufacture deteriorate due to the need for separate detecting devices and complex calibration
Solution Approach 1:
The patent extracts and removes the marker surfaces from the system by using natural features of the advertisement board itself (edges, corners, surfaces) for detection. The detection is performed using the television camera's own image processing capabilities rather than separate detecting devices, thereby eliminating the need for complex calibration between multiple detection systems while maintaining precise location definition.
Solution Approach 2:
The television camera serves multiple functions: it captures the advertisement board for broadcast and simultaneously detects the board's location and orientation through image processing of natural features. This eliminates the need for separate detecting devices and simplifies the system while maintaining measurement precision.
2Measurement precision
If marker surfaces are applied on advertisement boards for accurate detection, then measurement precision is improved, but ease of manufacture and object-generated harmful factors deteriorate due to additional marking requirements
Solution Approach 1:
The patent removes the requirement for applying marker surfaces on advertisement boards by extracting and utilizing the board's natural geometric features (edges, corners, surfaces) for detection. The image processing system identifies these inherent features through edge detection and feature recognition algorithms, eliminating the need for additional marking materials or preparation steps while maintaining detection accuracy.
3Measurement precision
If separate detecting devices are used to identify marking surfaces, then measurement precision is improved, but device complexity and loss of time increase due to additional detection equipment and calibration requirements
Solution Approach 1:
The television camera performs dual functions: capturing the advertisement board for broadcast and detecting its location and orientation through image processing. The same camera and processing system used for normal operation automatically identifies the board's features, eliminating the need for separate detecting devices and calibration procedures, thereby saving time while maintaining detection precision.
Solution Approach 2:
The system uses its own television camera and image processing capabilities to detect and identify the advertisement board's location and orientation without requiring external detecting devices or separate calibration processes. The board's natural features serve as self-identifying markers that the system can automatically recognize during normal operation.
Data Source
AI summary
A system for digitally overlaying an image with another image is disclosed. A storage is for storing a model of a real world space, wherein the model includes an overlay surface to be overlaid with an overlay image. A camera parameter interface is for receiving camera parameters. A camera image interface is for receiving at least one image. A positioner is for determining a position of the overlay surface within the at least one captured image based on the model and the camera parameters. A detector is for detecting an occluding object based on an image property of the occluding object and a detection image. An overlayer is for overlaying a non-occluded portion of the overlay surface in the selected captured image with the overlay image to obtain an output image.