Virtual Object Overlay With Color Calibration for Real-Life Scenes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for matching the visual appearance of a trial object to an existing object are unreliable due to limited availability of dedicated appearance capture devices and the inability to accurately predict the appearance of trial objects, leading to potential waste and increased costs, especially when gonioapparent properties are involved.
Innovation Solution
A method and system for displaying a virtual object in a real-life scene using a target apparatus with color and illumination target elements to determine illumination and viewing conditions, applying color transformation parameters to ensure accurate comparison of the virtual object's appearance with the scene, allowing for real-time adjustments and seamless integration with the sample object.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If dedicated appearance capture devices are used to measure appearance attributes, then measurement precision is improved, but device complexity and availability worsen
Solution Approach 1:
The patent creates a virtual copy of the sample object with its appearance attributes (color, gloss, sparkle, coarseness) stored in a database. This virtual representation allows appearance matching without requiring physical presence of the sample object or specialized measurement devices at the comparison location, resolving the contradiction between measurement precision and device availability
Solution Approach 2:
The patent introduces a portable computing device as an intermediary that captures images of both the sample object and trial object, processes these images to extract appearance attributes, and performs the comparison. This intermediary approach replaces complex dedicated appearance capture devices with a portable device that has standard imaging capabilities, improving availability while maintaining measurement capability
2Manufacturing precision
If appearance attributes are measured and matched, then manufacturing precision is improved, but loss of time increases due to trial and error
Solution Approach 1:
The patent performs preliminary capture and storage of the sample object's appearance attributes in a database before any trial objects are produced. This preliminary action allows rapid comparison with trial objects later, eliminating the need for time-consuming physical measurement of each trial object and reducing iterative trial-and-error time
Solution Approach 2:
The patent replaces physical mechanical measurement systems with image processing and computational analysis. By capturing appearance attributes through standard imaging devices and processing images computationally, the system eliminates the need for specialized physical measurement equipment and reduces the time required for appearance comparison
3Measurement precision
If gonioapparent properties are considered in appearance matching, then measurement precision is improved, but device complexity and cost increase
Solution Approach 1:
The patent captures appearance attributes at multiple angles and positions to account for gonioapparent properties, but uses a portable computing device with standard imaging capabilities rather than a dedicated multi-angle appearance capture device. This partial action approach (capturing multiple views) achieves gonioapparent measurement without the full complexity and cost of specialized equipment
Data Source
AI summary
In a method for displaying a virtual object (140), a scene (100) is imaged. The scene comprises a target apparatus (120). The target apparatus comprises a set of color target elements (121) having known reflectance properties and at least one illumination target element (122) having a plurality of known surface normals. At least one image of the scene is processed to determine measured colors for the color target elements and illumination and viewing conditions for the scene. Color transformation parameters are calculated by comparing the measured colors and the known reflectance properties of the color target elements. The virtual object is rendered for the determined illumination and viewing conditions. The rendered virtual object is aligned with the scene. A color transformation is applied to the imaged scene and/or to the virtual object, and an overlay of the rendered virtual object with the imaged scene is displayed on a display device (220) in real time while the illumination and/or viewing conditions are changed.