Diminished Reality Tool for AR Object Removal
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality applications face challenges in effectively removing unwanted real-world objects from images to facilitate the visualization of new virtual configurations, and accurately measuring spaces for proper fit analysis of virtual objects like kitchen cabinets.
Innovation Solution
A computer-based tool utilizing a reality staging engine and 3D modeler to declutter reality images by user-selectable diminished reality views, generating 3D models of environments with or without real-world objects, and enabling augmented reality subsystems to superimpose virtual elements for design analysis.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If augmented reality is used to visualize virtual objects in real environments, then design visualization capability is improved, but existing real-world objects obstruct the visualization of new virtual configurations
Solution Approach 1:
The patent extracts and removes unwanted real-world objects from the captured image through image processing techniques. The system identifies objects to be removed, creates masks for these objects, and eliminates them from the image to produce a cleaned background that allows unobstructed visualization of virtual design elements.
Solution Approach 2:
The patent creates a copy of the background environment without the obstructing objects. By generating a modified version of the real environment with removed objects, the system allows virtual objects to be superimposed and visualized as if the real objects were not present, while maintaining the authentic feel of the actual space.
2Adaptability or versatility
If real objects are removed from images to enable virtual configuration visualization, then design flexibility is improved, but measurement accuracy of the underlying space may deteriorate
Solution Approach 1:
The patent introduces an intermediary measurement layer that operates independently of the visual appearance of objects. The system captures geometric and spatial data from the environment, creating a measurement model that remains valid even when visual objects are removed or modified, thus preserving measurement accuracy while enabling design flexibility.
Solution Approach 2:
The patent segments the image processing into distinct functional layers: object removal for visualization purposes and geometric measurement for spatial analysis. By separating these functions, the system can remove objects from the visual display while maintaining intact measurement data for accurate spatial analysis and virtual object fitting.
3Adaptability or versatility
If image processing is used to remove real objects, then visualization quality is improved, but processing time and computational complexity increase
Solution Approach 1:
The patent applies partial action by selectively removing only the specific objects that obstruct design visualization, rather than processing the entire image uniformly. The system identifies and removes only the necessary objects while leaving other parts of the image intact, reducing processing time while maintaining visualization quality.
Solution Approach 2:
The patent performs preliminary object identification and segmentation before the actual removal process. By pre-processing the image to identify objects that need removal and preparing their masks in advance, the system optimizes the subsequent removal operation, reducing overall processing time and computational load during interactive design sessions.
Data Source
Figure 1
Figure 2A~2C
Figure 3A~3B
AI summary
A computer tool generates user-defined diminished reality images of a subject environment from source images. The diminished reality images display less real-world objects in the subject environment than that displayed in the source images. A 3D model of the subject environment in diminished reality is formed from the diminished reality images. The 3D model supports augmented reality user interaction with views of the subject environment diminished in reality and tidied/decluttered of user-selected objects.