Virtual Object Overlay Using Marker-Based Perspective Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Online shopping for expensive items like paintings lacks sufficient visualization tools, making it difficult for users to make informed purchases without seeing the item in person, and returns can be challenging due to the inability to accurately assess the item's fit in a real environment.
Innovation Solution
A computing device uses a two-dimensional marker, such as a QR code, to overlay a virtual representation of the item onto the real-world environment, allowing users to view how the item would look in their space with accurate size, lighting, and perspective, enabling better decision-making before purchase.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If pictures and descriptions are provided online for expensive items like paintings, then users can view basic information, but users cannot accurately assess how the item will look in their real environment
Solution Approach 1:
The patent creates a virtual copy of the physical painting that can be displayed on the user's wall through the computing device. This virtual copy replicates the visual appearance, lighting, and perspective of the actual painting, allowing users to view it in their real environment without physically having the painting present. This resolves the information loss by providing complete visual information while avoiding the complexity of physical transportation and installation.
Solution Approach 2:
The computing device acts as an intermediary between the user and the painting. It captures images of the user's wall, processes them to determine perspective and lighting conditions, and displays the virtual painting through the camera viewfinder. This intermediary system provides accurate visualization information while keeping the system relatively simple by using existing camera and display hardware.
2Ease of operation
If users purchase expensive items online without seeing them in person, then online shopping convenience is maintained, but return rates increase due to inaccurate assessment
Solution Approach 1:
The system performs preliminary visualization before the user makes a purchase decision. By displaying the virtual painting in the user's actual environment through the camera viewfinder, the user can assess how it looks, feels, and fits their space before committing to the purchase. This preliminary viewing action reduces the likelihood of returns while maintaining online shopping convenience.
Solution Approach 2:
The system provides immediate visual feedback to the user about how the painting will appear in their environment. The camera viewfinder shows the virtual painting overlaid on the actual wall in real-time, allowing the user to see the perspective, lighting, and scale accurately. This feedback loop enables informed decision-making while maintaining the convenience of online shopping.
3Measurement precision
If physical items are shipped to users for examination before purchase, then accurate assessment is possible, but shipping costs and time increase
Solution Approach 1:
Instead of shipping the physical painting for examination, the system creates and displays a virtual copy in the user's environment. This virtual copy provides accurate visual information about the painting's appearance, size, and how it interacts with the user's lighting and space. The user can assess the item immediately without waiting for shipping, eliminating time loss while maintaining assessment accuracy.
Solution Approach 2:
The patent replaces the mechanical system of physical shipping and handling with a digital visualization system. The computing device captures images, processes lighting and perspective data, and displays the virtual painting through software. This substitution eliminates the time and cost of physical transportation while providing equivalent or superior assessment accuracy through controlled virtual lighting and perspective.
4Device complexity
If virtual representations are displayed without perspective correction, then display simplicity is maintained, but accurate representation of item in real environment is compromised
Solution Approach 1:
The system changes the parameters of the virtual painting display based on the captured wall image. It adjusts the perspective, scale, and lighting of the virtual painting to match the actual wall's orientation, distance, and lighting conditions. This parameter adjustment ensures accurate visual representation while using standard image processing techniques that don't significantly increase system complexity.
Solution Approach 2:
The system transitions from displaying a flat, two-dimensional image to creating a three-dimensional perspective-corrected view. By analyzing the wall's orientation and the camera's position, the system adjusts the virtual painting's perspective to match how it would actually appear on the wall. This dimensional adjustment provides accurate representation while leveraging the device's existing camera and display capabilities.
Data Source
AI summary
Systems and methods for displaying an image of a virtual object in an environment are described. A computing device is used to capture an image of a real environment including a marker. One or more virtual objects which do not exist in the real environment are displayed in the image based at least on the marker. The distance and orientation of the marker may be taken into account to properly size and place the virtual object in the image. Further, virtual lighting may be added to an image to indicate to a user how the virtual object would appear with the virtual lighting.