Sketch-Based 3D Virtual Object Placement for Custom AR Content
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for populating computer-generated environments with virtual objects lack customizability as they rely on pre-existing libraries, limiting user creativity and flexibility.
Innovation Solution
A method and device for sketch-based placement of computer-generated graphical objects, where a 3D model is obtained from a user's sketch and placed within a graphical setting, allowing for real-time customization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If users select virtual objects from a pre-existing library, then the system maintains simplicity and reliability, but user customizability and flexibility are limited
Solution Approach 1:
The system captures images of physical objects using a camera and generates 3D models by copying the visual appearance and geometric structure from these images. This allows users to create custom virtual objects without manually modeling them, significantly enhancing customizability while keeping the system relatively simple.
Solution Approach 2:
The patent replaces traditional manual 3D modeling mechanisms with automated image-based 3D reconstruction. Instead of requiring users to manipulate complex modeling tools, the system automatically generates 3D models from photographs, substituting mechanical interaction with computational processing.
2Adaptability or versatility
If a 3D model is obtained from a sketch and used to generate a computer-generated object, then object customizability is enhanced, but processing time and computational complexity increase
Solution Approach 1:
The system performs preliminary actions by capturing images of physical objects in advance and pre-processing them to extract geometric and visual features. These pre-processed data are then quickly converted into 3D models when needed, reducing the time required for on-demand object creation.
Solution Approach 2:
The system creates simplified copies of physical objects by extracting key geometric and visual features from images rather than performing complete 3D scans. This copying approach maintains object customizability while significantly reducing computational complexity and processing time.
Data Source
AI summary
In some implementations, a method of sketch-based placement of computer-generated graphical objects includes: obtaining an input directed to a content creation region within a user interface, wherein the input corresponds to a sketch of a candidate object, and wherein the user interface includes the content creation region and a presentation region for computer-generated content; and in response to obtaining the input directed to the content creation region: presenting the sketch within the content creation region; obtaining a three-dimensional (3D) model using the input that corresponds to the sketch of the candidate object; generating a computer-generated graphical object using the obtained 3D model; and causing presentation of the computer-generated graphical object together with imagery obtained using the one or more cameras of the device within the presentation region while maintaining presentation of the sketch within the content creation region.