Sketch-Based Virtual Object Placement for Customizable 3D Scenes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for populating computer-generated rooms with virtual objects limit customizability by relying on pre-existing libraries, restricting user creativity and flexibility.
Innovation Solution
A method and device for sketch-based placement of computer-generated graphical objects, where a 3D model is obtained from a user's sketch and placed within a computer-generated graphical setting, allowing for real-time customization and placement based on the sketch's location and angle.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If users select virtual objects from a pre-existing library, then the system maintains simplicity and reliability, but customizability and user creativity are limited
Solution Approach 1:
The patent introduces an intermediary processing system that converts simple 2D sketches into 3D models. The sketch processing module acts as a mediator between user input and the virtual object library, automatically generating 3D representations from 2D drawings and matching them with appropriate virtual objects, thereby enabling customization without requiring users to manually create complex 3D models
Solution Approach 2:
The system creates simplified 2D sketch copies of desired objects instead of requiring users to work with complex 3D models directly. Users draw 2D representations that are then processed and converted into 3D virtual objects, making the customization process more accessible and intuitive while maintaining system reliability
2Adaptability or versatility
If a 3D model is obtained from a sketch and placed in real-time, then customizability and user flexibility are enhanced, but processing time and computational resources increase
Solution Approach 1:
The system performs preliminary processing by pre-establishing libraries of 3D models and object templates. When a user submits a sketch, the system matches it against pre-prepared 3D models in the library rather than generating entirely new models in real-time, significantly reducing processing time while maintaining customization capabilities
Solution Approach 2:
The system processes only the essential features of sketches needed for identification and matching, rather than performing complete 3D reconstruction. By focusing on key geometric characteristics and using approximate matching algorithms, the system achieves satisfactory results with reduced computational overhead and faster processing
Data Source
Figure 1
Figure 2
Figure 3
AI summary
In some implementations, a method of sketch-based placement of computer-generated graphical objects is performed at a device including one or more cameras and non-transitory memory coupled to one or more processors. The method includes obtaining an input directed to a content creation interface (e.g., a sketchpad), wherein the input corresponds to a sketch of a candidate object, and wherein the content creation interface facilitates creation of computer-generated graphical objects presentable using the device. The method also includes: obtaining a three-dimensional (3D) model using the input that corresponds to the sketch of the candidate object; generating a computer-generated graphical object using the obtained 3D model; and causing presentation of the computer-generated graphical object together with imagery obtained using the one or more cameras of the device.