2D to 3D Scene Conversion via Touch Gesture Plane Arrangement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for creating three-dimensional (3D) computer graphics representations from two-dimensional (2D) drawings or images are either fully automatic and inflexible, or require staged processes that do not allow for user control or input in vector formats, limiting the complexity and controllability of the output scene.

Innovation Solution

A system and method that enables users to construct a 3D scene simultaneously with inputting 2D drawings or images in raster or vector form, using a graphical user interface with a touch-sensitive display to arrange and project 2D planes in virtual 3D space, allowing for rotation and modification of content using gestures and tools like 'pinching for parallel' and 'hinge for angled' interfaces.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If automatic techniques are used to create 3D representation from 2D images, then the process is automated, but the output geometry is mathematically inferred and not controllable by the user

Engineering Contradiction:
ImproveautomationVSAvoidcontrollability
Core Design Contradiction:
Extent of automationVSEase of operation

Solution Approach 1:

The system allows users to directly manipulate and position 2D images in 3D space through intuitive touch interface gestures, making the system serve the user's creative intent rather than forcing mathematical inference. Users can pinch to create parallel planes, use hinge gestures for rotation, and directly place images where they want them in the 3D scene.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent introduces an intermediary touch-sensitive display interface that translates simple user gestures into complex 3D scene construction operations. This intermediary layer bridges the gap between simple user input and sophisticated 3D rendering, allowing users to control the geometry directly without complex manual manipulation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Stability of the object's composition

If staged processes are used where 3D geometry is constructed first and then image data is affixed, then the process is systematic, but it is not an integrated process and lacks flexibility

Engineering Contradiction:
Improvesystematic processVSAvoidintegration flexibility
Core Design Contradiction:
Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The patent merges the 3D geometry construction and image data affixing operations into a single integrated process. Users simultaneously define the 3D spatial arrangement and place 2D images on the appropriate planes during the same interactive session, eliminating the need for separate staged operations and enabling flexible adjustments at any point.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system dynamically adjusts the 3D scene configuration as users interact with it. The geometry and image placement are not fixed in separate stages but can be continuously modified and repositioned during the same workflow, allowing the scene to adapt to user needs in real-time.

Inventive Principle:
Principle #15Dynamics

3Manufacturing precision

If conventional systems like 'Tour into the picture' are used to augment raster images with depth values, then depth information is added, but the system only works with raster format and not vector format

Engineering Contradiction:
Improvedepth informationVSAvoidinput format support
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent creates a universal interface that accepts both raster and vector image formats through the same touch interaction mechanism. The system treats different image formats uniformly, allowing users to pinch, rotate, and position both raster and vector images in the 3D space using identical gestures and operations.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system changes the parameter of image format acceptance from restricted to inclusive. By implementing a format-agnostic projection and positioning system, it can handle various image types (raster, vector, multiple layers) without requiring different processing workflows, thereby expanding versatility.

Inventive Principle:
Principle #35Parameter changes

4Device complexity

If conventional systems use restricted output scenes with specific mesh structures, then the implementation is simplified, but the output scene complexity is limited

Engineering Contradiction:
Improveimplementation simplicityVSAvoidscene complexity
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent segments the 3D scene into multiple independent 2D planes that can be individually manipulated. Each plane can be positioned, rotated, and scaled independently through touch gestures, allowing users to construct complex scenes from simple modular units while maintaining implementation simplicity through consistent interaction patterns.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10867452B2System and methods for conversion of 2D assets into 3D graphical scenes
Publication Date: 2020.12.15 MENTAL CANVAS
  • US10867452B2 patent drawing
  • US10867452B2 patent drawing
  • US10867452B2 patent drawing

AI summary

A computer-implemented method of and system for converting a two-dimensional drawing into a navigable three-dimensional computer graphics representation of a scene that includes inputting the two-dimensional drawing, embedding some portion of the two-dimensional drawings onto one or more two-dimensional planes, arranging the two-dimensional planes in a virtual three-dimensional space; and outputting the arranged two-dimensional planes into the three-dimensional computer graphics representation of the scene.