2D Wireframe to 3D AR Model Translation System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for creating augmented and virtual reality (AR/VR) objects are inefficient, as designers struggle to translate two-dimensional wireframe designs into three-dimensional models due to lack of scale and positioning accuracy, requiring multiple iterations and revisions, which wastes time and resources.

Innovation Solution

A system that converts two-dimensional user interface designs into three-dimensional models, allowing direct import into AR/VR development environments, enabling real-time editing and reducing the need for recompilation, using a combination of 2D design software and 3D content creation tools integrated with XR devices for accurate representation and editing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If designers use 2D wireframe tools to create UI designs, then design iteration speed is improved, but translation accuracy to 3D AR/VR environment deteriorates due to lack of scale and positioning information

Engineering Contradiction:
Improvedesign iteration speedVSAvoidtranslation accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent introduces an intermediary translation system that converts 2D wireframe data into 3D AR/VR environment data. This intermediary process includes automatic generation of scale references, positioning information, and transformation matrices that map 2D coordinates to 3D space, thereby maintaining both design iteration speed and translation accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary actions by pre-calculating scale factors, positioning references, and transformation rules before the actual translation process. This allows designers to work with simplified 2D wireframes while the system automatically prepares the necessary 3D conversion data, ensuring both speed and accuracy.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If artists and programmers manually translate wireframes to 3D models, then manufacturing precision is improved, but loss of time increases due to multiple iterations and revisions

Engineering Contradiction:
Improveobject representation accuracyVSAvoidtranslation time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The translation system performs self-service by automatically converting 2D wireframe data into 3D AR/VR environment data without requiring manual intervention from artists and programmers. The system self-calculates scale, positioning, and transformation, thereby maintaining high accuracy while eliminating time-consuming manual translation and multiple revision cycles.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical manual translation process with an automated computational system. Instead of artists and programmers manually creating 3D models from wireframes, the system uses algorithmic transformation to convert 2D data into 3D representations, significantly reducing time while maintaining precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of operation

If designers use simplified 2D design tools, then ease of operation is improved, but measurement precision deteriorates due to inability to accurately represent scale and positioning in 3D space

Engineering Contradiction:
Improvedesign tool usabilityVSAvoidscale and positioning accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system bridges the gap between 2D design tools and 3D AR/VR environments by introducing dimensional transformation. It automatically calculates and applies scale factors and positioning transformations that map 2D coordinates to 3D space, allowing designers to use simple 2D tools while achieving precise 3D measurements and positioning.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11347371B2Automatic translation of user interface elements from wireframe tools to production augmented reality framework
Publication Date: 2022.05.31 UNITY TECH APS
  • US11347371B2 patent drawing
  • US11347371B2 patent drawing
  • US11347371B2 patent drawing

AI summary

Systems and methods for generating an extended reality (XR) user interface are disclosed. A two-dimensional data set is imported. The two-dimensional data set defines a two-dimensional user interface design layout. The two-dimensional data set includes a transition data set corresponding to a user interface element included in the design layout. The two-dimensional data set is converted into a three-dimensional data set. The three-dimensional data set defines a three-dimensional user interface design layout corresponding to the two-dimensional design layout. The converting includes identifying three-dimensional art for each of a plurality of phases corresponding to the transition data set. An XR representation of the three-dimensional data set is provided for editing using an editing application associated with one or more XR devices. Based on the editing, the three-dimensional data set is exported as one or more files that are compatible with an XR development environment.