Mapping 2D UIs to 3D Wireframes for Rapid Interface Creation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Creating fully interactive three-dimensional (3-D) user interfaces (UIs) is difficult and time-intensive, requiring knowledge of 3-D authoring packages and stringent requirements, and existing 2-D interactive UI tools do not map well into 3-D environments.
Innovation Solution
A 3-D UI creation system that allows for the easy mapping of 2-D interactive UIs onto 3-D object templates, enabling rapid implementation of fully interactive 3-D UIs without the need for extensive knowledge of 3-D space or authoring packages, by using a process that includes laying out 2-D UIs, loading 3-D scenes, and applying 2-D UIs to 3-D wireframe templates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If fully interactive 3-D UIs are created using traditional 3-D authoring packages, then the functionality and interactivity of the UI is improved, but the complexity of creation and time required increases significantly
Solution Approach 1:
The system segments the UI creation process into two distinct parts: 2-D UI design using standard tools and 3-D scene definition using a simplified markup language. This allows designers to work with familiar 2-D tools while the system handles the complex 3-D integration automatically, reducing creation complexity while maintaining full interactivity.
Solution Approach 2:
A scene description file written in a simplified markup language serves as an intermediary between the 3-D scene definition and the UI mapping process. This intermediary layer abstracts the complexity of 3-D space and authoring package requirements, allowing designers to define 3-D scenes without needing expert knowledge of 3-D graphics programming.
2Ease of manufacture
If 2-D interactive UI tools are used to create UIs, then the ease of creation is improved, but the ability to map into 3-D environments deteriorates
Solution Approach 1:
The system makes standard 2-D UI tools universal by enabling them to produce UIs that can be mapped to both 2-D and 3-D displays. The scene description file and mapping mechanism allow the same 2-D UI design tools to create interfaces that adapt to various display geometries, including 3-D environments, without requiring separate toolsets.
Solution Approach 2:
The system enables 2-D UI designs to be projected onto 3-D surfaces by introducing a mapping layer that translates 2-D UI element coordinates into 3-D surface coordinates. This allows standard 2-D UI tools to create interfaces that can be displayed on 3-D displays while maintaining the simplicity of 2-D design workflows.
3Productivity
If standard 2-D UI templates are used, then the development time is reduced, but the visual appeal and immersion in 3-D environments is limited
Solution Approach 1:
The system performs preliminary actions by automatically generating the 3-D mapping and integration code based on the scene description file. This pre-computation allows designers to use simple 2-D UI templates without worrying about the complex 3-D integration details, while the system handles the transformation and adaptation to 3-D environments automatically.
Solution Approach 2:
The system enables dynamic parameter changes by allowing UI elements to adapt their position, shape, and size based on the 3-D surface geometry. The mapping mechanism transforms static 2-D UI parameters into dynamic 3-D parameters that automatically adjust to the target surface, maintaining visual flexibility while using simple 2-D templates.
Data Source
AI summary
A three-dimensional (3-D) user interface (UI) creation system maps a two-dimensional (2-D), interactive UI to an 3-D object template in a 3-D scene. Once mapped, the 2-D UI functions as a simple user interface while appearing as a skin to the 3-D object. A 3-D UI creation tool applies image resources of a 2-D UI template to a 3-D wire frame template to create a 3-D UI. The system provides for rapid implementation of a 3-D UI without need for understanding a 3-D space or 3-D authoring software. The process includes preparing a 2-D UI, loading a 3-D scene of 3-D objects, and mapping the 2-D UI to a 3-D object template in the 3-D scene. A scheme file provides a specification for recreating the 3-D scene in a runtime module whereby the 3-D scene functions as a 3-D UI system, allowing interaction via a user input system.