Mixed-Reality Viewport for 3D Modeling Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of 3D modeling applications face limitations in interacting with complex 3D models due to the need for limited 2D displays and cumbersome interfaces, which hinder natural interaction and require time-consuming and resource-intensive 3D printing for design iterations.
Innovation Solution
A mixed-reality head-mounted display (HMD) device extends 3D modeling applications with a virtual viewport for rendering 3D holograms, allowing users to interact naturally with models in 3D without printing, by exchanging scene and user interface data with a 2D monitor, and using head tracking for appropriate input direction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If 2D displays and traditional interfaces are used for 3D modeling applications, then device complexity is reduced, but ease of operation deteriorates due to limited interaction capabilities
Solution Approach 1:
The patent transitions from 2D display interaction to 3D spatial interaction by rendering the 3D model within a virtual viewport that occupies three-dimensional space in the user's field of view. This allows users to interact with the model from multiple angles and perspectives naturally, eliminating the need for complex 2D interface manipulations while maintaining simple display hardware.
2Productivity
If 3D printing is used for design iterations, then manufacturing precision is improved, but productivity deteriorates due to time-consuming and resource-intensive processes
Solution Approach 1:
The patent creates virtual copies of 3D models within the HMD viewport that can be manipulated, modified, and iterated upon instantly. These virtual representations serve as sufficient copies for design review and iteration purposes, eliminating the need for physical printing while maintaining design accuracy. The virtual models can be rotated, scaled, and examined from all angles without material consumption or production delays.
3Ease of operation
If 3D models are viewed on 2D monitors, then device complexity is minimized, but ease of operation worsens due to limited viewing angles and natural interaction
Solution Approach 1:
The HMD device serves multiple functions: it acts as both a virtual display for 3D model rendering and an input device through head tracking. The same hardware platform supports both viewing and interaction capabilities, eliminating the need for separate complex interaction devices while enabling natural head-based control of the 3D model viewport.
Solution Approach 2:
The patent replaces manual manipulation of 2D interface controls with natural head movements for navigating and interacting with 3D models. Head tracking captures spatial orientation and position data, automatically translating physical head movements into virtual viewport navigation, thereby replacing complex mechanical interface interactions with intuitive biological movements.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An application running on a computing platform that employs three-dimensional (3D) modeling is extended using a virtual viewport into which 3D holograms are rendered by a mixed-reality head mounted display (HMD) device. The HMD device user can position the viewport to be rendered next to a real world 2D monitor and use it as a natural extension of the 3D modeling application. For example, the user can interact with modeled objects in mixed-reality and move objects between the monitor and the viewport. The 3D modeling application and HMD device are configured to exchange scene data for modeled objects (such as geometry, lighting, rotation, scale) and user interface parameters (such as mouse and keyboard inputs). The HMD device implements head tracking to determine where the user is looking so that user inputs are appropriately directed to the monitor or viewport.