3D Spatial Model Interaction via Gesture Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for simulating dynamic systems lack intuitive user interaction, relying on conventional techniques like pointing devices and keyboards, which can hinder user experience and effectiveness in simulating and navigating complex models.
Innovation Solution
A computing device communicates with an interactive system to provide a 3D spatial environment, allowing users to interact with models by manipulating 3D physical structures or images, enabling direct access, modification, and execution of models through gestures and movements, using emitter-detectors and spatial information to update the model elements and attributes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional interaction methods (pointing devices, keyboards) are used, then device complexity is reduced, but ease of operation deteriorates when interacting with complex 3D models
Solution Approach 1:
The patent transitions from 2D screen-based interaction to 3D spatial interaction by allowing users to manipulate holographic or 3D representations of models directly in physical space. Users can walk around, approach, and gesture toward different portions of the 3D model, transforming the interaction paradigm from flat screen to volumetric space, thereby improving ease of operation with complex models.
Solution Approach 2:
The system introduces a 3D spatial representation (hologram or virtual model) as an intermediary between the user and the actual complex model data. This intermediary allows intuitive manipulation and exploration of the model's structure, properties, and relationships in a more natural interaction mode, resolving the contradiction between operational ease and system complexity.
2Ease of operation
If 3D spatial environment is provided, then ease of operation improves, but device complexity increases
Solution Approach 1:
The 3D spatial environment serves multiple functions: it displays the model, enables navigation through the model structure, allows manipulation of model components, and facilitates communication of model properties. By consolidating these functions into a single immersive environment, the system improves operational ease while managing the complexity through multi-functional integration rather than separate systems for each function.
3Productivity
If direct manipulation of 3D representations is enabled, then productivity increases, but device complexity increases
Solution Approach 1:
The system enables users to directly manipulate and explore the 3D model representations without requiring complex software interfaces or specialized tools. Users can naturally navigate, select, and modify model elements through direct physical interaction with the 3D representation, making the system self-sufficient and eliminating the need for intermediary software layers, thereby increasing productivity.
Data Source
AI summary
A device may provide, for display by a technical computing environment (TCE), a group of model elements of a model. The model, when executed, may simulate behavior of a system. The group of model elements may correspond to a group of physical elements of the system. The device may further detect interaction with a three-dimensional (3D) structure located within a spatial environment. The 3D structure may correspond to one or more physical elements of the group of physical elements of the system. The device may further cause the TCE to modify the model based on the detected interaction.