Touchscreen Interface for 3D Model Manipulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for interacting with virtual 3D models, such as those used in medical procedures, require separate input devices like mice or trackballs, which can disrupt the workflow and introduce risks by necessitating the surgeon to leave the console for troubleshooting or information retrieval.
Innovation Solution
A touchscreen-based visualization tool that allows for pressure-based and gesture-based inputs to navigate and interact with 3D models, enabling direct manipulation of the model on the display without the need for additional devices, using sensors and a stereo camera to detect inputs and adjust display parameters like transparency and rotation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If separate input devices (mouse, trackball) are used to interact with 3D models, then navigation and manipulation capabilities are provided, but workflow disruption and safety risks increase due to requiring the surgeon to leave the console
Solution Approach 1:
The patent merges the display device and input device functions into a single touchscreen interface. The touchscreen accepts both visual output and tactile input (touch, drag, pinch gestures) directly on the display surface, eliminating the need for separate mice or trackballs. This integration allows surgeons to interact with 3D models without leaving the console, maintaining workflow continuity while preserving full navigation and manipulation capabilities.
2Adaptability or versatility
If multiple nested drop-down or pop-up menus are used for interaction, then comprehensive control options are provided, but operation complexity and time consumption increase
Solution Approach 1:
The patent extracts the essential interaction functions from complex multi-level menus and implements them through direct touchscreen gestures. Instead of requiring users to navigate through nested drop-down menus to access rotation, zoom, and pan functions, the system responds directly to intuitive gestures (two-finger rotation, pinch-to-zoom, drag-to-pan) performed directly on the 3D model display, significantly simplifying the interaction path while maintaining full functional versatility.
Solution Approach 2:
The touchscreen interface enables direct manipulation where the user's finger or stylus directly interacts with the 3D model representation on the screen. The system interprets gesture movements and directly translates them into corresponding 3D model transformations without requiring intermediate menu selections. This self-service approach allows surgeons to perform complex interactions through natural gestures, reducing operational complexity while maintaining comprehensive control options.
3Ease of operation
If a touchscreen interface is implemented for direct interaction, then workflow continuity and ease of operation are improved, but input precision and detection accuracy may be reduced compared to separate input devices
Solution Approach 1:
The patent replaces traditional mechanical input devices (mouse, trackball) with a touchscreen interface that detects touch, drag, and pinch gestures through capacitive or resistive sensing. The touchscreen controller captures multi-point touch coordinates and gesture patterns with high precision, translating them into accurate 3D model transformations. This substitution maintains input precision while enabling direct interaction on the display surface, eliminating the need to switch between separate input devices and the console.
Data Source
AI summary
A method comprises accessing a three-dimensional (3D) model of an object with a visualization tool including a touchscreen. The 3D model comprises a plurality of components. The method further comprises displaying an image of a subset of the components. The subset of the components includes each one of the components of the 3D model with a transparency of less than 100%. The method further comprises detecting a first contact based input at the touchscreen and displaying a first icon on the touchscreen. The first icon represents a location on the touchscreen of the first contact based input. The method further comprises detecting movement of the first contact based input along the touchscreen with the first icon tracking the movement of the first contact based input. The method further comprises responsive to the detected movement, rotating the subset of the components about a center of rotation.