Hand Drawn Object Grouping via Wet-Dry Stroke State Transition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Multi-touch and pen-enabled user interfaces face challenges in designing intuitive UIs for drawing and note-taking due to conflicts between writing/drawing and object manipulation, and inefficient grouping of handwriting and drawing objects, leading to complex and less productive interfaces for a broad user base.
Innovation Solution
The system maintains recently drawn strokes in a 'wet' state, transitioning them to a 'dry' state based on time, proximity, or user input, allowing for automatic grouping and manipulation of strokes, with visual differentiation between wet and dry states to facilitate seamless combination of drawing and object manipulation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a multi-mode design with special object manipulation mode is used to resolve conflicts between drawing and object manipulation, then the conflict between drawing and object manipulations is resolved, but the product UI becomes overloaded and more complex
Solution Approach 1:
The system dynamically switches between drawing mode and object manipulation mode based on the state of strokes. When strokes are in wet state, drawing operations are enabled; when in dry state, manipulation operations are enabled. This dynamic mode switching resolves the conflict between drawing and manipulation while avoiding the need for permanent complex multi-mode interfaces.
Solution Approach 2:
The system changes the operational parameters of strokes by transitioning them between wet and dry states. This parameter change enables the same interface to support both drawing and manipulation functions without requiring separate complex modes, thereby simplifying the UI while maintaining ease of operation.
2Productivity
If conventional grouping based purely on line continuity is used, then the grouping implementation is simple, but the grouping efficiency and user productivity are reduced
Solution Approach 1:
The system performs preliminary grouping actions by automatically grouping dry strokes based on spatial proximity and temporal relationships. This preliminary automatic grouping eliminates the need for manual grouping operations, significantly improving productivity while the grouping logic remains based on simple spatial and temporal criteria rather than complex algorithms.
Solution Approach 2:
The system enables self-service grouping where strokes automatically group themselves based on their spatial relationships and the user's drawing behavior. The grouping process requires no active user intervention, and the system autonomously determines groupings based on proximity and timing, improving efficiency without adding complexity to the user interface.
3Ease of operation
If wet strokes are allowed to be manipulated freely, then the user has maximum control over strokes, but the distinction between active drawing and editable objects becomes unclear
Solution Approach 1:
The system segments the stroke lifecycle into distinct wet and dry states with different operational characteristics. Wet strokes are exclusively for drawing with no manipulation allowed, while dry strokes are for manipulation with no drawing allowed. This clear segmentation provides unambiguous state distinction while maintaining full flexibility within each state through appropriate operations.
Solution Approach 2:
The system employs periodic state transitions where strokes alternate between wet and dry states over time. This periodic action creates clear temporal boundaries between drawing phases and manipulation phases, making the state distinction obvious to users while allowing flexible manipulation during the dry state periods.
Data Source
AI summary
A graphical drawing includes maintaining recently drawn strokes in a wet state after the strokes are drawn, causing strokes in a wet state to transition to a dry state based on passage of time, proximity of other recently drawn strokes, and/or explicit user input directing that at least some wet strokes be transitioned to the dry state, and grouping strokes in the dry state for future user manipulation based at least in part on how the strokes transitioned from the wet state to the dry state. Wet ink strokes may transition from the wet state to the dry state in response to not adding any new wet ink strokes for a predetermined amount of time. The predetermined amount of time may be twelve hundred milliseconds.