Gesture Recognition for Drawing Input Command Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing information processing systems face challenges in efficiently recognizing and processing user commands when combining multiple input methods like voice and gesture, leading to decreased usability and work efficiency, especially during presentations or shared displays.
Innovation Solution
An information processing apparatus that includes a reception unit for drawing and sound information, a gesture recognition unit to identify command gestures, a figure extraction unit to determine figure types, and a processing unit to convert these into objects, allowing for seamless command input without requiring explicit start and end designation of the command mode.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the system requires explicit start and end designation of command mode, then command recognition accuracy is improved, but ease of operation deteriorates
Solution Approach 1:
The system automatically determines command mode periods based on drawing operation patterns without requiring explicit user designation. The gesture recognition unit analyzes drawing information to autonomously identify when the user intends to input a command, allowing the system to serve itself in determining command states.
Solution Approach 2:
The system performs preliminary analysis of drawing operation patterns to pre-identify potential command gestures before full command processing begins. By analyzing stroke patterns, shapes, and sequences in advance, the system prepares for accurate command recognition without requiring explicit user markers.
2Productivity
If multiple input units are combined for command input, then productivity is improved, but device complexity increases
Solution Approach 1:
The system merges drawing operations with gesture recognition into a unified command input mechanism. By combining the drawing unit and gesture recognition unit, the system allows users to input commands through natural drawing gestures without requiring separate controls or interfaces for each function.
Solution Approach 2:
The drawing operation serves multiple functions: it can be used for both regular drawing tasks and command input gestures. The same drawing interface and gesture recognition system handle both ordinary drawing operations and command gestures, eliminating the need for dedicated command input devices.
3Ease of operation
If command mode is always active, then ease of operation is improved, but harmful factors increase due to unintentional object movements
Solution Approach 1:
The command mode state dynamically changes based on real-time analysis of drawing operation patterns. The system transitions between command mode and normal drawing mode automatically, adjusting its behavior according to the user's current intent as detected through gesture analysis.
Solution Approach 2:
The system provides feedback by analyzing drawing patterns and determining whether the user intends to input a command or perform regular drawing. This feedback mechanism allows the system to adjust its interpretation of subsequent inputs, preventing unintentional command activation while maintaining ease of operation.
Data Source
AI summary
An information processing apparatus includes a reception unit, a recognition unit, an extraction unit, and a processing unit. The reception unit receives drawing information which is information on a drawing operation by a user. The recognition unit recognizes whether or not a last part of the drawing operation is a gesture which the user designates a command, based on the drawing information. The extraction unit extracts a type of a figure drawn by the user before the user performs the gesture. The processing unit performs a process based on the extracted type of the figure.