Multi-string Instrument Chord Recognition via Finger Geometry
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing portable device implementations of musical instruments face challenges in providing a captivating and expressive experience due to limitations in multi-touch screen real estate and finger precision, particularly for multi-string instruments like guitars, where users struggle to accurately register multiple contacts on a small screen.
Innovation Solution
A method is developed to capture chord sounding gestures on a multi-touch sensitive display by recognizing multiple-finger contact geometries rather than precise positional registrations, allowing for dynamic allocation of note and chord selection positions, and enabling gestural recognition of chords through shape and orientation, even with limited screen space.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If precise positional registration of multiple finger contacts is required for chord recognition, then measurement precision is improved, but ease of operation deteriorates due to limited screen real estate and finger precision constraints
Solution Approach 1:
The patent transforms the measurement parameters from precise positional coordinates to geometric characteristics (shape, orientation, relative positions). This parameter transformation allows chord recognition to be based on the overall configuration of finger contacts rather than exact positions, making the system more tolerant of imprecise input while maintaining accurate chord identification
Solution Approach 2:
The patent replaces the mechanical precision requirement (exact finger placement on screen) with a geometric pattern recognition system. Instead of requiring users to hit specific coordinates, the system recognizes chord shapes and orientations, substituting geometric analysis for precise mechanical positioning
2Adaptability or versatility
If multiple strings are displayed on a small screen, then adaptability of the instrument is improved, but device complexity increases due to limited display real estate
Solution Approach 1:
The patent extracts the essential information from the full multi-string display by focusing only on the geometric relationships between finger contacts. Instead of requiring the display of all strings and their individual positions, the system extracts chord identification from the overall finger configuration, simplifying the display requirements while maintaining multi-string instrument capability
Solution Approach 2:
The patent creates a universal gesture recognition system that can identify chords across multiple strings without requiring string-specific display elements. The same geometric recognition principles apply regardless of which strings are being played, allowing the interface to handle multi-string instruments with a simplified, unified approach
Data Source
AI summary
A synthetic multi-string musical instrument captures a stream of expressive gestures indicated on a multi-touch sensitive display for note/chord soundings and associated performance effects and embellishments. Visual cues in accord with a musical score may be revealed/advanced at a current performance tempo, but it is the user's gestures that actually drive the audible performance rendering via digital synthesis. Opportunities for user expression (or variance from score) include onset and duration of note soundings, tempo changes, as well as uncued string bend effects, vibrato, etc. Gesturing mechanism are provide to allow user musicians to sound chords without having to register precisely accurate multi-touch screen contacts. This can be especially helpful for mobile phone, media player and game controller embodiments, where there is generally limited real-estate to display six (6) or more strings, and user fingers are generally too fat to precisely contact such strings.