Touchscreen Gesture Recognition for Expressive Percussion Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Touchscreen electronic percussion instruments lack the expressive range and functionality of dedicated electronic percussion instruments due to their non-velocity sensitive touchscreens and limited user interface space, which restricts the implementation of gesture interfaces for percussion instrument functionality.

Innovation Solution

The technology enables the reception and interpretation of various gestures on a touchscreen to generate percussion instrument signals, including single and multi-touch gestures that modify signal parameters such as repeat rate, volume, and pitch, allowing for a more expressive interface by dividing the touchscreen area into distinct zones and using capacitive sensing to detect multi-touch events.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a touchscreen is used for percussion instrument functionality, then device portability and integration are improved, but velocity sensitivity and expressive range are lost

Engineering Contradiction:
Improvepercussion functionality integrationVSAvoidvelocity sensitivity
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent changes the parameter of touch detection from simple binary contact detection to multi-dimensional gesture analysis. By detecting gesture type (tap, slide, pinch, palm), touch duration, and movement trajectory, the system transforms the touchscreen from a non-velocity sensitive interface into an expressive control surface that can mimic traditional drum pad velocity sensitivity through software-based gesture recognition and parameter mapping.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If the touchscreen is divided into multiple areas representing different percussion instruments, then functional versatility is improved, but the limited touch surface area restricts the number of available controls

Engineering Contradiction:
Improveinstrument coverageVSAvoidtouch surface area
Core Design Contradiction:
Adaptability or versatilityVSArea of stationary object

Solution Approach 1:

The patent segments the touchscreen into multiple functional zones, each representing different percussion instruments or sound types. By dividing the limited touch surface into distinct areas (e.g., virtual drum pads for different drums, cymbals, and percussion instruments), the system maximizes the number of available controls within the constrained physical space, allowing users to access multiple instrument types simultaneously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent adds dimensional complexity to the touchscreen interface by implementing multi-touch gestures (pinch, slide, rotate, palm) that operate in two-dimensional space to control additional parameters. This allows the limited touch surface area to provide control over multiple dimensions (pitch, volume, rhythm, texture) through gesture-based interaction, effectively expanding the control space beyond the physical screen area.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If gesture-based control is implemented on a limited touch surface, then ease of operation is improved, but the complexity of gesture recognition and signal generation increases

Engineering Contradiction:
Improveinterface usabilityVSAvoidgesture processing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent implements self-service gesture recognition by having the touchscreen itself detect and interpret gestures directly through its capacitive sensing capabilities, without requiring external sensors or complex hardware modifications. The system uses the touchscreen's inherent ability to detect touch location, duration, and movement to automatically recognize gesture types and translate them into appropriate percussion signals, simplifying the overall system architecture while maintaining ease of operation.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS8809665B2Electronic percussion gestures for touchscreens
Publication Date: 2014.08.19 APPLE INC
  • US8809665B2 patent drawing
  • US8809665B2 patent drawing
  • US8809665B2 patent drawing

AI summary

Methods, computer program products, and systems for receiving gestures and producing percussion instrument signals are disclosed. An exemplary method includes receiving a gesture on an area of a touchscreen representing a percussion instrument and generating a signal based on the gesture and area. The gesture can be a single point initiation touch on an area, and a drag into another area. The gesture can be a two-touch point initiation touch on a first area, and a change in distance between the points to change a first parameter such as repeat rate. Such gestures can further include translation of the touch points as a group along an axis to change a second parameter such as volume, pitch, or reverb.