Virtual Instrument Interface Segmentation for Authentic Playing Techniques

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Virtual musical instruments lack the ability to accurately simulate the stylistic features and playing techniques of physical instruments, such as specific picking techniques, embellishments, and ornamental features, which can be difficult for users to emulate with conventional interfaces, especially for inexperienced musicians.

Innovation Solution

A system and method for implementing user interfaces on computing devices that allow users to interact with virtual instruments by using touch inputs to select fret positions, apply variation control, and access ornamental features like vibrato and trills, enabling the simulation of authentic playing techniques through a combination of audio samples and interface elements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the user interface closely resembles the physical instrument, then the authenticity of the virtual instrument is improved, but the ease of operation deteriorates for inexperienced users

Engineering Contradiction:
ImproveauthenticityVSAvoidease of operation
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The user interface is segmented into multiple functional areas: a playing surface area that resembles the physical instrument for note selection, and a variations control area that provides accessible controls for stylistic features. This segmentation allows the interface to maintain visual authenticity while providing simplified, intuitive controls for inexperienced users through dedicated control zones.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The variations control area acts as an intermediary between the user and the complex stylistic features of the physical instrument. It provides simplified controls that mediate access to picking techniques, embellishments, and ornamental features, making these authentic-sounding features accessible without requiring users to master the complex physical techniques.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If conventional user interfaces are used, then the ease of operation is maintained, but the ability to simulate stylistic features deteriorates

Engineering Contradiction:
Improveease of operationVSAvoidsimulation accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The interface adds a new dimensional layer by introducing the variations control area as a separate dimension of control. This allows users to access stylistic features through a different interface dimension rather than through complex physical technique simulation, maintaining ease of operation while achieving authentic sound simulation through audio processing dimensions.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The variations control area enables parameter changes that directly affect the audio output to simulate stylistic features. By changing parameters such as picking technique, embellishment intensity, and ornamental feature activation through simplified controls, the system achieves accurate simulation of physical instrument characteristics without requiring complex user actions.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If multiple controls for stylistic features are added, then the simulation accuracy is improved, but the device complexity increases

Engineering Contradiction:
Improvesimulation accuracyVSAvoidinterface complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

Multiple controls for stylistic features are merged into a unified variations control area with a grid of selectable elements. This consolidation combines numerous individual controls into an organized array where each element represents a specific stylistic feature or combination of features, reducing interface complexity while maintaining simulation accuracy through integrated control.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS9928817B2User interfaces for virtual instruments
Publication Date: 2018.03.27 APPLE INC
  • US9928817B2 patent drawing
  • US9928817B2 patent drawing
  • US9928817B2 patent drawing

AI summary

Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for implementing user interfaces for interacting with a virtual instrument. For example, first touch input indicating a string location of a plurality of string locations within the note selection area. Audio output corresponding to the sting location may be presented on a speaker based at least in part on the first touch input. Second touch input corresponding to an ornamental interface element of the user interface may be received. In response to the first and second touch input, a series of two or more audio outputs may be presented on the speaker according to a predetermined pattern.