Virtual Instrument Library Management for Expressive MIDI Performance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The music industry faces limitations due to the outdated MIDI Standard, which lacks standardization in instrument sampling and control, leading to constraints in musical notation, performance, and the inability to accurately express complex musical expressions, particularly with the growing need for AI-based musical composition and performance.

Innovation Solution

A new virtual musical instrument library management system employing rule-based instrument performance logic to predict sample playback based on music-theoretic states, allowing for automated selection and performance of sampled and synthesized notes, integrated with AI-driven music composition and generation systems.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the MIDI Standard is used for instrument control and sampling, then device compatibility and basic performance are ensured, but musical expression capability and performance realism are limited

Engineering Contradiction:
Improvemusical expression capabilityVSAvoidperformance realism
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent segments the monolithic MIDI control system into multiple specialized subsystems: music-theoretic state analysis module, instrument performance logic module, sample selection module, and playback module. Each subsystem handles specific aspects of musical expression, allowing independent optimization of each component while maintaining overall system compatibility with standard MIDI interfaces.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces music-theoretic state descriptors as an intermediary layer between the MIDI input and the instrument performance output. These descriptors capture complex musical contexts (harmonic function, melodic role, rhythmic position) that standard MIDI cannot express, enabling more realistic instrument responses without abandoning MIDI compatibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If rule-based instrument performance logic is implemented, then automated sample playback accuracy is improved, but system complexity increases

Engineering Contradiction:
Improvesample playback accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary analysis of the music composition to extract music-theoretic state descriptors before sample playback. By pre-processing the musical data to identify contextual states (chord progressions, melodic contours, rhythmic patterns), the system establishes performance rules in advance, enabling accurate sample selection without real-time computational complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent transforms musical data from standard MIDI parameters into music-theoretic state descriptors that capture higher-level musical concepts. This parameter transformation enables rule-based performance logic to operate on meaningful musical attributes rather than raw note data, improving playback accuracy while keeping rule sets manageable through semantic abstraction.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If AI-driven music composition and generation systems are integrated, then creative capability and musical uniqueness are enhanced, but computational resource requirements increase

Engineering Contradiction:
Improvecreative capabilityVSAvoidcomputational resource consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent performs AI-based music-theoretic state analysis as a preliminary step before performance generation. By using AI to pre-analyze the compositional structure, harmonic progressions, and stylistic characteristics, the system creates a detailed musical context map that guides subsequent sample selection. This approach leverages AI's creative capabilities while avoiding continuous heavy computation during playback.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses AI to generate music-theoretic state descriptors that copy and represent essential musical characteristics in a compressed format. Rather than running AI models continuously during performance, the system creates simplified representations of musical context that can be processed by rule-based logic, reducing computational overhead while preserving creative intent.

Inventive Principle:
Principle #26Copying

4Ease of operation

If standardized instrument sampling methods are adopted, then library compatibility and ease of integration are improved, but performance expressiveness and instrument uniqueness are reduced

Engineering Contradiction:
Improvelibrary integration easeVSAvoidperformance expressiveness
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent segments instrument sampling into standardized core components (basic note playback, velocity layers) and extended expressive components (articulation-specific samples, context-dependent variations). The standardized core ensures compatibility with existing libraries, while the extended components provide enhanced expressiveness through music-theoretic state-driven selection.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces dynamic sample selection based on music-theoretic states, allowing the same instrument library to produce different performances depending on contextual factors like harmonic function, melodic role, and rhythmic position. This dynamic approach maintains compatibility with standard libraries while extracting maximum expressiveness through context-aware playback rules.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11037538B2Method of and system for automated musical arrangement and musical instrument performance style transformation supported within an automated music performance system
Publication Date: 2021.06.15 SHUTTERSTOCK
  • US11037538B2 patent drawing
  • US11037538B2 patent drawing
  • US11037538B2 patent drawing

AI summary

An automated music performance system that is driven by the music-theoretic state descriptors of any musical structure (e.g. a music composition or sound recording). The system can be used with next generation digital audio workstations (DAWs), virtual studio technology (VST) plugins, virtual music instrument libraries, and automated music composition and generation engines, systems and platforms. The automated music performance system generates unique digital performances of pieces of music, using virtual musical instruments created from sampled notes or sounds and/or synthesized notes or sounds. Each virtual music instrument has its own set of music-theoretic state responsive performance rules that are automatically triggered by the music theoretic state descriptors of the music composition or performance to be digitally performed. An automated virtual music instrument (VMI) library selection and performance subsystem is provided for managing the virtual musical instruments during the automated digital music performance process.