Real-Time Music Accompaniment Mode Classification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing music accompaniment technologies, such as loop pedals and minus-one recordings, often result in monotonous and stylistically inconsistent performances due to repetitive playback of pre-recorded material, limiting their use in professional concerts and recordings.

Innovation Solution

A device and method that classify music input into modes like solo, bass, and harmony, allowing real-time generation of accompaniment by selecting and transforming recorded pieces to match the current performance, using multi-modal analysis and concatenative synthesis to create an adaptive and stylistically consistent audio accompaniment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If loop pedals are used to generate real-time music accompaniment, then the musician can perform solo with recorded material playback, but the performance becomes monotonous and boring due to repetitive playback of the same material

Engineering Contradiction:
Improvemusic accompaniment varietyVSAvoidperformance monotony
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system dynamically selects and transforms recorded music segments in real-time based on the current musical context, chord progression, and musician's performance. Instead of playing back fixed loops, the system adapts the accompaniment material dynamically by selecting different segments and applying transformations such as pitch shifting, time stretching, and effects processing to maintain variety and engagement throughout the performance.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes multiple parameters of the recorded music segments including pitch, tempo, duration, and timbre through digital signal processing. By transforming the acoustic parameters of the recorded material, the system generates diverse accompaniment variations from the same source recordings, preventing monotony while maintaining musical coherence.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If standard loop pedals force the musician to play the entire loop once during a feeding phase, then the loop can be repeated for improvisation, but this creates repetitiveness and delays the start of improvisation

Engineering Contradiction:
Improvechord grid consistencyVSAvoidimprovisation start delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system pre-processes and analyzes the recorded music material during the feeding phase, organizing it into reusable segments tagged with musical information such as chord type, tempo, and style characteristics. This preliminary organization allows the system to quickly retrieve and assemble appropriate segments during improvisation without requiring the musician to play through the entire loop first, reducing the delay while maintaining chord grid consistency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system divides the recorded music into smaller segments or phrases that can be independently selected and recombined. Instead of treating the entire loop as a single unit, the segmentation allows the system to pick and choose specific segments that match the current musical context, enabling faster assembly of accompaniment material and reducing the effective feeding phase duration.

Inventive Principle:
Principle #1Segmentation

3Productivity

If pre-recorded loops are used for accompaniment, then the musician can improvise immediately, but the audience cannot distinguish what is pre-recorded and what is actually performed

Engineering Contradiction:
Improveimprovisation readinessVSAvoidperformance authenticity
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The system continuously monitors the musician's performance in real-time and uses this feedback to dynamically adjust and select appropriate recorded segments for accompaniment. The system analyzes the musician's playing style, tempo, and musical choices, then selects and transforms recorded material to match, creating a responsive interaction that maintains the illusion of live performance while utilizing pre-recorded elements.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system acts as an intermediary between the pre-recorded material and the live performance, transforming and adapting the recorded segments to match the musician's playing in real-time. Through pitch shifting, time stretching, and effects processing, the system blends the pre-recorded and live elements seamlessly, making it difficult for the audience to distinguish between the two while maintaining performance authenticity.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Stability of the object's composition

If loop pedals play back the same material repeatedly, then the accompaniment is consistent, but it prevents uptake in professional concerts due to monotony

Engineering Contradiction:
Improveaccompaniment consistencyVSAvoidperformance engagement
Core Design Contradiction:
Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The system uses periodic analysis of the musician's performance to determine when to select new recorded segments or apply transformations. By periodically refreshing the accompaniment material based on temporal patterns in the music and performance dynamics, the system maintains consistency within musical phrases while introducing variety between phrases, balancing stability with engagement for professional concert settings.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS10600398B2Device and method for generating a real time music accompaniment for multi-modal music
Publication Date: 2020.03.24 SONY GROUP CORP
  • US10600398B2 patent drawing
  • US10600398B2 patent drawing
  • US10600398B2 patent drawing

AI summary

A device for generating a real time music accompaniment includes a music input interface, a music mode classifier that classifies pieces of music received at the music input interface into one of different music modes including at least a solo mode, a bass mode, and a harmony mode, a music storage, and a music output interface. A music selector selects one or more recorded pieces of music as real time music accompaniment to an actually played piece of music received at the music input interface, wherein the one or more selected pieces of music are selected to be in a different music mode than the actually played piece of music. A music output interface outputs the selected pieces of music.