Bidirectional RNN Music Variation via Token Insertion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Repetitive music can be annoying, especially in waiting situations like call center queues, but maintaining recognizable tunes while introducing variations is challenging for existing technologies.

Innovation Solution

A bidirectional recurrent neural network is used to generate variations in music files by inserting token data at specific locations, allowing for changes in amplitude, pitch, timing, rhythm, or timbre, and then replacing these tokens with generated music data, while maintaining some recognizable aspects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If repetitive music is used in call center queues, then music recognition is maintained, but listener annoyance increases

Engineering Contradiction:
Improvemusic recognitionVSAvoidlistener annoyance
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent applies dynamics by making the music adaptable and variable rather than static. The neural network generates different variations of the same musical piece by learning from training data and introducing controlled randomness through temperature parameters and sampling strategies. This allows the music to evolve over time while preserving its core identity, preventing listener fatigue from repetition.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes multiple musical parameters simultaneously including pitch, timing, rhythm, amplitude, and timbre. These parameter modifications are controlled by the neural network which learns the underlying structure of the music and introduces variations within acceptable bounds. The temperature parameter controls the degree of variation, allowing balanced modification that maintains recognition while reducing monotony.

Inventive Principle:
Principle #35Parameter changes

2Object-affected harmful factors

If music variations are generated using neural networks, then listener annoyance is reduced, but computational complexity increases

Engineering Contradiction:
Improvelistener annoyanceVSAvoidcomputational complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The system performs preliminary action by pre-training the neural network on extensive music data before actual use. During the training phase, the network learns the structure, patterns, and characteristics of music files. This upfront preparation enables the model to generate variations efficiently during runtime without requiring complex real-time computations, as the heavy learning work is completed beforehand.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The neural network creates copies of the original music with modified parameters rather than generating entirely new compositions. The model learns to replicate the essential characteristics of the training music while introducing controlled variations. This copying approach with parameter modulation is computationally more efficient than de novo composition while still producing novel variations that reduce listener fatigue.

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If token data is inserted in music files to enable variation, then music variability is improved, but manufacturing precision deteriorates

Engineering Contradiction:
Improvemusic variabilityVSAvoidmusic file integrity
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent uses token data as an intermediary mechanism to enable variation while preserving integrity. Tokens are inserted at specific locations in the music file to mark where variations should be applied. The neural network learns to interpret these tokens and generate appropriate musical content that replaces or modifies the token-marked sections. This intermediary approach allows controlled variation without corrupting the overall music file structure.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system employs feedback during training where the neural network generates variations and the training process evaluates whether the original music can be reconstructed or whether the variations maintain acceptable quality. This feedback loop ensures that the variation process does not degrade the music file beyond acceptable thresholds, maintaining manufacturing precision while enabling variability.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10572447B2Generating using a bidirectional RNN variations to music
Publication Date: 2020.02.25 NOKIA TECHNOLOGIES OY
  • US10572447B2 patent drawing
  • US10572447B2 patent drawing
  • US10572447B2 patent drawing

AI summary

Methods and apparatus, including computer program products, are provided for receiving, at a bidirectional recurrent neural network, a music file preprocessed to include at least one token data inserted within at least one location in the music file in order to enable varying the music file; generating, by the bidirectional recurrent neural network, an output music file, wherein the bidirectional recurrent neural network generates music data to replace the at least one token data; and providing, by the bidirectional recurrent neural network, the output music file representing a varied version of the music file. Related apparatus, systems, methods, and articles are also described.