Dynamic Game Soundtrack Replacement via Emotional Audio Classification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users of video and computer games have limited control over game background soundtracks, leading to dissatisfaction when their music preferences differ from those of the game developers, resulting in a desire to replace predefined soundtracks with personal music choices.

Innovation Solution

A method and system that analyze game background soundtracks to extract audio parameters, determine emotional classifications, and match them with user-selected music from a personal library, allowing dynamic and seamless replacement of game soundtracks with user soundtracks while preserving in-game sounds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If game background soundtracks are predefined by developers, then the emotional experience intended by developers is preserved, but user control and personalization are limited

Engineering Contradiction:
Improveuser control over soundtrackVSAvoidemotional experience consistency
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system dynamically replaces static predefined soundtracks with user-selected music based on real-time emotional classification of game scenes. The soundtrack changes adaptively according to detected emotional contexts (e.g., happy, sad, angry, fearful) while maintaining consistency with the intended emotional experience through algorithmic matching.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the parameter of music selection from fixed (predefined by developers) to variable (user-selected based on emotional classification). By extracting audio parameters and classifying emotions, the system enables flexible soundtrack selection that adapts to different game scenarios while preserving emotional integrity.

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If users replace game background soundtracks with personal music, then user preferences are satisfied, but the emotional experience intended by developers may be compromised

Engineering Contradiction:
Improveuser music selectionVSAvoidemotional experience preservation
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system uses emotional classification as feedback to guide soundtrack selection. By analyzing audio parameters and determining emotional contexts of game scenes, the system provides intelligent feedback that matches user-selected music to appropriate emotional scenarios, ensuring that personalization does not compromise the intended emotional experience.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The emotional classification algorithm acts as an intermediary between user music selection and game scenes. It mediates by classifying the emotional context of each scene and matching it with user-selected music that aligns with that emotion, thereby preserving the emotional experience while enabling user control.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If game background soundtracks are replaced with user music, then user satisfaction increases, but system complexity increases

Engineering Contradiction:
Improvesoundtrack customizationVSAvoidaudio processing system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The audio processing system segments the game soundtrack into distinct emotional scenes through emotional classification. By dividing the continuous audio stream into discrete emotional segments (happy, sad, angry, fearful), the system simplifies the replacement process by matching user music to specific emotional segments rather than processing the entire soundtrack uniformly.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs self-service by automatically extracting audio parameters, classifying emotions, and matching user music to appropriate scenes without requiring manual user intervention. This automation reduces the operational complexity for users while maintaining high adaptability in soundtrack customization.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10661175B2Intelligent user-based game soundtrack
Publication Date: 2020.05.26 SONY INTERACTIVE ENTERTAINMENT LLC
  • US10661175B2 patent drawing
  • US10661175B2 patent drawing
  • US10661175B2 patent drawing

AI summary

A method, system, and processor-readable storage medium for providing audio playback are disclosed to enable users to replace background music in a computer or video game with music of user choice, while preserving other in-game sounds. An example method comprises receiving a game music stream from a gaming application of a user which includes a game background soundtrack and in-game sounds, extracting audio parameters of the game background soundtrack, determining an emotional classification of the game background soundtrack based on the audio parameters of the game background soundtrack, selecting a user soundtrack from a user music library that matches the emotional classification of game background soundtrack, replacing at least a part of the game background soundtrack with the user soundtrack, and providing a replacement game music stream to the user, the replacement game music including the user soundtrack and the in-game sounds.