Compact Audio Stem Separation Modules for Real-Time Playback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional stem separation algorithms require significant computational resources and are typically implemented in high-resource environments, making them unsuitable for resource-constrained devices.

Innovation Solution

Development of condensed, compact, and lightweight stem separation modules that can be implemented on user electronic devices, utilizing neural processing units and other processing circuits to isolate and playback audio stems in real-time or near-real-time, even in resource-constrained environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional stem separation algorithms are used, then stem separation performance is improved, but computational resource requirements increase

Engineering Contradiction:
Improvestem separation performanceVSAvoidcomputational resource requirements
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the audio signal into temporal segments and processes them through a series of processing stages (first processing stage, second processing stage, third processing stage) that divide the complex stem separation task into manageable parts. Each stage handles specific aspects of the separation process, allowing the system to achieve high separation performance while reducing overall computational burden through staged processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs dynamic processing where the system adapts to different audio characteristics and processing conditions. The neural network model dynamically adjusts to varying audio inputs, and the processing stages can be configured with different parameters based on the specific audio content, enabling high performance across diverse scenarios without requiring excessive computational resources for every possible case.

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If stem separation is performed in real-time on user devices, then ease of operation is improved, but power consumption increases

Engineering Contradiction:
Improvereal-time processing capabilityVSAvoidpower consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The patent applies partial processing by implementing a three-stage processing pipeline where not all stages process every audio segment with full intensity. The system can adjust the processing depth based on requirements, applying full processing only when necessary and using lighter processing for less critical cases, thereby maintaining real-time capability while reducing average power consumption.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent utilizes parameter changes by adjusting processing parameters dynamically based on audio characteristics and device conditions. The neural network model parameters can be optimized for different scenarios, and processing parameters such as segmentation duration, processing frequency, and computational intensity can be modified to balance real-time performance requirements with power consumption constraints.

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If lightweight stem separation modules are implemented, then device complexity is reduced, but processing speed decreases

Engineering Contradiction:
Improvemodule sizeVSAvoidprocessing speed
Core Design Contradiction:
Device complexityVSSpeed

Solution Approach 1:

The patent segments the processing into three distinct stages that can be executed sequentially or in parallel depending on device capability. This segmentation allows the system to use a lightweight module structure while maintaining processing speed through efficient stage transitions and potential parallel execution of independent stages, achieving a balance between model size and processing performance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements preliminary processing actions in the first processing stage that prepare and pre-process the audio signal before it enters subsequent stages. This preliminary action reduces the computational burden on later stages and can be performed efficiently with lightweight operations, maintaining overall processing speed while using a more compact module architecture.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12437786B2Stem separation systems and devices
Publication Date: 2025.10.07 MOISES SYSTEMS INC
  • US12437786B2 patent drawing
  • US12437786B2 patent drawing
  • US12437786B2 patent drawing

AI summary

A hardware peripheral is configurable to: (i) receive at least a part of an input audio signal from a first source; (ii) process the part of the input audio signal using a stem separation module to generate stem-separated audio, the stem-separated audio comprising a plurality of audio stems corresponding to different audio sources represented in the part of the input audio signal; and (iii) trigger playback of one or more of the plurality of audio stems by sending the one or more of the plurality of audio stems to a playback device that is in communication with the hardware peripheral such that, following the hardware peripheral receiving the part of the input audio signal, the playback of the one or more of the plurality of audio stems begins at the playback device in real-time or near-real-time.