Selective Audio Capture via Process Code Injection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current audio capture technologies for streaming services do not allow for selective capture of audio components from multiple applications, leading to unwanted audio being broadcasted, such as email notifications, and lack control over individual audio components' transmission and volume levels.

Innovation Solution

The solution involves injecting code into computing processes to identify and control audio data storage locations, allowing for selective capture and transmission of audio components, enabling users to choose which audio components to transmit and which to exclude, and adjust volume levels independently for each process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If all audio from applications is captured for broadcasting, then complete audio coverage is achieved, but unwanted audio (email notifications, chat) is included in the stream

Engineering Contradiction:
Improveaudio coverageVSAvoidunwanted audio
Core Design Contradiction:
Quantity of substanceVSObject-affected harmful factors

Solution Approach 1:

The patent segments audio capture by application, allowing selective inclusion or exclusion of audio from individual applications. The audio capture module identifies multiple applications and enables users to specify which applications' audio should be captured and which should be excluded, thereby achieving complete coverage of desired audio while filtering out unwanted audio streams.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary audio capture module that sits between the applications and the broadcast stream. This module intercepts audio output from applications, applies user-defined selection criteria, and forwards only the desired audio to the broadcast stream, thus acting as a mediator that prevents unwanted audio from reaching the stream while maintaining complete capture of wanted audio.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If virtual audio output devices are used to exclude specific applications, then selective audio exclusion is achieved, but device complexity increases and some applications cannot have their audio output device changed

Engineering Contradiction:
Improveselective audio exclusionVSAvoidvirtual device complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a universal audio capture module that can selectively capture or exclude audio from any application regardless of whether the application allows its audio output device to be changed. This multi-functional approach consolidates the selective exclusion capability into a single system that works with all applications uniformly, eliminating the need for application-specific virtual device configurations.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges the selective audio exclusion functionality into the audio capture module itself, combining what would otherwise require multiple virtual audio output devices into a single unified system. This consolidation reduces device complexity by eliminating the need for a complex web of virtual devices while maintaining the ability to selectively exclude audio from any application.

Inventive Principle:
Principle #5Merging (Combining)

3Productivity

If all audio components are transmitted at default volume levels, then simple transmission is achieved, but control over individual audio component volume levels is lost

Engineering Contradiction:
Improvetransmission efficiencyVSAvoidvolume control
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent implements dynamic volume control for each audio component, allowing users to independently adjust the volume level of each application's audio in the broadcast stream. The system maintains flexible volume settings that can be changed in real-time without affecting other audio components, enabling precise control over individual audio component volume levels while maintaining efficient transmission.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11157233B1Application subset selective audio capture
Publication Date: 2021.10.26 TWITCH INTERACTIVE INC
  • US11157233B1 patent drawing
  • US11157233B1 patent drawing
  • US11157233B1 patent drawing

AI summary

Techniques for selective audio capturing are described herein. In some cases, a user, such as a content provider, may select one or more computing processes from which to capture audio data. The audio data may be captured for transmission to at least one other computing device. Code may be injected into at least the one or more computing processes. In some cases, upon execution of the code, storage locations of the audio data are obtained. Thus, the audio data may be captured from the storage locations, and the captured audio data may be transmitted to one or more other computing devices. Additionally, based, at least in part, on a user selection, other audio data from other computing processes executing on the computing device may not be transmitted to the one or more other computing devices.