Automated Audio Post-Processing for Audience Reaction Effects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for adding audience reaction effects to audio recordings are cumbersome, error-prone, and time-consuming, especially for inexperienced users, as they require manual analysis and can result in an inaccurate representation of the audience size and enthusiasm.

Innovation Solution

An automated method for post-processing audio recordings that analyzes characteristics such as audio level, spectral distribution, and musical intensity to identify points of interest, allowing for the addition of audience reaction effects like applause and cheering, which can be amplified to enhance the perceived audience reaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual analysis is used to add audience reaction effects, then the accuracy of placing effects at appropriate points can be improved, but the time consumption and complexity of the process increase

Engineering Contradiction:
Improveaccuracy of placing effectsVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system automatically analyzes the audio recording itself to identify points of interest and determine appropriate placement of audience reaction effects, eliminating the need for manual analysis. The processor extracts features directly from the audio data and autonomously decides where to insert effects based on detected musical structures, applause patterns, and speech segments.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The manual mechanical process of listening and marking points of interest is replaced by an automated digital signal processing system that uses feature extraction, pattern recognition, and algorithmic decision-making to identify appropriate locations for audience reaction effects.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If manual analysis is used to add audience reaction effects, then the control over effect placement can be improved, but the ease of operation deteriorates

Engineering Contradiction:
Improvecontrol over effect placementVSAvoidease of use
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system performs the entire analysis and effect placement process automatically without requiring user intervention. The processor independently identifies points of interest, selects appropriate effect types, and inserts them at the correct positions, making the tool accessible to users regardless of their expertise level.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system pre-identifies all points of interest and pre-selects appropriate effect placements before the user needs to use the functionality. This preliminary automated analysis prepares the audio recording with suggested effect placements that can be applied immediately or reviewed by the user.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If the intensity of audience reaction effects matches the detected first intensity, then the realism is improved, but the perceived audience enthusiasm is limited

Engineering Contradiction:
ImproverealismVSAvoidperceived audience enthusiasm
Core Design Contradiction:
ReliabilityVSIllumination intensity

Solution Approach 1:

The system intentionally modifies the intensity parameter of audience reaction effects, increasing it above the detected first intensity to create a more enthusiastic and immersive listening experience. This parameter change transforms the realistic baseline into an enhanced emotional response.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system applies excessive action by adding audience reaction effects with intensity larger than what would be naturally detected, creating a more vibrant and engaging atmosphere that exceeds the minimal realistic requirement.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP3942551B1Post-processing of audio recordings
Publication Date: 2024.10.16 SONY GROUP CORP
  • EP3942551B1 patent drawingFigure 1
  • EP3942551B1 patent drawingFigure 2
  • EP3942551B1 patent drawingFigure 3

AI summary

A method of post-processing an audio recording in an audio production equipment (101) includes receiving at least one audio track (91) of the audio recording, analyzing one or more characteristics (80) of the at least one audio track (91) to identify a timing of one or more points of interest (251 -254) of a content (201-203, 269) of the at least one audio track (91), and adding, to the audio recording and at the timing of the one or more points of interest (251-254), one or more audience reaction effects (261-264).