Audio-Video Marker Scoring for Smoother Content Insertion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for inserting content into media programs, such as commercials, often disrupt the viewing experience due to inconsistent and subjective manual review processes, leading to suboptimal insertion points that fail to consider multiple factors and are resource-intensive.

Innovation Solution

A computer system with an analysis engine and scoring engine that assesses audio and video characteristics around potential insertion points to determine suitability for content insertion, using objective criteria to select optimal insertion points and apply treatments for smoother transitions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual review is used to select insertion points, then insertion suitability can be evaluated, but the process is time-consuming and resource-intensive

Engineering Contradiction:
Improveinsertion suitability evaluationVSAvoidreview time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces the manual mechanical review process with an automated computer-based analysis system that uses audio and video processing algorithms to evaluate insertion points, eliminating the need for human reviewers while maintaining or improving evaluation accuracy

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service automation where the computer automatically analyzes media content, generates scores for potential insertion points, and produces reports without human intervention, making the process efficient and scalable

Inventive Principle:
Principle #25Self-service

2Measurement precision

If manual review is used to select insertion points, then some evaluation can be performed, but results are inconsistent and unpredictable

Engineering Contradiction:
Improveinsertion point evaluation accuracyVSAvoidevaluation consistency
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent transforms subjective manual evaluation into objective parameter-based scoring by analyzing specific audio characteristics (loudness, spectrum, temporal features) and video characteristics (luminance, spatial activity, temporal activity) to generate consistent, reproducible insertion point scores

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

By replacing human reviewers with automated audio-video analysis algorithms, the system eliminates variability in human judgment and produces reliable, consistent evaluation results based on standardized computational criteria

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If content is inserted at designated insertion points, then commercial breaks can be scheduled, but viewing experience is degraded

Engineering Contradiction:
Improvecommercial break schedulingVSAvoidviewing experience disruption
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The patent applies different evaluation criteria and scoring weights to different locations within the media content based on local audio and video characteristics, identifying specific insertion points that minimize disruption to the viewing experience while maintaining scheduling efficiency

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system uses multiple audio parameters (loudness, spectrum correlation, temporal features) and video parameters (luminance, spatial/temporal activity) to objectively identify optimal insertion points that maintain content quality while enabling commercial scheduling

Inventive Principle:
Principle #35Parameter changes

4Ease of operation

If manual review considers limited factors, then review process is manageable, but insertion points are suboptimal

Engineering Contradiction:
Improvereview process manageabilityVSAvoidinsertion point quality
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent incorporates multiple audio parameters (loudness, spectrum characteristics, temporal features) and video parameters (luminance, spatial activity, temporal activity) to comprehensively evaluate insertion points, achieving high-quality results through automated multi-factor analysis

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12413830B2Optimizing insertion points for content based on audio and video characteristics
Publication Date: 2025.09.09 BEIJING YOJAJA SOFTWARE TECHNOLOGY DEVELOPMENT CO LTD
  • US12413830B2 patent drawing
  • US12413830B2 patent drawing
  • US12413830B2 patent drawing

AI summary

One embodiment of the present invention sets forth a technique for inserting content into a media program. The technique includes determining a plurality of markers corresponding to a plurality of locations within a media program. The technique also includes for each marker included in the plurality of markers, automatically analyzing a first set of intervals within the media program that lead up to the marker and a second set of intervals within the media program that immediately follow the marker and determine a set of audio characteristics associated with the first set of intervals and the second set of intervals. The technique further includes generating a plurality of scores for the plurality of markers based on the set of audio characteristics for each marker and inserting additional content at one or more markers included in the plurality of markers based on the plurality of scores.