Salience-Based Video Ad Insertion via White-Space Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for inserting advertisements into videos are inefficient, often disrupting the viewer's experience by overlaying ads on top of the video stream without considering salience, leading to discomfort and reduced effectiveness in capturing attention.

Innovation Solution

A salience-based media manipulation method and system that analyzes video scenes with static backgrounds and limited camera motion to detect white-space candidates and adjust the alignment of advertisement elements, maximizing their salience while minimizing the change in the original scene's salience, thereby integrating ads seamlessly into the video.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If advertisement elements are overlaid on the top layer of the video stream, then the advertisement insertion is simple and efficient, but the original main content of the video is obscured and viewer experience deteriorates

Engineering Contradiction:
Improveadvertisement insertion efficiencyVSAvoidobscuration of original content
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by analyzing different regions of the video frame and identifying white-space candidates based on local salience characteristics. Instead of uniformly overlaying advertisements across the entire video, the system selectively places ads in regions with low salience (white spaces) while preserving high-salience regions for original content, thus resolving the contradiction between insertion efficiency and content preservation

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent employs preliminary action by pre-calculating salience maps and identifying white-space candidate regions before advertisement insertion. This preliminary analysis of the video content allows the system to determine optimal placement locations in advance, ensuring that advertisements are inserted only in regions that will not obscure important visual information, thereby maintaining both efficiency and content quality

Inventive Principle:
Principle #10Preliminary action

2Ease of manufacture

If advertisement elements are displayed at the beginning and during video playback, then the advertisement insertion is straightforward, but viewer experience becomes unpleasant and attention capture effectiveness decreases

Engineering Contradiction:
Improveadvertisement insertion simplicityVSAvoidviewer experience quality
Core Design Contradiction:
Ease of manufactureVSReliability

Solution Approach 1:

The patent applies dynamics by making the advertisement placement adaptive and dynamic based on the video content's salience characteristics. Rather than using fixed placement positions or predetermined slots, the system dynamically identifies white-space candidates in each video frame based on real-time salience analysis, allowing advertisements to be placed optimally according to the actual visual content, thus improving viewer experience while maintaining implementation feasibility

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent employs parameter changes by utilizing salience map parameters to guide advertisement placement decisions. The system transforms the video content into salience space and uses salience values as parameters to determine placement locations, adjusting the placement strategy based on the quantitative salience parameters of different regions, thereby resolving the contradiction between simplicity and effectiveness

Inventive Principle:
Principle #35Parameter changes

3Productivity

If salience information is not incorporated during content insertion, then the insertion process is simpler and faster, but the advertisement elements do not blend into the scene and viewer comfort is reduced

Engineering Contradiction:
Improvecontent insertion speedVSAvoidvisual comfort and blending quality
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent applies self-service by using the video content's own salience information to guide the advertisement placement process. The system extracts salience features from the original video content and uses these self-derived parameters to automatically identify suitable placement regions, eliminating the need for manual placement decisions while ensuring that advertisements blend naturally with the scene, thus resolving the contradiction between automation speed and visual quality

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9432703B2Method and system for inserting contents into video presentations
Publication Date: 2016.08.30 TCL TECHNOLOGY GROUP CORPORATION
  • US9432703B2 patent drawing
  • US9432703B2 patent drawing
  • US9432703B2 patent drawing

AI summary

The present invention provides a salience-based media manipulation method and system for inserting contents into video presentations. The method includes establishing an advertisement-element pool containing a plurality of advertisement elements provided for insertion; obtaining an input video presenting at least one scenes and containing a plurality of original frames; and performing shot grouping and primary scene analysis on the input video to acquire scenes with static background and limited camera motion. The method also includes detecting white-space candidates in the acquired scenes for inserting at least one advertisement element and adjusting alignment between the white-space candidates and the at least one advertisement element. The adjusted alignment increases a salience gain of the advertisement elements and limit salience change of the scenes without insertion. The method further includes generating an output video by inserting the advertisement elements into the white-space candidates according to the adjusted alignment between the white-space candidates and the advertisement elements.