Video Frame Clustering for Uniform Advertisement Insertion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional advertisement insertion technologies fail to uniformly insert advertisements into video frames, leading to disrupted content and user distraction, and lack methods for determining optimal virtual indirect advertisement regions and minimizing inpainting regions.

Innovation Solution

A device and method for inserting advertisements using frame clustering, which searches for and clusters advertisement target frames, applies a clustering factor for uniform advertisement insertion, determines candidate regions for virtual indirect advertisements, measures exposure levels, and performs inpainting to harmonize with the surrounding image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If advertisement images are inserted into video frames without frame clustering, then the advertisement insertion process is simple, but the advertisement insertion is not uniform across frames causing user distraction and content disruption

Engineering Contradiction:
Improveuniformity of advertisement insertionVSAvoidcomplexity of advertisement insertion system
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by performing frame clustering and identifying advertisement insertion target frames before actually inserting the advertisement. The system pre-processes the video frames to group them into clusters and determines which frames are suitable for advertisement insertion, ensuring uniformity across all frames while maintaining a manageable process complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the video processing task into distinct phases: frame clustering, identification of advertisement insertion target frames, and advertisement insertion. By dividing the process into these segments, the system achieves uniform advertisement insertion across frames without overwhelming complexity, as each segment handles a specific aspect of the problem.

Inventive Principle:
Principle #1Segmentation

2Reliability

If advertisement insertion regions are determined for all frames individually, then the advertisement can be inserted into each frame, but the processing time and computational resources increase significantly

Engineering Contradiction:
Improvecompleteness of advertisement insertionVSAvoidprocessing time for advertisement insertion
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent merges multiple frames into clusters based on their similarity, and then determines advertisement insertion target frames at the cluster level rather than individually for each frame. This merging approach ensures that advertisements are inserted into all relevant frames (maintaining completeness) while significantly reducing processing time and computational resources by handling clusters as unified groups.

Inventive Principle:
Principle #5Merging (Combining)

3Productivity

If virtual indirect advertisement regions are determined without exposure level measurement, then the insertion process is faster, but the advertising effectiveness cannot be optimized

Engineering Contradiction:
Improvespeed of advertisement insertionVSAvoidadvertising effect information
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent applies self-service by automatically measuring exposure levels and providing guide information to users without requiring manual assessment. The system performs exposure level measurements and presents the results to help users select optimal advertisement insertion regions, maintaining fast processing speed while preserving advertising effect information through automated analysis.

Inventive Principle:
Principle #25Self-service

4Object-generated harmful factors

If inpainting is performed on large regions to eliminate markers, then the markers are completely removed, but the inpainting costs and processing time increase

Engineering Contradiction:
Improvevisibility of markersVSAvoidinpainting computational resources
Core Design Contradiction:
Object-generated harmful factorsVSLoss of energy

Solution Approach 1:

The patent applies local quality by determining inpainting regions specifically based on marker locations rather than processing entire frames. The system identifies where markers are present and performs inpainting only on those localized regions, completely removing marker visibility while minimizing computational resources and processing time by avoiding unnecessary processing of marker-free areas.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10904638B2Device and method for inserting advertisement by using frame clustering
Publication Date: 2021.01.26 ELEVEN STREET CO LTD
  • US10904638B2 patent drawing
  • US10904638B2 patent drawing
  • US10904638B2 patent drawing

AI summary

The present invention is directed to a device and method for inserting an advertisement using frame clustering. According to the present invention, when an advertisement insertion region is set in at least one of the frames of a video, advertisement insertion target frames including advertisement insertion regions are searched for and clustered, and an advertisement is inserted for all the clustered frames in a uniform manner, thereby enabling the natural insertion of the advertisement.