Machine Learning Video Insertion Zone Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current digital object insertion in videos is a time-consuming, multi-stage process that relies heavily on human operators for identifying suitable insertion zones and contextually relevant objects, limiting the volume of video material that can be analyzed efficiently.

Innovation Solution

A system utilizing machine learning to identify candidate insertion zones and determine suitable object types by processing video frames, incorporating scene descriptors and regional context probability vectors to automate the identification of pixels suitable for object insertion, and providing a Video Impact Score for optimization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual analysis by human operators is used to identify insertion zones and suitable objects, then the quality of contextual relevance is improved, but the time required and volume of video material that can be analyzed is limited

Engineering Contradiction:
Improvequality of contextual relevanceVSAvoidvolume of video material analyzed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent introduces machine learning models as intermediary systems between the video content and human operators. These models automatically analyze video frames, identify insertion zones, and suggest suitable objects, thereby mediating the analysis process. This allows operators to review pre-processed content rather than analyzing everything from scratch, significantly increasing the volume of video material that can be efficiently reviewed while maintaining contextual relevance through human-in-the-loop validation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If a multi-stage processing approach is used for digital object insertion, then the comprehensiveness of analysis is improved, but the time required for processing is increased

Engineering Contradiction:
Improvecompleteness of insertion opportunity identificationVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by using machine learning models to perform automated pre-analysis of video content before human operators intervene. The system pre-identifies insertion zones, pre-determines suitable objects, and pre-ranks opportunities based on contextual relevance. This preliminary processing reduces the time operators need to spend on manual analysis while maintaining comprehensive coverage through the multi-stage approach that combines automated screening with human validation.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If automated machine learning systems are used to identify insertion zones and objects, then the speed of analysis is improved, but the complexity of the system is increased

Engineering Contradiction:
Improvespeed of analysisVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the complex object insertion analysis system into distinct functional modules: video processing module, insertion zone detection module, object suggestion module, and scoring module. Each module handles a specific aspect of the analysis independently, which simplifies the overall system architecture while maintaining high processing speed. The segmentation allows each component to be optimized separately and facilitates easier debugging and maintenance despite the automated nature of the system.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10671853B2Machine learning for identification of candidate video insertion object types
Publication Date: 2020.06.02 MIRRIAD ADVERTISING PLC
  • US10671853B2 patent drawing
  • US10671853B2 patent drawing
  • US10671853B2 patent drawing

AI summary

The method disclosure provides methods, systems and computer programs for identification of candidate video insertion object types using machine learning. Machine learning is used for at least part of the processing of the image contents of a plurality of frames of a scene of a source video. The processing includes identification of a candidate insertion zone for the insertion of an object into the image content of at least some of the plurality of frames and determination of an insertion zone descriptor for the identified candidate insertion zone, the insertion zone descriptor comprising a candidate object type indicative of a type of object that is suitable for insertion into the candidate insertion zone.