Ad Insertion in Video Frames Using Face Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Viewers often avoid traditional television commercials by changing channels or using DVRs to skip ads, making it difficult for advertisers to effectively reach their audience, especially with the rise of user-created video services that allow for greater control over content consumption.

Innovation Solution

A processor-based system analyzes video frames to identify areas where ads can be inserted without obstructing active scenes or areas of interest, determining the timing and size of these areas to seamlessly integrate advertisements into the media without disrupting the viewer's experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If advertisements are inserted into media content, then viewer exposure to advertisements is maximized, but the viewing experience is disrupted and key areas of interest may be obstructed

Engineering Contradiction:
Improveviewer exposure to advertisementsVSAvoiddisruption of viewing experience and obstruction of key areas
Core Design Contradiction:
Quantity of substanceVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by analyzing different regions of the video frame and identifying specific areas where advertisements can be inserted without obstructing key content. The system determines insertion locations based on local characteristics of each region, such as whether it contains faces, text, or other important elements, thereby placing ads only in suitable locations to minimize disruption to the viewing experience

Inventive Principle:
Principle #3Local quality

2Measurement precision

If face recognition is used to identify areas of interest, then key areas are accurately identified, but processing time and computational complexity increase

Engineering Contradiction:
Improveaccuracy of area identificationVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-defining a set of candidate insertion locations before the actual advertisement insertion process. The system analyzes video frames in advance to identify potential areas and pre-processes the data to determine suitable insertion points, reducing the computational burden and processing time during the actual ad placement operation

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If multiple insertion areas are identified, then ad placement options increase, but determining the optimal insertion location becomes more complex

Engineering Contradiction:
Improvead placement optionsVSAvoiddetermination of optimal insertion location
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies feedback by implementing an iterative process where the system evaluates multiple insertion areas and refines the selection based on feedback from analysis of video content characteristics. The system continuously monitors factors such as scene type, important element locations, and visual characteristics to adjust and optimize the insertion location selection, making the complex determination process more systematic and manageable

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10715839B2Scheme for determining the locations and timing of advertisements and other insertions in media
Publication Date: 2020.07.14 SONY INTERACTIVE ENTERTAINMENT LLC
  • US10715839B2 patent drawing
  • US10715839B2 patent drawing
  • US10715839B2 patent drawing

AI summary

A non-transitory computer readable storage medium stores one or more computer programs adapted to cause a processor based system to execute steps that include analyzing an image, identifying one or more faces in the image using a face recognition technique, designating at least one of the identified faces collectively as a first area of interest, and determining whether an insertion area exists in the image where additional content can be inserted without obstructing the first area of interest. Another computer program is adapted to cause a processor based system to execute steps that include determining whether the insertion area can be divided into two or more regions based on color. Methods and processor based apparatuses that perform one or more of these steps are also disclosed.