Chroma Keying for Virtual Advertising in Live Sports Video

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for replacing advertising content in live sports events struggle to effectively replace visible advertising spaces without adding new ones, especially when the advertising is monochrome, as they require encoding of banner images and are limited by the use of primary colors to maintain recognizability and avoid interfering with the event's visuals.

Innovation Solution

A method that generates intensity masks for primary colors present in the advertising feature, calculates a gray scale mask, and uses chroma keying to replace the original content with new content, allowing for transparent overlay and adaptation to lighting and camera settings, enabling replacement without additional characterization beyond the original content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If chroma keying with measured chromaticity is used to replace advertising content, then the replacement can be achieved, but the method requires encoding of banner images and is limited to monochrome advertising spaces

Engineering Contradiction:
Improveadvertising content replacement capabilityVSAvoidencoding requirement
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent uses chroma keying technology to detect and replace advertising content based on color characteristics. By identifying primary colors (red, green, blue, cyan, magenta, yellow) in the camera image and using chromaticity measurement, the system can seamlessly replace advertising banners without requiring encoding of the banner images, thus reducing device complexity while maintaining replacement capability

Inventive Principle:
Principle #32Color changes

Solution Approach 2:

The patent transforms the advertising replacement approach from encoding-based to color-space-based parameter identification. By working in the chromaticity space and using intensity masks for primary colors, the system changes the fundamental parameters used for detection, eliminating the need for banner image encoding and expanding adaptability to various advertising formats

Inventive Principle:
Principle #35Parameter changes

2Productivity

If additional advertising spaces are added to meet market demand, then market potential is increased, but legal restrictions prohibit adding advertising spaces

Engineering Contradiction:
Improveadvertising revenue potentialVSAvoidlegal compliance
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent creates virtual advertising banners that are composited into the camera image in real-time. These virtual banners are generated as digital overlays that replace or supplement physical advertising spaces, allowing multiple advertising opportunities without physically adding more advertising areas, thus maintaining legal compliance while increasing revenue potential

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces a virtual dimension to advertising by compositing digital banners into the video feed. This creates an additional layer of advertising content that exists in the digital domain rather than physical space, allowing advertisers to purchase advertising slots without expanding physical advertising infrastructure, thereby maintaining compliance while increasing productivity

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Adaptability or versatility

If banner advertising uses multiple colors to enhance visual appeal, then advertising effectiveness improves, but recognizability of objects like balls is impaired

Engineering Contradiction:
Improveadvertising design flexibilityVSAvoidobject recognizability
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent segments the color space into distinct primary color regions (red, green, blue, cyan, magenta, yellow) and processes each color separately using intensity masks. This segmentation allows the system to identify and replace advertising content in specific color regions while preserving other areas, enabling colorful advertising designs without interfering with object recognizability in non-advertising regions

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies chroma keying and replacement operations locally to specific regions of the image where advertising content is detected. By using spatial masks and chromaticity thresholds, the system ensures that color-based advertising replacement only affects designated advertising zones, leaving the rest of the scene (including sports balls and players) unchanged and easily recognizable

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables seamless replacement of graphical content in images recorded by a camera, maintaining event visuals and adhering to advertising restrictions by using primary colors, while ensuring recognition and adaptability to varying light and camera conditions, thus enhancing market potential for virtual advertising.

Implementation Method 1

an electronic camera that converts light incident into its lens into electrical signals by means of an electronic image sensor such as a CCD sensor or a CMOS sensor

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Implementation Method 2

the rendered banner content can be combined with the image of the camera by chroma keying with a measured chromaticity

Methodology Applied
Scientific EffectChroma keying:

Data Source

PatentUS10412322B2Method of replacing image content
Publication Date: 2019.09.10 FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
  • US10412322B2 patent drawing
  • US10412322B2 patent drawing
  • US10412322B2 patent drawing

AI summary

A method of replacing graphical content in images of a scene recorded by a camera, wherein the graphical content to be replaced is an image of at least one feature in the scene whose color represents one or more primary colors. The graphical content to be replaced is replaced by replacing content in accordance with a gray scale mask in the image recorded by the camera.