Highlight Learning Module for Sports Video Event Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video processing technologies fail to efficiently identify and extract highlights from sports videos, requiring viewers to watch entire games to find exciting moments, as they are scattered amidst uninteresting content.

Innovation Solution

A highlight learning module that uses event vectors and unsupervised feature extraction to classify video highlights, allowing for the automatic identification of exciting moments by training classifiers on event models developed from low-level features, enabling the separation of highlights from non-highlights in sports videos.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If traditional video processing technologies are used to identify highlights, then the system can process videos, but it requires viewers to watch entire games to find exciting moments, resulting in loss of time

Engineering Contradiction:
Improvetime to find exciting momentsVSAvoidefficiency of highlight identification
Core Design Contradiction:
Loss of timeVSProductivity

Solution Approach 1:

The patent segments the video processing task into multiple components: low-level feature extraction (color, motion, texture), mid-level event detection (throws, catches, runs), and high-level highlight classification. This segmentation allows each component to be optimized independently and processed in parallel, dramatically reducing the time to identify highlights compared to traditional frame-by-frame analysis.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary action by pre-training event models and classifiers on labeled training data before actual highlight detection. The event models are trained to recognize recurring events in sports videos, and classifiers are trained to distinguish highlights from non-highlights based on event vectors. This preliminary training enables rapid highlight identification during actual video processing without requiring viewers to watch entire games.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If manual highlight identification is used, then accuracy can be maintained, but the device complexity and operational effort increase significantly

Engineering Contradiction:
Improveaccuracy of highlight identificationVSAvoidcomplexity of highlight detection system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system implements self-service through automated event detection and highlight classification. The event models automatically detect recurring events in videos by analyzing low-level features, and the trained classifiers automatically determine which segments are highlights. This eliminates the need for manual annotation while maintaining high accuracy, as the system learns from training data and applies the learned patterns automatically to new videos.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical analysis with automated computational processes. Instead of human viewers watching and identifying highlights manually, the system uses computer vision algorithms to extract features, event models to detect patterns, and machine learning classifiers to identify highlights. This substitution of mechanical human analysis with automated computational systems maintains accuracy while reducing operational complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If general video processing methods are applied to sports videos, then the system can handle various video types, but it fails to accurately identify sports-specific highlights

Engineering Contradiction:
Improveapplicability to various sports videosVSAvoidaccuracy of highlight detection
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system achieves universality through event models that are trained to recognize recurring events across different sports videos. The same event models and classification framework can be applied to various sports (baseball, football, soccer, hockey) by training on sport-specific data. The event vectors capture sport-specific patterns while the overall architecture remains universal, allowing the system to adapt to different sports while maintaining accurate highlight detection.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11556743B2Learning highlights using event detection
Publication Date: 2023.01.17 GOOGLE LLC
  • US11556743B2 patent drawing
  • US11556743B2 patent drawing
  • US11556743B2 patent drawing

AI summary

A highlight learning technique is provided to detect and identify highlights in sports videos. A set of event models are calculated from low-level frame information of the sports videos to identify recurring events within the videos. The event models are used to characterize videos by detecting events within the videos and using the detected events to generate an event vector. The event vector is used to train a classifier to identify the videos as highlight or non-highlight.