Facial Recognition Video Augmentation via Automated Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for creating interactive video content require significant manual configuration and planning, discouraging its production and distribution, especially on non-interactive platforms like televisions, where embedded interactivity has not become commonplace.

Innovation Solution

A computer-based method for augmenting video with facial recognition features, involving facial detection, automatic object-tracking, and recognition algorithms to enable interactive links along a face's track in video frames, allowing users to access additional information about identified individuals.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If manual configuration and planning methods are used to create interactive video content, then the precision of interactivity embedding is improved, but the productivity and ease of manufacture deteriorate due to significant manual effort required

Engineering Contradiction:
Improveinteractivity embedding precisionVSAvoidinteractive content production efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The system performs automatic face detection, tracking, and interactive link configuration without requiring manual intervention. The video processing apparatus autonomously identifies faces in video frames, tracks their movement across frames, and embeds interactive links along the detected face tracks, enabling the system to serve itself in creating interactive video content.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical configuration processes with automated computer vision algorithms. Face detection algorithms automatically identify faces in video frames, tracking algorithms replace manual frame-by-frame annotation, and the system automatically generates interactive links, substituting the mechanical manual process with an automated computational system.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If automatic face detection and tracking algorithms are implemented, then the productivity of interactive video creation is improved, but the device complexity increases due to multiple processing algorithms required

Engineering Contradiction:
Improveinteractive video creation efficiencyVSAvoidvideo processing system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent combines face detection, face tracking, and interactive link configuration into a single integrated video processing apparatus. These previously separate functions are merged into one system that processes video frames continuously, detecting faces and establishing interactive links in an automated workflow, thereby managing complexity through integration rather than separate components.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The video processing apparatus performs multiple functions: it detects faces in video frames, tracks face movement across multiple frames, identifies face tracks, and configures interactive links along those tracks. This multi-functional system handles the entire interactive video creation process within a single apparatus, improving productivity while consolidating complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If interactive features are embedded in video content, then the user engagement and information accessibility are improved, but the ease of operation deteriorates on non-interactive platforms like televisions

Engineering Contradiction:
Improveinformation accessibilityVSAvoidplatform compatibility
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system segments the video content by identifying and tracking individual faces as separate interactive objects. Each face becomes an independent interactive element with its own link, allowing the video to maintain its original playback on non-interactive platforms while enabling interactivity when viewed on capable devices. The segmentation of faces into discrete trackable objects facilitates platform-agnostic distribution.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary layer of face track data that bridges traditional video playback and interactive features. The face tracking information serves as metadata that can be ignored by non-interactive platforms (like televisions) while being utilized by interactive media players to enable enhanced user engagement, thus mediating between different platform capabilities.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9047376B2Augmenting video with facial recognition
Publication Date: 2015.06.02 HULU LLC
  • US9047376B2 patent drawing
  • US9047376B2 patent drawing
  • US9047376B2 patent drawing

AI summary

A video segment including interactive links to information about an actor appearing in the segment may be prepared in an automatic or semi-automatic process. A computer may detect an actor's face appearing in a frame of digital video data by processing the video file with a facial detection algorithm. A user-selectable link may be generated and activated along a track of the face through multiple frames of the video data. The user-selectable link may include a data address for obtaining additional information about an actor identified with the face. The video data may be associated with the user-selectable link and stored in a computer memory. When later viewing the video segment via a media player, a user may select the link to obtain further information about the actor.