Adaptive Workflow System for Live Video Captioning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Outsourcing projects to cost-effective labor sources often fail to deliver promised cost savings due to inadequate management and selection of qualified remote workers, resulting in subpar work that requires revision or redoing.

Innovation Solution

An adaptive workflow system that dynamically assigns captioning projects to remote workers based on past performance ratings, using a voice recognition engine for respeaking, with failover mechanisms and performance rating recalculations to ensure quality and efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple backup respeakers are assigned to each broadcast program, then project reliability is improved, but device complexity increases

Engineering Contradiction:
Improveproject reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by pre-assigning backup respeakers to broadcast programs before any interruption occurs. The project management module automatically identifies and assigns backup workers based on performance ratings, so that when an interruption happens, the failover can occur immediately without needing to search for or train a new backup worker at that moment.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates a copy of the primary respeaker's role by assigning a backup respeaker with similar or comparable skills and performance characteristics. This copying approach ensures that the backup can seamlessly take over the captioning task without requiring extensive retraining or adaptation, thereby maintaining reliability while managing complexity through role replication.

Inventive Principle:
Principle #26Copying

2Manufacturing precision

If performance ratings are used to select and assign workers, then manufacturing precision is improved, but loss of time increases due to rating calculations

Engineering Contradiction:
Improveworker selection precisionVSAvoidrating calculation time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

Performance ratings for all potential respeakers are calculated and stored in advance, before any actual assignment is needed. The system maintains updated performance profiles for each worker based on their historical performance, so that when a assignment decision is needed, the system can immediately query pre-computed ratings rather than calculating them from scratch at the moment of assignment.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The manual or ad-hoc process of evaluating and selecting workers is replaced by an automated computer-based system that objectively calculates performance ratings using standardized metrics. This substitution eliminates subjective judgment and manual evaluation time, providing precise worker selection through automated comparison of stored performance data.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If automated failover mechanisms are implemented, then reliability is improved, but device complexity increases

Engineering Contradiction:
Improvecaption generation reliabilityVSAvoidsystem architecture complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system implements continuous feedback monitoring of the primary respeaker's performance and system status. The failover module constantly receives feedback about whether the primary respeaker is actively generating captions, and automatically triggers the failover process when negative feedback (interruption or failure) is detected, ensuring reliable caption generation without requiring complex manual intervention systems.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The failover mechanism operates autonomously without requiring external intervention. When an interruption is detected, the system automatically activates the backup respeaker and switches over the caption feed, serving itself by detecting and correcting its own operational failures. This self-service approach improves reliability while keeping the control architecture relatively simple.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9026446B2System for generating captions for live video broadcasts
Publication Date: 2015.05.05 SOFTITLER NET INC
  • US9026446B2 patent drawing
  • US9026446B2 patent drawing
  • US9026446B2 patent drawing

AI summary

An adaptive workflow system can be used to implement captioning projects, such as projects for creating captions or subtitles for live and non-live broadcasts. Workers can repeat words spoken during a broadcast program or other program into a voice recognition system, which outputs text that may be used as captions or subtitles. The process of workers repeating these words to create such text can be referred to as respeaking. Respeaking can be used as an effective alternative to more expensive and hard-to-find stenographers for generating captions and subtitles.