Video Hazard Prediction via Deep Learning Annotation and Repository Comparison

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems lack the capability to automatically predict and prevent dangerous conditions in closed environments, such as facilities, using video analysis without human intervention, which can lead to liability issues due to unforeseen injuries.

Innovation Solution

A computer system utilizing machine learning algorithms to annotate and analyze video data, comparing it to similar recordings to determine a similarity score, and taking corrective action when the score exceeds a threshold, thereby identifying and mitigating potential hazards.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If automated video analysis using machine learning is implemented, then the capability to predict and prevent dangerous conditions is improved, but the device complexity increases

Engineering Contradiction:
Improvesafety prediction capabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system segments the complex video analysis task into distinct functional modules: video data reception module, annotation module using deep learning tools, analysis module for identifying dangerous conditions, comparison module for matching with repository videos, scoring module for similarity assessment, and action generation module. This segmentation allows each module to handle specific aspects of the analysis independently, managing overall system complexity while achieving reliable safety prediction.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary database/repository that stores pre-annotated videos of known dangerous conditions. This intermediary structure serves as a reference library that mediates between the incoming video analysis and the final safety determination, allowing the system to compare analyzed videos against known patterns without requiring complex real-time classification of all possible hazards.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If deep learning annotation is used to analyze video data, then the precision of dangerous condition detection is improved, but the processing time increases

Engineering Contradiction:
Improvedangerous condition detection accuracyVSAvoidvideo processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary annotation of videos in advance and stores them in a repository with pre-identified dangerous conditions. When analyzing new video data, the system compares against these pre-annotated references rather than performing full deep learning annotation in real-time. This preliminary action significantly reduces processing time while maintaining detection precision through the comparison with known patterns.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of performing complete deep learning annotation on every video frame in real-time, the system applies partial annotation by comparing key features against the pre-annotated repository. This partial action approach focuses computational resources only on critical comparison operations rather than full annotation, reducing processing time while maintaining sufficient detection accuracy.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If automated action generation is implemented when threshold is exceeded, then the productivity of hazard mitigation is improved, but the device complexity increases

Engineering Contradiction:
Improvehazard mitigation efficiencyVSAvoidautomation system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system implements self-service automation where the computer automatically generates and executes mitigation actions when the similarity score exceeds the threshold, without requiring human intervention. The system serves itself by autonomously completing the full workflow from video analysis through to action generation, improving hazard mitigation productivity while managing complexity through automated decision rules.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system incorporates feedback mechanisms where the results of automated actions are monitored and used to refine future analysis. The similarity scoring system provides feedback on detection confidence, and the threshold mechanism provides feedback-based decision making. This feedback loop improves productivity by enabling continuous automated operation while managing complexity through established feedback control patterns.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11854264B2Speculative actions based on predicting negative circumstances
Publication Date: 2023.12.26 KYNDRYL INC
  • US11854264B2 patent drawing
  • US11854264B2 patent drawing
  • US11854264B2 patent drawing

AI summary

A computer that identifies the video. The computer annotates the video using a deep learning tool. The computer analyzes the annotated video to highlight a dangerous condition. The computer identifies a video from a repository with the dangerous condition. The computer analyzes the video and the video from the repository using a similarity analysis. The computer determines a score based on the annotated video and based on comparing the video to the video from the repository and based on determining the score is above a threshold value, the computer generates an action.