Inpainting Neural Network for Automated Pixel Error Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for detecting and correcting pixel errors in images rely heavily on human inspectors, making the process expensive and time-consuming due to the need for manual inspection of every frame in a video production pipeline.

Innovation Solution

An automated system utilizing an inpainting neural network for detecting pixel errors, which uses a computer server with a hardware processor and system memory to analyze input images, generate residual images, and identify anomalous pixels through a process involving partial convolutional layers and batch normalization, enabling concurrent patch prediction and error markup generation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If human inspectors manually check every frame for pixel errors, then detection accuracy is maintained, but the process becomes expensive and time-consuming

Engineering Contradiction:
Improvepixel error detection accuracyVSAvoidinspection time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces the mechanical human inspection process with an automated neural network system. The inpainting neural network automatically analyzes video frames to detect pixel errors, eliminating the need for manual human inspection while maintaining detection accuracy. This substitution directly resolves the contradiction by removing the time-consuming human element while preserving the precision of error detection.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service detection where the neural network autonomously identifies and flags pixel errors without human intervention. The automated framework processes video frames independently, performing quality assurance tasks that previously required human inspectors, thereby reducing both time and cost while maintaining detection capabilities.

Inventive Principle:
Principle #25Self-service

2Reliability

If human inspectors manually check every frame for pixel errors, then comprehensive error detection is achieved, but the cost increases significantly

Engineering Contradiction:
Improveerror detection reliabilityVSAvoidinspection cost
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent replaces expensive human inspection resources with an automated neural network system. The inpainting neural network provides reliable error detection without incurring human labor costs, directly addressing the contradiction between maintaining detection reliability and reducing inspection costs. The automated system delivers consistent performance without the escalating costs associated with manual human inspection.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If automated methods are used for pixel error detection, then processing speed increases, but detection accuracy may decrease

Engineering Contradiction:
Improvedetection speedVSAvoidanomaly detection accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent implements an automated neural network system that achieves both high processing speed and high detection accuracy simultaneously. The inpainting neural network processes video frames rapidly while maintaining accurate pixel error detection, resolving the contradiction by demonstrating that automation does not necessarily compromise precision when implemented with appropriate algorithms.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11210774B2Automated pixel error detection using an inpainting neural network
Publication Date: 2021.12.28 DISNEY ENTERPRISES INC
  • US11210774B2 patent drawing
  • US11210774B2 patent drawing
  • US11210774B2 patent drawing

AI summary

According to one implementation, a pixel error detection system includes a hardware processor and a system memory storing a software code. The hardware processor is configured to execute the software code to receive an input image, to mask, using an inpainting neural network (NN), one or more patch(es) of the input image, and to inpaint, using the inpainting NN, the masked patch(es) based an input image pixels neighboring each of the masked patch(es). The hardware processor is configured to further execute the software code to generate, using the inpainting NN, a residual image based on differences between the inpainted masked patch(es) and the patch(es) in the input image and to identify one or more anomalous pixel(s) in the input image using the residual image.