Printer Error Analysis Using Computer Vision and Machine Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users of printers with limited output capabilities, such as LEDs or 7-segment displays, face difficulties in quickly identifying device errors like paper jams or ink levels without consulting manuals, as they need to interpret complex light patterns.

Innovation Solution

A computer-vision system that captures videos of light emitters on the printer, uses machine-learning models to analyze light-emitting states over time, and determines the device's status, providing users with clear and immediate alerts about the printer's condition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If LEDs or 7-segment displays are used to alert users of device issues, then the device can provide status information, but users must search through manuals to interpret light patterns, increasing the time and complexity of error identification

Engineering Contradiction:
Improvestatus information deliveryVSAvoiderror identification time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

A camera-based imaging device serves as an intermediary between the printer's LED status indicators and the user. The imaging device captures images of the illuminated LEDs, processes them through machine learning models to interpret the light patterns, and presents the results in user-friendly formats such as colored overlays or text descriptions. This intermediary system eliminates the need for users to consult manuals while preserving the original LED status information.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates a visual copy of the LED status information by capturing images of the illuminated LEDs and overlaying colored indicators on the captured images. This visual copy directly represents the device status without requiring users to interpret complex light patterns or reference manual documentation, thereby reducing error identification time.

Inventive Principle:
Principle #26Copying

2Loss of information

If complex light patterns are used to convey multiple device statuses, then more information can be communicated with limited display elements, but the difficulty of detecting and measuring the status increases

Engineering Contradiction:
Improvestatus information capacityVSAvoidlight pattern interpretation
Core Design Contradiction:
Loss of informationVSDifficulty of detecting and measuring

Solution Approach 1:

The imaging device and machine learning system act as intermediaries that handle the complexity of interpreting light patterns. The system captures images of the LEDs, uses trained machine learning models to decode the complex light patterns, and presents simplified visual feedback through colored overlays or text descriptions, making the status information easily detectable without increasing information capacity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The manual interpretation process is replaced with an automated optical and computational system. Instead of users visually analyzing light patterns and consulting manuals, the system uses image capture, machine learning inference, and automated visual presentation to interpret and communicate device status, substituting mechanical human cognition with automated computational analysis.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Loss of time

If a camera-based system with machine learning models is implemented, then users can quickly identify device errors, but the device complexity increases

Engineering Contradiction:
Improveerror identification timeVSAvoidsystem architecture
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The complexity of the machine learning system is isolated in an intermediary imaging device rather than being integrated into the printer itself. This separation allows the printer to maintain its original simple architecture while the imaging device handles all complex processing, including image capture, machine learning inference, and result presentation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates visual copies of the LED status information through image capture and colored overlays. This copying approach allows the complex interpretation logic to be implemented in software rather than hardware, reducing the complexity burden on the physical device while maintaining fast error identification capabilities.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11113568B2Devices, systems, and methods for device-error analysis using computer vision and machine learning
Publication Date: 2021.09.07 CANON KK
  • US11113568B2 patent drawing
  • US11113568B2 patent drawing
  • US11113568B2 patent drawing

AI summary

Devices, systems, and methods obtain a video of a device, wherein the device includes one or more light emitters that are visible in the video; input the video to a first machine-learning model and executing the first machine-learning model, wherein the first machine-learning model outputs a time series of light-emitting states that indicate respective light-emitting states of the light emitters at respective times in the time series; and input the time series of light-emitting states to a second machine-learning model and executing the second machine-learning model, wherein the second machine-learning model outputs a status of the device.