Augmented Reality Overlay for Paper Quality Inspection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Papermaking machine operators face challenges in visually identifying quality issues such as wet streaks and uneven areas on the paper sheet, as these problems are not immediately apparent when inspecting the physical sheet, making it difficult to troubleshoot and understand their sources.

Innovation Solution

An augmented reality system on a portable device, equipped with a camera, captures images of the paper sheet and overlays real-time quality measurements, allowing operators to diagnose issues by superimposing sheet information like color maps and profiles onto the image, enabling precise identification of problem locations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If operators visually inspect the physical paper sheet at the reel or along the papermaking machine, then they can directly observe the paper, but they cannot detect quality problems such as wet streaks and light or heavy areas that are not evident to the human eye

Engineering Contradiction:
Improvequality problem detection accuracyVSAvoidvisual inspection effectiveness
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent introduces an intermediary system consisting of a camera, processing system, and augmented reality display that mediates between the physical paper sheet and the operator's perception. The camera captures images of the paper sheet, the processing system generates quality measurement data and color maps, and the augmented reality display overlays this information onto the visual field, enabling operators to detect quality problems that are invisible to the naked eye while maintaining natural visual inspection operations

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent employs color changes as a visual encoding mechanism to represent quality measurement data. Color maps are generated to display basis weight variations, moisture content, and other quality parameters across the paper sheet. These color-coded overlays are superimposed onto the camera image through augmented reality, transforming invisible quality variations into visible color patterns that operators can easily interpret

Inventive Principle:
Principle #32Color changes

2Loss of information

If operators use traditional visual inspection methods, then the operation is simple and direct, but the ability to locate specific quality problems and understand their sources is limited

Engineering Contradiction:
Improvequality problem location informationVSAvoidinspection system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent adds an informational dimension to the traditional two-dimensional visual inspection by overlaying quality measurement data onto the camera image. This creates a multi-layered display where the physical paper image and the quality data layer coexist in the operator's field of view, allowing simultaneous visualization of both the paper's physical appearance and its quality characteristics without requiring separate displays or complex data interpretation

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system creates a digital copy of the paper sheet through camera imaging and overlays quality information onto this copy. Rather than requiring operators to examine the physical sheet directly, the augmented reality display presents a enhanced digital representation that contains both visual and measurement information, reducing the need for direct physical inspection while preserving spatial context

Inventive Principle:
Principle #26Copying

3Productivity

If operators manually inspect paper quality without augmented reality assistance, then the inspection process is simple, but troubleshooting efficiency and response time are reduced

Engineering Contradiction:
Improvetroubleshooting efficiencyVSAvoiddiagnosis time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by continuously capturing images of the paper sheet and pre-processing quality measurement data in real-time. Quality issues are detected and localized before operators need to intervene, with all measurement data and color maps already prepared and ready for immediate overlay display. This eliminates data processing delays during actual inspection and enables instant diagnosis when operators observe abnormalities

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20170241078A1Augmented Reality of Paper Sheet With Quality Measurement Information
Publication Date: 2017.08.24 HONEYWELL LTD(CA)
  • US20170241078A1 patent drawing
  • US20170241078A1 patent drawing
  • US20170241078A1 patent drawing

AI summary

Augmented reality techniques for monitoring and controlling continuous sheetmaking systems superimpose real-time sheet quality measurements onto images of the sheet and/or machine during production. A portable, hand-held computer device that is equipped with a camera, such as a tablet or smartphone, enables an operator to direct the device at the sheet along specific locations of the papermaking machine and view an indication of one or more quality measurements that are superimposed over the image of the paper. The operator can assess and resolve problems associated with the sheet being produced and/or machine.