Head-Mounted Display Maintenance Support for Factory Equipment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing maintenance processes for factory equipment are burdensome for operators, as they require manual visual checks, recording, and data input, leading to potential overlooks of equipment abnormalities and increased costs in establishing network-connected management systems.

Innovation Solution

A maintenance support device and system using a head-mounted display with image analysis, data storage, and augmented reality to extract and display maintenance information directly to operators, reducing the need for manual data collection and enabling timely abnormality detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual visual checks and data recording are used, then operator flexibility is maintained, but operator burden increases and abnormality detection precision deteriorates

Engineering Contradiction:
Improveabnormality detection precisionVSAvoidoperator burden
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces the mechanical manual checking system with an automated image recognition system. The head-mounted display captures images of measurement devices, and an image recognition unit automatically extracts and records data, substituting the operator's manual visual inspection and recording actions with automated optical and computational processes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service by allowing the measurement devices to be automatically monitored and recorded without requiring operator intervention. The image capture unit and recognition system continuously collect data autonomously, and the head-mounted display presents information to operators without requiring them to manually check or record data.

Inventive Principle:
Principle #25Self-service

2Extent of automation

If network-connected management systems are established, then centralized control capability is improved, but system complexity and costs increase

Engineering Contradiction:
Improvecentralized control capabilityVSAvoidsystem complexity
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The head-mounted display serves multiple functions: it captures images via the image capture unit, processes data through the image recognition unit, stores information in the data storage unit, displays results on the display unit, and outputs data through the output unit. This multi-functional device consolidates what would otherwise require separate network-connected systems into a single portable unit.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent extracts the core data collection and processing functions from a complex networked management system and concentrates them in a portable head-mounted display device. This extraction allows centralized control capability to be achieved without requiring extensive network infrastructure or complex system integration.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10838211B2Maintenance support device and maintenance support system for factory equipment
Publication Date: 2020.11.17 FANUC LTD
  • US10838211B2 patent drawing
  • US10838211B2 patent drawing
  • US10838211B2 patent drawing

AI summary

A maintenance support device includes: an image analysis unit configured to extract information indicating an operational state of a piece of factory equipment, based on a real image acquired by an image capture unit of a head-mounted display including a display unit and an image capture unit configured to acquire a real image; a data storage unit configured to store the information indicating the operational state; a data analysis unit configured to determine whether or not an abnormality has occurred in a piece of factory equipment, based on the stored information indicating the operational state; and a display control unit to cause the display unit to display the augmented reality image in which an additional image is superimposed on the real scene, the additional image indicating maintenance information for the piece of factory equipment with respect to which the data analysis unit has determined that an abnormality has occurred.