AR Maintenance Terminal with VSLAM Target Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional maintenance work methods are prone to human errors, such as incorrect equipment inspection and data entry, due to the manual nature of recording and inputting inspection results, which can lead to inefficiencies and inconsistencies, especially in environments like nuclear power plants and factories.
Innovation Solution
A maintenance work support system utilizing augmented reality (AR) and Visual Simultaneous Localization and Mapping (VSLAM) technology, where a portable terminal equipped with a camera and sensors automatically recognizes maintenance targets, superimposes support information onto the real-world image, and integrates data management to reduce errors and enhance efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If manual recording and input methods are used, then workers can perform maintenance tasks with simple tools, but human errors increase and work efficiency decreases
Solution Approach 1:
The patent replaces manual mechanical recording methods with an automated optical recognition system. The portable terminal uses an imaging device to capture images of inspection targets and automatically recognizes information through image processing, eliminating the need for manual writing and input operations. This substitution of mechanical manual operations with optical-mechanical automation directly reduces human errors while improving work efficiency.
Solution Approach 2:
The system enables self-service automation where the portable terminal autonomously performs recognition and data recording without requiring manual intervention. The imaging device automatically captures target information, the processing unit automatically recognizes and extracts data, and the system automatically records inspection results. This self-service mechanism eliminates repetitive manual tasks, reducing both errors and time consumption.
2Reliability
If RFID tags are used for contactless data transmission, then data entry errors are reduced, but the system complexity increases and recognition time increases due to contact requirements
Solution Approach 1:
The patent replaces RFID electromagnetic communication with optical-mechanical image recognition. Instead of using radio frequency tags and readers, the system uses an imaging device to capture visual information of the inspection target and processes this image data to extract identification information. This substitution simplifies the system by eliminating RFID hardware components while maintaining accurate data correspondence through visual recognition.
3Device complexity
If manual writing of inspection results is required, then no additional equipment is needed, but the workload on workers increases and errors occur
Solution Approach 1:
The portable terminal performs self-service automation by autonomously capturing images of inspection targets, automatically recognizing and extracting information from these images, and recording the data without requiring manual writing operations. This eliminates the tedious manual recording workload while the device remains relatively simple and portable, maintaining ease of operation.
Solution Approach 2:
The patent substitutes manual writing operations with automated optical recognition and digital recording. The imaging device captures visual data, the processing unit automatically transcribes information, and the system digitally records results. This replacement of manual mechanical writing with automated optical-mechanical processing significantly reduces worker workload while keeping the equipment simple and portable.
Data Source
AI summary
A maintenance work support system comprising: a database in which support information for supporting maintenance work is registered; a camera-image acquisition unit configured to acquire a camera-image imaged by a camera that is mounted on a terminal possessed by a worker performing the maintenance work; a position/attitude estimation unit configured to estimate a position and attitude of the terminal based on information that is obtained by at least one device mounted on the terminal; a target recognition unit configured to recognize a target of the maintenance work depicted in the camera-image; and a superimposed display unit configured to perform display processing in such a manner that the support information corresponding to the target acquired from the database is superimposed on least part of an image of the target visually recognized by the worker.