Augmented Reality Fastening Traceability via Visual Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing mechanical fastening work management systems require RFIC tags on bolts and tools, increasing operating costs and complexity, and lack efficient traceability methods for ensuring accurate torque settings and handover of work data between workers.

Innovation Solution

A method utilizing augmented reality to generate a virtual space overlapping with the real space, allowing workers to record and transmit tightening/loosening information directly through a camera and server, eliminating the need for RFIC tags and enabling traceability without additional identification marks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If RFIC tags are provided on all bolts and tools are equipped with antennas for data transmission, then traceability for fastening tools and bolts is improved, but operating cost increases

Engineering Contradiction:
ImprovetraceabilityVSAvoidoperating cost
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The patent extracts the identification function from physical RFIC tags on bolts and separates it into a camera-based visual recognition system. The camera captures images of bolts and tools, and the server extracts identification information from these images, eliminating the need for expensive RFIC tags and antennas while maintaining traceability.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent creates a virtual copy of the physical fastening environment in the augmented reality space. Virtual fastening parts correspond one-to-one with physical parts, and work content is recorded in this virtual space. This allows traceability without physical identification marks, as the virtual model tracks all fastening operations.

Inventive Principle:
Principle #26Copying

2Reliability

If RFIC tags and antenna-equipped tools are used for data transmission, then work data traceability is improved, but device complexity increases

Engineering Contradiction:
Improvework data traceabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical/electronic RFIC tag and antenna system with an optical system using a camera. The camera captures visual information of bolts and tools, and the server processes this visual data to extract identification information and record work content, simplifying the overall system architecture.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The camera serves multiple functions: capturing bolt identification information, recording tool information, and documenting work content. This multi-functional approach replaces the specialized RFIC tags and antennas, reducing system complexity while maintaining comprehensive traceability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of manufacture

If a camera and server system with augmented reality is implemented, then traceability without RFIC tags is achieved, but measurement and detection difficulty increases

Engineering Contradiction:
Improvecost reductionVSAvoidimage analysis complexity
Core Design Contradiction:
Ease of manufactureVSDifficulty of detecting and measuring

Solution Approach 1:

The patent introduces an augmented reality space as an intermediary between the physical fastening environment and the traceability system. The AR space provides a visual interface that overlays virtual information on the real workspace, making it easier to identify and track fastening parts without complex image analysis.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transforms the detection problem from extracting data from physical RFIC tags to recognizing visual features in camera images within an augmented reality context. The AR environment structures the visual information, making parameter extraction and identification more straightforward despite the increased initial system complexity.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12094067B2Machine fastening work method using augmented reality
Publication Date: 2024.09.17 HITACHI LTD
  • US12094067B2 patent drawing
  • US12094067B2 patent drawing
  • US12094067B2 patent drawing

AI summary

In a mechanical fastening work method in an augmented reality space, a mechanical fastening part and a mechanical fastening part virtual body correspond one-to-one, and a tool and a tool virtual body correspond one-to-one. An augmented reality configuration system generates an augmented reality space including: a camera that captures a real space; a server that analyzes an image captured by the camera and generates the augmented reality space; and a tool that acquires torque information observed when tightening or loosening the mechanical fastening part and transmits and receives the torque information to and from the server. The mechanical fastening work method includes a step of, when the tool detects torque information that the mechanical fastening part is to be tightened or loosened, defining the mechanical fastening part virtual body corresponding one-to-one to the mechanical fastening part, and making the defined mechanical fastening part virtual body appear in the virtual space.