AR Tool Tracking via Head-Mounted Optical Sensing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Maintaining an accurate inventory of tools in large factories is challenging due to the increasing number of workers and tools, leading to misplaced or misused equipment, which can result in inefficiencies and costly repairs.

Innovation Solution

A system utilizing head-mounted devices with sensors and a dedicated tool board to track tool locations and inventory, using computer vision and augmented reality to identify and guide users on tool usage, ensuring correct tools are used for tasks and preventing misplacement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual inventory processes are used to track tools, then worker time and attention can be allocated to inventory management, but the inventory becomes stale quickly and requires worker downtime for items being inventoried

Engineering Contradiction:
Improveinventory accuracyVSAvoidworker downtime
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces manual mechanical inventory processes with an automated optical sensing system. Head-mounted devices with cameras and processors automatically detect, identify, and track tools in real-time, eliminating the need for workers to manually inventory items. This substitution of mechanical/manual operations with automated sensing and processing systems resolves the contradiction by maintaining high inventory accuracy without requiring worker downtime.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service inventory management where the automated detection system continuously monitors tool locations and statuses without human intervention. The head-mounted devices independently perform inventory tasks, updating the central system in real-time, which eliminates the need for dedicated worker time for inventory management while maintaining continuous accuracy.

Inventive Principle:
Principle #25Self-service

2Productivity

If the number of workers and tools increases to meet production demands, then productivity increases, but tracking inventory becomes increasingly difficult

Engineering Contradiction:
Improveproduction outputVSAvoidinventory tracking complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The head-mounted devices serve multiple functions simultaneously: they detect tools, identify them, track their locations, monitor their statuses, and communicate with the central system. This multi-functionality allows the system to handle increasing numbers of workers and tools without proportionally increasing tracking complexity, as the same device performs all inventory management tasks.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent replaces complex manual tracking methods with automated optical sensing and digital processing. The system uses cameras, image processing algorithms, and centralized databases to automatically manage inventory across increasing numbers of workers and tools, transforming the complexity from manual coordination to automated digital management that scales more efficiently.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of operation

If tools are freely accessible to workers, then ease of operation improves, but tools can be misplaced or lost reducing worker efficiency

Engineering Contradiction:
Improvetool accessibilityVSAvoidtool availability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system continuously provides feedback to workers about tool locations and availability through the head-mounted display. The real-time tracking and visualization of tool positions enable workers to easily locate and access tools while the system simultaneously monitors and alerts when tools are misplaced or returned, maintaining both accessibility and reliability.

Inventive Principle:
Principle #23Feedback

4Adaptability or versatility

If unskilled workers are provided with tools, then labor flexibility increases, but they may use the wrong tool leading to machine malfunction and costly repairs

Engineering Contradiction:
Improvelabor flexibilityVSAvoidmachine functionality
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system provides real-time feedback to workers about the correct tools for specific tasks. The head-mounted display shows guidance information, tool requirements, and verification of proper tool selection, enabling unskilled workers to use tools correctly without extensive training while maintaining machine safety and functionality.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10679337B2System and method for tool mapping
Publication Date: 2020.06.09 RPX CORP
  • US10679337B2 patent drawing
  • US10679337B2 patent drawing
  • US10679337B2 patent drawing

AI summary

A mobile device identifies a user task provided by an augmented reality application at a mobile device. The mobile device identifies a first physical tool valid for performing the user task from a tool compliance library based on the user task. The mobile device detects and identifies a second physical tool present at the mobile device. The mobile device determines whether the second physical tool matches the first physical tool. The mobile device display augmented reality content that identifies at least one of a missing physical tool, an unmatched physical tool, or a matched physical tool based on whether the second physical tool matches the first physical tool.