AR Screw-Tightening Guidance for Hidden Fastening Locations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In screw-tightening tasks, especially when fastening locations are difficult to see or hidden, workers face challenges in accurately positioning tools and applying the correct torque, leading to errors such as missed screws or improper tightening sequences.

Innovation Solution

A processing device and head-mounted display system that displays virtual objects indicating fastening locations at positions separate from the actual locations, allowing workers to easily identify where to position their hands and tools, and provides guidance through augmented reality, associating data from tools with the virtual objects to ensure accurate screw tightening.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If virtual objects are displayed at the actual fastening locations, then workers can see the screw positions, but the virtual objects may be obscured or difficult to see when fastening locations are hidden

Engineering Contradiction:
Improvevisibility of fastening location informationVSAvoidobscuration of virtual objects
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent displays virtual objects in a separated position rather than directly at the fastening location, effectively moving the information display to a different spatial dimension where it remains visible and not obscured by the workpiece or fastening area

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system introduces an intermediary virtual indicator object that mediates between the worker and the actual fastening location, providing visual guidance without requiring the indicator to be placed directly at the obscured location

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If virtual objects are displayed at separated positions, then virtual objects remain visible and guide workers effectively, but workers may have difficulty accurately positioning tools at the actual fastening locations

Engineering Contradiction:
Improvevisibility and guidance for workersVSAvoidpositioning accuracy of tools
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The virtual indicator object serves as an intermediary that provides clear visual guidance while the system maintains the ability to detect actual tool positioning through sensor data, bridging the gap between visual guidance and precise positioning

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system incorporates feedback mechanisms that detect the actual position of tools and provide real-time information to determine when the tool has reached the correct fastening location, ensuring positioning accuracy despite the separated display position

Inventive Principle:
Principle #23Feedback

3Loss of information

If the system displays detailed information at fastening locations, then workers receive comprehensive guidance, but the system complexity increases

Engineering Contradiction:
Improveguidance information deliveryVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent extracts the information display function from the fastening location itself and places it in a separated position, simplifying the overall system by decoupling the display location from the operational location

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system uses virtual indicator objects that are visual representations or copies of the fastening location information, displayed at separated positions, providing comprehensive guidance without requiring complex physical modifications at the fastening locations

Inventive Principle:
Principle #26Copying

Data Source

PatentEP4261636A1Processing device, processing system, head mounted display, processing method, program, and storage medium
Publication Date: 2023.10.18 KK TOSHIBA
  • EP4261636A1 patent drawingFigure 1
  • EP4261636A1 patent drawingFigure 2
  • EP4261636A1 patent drawingFigure 3~4

AI summary

According to one embodiment, a processing device (10) causes a display of a first object at a position separated from a fastening location of a screw. The first object is virtual and indicates the fastening location. The processing device associates first data and second data when a prescribed physical object contacts the first object and the first data is received from a tool turning the screw. The second data is related to the fastening location.