Augmented Reality Spatial Guidance for Assembly Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current guidance systems for complex assembly procedures in industrial settings are inadequate as they are typically two-dimensional, leading to errors due to the lack of three-dimensional visualization, and do not integrate with external tools or verify if actions are performed correctly on specific components according to specifications.

Innovation Solution

An augmented reality spatial guidance and procedure control system that uses a mixed-reality headset to superimpose virtual indicators over real objects, guiding operators through procedures with smart tools that communicate with a data-processing system to ensure correct actions and store results, and includes spatial-positioning subsystems for accurate alignment and tracking.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If two-dimensional guidance systems are used, then device complexity is reduced, but manufacturing precision deteriorates due to lack of three-dimensional visualization

Engineering Contradiction:
Improveguidance system complexityVSAvoidassembly accuracy
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent transitions from two-dimensional guidance representations to three-dimensional augmented reality guidance. The system superimposes virtual indicators directly onto the physical workpiece in three-dimensional space, allowing operators to see assembly instructions in the same spatial context as the actual components, thereby improving assembly accuracy without significantly increasing system complexity

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces a camera and display system as an intermediary between the operator and the workpiece. The camera captures images of the physical workspace, and the display superimposes virtual guidance indicators onto these images, creating an augmented reality interface that provides three-dimensional visualization while maintaining relatively simple device architecture

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If laser guidance systems are used, then manufacturing precision is improved through three-dimensional visualization, but object-affected harmful factors increase due to vision safety risks

Engineering Contradiction:
Improveassembly accuracyVSAvoidvision safety risk
Core Design Contradiction:
Manufacturing precisionVSObject-affected harmful factors

Solution Approach 1:

The patent replaces laser-based guidance systems with a camera-based augmented reality system. Instead of using lasers to project guidance information, the system uses a camera to capture the workspace and a display to show virtual indicators overlaid on the captured images. This substitution eliminates the vision safety risks associated with lasers while maintaining three-dimensional visualization capabilities

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent converts the potential harm of laser radiation into a beneficial approach by using passive optical elements (camera and display) that do not emit harmful radiation. The system achieves its guidance function through image capture and display rather than active laser projection, thereby eliminating safety risks while preserving the three-dimensional visualization benefit

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

3Ease of operation

If simple guidance systems are used, then ease of operation is improved, but reliability deteriorates due to inability to verify correct action performance

Engineering Contradiction:
Improveguidance simplicityVSAvoidprocedure verification capability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent incorporates a verification mechanism that provides feedback to confirm correct procedure execution. The system captures images of the workpiece and uses image recognition to verify whether the operator has performed the required actions correctly. This feedback loop maintains ease of operation while significantly improving reliability by ensuring procedural compliance

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent makes the guidance system multi-functional by combining guidance provision with verification capability. The same camera and processing system that displays virtual indicators also captures images to verify that operators have completed the required actions. This universal system performs both guidance and verification functions, improving reliability without complicating the operation

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11450048B2Augmented reality spatial guidance and procedure control system
Publication Date: 2022.09.20 MARCHAND STACEY LEIGHTON
  • US11450048B2 patent drawing
  • US11450048B2 patent drawing
  • US11450048B2 patent drawing

AI summary

A human system operator is guided through procedures relative to workpiece objects in real space by a machine-executable procedure program including procedure instructions related to the real-space operations. A spatial-positioning system tracks the locations and orientations within a defined physical space of workpiece objects and tools required to perform procedure steps relative to the workpiece objects. Machine-generated indicia related to sequential procedure steps are presented to the system operator through a mixed-reality headset. The machine generated indicia illustratively include graphical objects and textual instructions that convey to the system user information relative to a procedure step, such as which tool to use to act on which workpiece object, and the operation to be performed on each workpiece object. The system operator contemporaneously views both (i) the physical space and (ii) selected machine-generated indicia such that the machine-generated indicia, from the perspective of the system user, are superimposed over real space.