AR Headset Overlay for Sorting Object Identification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional work environments face inefficiencies and inaccuracies in tasks involving the sorting of objects, especially when objects are difficult to distinguish or require fragile handling, making automation costly and inflexible, particularly in low-volume or variable-demand scenarios.

Innovation Solution

An augmented reality (AR)-based assistance system that uses AR headsets to provide real-time image overlays with instructions for sorting, categorizing, and organizing objects, leveraging image recognition and database queries to guide users through tasks such as sorting microscope slides, while allowing multiple users to work concurrently without the need for a fixed infrastructure.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If automated sorting systems are implemented, then sorting accuracy and speed are improved, but system cost and complexity increase significantly

Engineering Contradiction:
Improvesorting speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces complex mechanical automated sorting systems with an AR-based visual guidance system. Instead of using mechanical arms, sensors, and automated conveyors to physically sort objects, the system uses augmented reality headsets to display visual overlays that guide users in manually sorting objects. This substitution of mechanical automation with information-based guidance dramatically reduces system complexity while maintaining high sorting throughput.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The AR headset serves as an intermediary between the user and the sorting task. The system projects virtual overlays, highlights, and instructions onto the physical workspace through the AR headset, mediating the interaction between the user and objects to be sorted. This intermediary layer provides automated guidance without requiring automated physical manipulation, resolving the contradiction between automation benefits and system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If physical infrastructure is built for automated sorting, then sorting capability is improved, but flexibility and ease of relocation deteriorate

Engineering Contradiction:
Improvesorting capabilityVSAvoidflexibility
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent eliminates the need for fixed physical sorting infrastructure by replacing mechanical sorting devices with software-based AR guidance. The system runs on portable AR headsets that can be worn by users anywhere in the workspace, eliminating the need for dedicated sorting machinery and allowing flexible relocation of equipment and personnel without losing sorting capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The AR headset and software system serve multiple functions: they provide sorting guidance, display object information, highlight target objects, and communicate instructions. This multi-functional approach consolidates what would traditionally require separate physical infrastructure into a single portable platform, dramatically improving flexibility while maintaining full sorting capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If AR-based assistance is implemented, then user performance and accuracy are improved, but device cost increases

Engineering Contradiction:
Improvesorting accuracyVSAvoidtechnology cost
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system creates a virtual copy of the physical workspace by projecting AR overlays that replicate the appearance and location of objects, containers, and workspace features. This virtual representation allows the system to provide precise guidance without requiring expensive sensors, cameras, or 3D scanning equipment to physically detect and track every object. The virtual model is overlaid on the physical scene, providing accurate guidance at lower cost.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11847751B2Method and system for implementing augmented reality (AR)-based assistance within work environment
Publication Date: 2023.12.19 AGILENT TECHNOLOGIES INC
  • US11847751B2 patent drawing
  • US11847751B2 patent drawing
  • US11847751B2 patent drawing

AI summary

Novel tools and techniques are provided for implementing augmented reality (AR)-based assistance within a work environment. In various embodiments, a computing system might receive, from a camera having a field of view of a work environment, first images of at least part of the work environment, the first images overlapping with a field of view of a user wearing an AR headset; might analyze the received first images to identify objects; might query a database(s) to determine a task associated with a first object(s) among the identified objects; might generate an image overlay providing at least one of graphical icon-based, text-based, image-based, and/or highlighting-based instruction(s) each indicative of instructions presented to the user to implement the task associated with the first object(s); and might display, to the user's eyes through the AR headset, the generated first image overlay that overlaps with the field of view of the user's eyes.