AR Visualization for Worker Collaboration Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In industrial environments, human and robotic workers often struggle to collaborate effectively, leading to suboptimal resource distribution and reduced productivity, as existing monitoring methods primarily focus on distance rather than actively guiding workers on task performance.

Innovation Solution

The system employs augmented reality (AR) to visualize activities by receiving real-time and historical data, identifying activity steps, and executing digital twin simulations to optimize the distribution of human and robotic workers. It prompts managers with an AR overlaid slider bar to set objectives, generates a knowledge corpus for optimized worker distribution, and displays a visual animation to human workers via AR devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional monitoring methods focusing on distance are used, then implementation simplicity is maintained, but collaboration effectiveness and productivity deteriorate

Engineering Contradiction:
Improvecollaboration effectivenessVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical monitoring approaches with AR-based visual guidance systems. AR devices provide real-time visual overlays showing optimal worker positions and task instructions, substituting complex monitoring infrastructure with intuitive visual interfaces that directly guide workers, thereby improving collaboration effectiveness without proportionally increasing system complexity

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces digital twins as intermediary representations of physical workers and processes. These virtual models serve as mediators between monitoring systems and actual workers, enabling optimized resource distribution and collaboration guidance without requiring direct complex interactions between all system components, thus improving productivity while managing system complexity

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If digital twin simulations and AR visualization are implemented, then resource distribution optimization is improved, but device complexity increases

Engineering Contradiction:
Improveresource distribution optimizationVSAvoidAR system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent creates digital twin copies of physical workers, equipment, and processes. These virtual replicas enable simulation and optimization of resource distribution without affecting actual operations. The digital twins process complex calculations and scenario evaluations, providing optimized guidance to physical workers through AR interfaces, thereby achieving resource optimization while containing the complexity burden through virtual modeling

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent performs digital twin simulations and optimizations in advance before actual worker deployment. By pre-calculating optimal resource distributions and task assignments through virtual modeling, the system prepares optimized guidance scenarios that are then delivered to workers via AR devices, reducing real-time computational complexity while maintaining optimization benefits

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If AR devices provide real-time visual guidance, then task performance guidance is improved, but information processing requirements increase

Engineering Contradiction:
Improvetask performance guidanceVSAvoiddata processing energy
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The patent extracts and separates complex data processing functions from the AR devices themselves. Digital twins running on separate computing infrastructure handle heavy simulation and optimization calculations, while AR devices receive and display pre-processed guidance information. This extraction reduces the energy burden on wearable AR devices while maintaining comprehensive visual guidance capabilities for workers

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS12277656B2AR-based visualization of activity with collaboration amelioration
Publication Date: 2025.04.15 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US12277656B2 patent drawing
  • US12277656B2 patent drawing
  • US12277656B2 patent drawing

AI summary

An embodiment for augmented reality (AR)-based visualization of an activity with collaboration amelioration is provided. The embodiment may include receiving real-time and historical data relating to an activity. The embodiment may also include identifying each step of the activity and a time to complete each step. The embodiment may further include executing a plurality of digital twin simulations of avatars of different types of workers performing each step of the activity. The embodiment may also include in response to determining a current distribution of human and robotic workers is not optimized, prompting a manager with an AR overlaid slider bar. The embodiment may further include generating a knowledge corpus including an optimized distribution. The embodiment may also include creating a visual animation of the optimized distribution. The embodiment may further include displaying the visual animation to at least one human worker via an AR device.