Remote Machinery Operation With AR Avatars in Hazardous Work Zones

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for managing industrial environments with both remote and physically present workers are inadequate for effective collaboration, particularly in risky areas where physically present workers are needed alongside machinery operated by remote workers.

Innovation Solution

A system that utilizes virtual reality for remote workers to operate machinery in risky areas and augmented reality for physically present workers to visualize the remote workers' avatars, with environmental data from sensors identifying safe and risky areas, separating the environment into suitable and non-suitable zones for physical presence.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If physically present workers are deployed to risky areas to operate machinery, then operational capability is improved, but worker safety deteriorates

Engineering Contradiction:
Improveoperational capabilityVSAvoidworker safety
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The system segments the workforce into physically present workers (in safe areas) and remote workers (in virtual reality environments), allowing machinery operation to continue in risky areas while physically separating workers from hazardous conditions. The industrial environment is also segmented into risky and non-risky zones through sensor-based identification.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Virtual reality technology serves as an intermediary between the worker and the risky environment. The remote worker interacts with the industrial environment through a virtual representation, eliminating direct physical exposure to hazards while maintaining operational capability. Sensors act as intermediaries to detect environmental conditions and identify risky areas.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Object-affected harmful factors

If remote workers operate machinery in risky areas, then worker safety is improved, but collaboration with physically present workers deteriorates

Engineering Contradiction:
Improveworker safetyVSAvoidcollaboration effectiveness
Core Design Contradiction:
Object-affected harmful factorsVSLoss of information

Solution Approach 1:

The system creates a virtual copy or avatar of the remote worker that is displayed to physically present workers through augmented reality displays. This visual representation allows physically present workers to perceive the remote worker's presence, actions, and movements, maintaining situational awareness and collaboration without requiring the remote worker to be physically present.

Inventive Principle:
Principle #26Copying

3Object-affected harmful factors

If the industrial environment is monitored to identify risky areas, then worker safety is improved, but system complexity deteriorates

Engineering Contradiction:
Improveworker safetyVSAvoidsystem complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The sensor network autonomously monitors environmental conditions and automatically identifies risky areas without requiring manual intervention. The system self-configures by having sensors detect conditions and the processing system automatically determine which areas are risky, eliminating the need for complex manual assessment procedures.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12572196B2Managing an industrial environment having machinery operated by remote workers and physically present workers
Publication Date: 2026.03.10 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US12572196B2 patent drawing
  • US12572196B2 patent drawing
  • US12572196B2 patent drawing

AI summary

Computer-implemented methods for managing an industrial environment having machinery operated by remote workers and physically present workers are provided. Aspects include identifying a first area of the industrial environment suitable for a presence of physically present workers and identifying a second area of the industrial environment that is not suitable for the presence of physically present workers. Aspects also include configuring machinery disposed in the second area of the industrial environment to be operated by remote workers and displaying, via an augmented reality display to the physically present workers, avatars of the remote workers operating machinery disposed in the second area.