AR/VR Artificial Human Guidance for Real-Time User Assistance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality (AR) and virtual reality (VR) systems lack the ability to provide personalized, real-time guidance and assistance to users performing specific activities, especially when they encounter difficulties.

Innovation Solution

The system creates an artificial human that can be projected onto an AR or VR device, allowing it to monitor the user's behavior and modify its appearance and actions based on the user's needs, providing step-by-step guidance and assistance through voice commands, written text, and haptic feedback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If an artificial human is projected onto an AR/VR device to provide personalized real-time guidance, then user assistance and interaction quality are improved, but device complexity and processing requirements increase

Engineering Contradiction:
Improveuser assistanceVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent creates a virtual replica or 'copy' of a human instructor that can be projected onto the user's AR/VR device. This digital twin captures the instructor's appearance, mannerisms, and knowledge, allowing personalized guidance without requiring the physical presence of the actual instructor. The system analyzes user behavior and dynamically adjusts the virtual instructor's responses, providing adaptive assistance while maintaining manageable system complexity through efficient rendering and processing.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If the system monitors user behavior in real-time to modify the artificial human's actions, then guidance personalization is improved, but data processing requirements and response time increase

Engineering Contradiction:
Improveguidance personalizationVSAvoidresponse time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs preliminary analysis of user behavior patterns and pre-computes appropriate responses from the artificial human instructor. By anticipating user needs and preparing guidance content in advance based on initial behavior detection, the system reduces real-time processing requirements and ensures rapid response without compromising personalization quality.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements continuous feedback loops where user behavior is monitored, analyzed, and used to dynamically adjust the artificial human's guidance actions. The feedback mechanism processes user responses and modifies the virtual instructor's behavior in real-time, creating an adaptive interaction that feels personalized while maintaining efficient response times through optimized processing algorithms.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12307335B2User assistance through demonstration
Publication Date: 2025.05.20 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US12307335B2 patent drawing
  • US12307335B2 patent drawing
  • US12307335B2 patent drawing

AI summary

A method, computer system, and a computer program product for handheld demonstration is provided. The present invention may include creating an artificial human. The present invention may include determining that assistance of the artificial human is needed by a user. The present invention may include projecting the artificial human onto an augmented reality (AR) or virtual reality (VR) device of the user. The present invention may include monitoring the user's behavior. The present invention may include modifying the projected artificial human based on the user's monitored behavior.