AR Object Interaction Guidance Using Avatar Impact Simulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality (AR) systems fail to provide users with safe interaction guidance by displaying only static information and neglect user impact assessment when interacting with identified objects, lacking collaborative user data utilization.

Innovation Solution

A computer-implemented system that uses image recognition to identify objects, determines user interest levels, and displays avatars performing safe actions based on crowdsourced data, including impact scores and boundary simulations to guide safe interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If standard AR displaying techniques are used to show information and statistics, then the system provides basic object information, but the system fails to provide safe interaction guidance and impact assessment

Engineering Contradiction:
Improveuser safetyVSAvoidinteraction guidance information
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent introduces an avatar as an intermediary between the user and the identified object. The avatar visually demonstrates safe interaction actions and potential impacts, serving as a mediator that translates complex safety information into intuitive visual guidance. This resolves the contradiction by providing comprehensive safety guidance through the avatar intermediary while maintaining the basic information display capabilities of standard AR systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If AR systems display only static information, then the system maintains simplicity, but the system fails to provide interactive safety guidance

Engineering Contradiction:
Improveinteractive guidanceVSAvoidAR system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent creates a virtual copy (avatar) of the user that replicates user actions and demonstrates safe interaction patterns. This avatar copy provides interactive safety guidance without requiring complex modifications to the underlying AR system architecture. The avatar copying approach enables ease of operation through intuitive visual demonstration while keeping the system complexity manageable by reusing existing AR display infrastructure.

Inventive Principle:
Principle #26Copying

3Reliability

If the system neglects user impact assessment, then the system maintains simplicity, but the system fails to provide safe interaction recommendations

Engineering Contradiction:
Improvesafe interaction recommendationVSAvoidimpact assessment complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent performs impact assessment in advance by having the avatar simulate potential user actions and demonstrate their consequences before the user actually interacts with the object. This preliminary action approach provides safe interaction recommendations by pre-evaluating potential impacts and displaying them through the avatar. The method manages impact assessment complexity by conducting simulations virtually rather than requiring complex real-time physical measurement systems.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12482194B2Augmented reality visualization of an action on an identified object
Publication Date: 2025.11.25 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US12482194B2 patent drawing
  • US12482194B2 patent drawing
  • US12482194B2 patent drawing

AI summary

Provided is a computer-implemented method, system, and computer program product for displaying augmented reality (AR) visualization of a user action on an identified and/or recognized object. A processor may determine, for a user, an object interest level for each object of a plurality of known objects. The processor may detect one or more objects in an environment. The processor may identify, based on the object interest level, a first object of the one or more objects in the environment that is similar to at least one object of the plurality of known objects. The processor may determine, based on properties of the first object and the object interest level, an action for interacting with the first object. The processor may display, using an AR display, an avatar performing the determined action for interacting with the first object.