AR Part Identification via IoT Interaction Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In the field of Augmented Reality (AR), users face challenges in evaluating and interacting with virtual objects in a real-and-virtual combined environment, particularly in identifying physical objects and generating relevant recommendations for handling or replacing them effectively.

Innovation Solution

A method that uses IoT devices to observe user interactions with physical objects, identifies these objects within a knowledge corpus through image analysis, and generates recommendations based on similar interactions, including e-commerce suggestions, handling instructions, and AR-generated parts, which can be edited and 3D printed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image analysis tools are used to identify physical objects in AR environment, then object identification accuracy is improved, but system complexity increases

Engineering Contradiction:
Improveobject identification accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary system comprising image analysis tools, knowledge corpus, and recommendation generation components that mediate between the physical object and the user. This intermediary layer processes visual data through multiple stages (object detection, identification, similarity matching) to achieve accurate identification while managing system complexity through modular architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system segments the object identification process into distinct functional modules: image capture by IoT device, object detection and identification using image analysis tools, similarity search in knowledge corpus, and recommendation generation. This segmentation allows each component to be optimized independently, improving overall accuracy while managing complexity through division of labor.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If knowledge corpus with similar interactions is utilized, then recommendation accuracy is improved, but information processing time increases

Engineering Contradiction:
Improverecommendation accuracyVSAvoidinformation processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-organizing interaction data into a structured knowledge corpus before actual use. Similar interactions are pre-categorized and stored with metadata, enabling rapid retrieval during actual recommendation scenarios. This preliminary organization reduces processing time during runtime while maintaining high recommendation accuracy through pre-filtered results.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates simplified copies or representations of complex interaction patterns in the knowledge corpus. Instead of storing and processing all raw interaction data, the system extracts essential features and creates condensed representations that capture the essence of similar interactions, enabling faster comparison and matching while preserving recommendation accuracy.

Inventive Principle:
Principle #26Copying

3Ease of operation

If multiple recommendation types are generated, then user service quality is improved, but computational load increases

Engineering Contradiction:
Improveuser service qualityVSAvoidcomputational load
Core Design Contradiction:
Ease of operationVSPower

Solution Approach 1:

The recommendation generation system is designed with multi-functionality to handle multiple recommendation types (e-commerce recommendations, handling instructions, AR-generated parts) through a unified computational framework. The same core image analysis and similarity matching infrastructure serves all recommendation types, reducing redundant computation while providing comprehensive service quality.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system applies local quality by generating different types of recommendations based on specific user needs and object characteristics. Rather than uniformly generating all recommendation types for every object, the system selectively generates appropriate recommendation types based on the identified object properties and user context, reducing unnecessary computational load while maintaining high service quality where needed.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11875564B2Augmented reality based part identification
Publication Date: 2024.01.16 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11875564B2 patent drawing
  • US11875564B2 patent drawing
  • US11875564B2 patent drawing

AI summary

A method, computer system, and a computer program product for part identification is provided. The present invention may include observing a user interaction with a physical object using an IoT device. The present invention may include identifying the physical object within a knowledge corpus using one or more image analysis tools. The present invention may include leveraging an identity of the physical object to identify one or more similar interactions with the physical object stored in the knowledge corpus. The present invention may include generating one or more recommendations based on the one or more similar interactions with the physical object. The present invention may include transmitting a user selected recommendation.