AI Chatbot AR Guidance Dynamic Visual Collection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality (AR) systems lack the ability to effectively integrate artificial intelligence (AI) chatbots to provide users with real-time, immersive guidance and instructions for problem-solving and task completion, relying on static natural language processing and lacking dynamic interaction with the user's visual environment.

Innovation Solution

A method that utilizes an AI chatbot integrated with an AR device to receive user queries, collect visual information, dynamically identify necessary additional information, provide activity instructions, and present recommended responses through an AR device, enabling users to interactively gather and analyze visual data to solve problems or complete tasks efficiently.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If static natural language processing is used in AR systems, then system complexity is reduced, but interaction effectiveness and adaptability to user's visual environment deteriorate

Engineering Contradiction:
Improvesystem complexityVSAvoidadaptability to user's visual environment
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent combines AI chatbot technology with augmented reality device guidance to create an integrated system that processes both natural language queries and visual environment data, enabling dynamic and adaptive interactions while maintaining manageable system complexity through unified architecture

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system introduces an intermediary processing layer that bridges natural language input and visual environment analysis, using image processing algorithms and natural language processing to translate between different data types and enable coherent interactions

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If dynamic visual information collection is implemented, then problem-solving effectiveness is improved, but information processing time and system complexity increase

Engineering Contradiction:
Improveproblem-solving effectivenessVSAvoidinformation processing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-processing visual information and maintaining ready-state processing capabilities, allowing rapid response to user queries without requiring complete re-analysis of the visual environment for each interaction

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system maintains continuous processing of visual information in the background, ensuring that analysis operations are ongoing and ready to immediately respond to user queries, thereby reducing perceived processing time while maintaining thorough analysis

Inventive Principle:
Principle #20Continuity of useful action

3Ease of operation

If AI chatbot integration is added to AR systems, then interaction effectiveness is improved, but device complexity increases

Engineering Contradiction:
Improveinteraction effectivenessVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The integrated system performs multiple functions including natural language processing, image processing, and augmented reality guidance through a unified platform, reducing the need for separate specialized systems and managing overall complexity while enhancing interaction effectiveness

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11277358B2Chatbot enhanced augmented reality device guidance
Publication Date: 2022.03.15 MAPLEBEAR INC
  • US11277358B2 patent drawing
  • US11277358B2 patent drawing
  • US11277358B2 patent drawing

AI summary

In an approach to interact with a chatbot through an augmented reality device. Embodiments consist of receiving a query from a user including a video feed, collecting visual information from the video feed, and determining additional visual information is required to respond to the query. Further, embodiments consist of dynamically identifying the additional visual information that is required, providing activity instructions to the user on how to collect the additional visual information in the form of a new video feed, and directing user actions via an augmented reality device while the user collects the additional visual information according to the activity instructions. Additionally, embodiments consist of identifying, in a knowledge corpus, a recommended response to the query based on the visual information from the video feed and the additional visual information from the new video feed, and presenting, via the augmented reality device, the recommended response to the user.