AR Chatbot Voice Command Recall via Session Recording

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users of voice-based chatbots in augmented reality environments face challenges in recalling and reusing voice commands from previous sessions, especially when contextual situations are similar but not identical, leading to inefficiencies in interacting with AI voice assistance systems.

Innovation Solution

A method and system that record and playback augmented reality sessions, allowing users to select and modify previous voice commands based on contextual situations, using AI analysis and IoT data to simulate past environments for reusing relevant voice commands.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If voice commands are recorded and stored for later retrieval, then users can recall and reuse commands from previous sessions, but the system complexity increases due to the need for recording, storage, and playback functionality

Engineering Contradiction:
Improveease of voice command recallVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system creates and stores copies of voice commands from previous AR sessions. These recorded voice commands are saved in a database with associated metadata (context, location, time), allowing users to retrieve and reuse them in similar situations without having to recreate them, thus improving ease of operation while managing complexity through automated copying

Inventive Principle:
Principle #26Copying

Solution Approach 2:

Voice commands are recorded and stored in advance during previous AR sessions, preparing them for future retrieval. This preliminary action of capturing and archiving commands before they are needed allows users to quickly access proven commands that worked in similar contexts, reducing the need for real-time command creation

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If the system stores detailed recordings of multiple AR sessions including voice commands and responses, then users can find and reuse relevant commands from past contexts, but the amount of data storage required increases

Engineering Contradiction:
Improveinformation retentionVSAvoiddata storage volume
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The system extracts only the essential elements from complete AR session recordings - specifically the voice commands themselves along with key contextual metadata (location, context type, timestamp). By separating and storing only these critical components rather than entire session recordings, the system maintains useful information while significantly reducing storage requirements

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system applies different levels of detail and storage priority to different types of data. Voice commands and their immediate contextual metadata are stored with high fidelity for retrieval, while other session details are either summarized or discarded. This selective quality approach ensures important information is preserved without uniformly high storage costs across all data

Inventive Principle:
Principle #3Local quality

3Reliability

If the system provides full playback of recorded AR sessions, then users can review complete previous interactions, but the time required to locate specific commands increases

Engineering Contradiction:
Improvecommand accuracyVSAvoidcommand retrieval time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system provides feedback mechanisms during command retrieval, such as displaying metadata previews (context, location, timestamp) of stored commands without requiring full playback. This allows users to quickly scan and identify relevant commands based on key attributes, then access only the specific command needed rather than reviewing entire sessions, reducing retrieval time while maintaining accuracy

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system segments the complete AR session recording into discrete, independently retrievable voice commands, each tagged with metadata. This segmentation allows users to query and retrieve individual commands or small groups based on specific criteria (context, location, time) rather than playing back entire sessions, significantly reducing the time to locate specific commands while preserving the完整性 of command information

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11741957B2Chatbot with augmented reality based voice command navigation
Publication Date: 2023.08.29 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11741957B2 patent drawing
  • US11741957B2 patent drawing
  • US11741957B2 patent drawing

AI summary

A method for recording a plurality of augmented reality (AR) sessions between a set of user(s) and an AR computer system, receiving first user input, through the AR computer system and from a first user, identifying a first AR session of the plurality of AR sessions, and presenting at least a portion of the recording of the first AR session on the AR computer system for the first user.