Augmented Reality Avatar for AI Bot User Experience
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional customer service bots provide a dehumanizing experience and have limitations in fulfilling actions, relying on pre-programmed rules-based logic, and they pose data security risks by requiring access to Personally Identifiable Information (PII) from third parties, which can lead to interception and hacking.
Innovation Solution
An augmented reality user service experience system that combines artificial intelligence with augmented reality, allowing bots to learn and adapt, providing visual indicators to users through a mobile device's camera, which processes data internally between devices, reducing the need for external data transfer and third-party access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If traditional rule-based bots are used for customer service, then automation is achieved, but the user experience becomes dehumanizing and limited to pre-programmed actions
Solution Approach 1:
An augmented reality avatar is introduced as an intermediary between the user and the AI bot. The avatar visually represents the bot's actions and provides human-like interaction cues through gestures and animations, while the underlying AI bot handles automation. This mediator resolves the contradiction by maintaining automation benefits while improving user experience through visual engagement.
Solution Approach 2:
The patent replaces traditional text-based or voice-based bot interfaces with an augmented reality visual interface. The AR avatar uses spatial positioning, gestures, and visual cues to communicate, substituting conventional interaction mechanics with immersive visual interactions that feel more natural and human-like while maintaining full automation capability.
2Adaptability or versatility
If bots require access to Personally Identifiable Information from third parties, then fulfillment capability is improved, but data security risks increase due to potential interception and hacking
Solution Approach 1:
The patent extracts and removes Personally Identifiable Information from the data transfer process. Instead of transmitting sensitive user data to third-party bots, the system processes fulfillment requests without requiring PII exchange. The AI bot can perform actions based on anonymized or minimal data, extracting only the essential information needed for fulfillment while leaving sensitive data secure on the user's device.
Solution Approach 2:
The augmented reality system acts as a secure intermediary layer between the user and the AI bot. It enables the bot to perform actions and access necessary information through the AR interface without directly exposing or transmitting sensitive personal data to third parties, thus maintaining fulfillment capability while mitigating data security risks.
3Reliability
If bots only fulfill pre-programmed actions, then system reliability is maintained, but adaptability to different circumstances is limited
Solution Approach 1:
The patent implements dynamic adaptability in the AI bot by enabling it to learn from interactions and adapt its behavior to different circumstances. The bot transitions from static pre-programmed actions to dynamic, context-aware responses while maintaining core reliability through structured AI frameworks. The system can adjust its fulfillment capabilities based on learned patterns and situational context.
Solution Approach 2:
The augmented reality interface provides rich feedback loops between the user and the bot. User interactions with the AR avatar generate data that feeds back to the AI system, enabling continuous learning and adaptation. This feedback mechanism allows the bot to improve its adaptability to different situations while maintaining reliability through systematic processing of feedback information.
Data Source
AI summary
The present disclosure describes systems and methods that apply artificial intelligence to augmented reality for enhanced user experience. A sensor, such as a camera, on a mobile phone can capture output data of a laptop computer or other computing device, such as a user interface. The captured image can be assessed by the mobile phone to determine an intent of a user and to display a three dimensional rendering, such as an avatar, on the mobile phone overlaid on top of the user interface of the laptop. The avatar can help navigate the user, such as pointing to areas of a webpage of interest, or inviting the user to scroll down on a webpage to a portion of the webpage that may not be in current view.