Smart Glasses UI Form Autofill via Conversation Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Bank agents face challenges in maintaining eye contact with customers while interacting, as they need to refer to screens for entering information, leading to suboptimal engagement and efficiency in customer interactions, and existing UI form text fields lack intelligence, requiring manual data input which is tedious and prone to errors.
Innovation Solution
The implementation of AI-supported smart glasses that can track conversations, autofill, and autocorrect UI form text fields, using technologies like generative AI, context-based UI forms, and voice cloning, allowing agents to maintain eye contact and streamline data entry processes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If bank agents manually input data into UI forms during customer interactions, then data entry accuracy can be maintained through verification, but agents cannot maintain eye contact with customers leading to reduced engagement quality
Solution Approach 1:
The system enables self-service by allowing the UI form to automatically capture and populate data from conversation audio transcripts without requiring manual agent input. The form fields are intelligently filled based on extracted entities from the conversation, making the data entry process autonomous and eliminating the need for agents to switch attention to screens.
Solution Approach 2:
The patent replaces the mechanical process of manual typing and data entry with an automated system that uses speech recognition, natural language processing, and entity extraction to populate form fields. This substitution eliminates the physical interaction between the agent and the keyboard/screen, allowing continuous eye contact with the customer.
2Manufacturing precision
If bank agents focus on screens to enter information accurately, then data entry precision is improved, but customer-agent eye contact is lost reducing interaction satisfaction
Solution Approach 1:
The UI form performs self-service by automatically capturing data from the conversation transcript and populating relevant fields without requiring agent intervention. The system identifies entities such as account numbers, customer names, and transaction details from the conversation and fills the corresponding form fields autonomously, maintaining both accuracy and interaction quality.
Solution Approach 2:
The system performs preliminary action by pre-processing the conversation audio into transcripts and extracting relevant entities before the agent needs to complete the form. This advance preparation ensures that data is ready for form population, eliminating the need for agents to manually search or type information during the interaction.
3Loss of time
If manual data input processes are used in UI forms, then flexibility in data verification is maintained, but time consumption increases and accuracy degrades due to repetitive manual entry
Solution Approach 1:
The system eliminates repetitive manual entry by implementing self-service automation where the UI form automatically extracts entities from conversation transcripts and populates data fields. This reduces both the time required for data entry and the potential for human error associated with repetitive manual tasks, while maintaining accuracy through automated verification processes.
Data Source
AI summary
Systems and methods for autofilling and autocorrecting an AI supported UI form text field via smart glasses are provided. The data autofillted and autocorrected may be identification data, including account numbers and user IDs. The smart glasses may work together with a conversation tracking application and a smart glasses UI. Methods may include prompting agents based on real-time conversational analysis with context clues and texts to assist and maintain customer eye contact. Methods may further include capturing segments of data within conversational analysis and storing the segments of data in memory on the smart glasses. Methods may further include updating smart glasses UI form text fields based on AI supported autocorrection from real-time conversation, by autofilling the segment of data in the smart glasses UI form text fields.