AR Avatars Simulating Eye Contact for AI Voice Assistants

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current AI voice assistance systems lack the ability to create a lifelike, person-to-person conversational interaction with users, failing to provide a realistic and engaging experience through augmented reality.

Innovation Solution

An AI smart assistant system that operates with an augmented reality device to select and display avatars based on user interactions, simulating eye contact and body language, allowing users to interact with virtual service providers that mimic human behavior and perform requested actions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional AI voice assistance systems are used, then voice commands can be processed and actions can be performed, but the interaction lacks lifelike quality and user engagement is limited

Engineering Contradiction:
Improveuser interaction qualityVSAvoidconversational engagement
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system creates virtual avatars that copy human physical appearance, body language, and facial expressions to simulate lifelike conversational interaction. The avatars replicate human cues such as eye contact, head movements, and gestures to make the AI interaction feel more natural and engaging, directly addressing the technical problem of creating realistic person-to-person communication.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If avatars are displayed in augmented reality to simulate human interaction, then user engagement is improved, but system complexity increases

Engineering Contradiction:
Improveconversational engagementVSAvoidsystem architecture
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system employs a multi-functional avatar framework that can represent different service providers, products, or concepts through a single technological platform. The same augmented reality infrastructure supports various avatar types and interaction modes, reducing overall system complexity while maintaining high adaptability and versatility in conversational engagement.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If contextual avatars are selected based on voice interaction analysis, then interaction realism is enhanced, but processing time increases

Engineering Contradiction:
Improveinteraction realismVSAvoidavatar selection processing time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system pre-analyzes voice commands and extracts contextual information before avatar selection is needed. By preparing the contextual analysis in advance and maintaining a ready pool of appropriate avatars, the system minimizes processing time during actual interaction while still delivering highly contextual and realistic avatar selections based on the voice interaction.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11010129B1Augmented reality user interface
Publication Date: 2021.05.18 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11010129B1 patent drawing
  • US11010129B1 patent drawing
  • US11010129B1 patent drawing

AI summary

An augmented reality device operates in concert with an artificial intelligence (AI) voice assistance system, to generate and display an avatar for user interaction with the AI voice assistance system. The avatar displays animated traits and body language, based on the context and content of the user interaction, to enrich the user's interactive experience with the AI voice assistance system. The body language includes simulating eye-contact with the user.