NPC Interaction System Using Merged Game and Chatbot AI
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current non-player characters (NPCs) in virtual environments, such as those in VR, AR, and XR, are limited in their ability to interact with users beyond simple text-based responses, failing to effectively engage users who express themselves through various means like speech, facial expressions, body movements, and gestures.
Innovation Solution
A reality interactive responding system comprising a first server that processes user inputs related to actions, facial expressions, gaze, text, speech, gestures, emotions, and movements, and a second server that determines and generates responses, enabling more sophisticated interactions with NPCs, including speeches, facial expressions, and body movements, by coordinating game AI and Chatbot functions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If NPC uses simple game AI for interaction, then the system complexity is low, but the interaction capability is limited to simple text responses
Solution Approach 1:
The patent merges game AI and Chatbot AI into a unified NPC system. The game AI server handles game logic and basic interactions, while the Chatbot AI server processes natural language understanding and generation. These two AI systems are combined through a server coupling mechanism that allows them to work together, enabling the NPC to respond to diverse user inputs (speech, text, gestures) with human-like interactions while maintaining manageable system complexity through modular architecture.
2Adaptability or versatility
If NPC responds only with text, then the implementation is simple, but the user experience is poor when users express through speech, facial expressions, or gestures
Solution Approach 1:
The Chatbot AI server is designed with multi-functionality to handle various types of user inputs including speech recognition, natural language processing, emotional analysis, and gesture interpretation. This universal processor can adapt to different input modalities (text, speech, facial expressions, gestures) and generate appropriate response types (text, speech, facial expressions, body movements), enabling the NPC to provide diverse responses matching the user's expression method without requiring separate processing systems for each input type.
Data Source
AI summary
A reality interactive responding system, comprising a first server configured to receive first input data from a user and to determine whether the first input data conform to any one of a plurality of variation conditions or not; and a second server coupled to the first server and configured to receive second input data from the first server when the first input data conform to any one of the plurality of variation conditions and to determine a plurality of interactions in response to the first input data from the user; wherein the first input data from the user are related to an action, a facial expression, a gaze, a text, a speech, a gesture, an emotion or a movement generated by the user.