The application provides a kind of based on 3D
virtual space's realistic embodied AI interaction
system and its implementation method, belong to
artificial intelligence and
virtual reality technical field, the
system includes: open object
visual space positioning system, for identifying the environmental information under current
visual angle / panoramic
field of view by visual
language model;Hierarchical memory and narrative memory generation
system, for establishing hierarchical
memory architecture, store the memory information corresponding to conversation;Director engine and context
assembly system, for assembling structured context information, task reasoning is carried out by director engine;
Natural language driven multi-track generative
animation system, for arranging
time sequence to multiple track instructions by large
language model, and compiling into target instruction;In front-end analysis and execution the target instruction, generate the
animation sequence of the role.The AI interaction system of the application has
visual perception, autonomous space movement, emotional state expression and continuous
behavior control ability, and improves the sense of reality.