The invention discloses a multi-mode AI interaction
system and method based on a
mobile phone video phone, the
system comprises a communication terminal, a call center module, a multi-mode logic
processing module and a dynamic
content generation module, the communication terminal is connected with the call center module through an operator communication network, the call center module is used for
processing incoming and outgoing calls of a large number of calls, and the multi-mode logic
processing module is used for processing the dynamic
content generation module. The call center module comprises an SIP (
Session Initiation Protocol) gateway unit, a video interaction transmission unit and a sound interaction transmission unit, the multi-
modal logic processing module is used for identifying and understanding user
semantics and extracting information valuable to a current service in user videos, and the dynamic
content generation module is used for generating audios and videos for interaction according to the user
semantics; according to the invention, expansion is carried out by combining multi-
modal logic processing and dynamic content generation based on an existing call center, so that the capability of intelligent video customer service is increased, more
complex problems can be processed, and the problem that a traditional IVR
system cannot interact with an AI and can only process simple services is effectively solved.