The invention relates to the technical field of
artificial intelligence, can be applied to business scenes such as financial science and technology and
medical health, and discloses an interaction intention-driven tool scheduling method, device and equipment and a medium. The method comprises the steps of obtaining to-be-processed interaction data of visual data or text data, executing cross-
modal semantic analysis to generate a unified interaction intention, and sending the unified interaction intention to a
server; detecting intention association strength between the matching tool and the context state data, selecting a context association mode based on the strength, determining a target dialogue node, scheduling the matching tool to perform sandbox execution to obtain a tool execution result, generating response content, and sending the response content to the
server; and selectively updating the to-be-processed interaction data, the unified interaction intention, the response content, the tool execution result, the target dialogue node and the extracted service entity data to context state data. According to the method, the interaction accuracy is improved through cross-
modal analysis and a switchable context association mechanism, tool decoupling is achieved in a sandbox execution mode, and the
system adaptability and stability are enhanced.