The invention relates to an app automatic execution and test
system based on multi-agent collaborative
perception decision, and the
system comprises three agents and an upper computer which is used for collecting information and carrying out interactive execution: an execution decision agent receives the output of a planning strategy recommendation agent and a
perception agent, serves as input information, generates an instruction to control the upper computer, and carries out the execution of the decision. And interacting with the to-be-tested
system to complete the execution task of the to-be-tested system. The three agents are an execution decision agent, a planning strategy recommendation agent and a
perception agent, and the three agents jointly form a
decision system of the app automatic execution system. After a task target is given, the system can interact with a system to be tested,
text recognition, icon recognition, keyboard recognition,
layout recognition and anomaly recognition are carried out on a UI page where the system is located through a sensing agent, and meanwhile,
system information is stored in a
knowledge base after a planning strategy recommendation agent carries out offline exploration; and the execution decision-making agent autonomously reasones out an execution action according to information input of the perception agent and the planning strategy recommendation agent so as to complete execution of a task target. According to the method, multiple agents with different capabilities are combined to work cooperatively while the reasoning capability of the
large model is utilized, so that the accuracy and the stability of the model are greatly improved.