The invention discloses an application
automation operation method and
system based on a large
language model, and belongs to the technical field of
network security, and the method comprises the following steps: 1, receiving the content input by a user; 2, performing control adjustment on task circulation; step 3, collecting and
processing an application page state, and outputting multi-
modal data; 4, multi-
modal input is constructed, and an operation instruction is generated; 5, executing an operation sequence according to the operation instruction generated in the step 4, and recording an operation process; 6, converting the operation instruction generated in the step 4 into an underlying equipment command; 7, after task circulation is finished, a judgment intelligent
processing unit module is constructed, global analysis is conducted based on the complete execution history and the user instruction in the process of the step 5, and the completion condition of automatic operation in the step 5 is obtained; the technical problems that in the prior art, the
workload is high, and
ambiguity is prone to occurring in recognition are solved.