The invention belongs to the technical field of
artificial intelligence, and particularly relates to a GUI-Agent trajectory data generation method and
system based on multi-agent collaborative reasoning. The method comprises the following steps: S1, capturing and analyzing a page state and a structure, and constructing an initial graph; s2, analyzing
semantics of interactive elements based on VLM and generating an initial action
instruction set; s3, executing the instruction, recording state change, automatically deducing a target intention, forming an initial track, and storing the initial track in a track
pool; s4, for the current track, predicting and executing the next action according to the target and the page state of the current track, and updating the track; s5, unexplored elements are recognized, new actions and intentions are generated in combination with the VLM, and a new track is created and added into a track
pool; s6, evaluating whether the action result achieves a target or not, and deciding to terminate, adjust or continue to explore according to the target; and S7, circularly executing the steps S4 to S6, performing parallel iteration
processing on the trajectory
pool until a termination condition is met, and outputting a trajectory
data set.