The invention provides an RPA flow script generation method and
system based on a
large model and a screen recording scene and a storage medium, and relates to the technical field of computers. The method comprises the following steps that screen videos operated by a user are recorded through RPA
software, and different device screen sources are covered; pre-
processing the recorded video, wherein the pre-
processing comprises
noise reduction, frame number adjustment and invalid action filtering; analyzing the video by using a pre-trained video
large model, and identifying an operation action and a target object; generating an action and target object template according to an identification result, and describing an operation behavior and target object information; mapping the template into an RPA script, including component arrangement, parameter setting and
process logic; and executing the generated script on the RPA platform to realize operation
automation. Through
deep learning and
video processing technologies, the operation steps, the interface elements and the interaction logic in the screen recording video are automatically identified, the corresponding RPA script can be generated without manual intervention, and the script generation efficiency is greatly improved.