3C assembly programming-free method based on large model action analysis and automatic programming

CN119027618AActive Publication Date: 2024-11-26TSINGHUA UNIVERSITY

Patent Information

Application Number
CN202410903992.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-08
Publication Date
2024-11-26
Estimated Expiration
2044-07-08

Smart Images

  • Figure CN119027618A_ABST
    Figure CN119027618A_ABST
Patent Text Reader

Abstract

The invention provides a 3C assembly programming-free method based on large model action analysis and automatic programming, and the method comprises the steps: constructing an intelligent assembly production line, and constructing a multi-mode virtual environment based on the intelligent assembly production line; in the multi-modal virtual environment, a perception model including vision, touch and depth is established, and acquisition of multi-modal teaching video data is realized; performing action analysis on the multi-modal teaching video data to obtain an action sequence set; constructing a basic task learning model, and inputting the action sequence set into the basic task learning model for training to obtain a task learning model; and defining input and output results of the task learning model as an execution sequence, and realizing migration of the learned skill strategy from the multi-mode virtual environment to the real environment according to the execution sequence. Through the method provided by the invention, the intelligent agent can better understand and adapt to different scenes and tasks in the 3C manufacturing field, and the intelligent level, skill migration and generalization ability of the system are improved.
Need to check novelty before this filing date? Find Prior Art

Citation Information

Patent Citations

  • Model training method, robot control method, device, equipment and medium

    CN117226842A

  • Intelligent flexible assembly method for 3C products

    CN118013838A

Cited By

  • Component assembly control method of assembly robot, electronic equipment and storage medium

    CN120755892A

  • Assembly robot component assembly control methods, electronic equipment and storage media

    CN120755892B