The invention provides a dexterous
manipulator fused with an ontology
visual perception function, and belongs to the technical field of electromechanical control. The depth camera is arranged in the palm, the size of the device is remarkably reduced, the size of the device is closer to the size of a human hand, and therefore flexibility and naturalness are improved, the depth camera and a
control system are highly integrated, the structure is simplified,
synchronism of visual data and hand actions is improved, operation precision is improved, the dexterous
manipulator has 16
degrees of freedom, and the flexibility and the reliability of the device are improved. The
system is completely driven by a steering engine, the operation flexibility and the fine action execution capability are greatly improved, the requirements of complex tasks are met, the production and maintenance cost is effectively reduced through optimization design and reduction of external accessories, multiple objects are positioned at the same time through a developed instance-level multi-target positioning method and by using a neural network, pre-training is not needed, and the operation efficiency is improved. The
space perception capability of the dexterous hand is further improved, and the autonomous operation capability of the dexterous hand in a complex environment is enhanced.