Object edge recognition method, device and system based on vision and touch and medium

An edge recognition and edge position technology, applied in the field of robot cognition, can solve the problems of limiting the application range of manipulators and manipulators, and the inability to grasp soft and fragile objects with geometric shapes, so as to achieve the effect of improving accuracy

Pending Publication Date: 2020-08-25
深圳阿米嘎嘎科技有限公司
View PDF4 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the grasping of manipulators mainly relies on vision to identify and grasp objects. Because of the lack of tactile feedback, it can only grasp objects with simple shapes and high hardness, but cannot grasp objects with complex geometric shapes and soft and fragile, which seriously limits the ability of manipulators and manipulators. scope of application

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Object edge recognition method, device and system based on vision and touch and medium
  • Object edge recognition method, device and system based on vision and touch and medium
  • Object edge recognition method, device and system based on vision and touch and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0057] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0058] The inventive idea of ​​the present invention is: there are biological and neuroscience researches showing that animal brain cognition operates in the manner of Bayesian principle. Inspired by biology and neuroscience, the invention proposes a novel visual and tactile multi-sensor fusion algorithm based on the Bayesian principle. The algorithm can collect the edge features of the object, and the collected information can be used in the graspi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses an object edge recognition method, device and system based on vision and touch and a medium, and the method comprises the steps: obtaining the global touch information of an object through an active touch exploration algorithm, and extracting an object edge contour 1 according to the global touch information of the object; processing the three-dimensionalpoint cloud information by using a visual algorithm, and extracting object edge contour information 2, wherein the three-dimensional point cloud information is obtained by a visual sensor; and fusingthe object edge contour 1 and the object edge contour 2 by using a Bayesian model to obtain final edge features of the object. By implementing the embodiment of the invention, the visual sense and thetactile sense are fused to realize the identification of the edge features of the object, and the identified edge features of the object can be used for mechanical arm grabbing, so that the grabbingaccuracy, robustness and reliability of the mechanical arm are improved.

Description

technical field [0001] The invention relates to the technical field of robot cognition, in particular to a method, device, system and medium for object edge recognition based on vision and touch. Background technique [0002] Today, with the rapid development of robot technology, the application fields of robots are becoming wider and wider, and the market's requirements for robots are getting higher and higher, especially in the field of robotic arm grasping. At present, the grasping of manipulators mainly relies on vision to identify and grasp objects. Because of the lack of tactile feedback, it can only grasp objects with simple shapes and high hardness, but cannot grasp objects with complex geometric shapes and soft and fragile, which seriously limits the ability of manipulators and manipulators. scope of application. [0003] The fusion of vision and touch can complement each other. Vision is good at providing geometric and positional information at long distances, wh...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/34G06K9/62
CPCG06N3/02G06V20/10G06V10/267G06F18/2135G06F18/25
Inventor 杨传宇蒲灿
Owner 深圳阿米嘎嘎科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products