Robot vision sorting method and device, electronic equipment and storage medium
A robot vision, principal component technology, applied in instruments, image analysis, computer parts, etc., can solve problems such as difficult to achieve grasping tasks
Active Publication Date: 2021-09-21
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF5 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] The invention provides a robot visual sorting method, device, electronic equipment and storage medium to solve the defect in the prior art that it is difficult to realize the grasping task in a complex scene
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0048] In order to make the purpose, technical solutions and advantages of the present invention clearer, the technical solutions in the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the present invention. Obviously, the described embodiments are part of the embodiments of the present invention , but not all examples. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.
[0049] figure 1 A schematic flow chart of the robot visual sorting method provided by the embodiment of the present invention, such as figure 1 As shown, the method includes:
[0050] Step 110, based on a deep learning instance segmentation model, perform instance segmentation and principal component analysis on the two-dimensional scene image of the scene to be sorted at the same time, and...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a robot vision sorting method and device, electronic equipment and a storage medium. The method comprises the steps of carrying out the instance segmentation and principal component analysis of a two-dimensional scene image of a to-be-sorted scene at the same time based on a deep learning instance segmentation model, obtaining a two-dimensional grabbing point coordinate, a gripper rotation angle and a two-dimensional gripper opening distance of each target in the two-dimensional scene image; based on the depth information of each target in the depth scene image registered with the two-dimensional scene image, and the two-dimensional grabbing point coordinate and the two-dimensional gripper opening distance of each target, determining the three-dimensional grabbing point coordinate and the three-dimensional gripper opening distance of each target; and on the basis of the three-dimensional grabbing point coordinate, the gripper rotation angle and the three-dimensional gripper opening distance of each target, executing grabbing operation on each target. According to the invention, object sorting in complex scenes such as disordered placement, even stacking placement and the like of various objects can be realized.
Description
technical field [0001] The invention relates to the technical field of robot control, in particular to a robot visual sorting method, device, electronic equipment and storage medium. Background technique [0002] At present, with the transformation of domestic manufacturing and other related industries to intelligent manufacturing, the application of intelligent products such as robots in the processing, manufacturing and service industries is growing rapidly, especially for the application of intelligent products in the manufacturing industry. [0003] In actual industrial production, for operations similar to grabbing and sorting, the traditional method is to manually sort workpieces or products of different types or sizes in front of the operating table, which will cost a lot of time. labor and costs. Not only that, but manual work is also difficult to meet the efficiency required for mass sorting, and the accuracy of sorting is also difficult to control. Therefore, the...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06K9/00G06K9/34G06T7/70G06N3/04
CPCG06T7/70G06N3/045
Inventor 胡建华王云宽邓杰仁张好剑王欣波郑军韩健伟张兴轩
Owner INST OF AUTOMATION CHINESE ACAD OF SCI