Method, device, equipment and medium for generating grid data structure from disordered point cloud

A grid data and point cloud generation technology, applied in image data processing, instruments, computing, etc., can solve problems such as difficult to adapt, difficult to adapt to accurate stacking, and difficult to meet the needs of e-commerce logistics disorder sorting, etc., to achieve strong perception Recognition effect and the effect of improving positioning accuracy

Active Publication Date: 2021-05-04
苏州帕维尔智能科技有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] At present, traditional 2D vision or 3D visual recognition methods cannot solve the problem of universal and accurate recognition of massive disordered posture workpieces, and it is difficult to meet the disordered sorting needs of e-commerce logistics
When the workpieces to be scanned have a large attitude inclination and are stacked in disorder, such as identifying instant noodles in barrels placed on the side of the turnover box, the traditional 2D method needs to make multiple templates with different viewing angles for matching and positioning. In this way, when facing a large number of workpieces, establish The workload of the template is too large; when the workpieces to be inspected are closely placed, it is difficult for the 3D vision method to segment different objects in the scene, and it is difficult to adapt to the workpieces to be inspected with small changes in object shape, such as identifying closely arranged mobile phone packages in a turnover box box
Only by identifying the complete shape of the workpiece (including the side and bottom surface), can the workpiece be accurately stacked to avoid damage to the workpiece when grabbing precious workpieces, while traditional 2D / 3D / deep learning methods can only be based on local information on the upper surface of the workpiece For identification, it is difficult to judge the complete shape of the workpiece to be measured, and it is difficult to adapt to accurate stacking
[0005] The above problems are mainly due to the fact that the existing visual recognition methods are limited to the data structure representing three-dimensional objects. Thanks to the matrix form of 2D images, the image processing methods in 2D vision are very mature, but it is difficult for 2D images to represent the three-dimensional objects. All-round information; In 3D visual processing, most of the existing 3D image processing methods are based on disordered point clouds, which is difficult to achieve ordered neighborhood access similar to 2D, so that 2D texture features cannot be used; 3D images based on disordered point clouds Processing method, since the disordered point cloud can only express the upper surface information of the workpiece, it cannot express the bottom surface and side surface, nor can it realize the expression of the complete shape

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, device, equipment and medium for generating grid data structure from disordered point cloud
  • Method, device, equipment and medium for generating grid data structure from disordered point cloud
  • Method, device, equipment and medium for generating grid data structure from disordered point cloud

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0065] Such as figure 1 As shown, the present invention provides a method for generating a 5D texture grid data structure from a disordered point cloud, comprising the steps of:

[0066] S1 acquires the unordered point cloud of the workpiece to be scanned;

[0067] S2 For any point P in the disordered point cloud i , adding the P i and P i 3D position coordinates (x, y, z), normal vector, color information to get the vertex S mn , establishing the P i with the vertex S mn There is a one-to-one index relationship between them;

[0068] S3 sorts the unordered point cloud data, and obtains each point P in the unordered point cloud i Sort by row and sort by column;

[0069] S4 traverses the point cloud data, for any point P in the point cloud data i , find P in the unordered point cloud according to the index rules in the sorting by row and sorting by column i Neighboring point P j ,Pk ,P q ;

[0070] S5 obtains P according to the index relationship i , P j ,P k ,...

Embodiment 2

[0091] Such as Figure 9 As shown, the present invention also provides a device 10 for generating a 5D texture grid data structure from a 3D disordered point cloud, comprising:

[0092] The disordered point cloud acquisition module 11 is used to obtain the disordered point cloud of the workpiece to be scanned;

[0093] Mapping module 12, for any point P in the disordered point cloud i , adding the P i and P i The 3D position coordinates (x, y, z) normal vector, color information to obtain the vertex S mn and build the P i with the vertex S mn There is a one-to-one index relationship between them;

[0094] Sorting acquisition module 13, used to sort the point cloud data, and obtain each point P in the point cloud data i Sort by row and sort by column respectively;

[0095] Adjacent point acquisition module 14, for traversing the point cloud data, any point P in the point cloud data i , find P in the unordered point cloud according to the index rules in the sorting by r...

Embodiment 3

[0112] Figure 10It is a schematic structural diagram of a computer device provided by an embodiment of the present invention, such as a smart phone, a tablet computer, a notebook computer, a desktop computer, a rack server, a blade server, a tower server, or a cabinet server (including independent server, or a server cluster composed of multiple servers), etc. The computer device 20 of this embodiment at least includes but is not limited to: a memory 21 and a processor 22 that can communicate with each other through a system bus, such as Figure 10 shown. It should be pointed out that, Figure 10 Only computer device 20 is shown having components 21-22, but it should be understood that implementing all of the illustrated components is not a requirement and that more or fewer components may instead be implemented.

[0113] In this embodiment, the memory 21 (that is, a readable storage medium) includes a flash memory, a hard disk, a multimedia card, a card-type memory (for e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A method for generating a 5D texture grid data structure from a 3D disordered point cloud, comprising: obtaining a disordered point cloud of a workpiece to be scanned; obtaining a vertex S mn , and establish each point P in the disordered point cloud i with vertex S mn There is a one-to-one correspondence between them; sort the point cloud data, and obtain each point P i Sort by row and sort by column; traverse point cloud data, for any point P i , find P according to the index rules in sorting by row and sorting by column i Neighboring point P j ,P k ,P q ;According to the index relationship, get P i ,P j ,P k ,P q Corresponding vertex S mn , S m,n+1 .S m+1,n , S m+1,n+1 ; Add a quadrangular facet, and set S mn , S m,n+1 .S m+1,n , S m+1,n+1 Add to the vertex position of the quadrangular face and generate a half-sided quadrangular mesh, traverse P i or vertex S mn , get all P i or vertex S mn Corresponding half-sided quadrangular grid, output 5D texture grid data structure. The method is used to grid the unordered point cloud, and the unordered point cloud data is represented based on the data structure of the texture grid, which has a topological structure and can effectively represent the omnidirectional information of the three-dimensional object.

Description

technical field [0001] The invention belongs to the technical fields of computer graphics and computer vision, and in particular relates to a data gridding method and device for disordered point clouds, computer equipment and storage media. Background technique [0002] In the fields of industrial manufacturing and logistics, unordered sorting tasks such as loading and unloading of machine tools, sorting of parts, and sorting of goods are labor-intensive, low in sorting efficiency, and difficult to recruit for traditional manual operations. Robot disorder sorting technology is increasingly replacing manual labor, and has become an important means for related industries to reduce costs, increase efficiency, and upgrade intelligently. [0003] The random sorting of robots relies on visual recognition methods to locate the objects to be sorted, and then guides the end of the robot to complete the grabbing and placing operations of the objects. Generally, 2D images, 3D point cl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06T17/20
CPCG06T17/205
Inventor 高磊田希文
Owner 苏州帕维尔智能科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products