Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Ordered point cloud 5D texture grid data structure generation method, device, equipment and medium

A grid data and point cloud data technology, applied in image data processing, 3D modeling, instruments, etc., can solve the problems of difficult to adapt to accurate stacking, difficult to adapt, huge template workload, etc., to achieve precise grasping and stacking, The effect of improving positioning accuracy

Active Publication Date: 2020-12-18
苏州帕维尔智能科技有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, traditional 2D vision or 3D visual recognition methods cannot solve the problem of universal and accurate recognition of massive disordered posture workpieces, and it is difficult to meet the disordered sorting needs of e-commerce logistics
When the workpieces to be scanned have a large attitude inclination and are stacked in disorder, such as identifying instant noodles in barrels placed on the side of the turnover box, the traditional 2D method needs to make multiple templates with different viewing angles for matching and positioning. In this way, when facing a large number of workpieces, establish The workload of the template is too large; when the workpieces to be inspected are closely placed, it is difficult for the 3D vision method to segment different objects in the scene, and it is difficult to adapt to the workpieces to be inspected with small changes in object shape, such as identifying closely arranged mobile phone packages in a turnover box box
Only by recognizing the complete shape of the workpiece (including the side and bottom surface), can the workpiece be placed accurately and avoid damage to the workpiece when grabbing the precious workpiece. The traditional 2D / 3D visual recognition methods can only be based on the local information on the upper surface of the workpiece. Recognition, it is difficult to judge the complete shape of the workpiece to be measured, and it is difficult to adapt to accurate stacking
[0004] The above problems are mainly due to the fact that the existing visual recognition methods are limited to the data structure representing three-dimensional objects. Thanks to the matrix form of 2D images, the image processing methods in 2D vision are very mature, but it is difficult for 2D images to represent the three-dimensional objects. All-round information; in 3D vision processing, most of the existing 3D image processing methods are based on disordered point clouds, and it is difficult to achieve ordered neighborhood access similar to 2D, so that 2D texture features cannot be used; 3D images based on ordered point clouds Processing method, since the ordered point cloud can only express the upper surface information of the workpiece, it cannot express the bottom surface and side surface, nor can it realize the expression of the complete shape

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Ordered point cloud 5D texture grid data structure generation method, device, equipment and medium
  • Ordered point cloud 5D texture grid data structure generation method, device, equipment and medium
  • Ordered point cloud 5D texture grid data structure generation method, device, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0049] Such as figure 1 As shown, the application provides a method for generating a 5D texture grid data structure of a 3D ordered point cloud, including:

[0050] S1 obtains the ordered point cloud data of the object to be detected.

[0051] In this embodiment, the original ordered point cloud of the object to be detected is acquired based on a 3D camera, wherein the point cloud data is recorded in the form of points for the object to be detected, and each point contains three-dimensional coordinates including color information and normal vectors. More specifically, the color information is usually acquired by the camera, and then the color information of the pixel at the corresponding position is assigned to the corresponding point in the point cloud; the ordered point cloud is generally in the camera coordinate system, and the normal is facing the camera .

[0052] S2 For any point P in the ordered point cloud ij , adding the P ij And the corresponding 3D position coo...

Embodiment 2

[0070] Such as Figure 5 As shown, the present application also provides a 5D texture grid data structure generation device 10 of a 3D ordered point cloud, including:

[0071] The ordered point cloud acquisition module 11 is used to acquire the ordered point cloud data of the workpiece to be scanned;

[0072] Mapping relationship establishment module 12, for any point P in the ordered point cloud ij , adding the P ij And the corresponding 3D position coordinates (x, y, z) normal vector, color information to obtain the vertex S mn information and build the P ij with the S mn One-to-one correspondence between;

[0073] Row and column sorting acquisition module 13, used to acquire each point P in the point cloud data ij row and column sorting;

[0074] Adjacent point search module 14, for any point P in the ordered point cloud ij , find P according to the index rules sorted by row and column ij Neighboring point P i,j+1 ,P i+1,j+1 ,P i+1,j , wherein, in the point clou...

Embodiment 3

[0085] Image 6 It is a schematic structural diagram of a computer device provided by an embodiment of the present invention, such as a smart phone, a tablet computer, a notebook computer, a desktop computer, a rack server, a blade server, a tower server, or a cabinet server (including independent server, or a server cluster composed of multiple servers), etc. The computer device 20 in this embodiment at least includes but is not limited to: a memory 21 and a processor 22 that can be communicatively connected to each other through a system bus, as shown in FIG. X . It should be pointed out that, Image 6 Only computer device 20 is shown having components 21-22, but it should be understood that implementing all of the illustrated components is not a requirement and that more or fewer components may instead be implemented.

[0086] In this embodiment, the memory 21 (that is, a readable storage medium) includes a flash memory, a hard disk, a multimedia card, a card-type memory (f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A method for generating a 5D texture grid data structure for a 3D ordered point cloud, comprising obtaining an ordered point cloud of a workpiece to be scanned; for any point P in the ordered point cloud ij ; get vertex S mn and build P ij with vertex S mn One-to-one correspondence between the points; obtain the row and column order of each point in the point cloud data; sort any point P in the ordered point cloud ij , find P ij the adjacent point P i,j+1 ,P i+1,j+1 ,P i+1,j , according to the index relationship, get P i,j ,P i,j+1 ,P i+1,j+1 ,P i+1,j Each corresponds to the vertex S mn , S m,n+1 .S m+1,n , S m+1,n+1 ;Add a quad patch and place the 4 vertices S mn , S m,n+1 .S m+1,n , S m+1,n+1 Add to the vertex position of the corresponding quadrilateral patch to generate a half-edge quadrilateral mesh, traverse P ij or vertex S mn , get all P ij or vertex S mn The corresponding half-edge quadrangular grid is used to output the 5D texture grid data structure corresponding to the point cloud data. The method is used to mesh the ordered point cloud. After the point cloud data is represented by the data structure of the texture mesh, it has a topology structure and can effectively represent the omnidirectional information of the three-dimensional object.

Description

technical field [0001] The invention belongs to the technical field of computer graphics and computer vision, and in particular relates to a method and device for gridding point cloud data, computer equipment and storage media. Background technique [0002] In the fields of industrial manufacturing and logistics, unordered sorting tasks such as loading and unloading of machine tools, sorting of parts, and sorting of goods are labor-intensive, low in sorting efficiency, and difficult to recruit for traditional manual operations. Robot disorder sorting technology is increasingly replacing manual labor, and has become an important means for related industries to reduce costs, increase efficiency, and upgrade intelligently. The random sorting of robots relies on visual recognition methods to locate the objects to be sorted, and then guides the end of the robot to complete the grabbing and placing operations of the objects. Generally, 2D images, 3D point clouds or grids are used...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/34G06T17/20B07C5/342
CPCG06T17/20B07C5/3422G06V20/64G06V10/267
Inventor 高磊田希文
Owner 苏州帕维尔智能科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products