Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Ordered point cloud 5D texture grid data structure generation method and device, equipment and medium

A technology of grid data and point cloud data, applied in image data processing, 3D modeling, 3D object recognition and other directions, can solve the problems of difficult to adapt to accurate stacking, difficult to adapt, unable to realize the expression of complete shape, etc., to achieve accurate grasping The effect of picking and stacking to improve positioning accuracy

Active Publication Date: 2020-11-03
苏州帕维尔智能科技有限公司
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, traditional 2D vision or 3D visual recognition methods cannot solve the problem of universal and accurate recognition of massive disordered posture workpieces, and it is difficult to meet the disordered sorting needs of e-commerce logistics
When the workpieces to be scanned have a large attitude inclination and are stacked in disorder, such as identifying instant noodles in barrels placed on the side of the turnover box, the traditional 2D method needs to make multiple templates with different viewing angles for matching and positioning. In this way, when facing a large number of workpieces, establish The workload of the template is too large; when the workpieces to be inspected are closely placed, it is difficult for the 3D vision method to segment different objects in the scene, and it is difficult to adapt to the workpieces to be inspected with small changes in object shape, such as identifying closely arranged mobile phone packages in a turnover box box
Only by recognizing the complete shape of the workpiece (including the side and bottom surface), can the workpiece be placed accurately and avoid damage to the workpiece when grabbing the precious workpiece. The traditional 2D / 3D visual recognition methods can only be based on the local information on the upper surface of the workpiece. Recognition, it is difficult to judge the complete shape of the workpiece to be measured, and it is difficult to adapt to accurate stacking
[0004] The above problems are mainly due to the fact that the existing visual recognition methods are limited to the data structure representing three-dimensional objects. Thanks to the matrix form of 2D images, the image processing methods in 2D vision are very mature, but it is difficult for 2D images to represent the three-dimensional objects. All-round information; in 3D vision processing, most of the existing 3D image processing methods are based on disordered point clouds, and it is difficult to achieve ordered neighborhood access similar to 2D, so that 2D texture features cannot be used; 3D images based on ordered point clouds Processing method, since the ordered point cloud can only express the upper surface information of the workpiece, it cannot express the bottom surface and side surface, nor can it realize the expression of the complete shape

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Ordered point cloud 5D texture grid data structure generation method and device, equipment and medium
  • Ordered point cloud 5D texture grid data structure generation method and device, equipment and medium
  • Ordered point cloud 5D texture grid data structure generation method and device, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0049] Such as figure 1 As shown, the application provides a method for generating a 5D texture grid data structure of a 3D ordered point cloud, including:

[0050] S1 obtains the ordered point cloud data of the object to be detected.

[0051] In this embodiment, the original ordered point cloud of the object to be detected is acquired based on a 3D camera, wherein the point cloud data is recorded in the form of points for the object to be detected, and each point contains three-dimensional coordinates including color information and normal vectors. More specifically, the color information is usually acquired by the camera, and then the color information of the pixel at the corresponding position is assigned to the corresponding point in the point cloud; the ordered point cloud is generally in the camera coordinate system, and the normal is facing the camera .

[0052] S2 For any point P in the ordered point cloud ij , adding the P ij And the corresponding 3D position coo...

Embodiment 2

[0070] Such as Figure 5 As shown, the present application also provides a 5D texture grid data structure generation device 10 of a 3D ordered point cloud, including:

[0071] The ordered point cloud acquisition module 11 is used to acquire the ordered point cloud data of the workpiece to be scanned;

[0072] Mapping relationship establishment module 12, for any point P in the ordered point cloud ij , adding the P ij And the corresponding 3D position coordinates (x, y, z) normal vector, color information to obtain the vertex S mn information and build the P ij with the S mn One-to-one correspondence between;

[0073] Row and column sorting acquisition module 13, used to acquire each point P in the point cloud data ij row and column sorting;

[0074] Adjacent point search module 14, for any point P in the ordered point cloud ij , find P according to the index rules sorted by row and column ij Neighboring point P i,j+1 ,P i+1,j+1 ,P i+1,j , wherein, in the point clou...

Embodiment 3

[0085] Figure 6It is a schematic structural diagram of a computer device provided by an embodiment of the present invention, such as a smart phone, a tablet computer, a notebook computer, a desktop computer, a rack server, a blade server, a tower server, or a cabinet server (including independent server, or a server cluster composed of multiple servers), etc. The computer device 20 in this embodiment at least includes but is not limited to: a memory 21 and a processor 22 that can be communicatively connected to each other through a system bus, as shown in FIG. X . It should be pointed out that, Figure 6 Only computer device 20 is shown having components 21-22, but it should be understood that implementing all of the illustrated components is not a requirement and that more or fewer components may instead be implemented.

[0086] In this embodiment, the memory 21 (that is, a readable storage medium) includes a flash memory, a hard disk, a multimedia card, a card-type memory...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a 5D texture grid data structure generation method of 3D ordered point cloud. The method comprises the following steps: obtaining ordered point cloud of a to-be-scanned workpiece; for any point Pij in the ordered point cloud, obtaining vertexes Smn and establishing a one-to-one correspondence relationship between Pij and the vertexes Smn; obtaining a row and column sequenceof each point in the point cloud data; for any point Pij in the ordered point cloud, searching for adjacent points Pi, j + 1, Pi + 1, j + 1, Pi + 1, j of the Pij, and obtaining vertexes Smn, Sm, n +1. Sm + 1, n, Sm + 1 and n + 1 respectively corresponding to the Pi, j, Pi, j + 1, Pi+1,j + 1, Pi+1,j according to the index relationship; adding a quadrangular surface patch, adding four vertexes Smn, Sm, n + 1. Sm + 1, n, Sm + 1,n + 1 to the vertex positions of the corresponding quadrangular surface patch to generate a half quadrangular grid, traversing Pij or vertex Smn, and obtaining half quadrangular grids corresponding to all Pij or vertexes Smn to output a 5D texture grid data structure corresponding to the point cloud data. The method is used for gridding ordered point cloud, and pointcloud data is of a topological structure and can effectively represent omnibearing information of a three-dimensional object after being represented based on data of a data structure of a texture grid.

Description

technical field [0001] The invention belongs to the technical field of computer graphics and computer vision, and in particular relates to a method and device for gridding point cloud data, computer equipment and storage media. Background technique [0002] In the fields of industrial manufacturing and logistics, unordered sorting tasks such as loading and unloading of machine tools, sorting of parts, and sorting of goods are labor-intensive, low in sorting efficiency, and difficult to recruit for traditional manual operations. Robot disorder sorting technology is increasingly replacing manual labor, and has become an important means for related industries to reduce costs, increase efficiency, and upgrade intelligently. The random sorting of robots relies on visual recognition methods to locate the objects to be sorted, and then guides the end of the robot to complete the grabbing and placing operations of the objects. Generally, 2D images, 3D point clouds or grids are used...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/34G06T17/20B07C5/342
CPCG06T17/20B07C5/3422G06V20/64G06V10/267
Inventor 高磊田希文
Owner 苏州帕维尔智能科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products