Flexible cable identification and three-dimensional reconstruction method based on point cloud

A technology of 3D reconstruction and flexible cables, which is applied in character and pattern recognition, 3D modeling, image analysis, etc., can solve problems such as weak rigidity and difficult job targets, achieve high accuracy, meet precision requirements, and simplify the calculation process Effect

Active Publication Date: 2021-06-04
NANJING UNIV OF SCI & TECH
View PDF4 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, at present, it is difficult for the robot system to grasp the weak rigidity and uncertain shape of the operation target. Therefore, the study of a flexible cable recognition and 3D reconstruction method based on point cloud has profound implications for the subsequent realization of the precise grasping of the flexible cable by the robotic arm. The theoretical significance and practical value of

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Flexible cable identification and three-dimensional reconstruction method based on point cloud
  • Flexible cable identification and three-dimensional reconstruction method based on point cloud
  • Flexible cable identification and three-dimensional reconstruction method based on point cloud

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0085] Combine figure 1 , A flexible cable identification and three-dimensional reconstruction method based on point cloud, including the following steps:

[0086] Step 1, use the Intel Realsense D435 camera to collect depth images with color images, such as figure 2 (a), the depth image is aligned with the color image by the conversion of the coordinate system, generating three-dimensional point cloud data (X, Y, Z, R, G, B), specifically:

[0087] Step 1-1, reduce the pixel point of the depth map to the depth coordinate system using the camera parameter matrix;

[0088] Step 1-2, convert the depth coordinate system to the world coordinate system using the camera outgoing parameter matrix;

[0089] Step 1-3, establish a depth map to the mapping relationship of the color map, convert the depth point in the world coordinate system to the color camera coordinate system;

[0090] Step 1-4, normalize the color image by z-axis, generate three-dimensional point cloud data, such as figur...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a flexible cable identification and three-dimensional reconstruction method based on a point cloud. The method comprises the following steps: firstly, carrying out preprocessing and filtering on the point cloud and removing outliers; then, based on a deep learning-based point cloud semantic segmentation algorithm, obtaining a trained model through pre-training and fine adjustment, outputting a semantic category label of each point, and completing point cloud segmentation; segmenting the cable point cloud into a plurality of point cloud clusters by using an improved K-Means clustering algorithm, and performing cylinder fitting on each point cloud cluster, wherein the center of each cylinder is a discrete point on a cable center line; finally, adopting a sorting algorithm based on PCA and octree direction constraint, on this basis, fitting a center line equation of the cable through a B spline interpolation algorithm, and achieving three-dimensional reconstruction of the cable in the space. The real-time performance is high, the accuracy is high, and the three-dimensional reconstruction effect of the cable can meet the precision requirement of subsequent mechanical arm grabbing.

Description

Technical field [0001] The present invention belongs to the field of image information processing, and in particular, the present invention relates to a flexible cable identification and three-dimensional reconstruction method based on point cloud. Background technique [0002] Today, today, the implementation of cloud computing, Internet of Things, and big data, the implementation of the robot has entered a growing industry, from the original structural chemical plant environment to unknown dangerous fields such as aerospace, robot intelligent development This dream has gradually become a reality from the experience from high-risk industries. Therefore, it is greatly practical for research autonomous distribution line maintenance robot system instead of artificial charging operations. [0003] However, the current robot system is difficult to capture, and therefore, it is necessary to study a point-based flexible cable identification and three-dimensional reconstruction method, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/00G06T7/593G06T7/12G06T3/40G06K9/62
CPCG06T17/00G06T7/12G06T7/593G06T3/4007G06T2207/10012G06T2207/10024G06T2207/10028G06F18/23213G06F18/2135Y04S10/50
Inventor 郑先杰陈欢王越肖潇吴巍吴沛航罗威郭健樊卫华
Owner NANJING UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products