Transformer substation inspection robot obstacle detection and recognition method integrated with depth camera

A technology for inspection robots and obstacle detection, applied in character and pattern recognition, instruments, computer components, etc., can solve problems such as low real-time performance, little obstacle information, and safety issues, and achieve rich information acquisition and reduced complexity degree, the effect of improving accuracy

Pending Publication Date: 2020-06-16
SOUTH CHINA UNIV OF TECH
View PDF5 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, there are many ways to realize robot obstacle detection and recognition function, among which the most widely used is based on two-dimensional laser radar, but due to the problem of the principle of two-dimensional laser radar, only a two-dimensional image of a three-dimensional space consistent with the installation height of the sensor can be obtained through the sensor. Cross-section, so the obstacle inform

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Transformer substation inspection robot obstacle detection and recognition method integrated with depth camera
  • Transformer substation inspection robot obstacle detection and recognition method integrated with depth camera
  • Transformer substation inspection robot obstacle detection and recognition method integrated with depth camera

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0035] The present invention will be further described below with reference to specific embodiments.

[0036] like figure 1 and figure 2 As shown, the method for detecting and identifying obstacles for a substation inspection robot integrated with a depth camera provided by this embodiment includes five parts: preprocessing, ground point cloud removal, adaptive density clustering, obstacle identification and data conversion. This example uses the LMS-511 two-dimensional lidar launched by German SICK company, such as figure 2 As shown in the middle 2D lidar 1, the depth camera model is Microsoft's Azure-Kinect camera, such as figure 2 Medium Depth Camera 2 is shown. The specific implementation of each part is described below:

[0037] 1) Preprocessing: The internal parameters of the depth camera have been calibrated, and the RGB color image and depth image in front of the robot acquired by the depth camera are converted into point cloud images, that is, the three-dimensi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a transformer substation inspection robot obstacle detection and recognition method integrated with a depth camera. The method comprises steps of using a depth camera for collecting data, preprocessing data, converting the depth map and the RGB color image into a point cloud image, eliminating ground point cloud in the point cloud image by using a defined ground plane model, then performing adaptive clustering on obstacles by using an adaptive density clustering algorithm, finally judging the types of the obstacles, and finally converting obstacle information into two-dimensional laser radar data information and sending the two-dimensional laser radar data information to a path planning algorithm. The calculated amount of the whole process is lower than that of an obstacle segmentation algorithm and an image segmentation obstacle algorithm using deep learning; meanwhile, due to the introduction of the depth camera, the transformer substation robot can easily obtain external three-dimensional information and color images, the perception capacity of the robot is greatly enhanced, and therefore the accuracy and stability of the obstacle avoidance function of the transformer substation inspection robot can be improved.

Description

technical field [0001] The invention relates to the technical field of automatic obstacle avoidance of a substation inspection robot, in particular to an obstacle detection and recognition method for a substation inspection robot integrated with a depth camera. Background technique [0002] In recent years, with the development of mobile robot technology, more and more mobile robots have entered people's lives. For example, home service robots, shopping guide robots, sweeping robots, substation inspection robots, etc. With the advent of the era of artificial intelligence (AI), robots are becoming more and more intelligent. In the existing robot technology, the automatic obstacle avoidance technology is particularly important. Most mobile robots need to realize the automatic obstacle avoidance function. The automatic obstacle avoidance function is an important symbol of intelligence for mobile robots. Therefore, it is of great significance to study the detection and recogni...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62G06T7/80
CPCG06T7/80G06V20/20G06F18/23Y04S10/50
Inventor 陈承隆邱志成田联房杜启亮郭月阳
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products