Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Transformer substation inspection robot obstacle detection and recognition method integrated with depth camera

A technology for inspection robots and obstacle detection, applied in character and pattern recognition, instruments, computer components, etc., can solve problems such as low real-time performance, little obstacle information, and safety issues, and achieve rich information acquisition and reduced complexity degree, the effect of improving accuracy

Pending Publication Date: 2020-06-16
SOUTH CHINA UNIV OF TECH
View PDF5 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, there are many ways to realize robot obstacle detection and recognition functions, among which the most widely used is based on two-dimensional laser radar, but due to the problem of the principle of two-dimensional laser radar, only Obtain a two-dimensional cross-section of a three-dimensional space consistent with the installation height of the sensor through the sensor, so the obstacle information obtained is less, and obstacles of different heights in front of the inspection robot cannot be obtained comprehensively, which is likely to cause safety problems during the inspection process , in addition to calculating the depth of obstacles through binocular cameras and segmenting obstacles using color images, this algorithm is more complex and has a large amount of calculation, and the real-time performance is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Transformer substation inspection robot obstacle detection and recognition method integrated with depth camera
  • Transformer substation inspection robot obstacle detection and recognition method integrated with depth camera
  • Transformer substation inspection robot obstacle detection and recognition method integrated with depth camera

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The present invention will be further described below in conjunction with specific embodiments.

[0036] Such as figure 1 with figure 2 As shown, the obstacle detection and recognition method of the substation inspection robot integrated with the depth camera provided in this embodiment includes five parts: preprocessing, ground point cloud elimination, adaptive density clustering, obstacle recognition and data conversion. This example uses the LMS-511 two-dimensional laser radar launched by the German SICK company, such as figure 2 As shown in the two-dimensional laser radar 1 in the middle, the model of the depth camera is Microsoft's Azure-Kinect camera, such as figure 2 Medium Depth Camera 2 is shown. The specific implementation of each part is introduced below:

[0037] 1) Preprocessing: The internal parameters of the depth camera have been calibrated, and the RGB color image and depth image in front of the robot acquired by the depth camera are converted in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a transformer substation inspection robot obstacle detection and recognition method integrated with a depth camera. The method comprises steps of using a depth camera for collecting data, preprocessing data, converting the depth map and the RGB color image into a point cloud image, eliminating ground point cloud in the point cloud image by using a defined ground plane model, then performing adaptive clustering on obstacles by using an adaptive density clustering algorithm, finally judging the types of the obstacles, and finally converting obstacle information into two-dimensional laser radar data information and sending the two-dimensional laser radar data information to a path planning algorithm. The calculated amount of the whole process is lower than that of an obstacle segmentation algorithm and an image segmentation obstacle algorithm using deep learning; meanwhile, due to the introduction of the depth camera, the transformer substation robot can easily obtain external three-dimensional information and color images, the perception capacity of the robot is greatly enhanced, and therefore the accuracy and stability of the obstacle avoidance function of the transformer substation inspection robot can be improved.

Description

technical field [0001] The invention relates to the technical field of automatic obstacle avoidance of a substation inspection robot, in particular to an obstacle detection and recognition method for a substation inspection robot integrated with a depth camera. Background technique [0002] In recent years, with the development of mobile robot technology, more and more mobile robots have entered people's lives. For example, home service robots, shopping guide robots, sweeping robots, substation inspection robots, etc. With the advent of the era of artificial intelligence (AI), robots are becoming more and more intelligent. In the existing robot technology, the automatic obstacle avoidance technology is particularly important. Most mobile robots need to realize the automatic obstacle avoidance function. The automatic obstacle avoidance function is an important symbol of intelligence for mobile robots. Therefore, it is of great significance to study the detection and recogni...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/62G06T7/80
CPCG06T7/80G06V20/20G06F18/23Y04S10/50
Inventor 陈承隆邱志成田联房杜启亮郭月阳
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products