Visual SLAM closed-loop detection method based on depth neural network

A deep neural network, closed-loop detection technology, applied in the field of image processing, can solve problems such as being easily affected by the environment, and achieve the effect of good performance

Inactive Publication Date: 2017-11-07
NORTHEASTERN UNIV
View PDF2 Cites 39 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Aiming at the disadvantage that the traditional manual feature method is easily affected by the environment, the present invention uses the high-dimensional features obtained by the output layer of the neural network to describe the image, and uses these features to measure the image distance and establish a frame-to-frame feature association

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Visual SLAM closed-loop detection method based on depth neural network
  • Visual SLAM closed-loop detection method based on depth neural network
  • Visual SLAM closed-loop detection method based on depth neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] The specific implementation of the present invention will be described in detail below with reference to the accompanying drawings.

[0061] The platform of the implementation is: Windows 10 system, MATLAB R2015b, the process is as follows figure 1 shown:

[0062] Step 1: Use the dataset of similar scenes to train the network parameters of the linear decoder. image 3 Visualization of the weights for the trained linear decoder.

[0063] Step 2: Convolution training is continuously performed on the captured images through the linear decoder. figure 2 The flow of operation can be seen.

[0064] Step 3: Use the pooling method to reduce the dimension of the high-dimensional feature vector.

[0065] Step 4: For the vectors obtained by training, use the angle cosine function to measure the similarity of features, and determine when a closed loop is formed by setting a threshold and combining the similarity of the two scene images. Figure 4 Specifically, the characteris...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a visual SLAM closed-loop detection method based on a depth neural network, and the method comprises the following steps: training the network parameters of a linear decoder through a data set of a similar scene; carrying out the convolution processing of a collected image through the linear decoder; carrying out the dimension reduction of a high-dimension feature vector through a pooling method; Measuring the similarity of the features of the vector, obtained through training, through employing an inclined angle cosine function, and judging when to form a closed loop through setting a threshold value and combining the similarity of two scene images; and outputting a closed-loop detection accuracy recall rate curve and the detected closed loop for the subsequent SLAM mapping optimization. The method gives full consideration to the impact on the closed-loop detection accuracy and robustness from the descriptor of manual features, greatly improves the accuracy of an algorithm at the lower calculation cost, solves a problem of wrong closed-loop detection, facilitates the building of a more accurate map, and guarantees the consistency of generated maps.

Description

technical field [0001] The invention belongs to the technical field of image processing, and relates to a visual SLAM closed-loop detection method based on a deep neural network model. Background technique [0002] Mobile robots create maps based on sensor data in unknown environments and complete autonomous positioning, that is, simultaneous localization and mapping (SLAM) of the robot, which is the key to realizing autonomous mobile robots. The SLAM process generally includes several important modules, such as feature extraction and matching, data registration, closed-loop detection, and global optimization. Loop Closure detection refers to the mobile robot judging whether the current location has been visited, which is a key link in SLAM research. Accurately detecting the closed loop can effectively reduce the cumulative error of the robot pose estimation, which is conducive to building a more accurate map and ensuring the consistency of the generated map. Conversely, i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V20/10G06N3/045G06F18/22
Inventor 张云洲胡航闻时光吴成东段强胡美玉
Owner NORTHEASTERN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products