Monocular vision-combined RGB-D SLAM method

A monocular vision, monocular technology, applied in image data processing, instruments, computing and other directions, can solve the problems of insufficient acquisition of depth information, RGB-D depth sensor unable to acquire depth information, etc.

Active Publication Date: 2016-11-16
EAST CHINA JIAOTONG UNIVERSITY
View PDF4 Cites 77 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to provide a RGB-D SLAM method combined with monocular vision, which is a RGB-D visual SLAM method with high real-time performance, strong adaptability and good stability, and solves the problem that the RGB-D depth sensor cannot acquire Obtaining depth information or obtaining insufficient depth information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Monocular vision-combined RGB-D SLAM method
  • Monocular vision-combined RGB-D SLAM method
  • Monocular vision-combined RGB-D SLAM method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] The following will be combined with figure 1 -5 and Examples describe the beneficial effects of the present invention in detail, aiming to help readers better understand the essence of the present invention, but can not constitute any limitation to the implementation and protection scope of the present invention.

[0051] A RGB-D SLAM method combined with monocular vision, including the following:

[0052] 1. Use the monocular vision method and the RGB-D depth vision method to construct the monocular local pose map and the RGB-D local pose map.

[0053] During the working process, the depth sensor can obtain two kinds of information, one is RGB color information I RGB and depth information I Depth , where the two kinds of information come from different channels. However, the actual working distance of the depth sensor is limited, so there is not always depth information feedback. In the proposed RGB-D SLAM method combined with monocular vision, the two methods are c...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a monocular vision-combined RGB-D SLAM method. The method comprises the following steps of: respectively carrying out feature extraction, feature matching, motion estimation and optimization on data obtained by a depth sensor by adopting a monocular vision method and an RGB-D depth vision method; establishing a monocular local position map and an RGB-D local position map; carrying out three-dimensional map fusion on the monocular local position map and the RGB-D local position map by a robot in a motion process so as to construct a global map; and carrying out closed loop detection on the fused position maps and carrying out optimization to obtain an optimum global map. The RGB-D SLAM method disclosed by the invention is high in timeliness, strong in adaptability and good in stability, and can be used for solving the problem that RGB-D depth sensors cannot obtain depth information or are insufficient in obtaining of the depth information.

Description

technical field [0001] The invention relates to a RGB-D SLAM method combined with monocular vision. Background technique [0002] Vision sensors can provide compact, accurate, non-invasive and easy-to-understand visual information. At the same time, in addition to providing rich visual information, vision sensors are inexpensive and cost-effective. At present, in the field of mobile robots, monocular vision methods and RGB-D SLAM methods are commonly used. [0003] The monocular vision SLAM method refers to the method of using one step and three turns to calculate the depth information by using the triangulation method in the state of robot movement, and put the depth information into the map to construct a three-dimensional map environment model, but in the actual process Among them, the depth calculation consumes a lot of computing resources and the speed is relatively slow. [0004] Since the depth sensor was applied to the SLAM field, more and more developers have shif...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/00
CPCG06T2207/30244
Inventor 张恒温珍强刘艳丽庄斌朱梦雨
Owner EAST CHINA JIAOTONG UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products