Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Simultaneous localization and mapping method of monocular vision robot based on retracking strategy

A monocular vision, synchronous positioning technology, applied in instrumentation, surveying and navigation, photogrammetry/video surveying and other directions, can solve the problem of camera pose and environment cannot be estimated and modeled, and achieve the effect of improving the integrity rate

Active Publication Date: 2017-06-23
PEKING UNIV SHENZHEN GRADUATE SCHOOL +1
View PDF10 Cites 56 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In view of the technical problems existing in the prior art, the purpose of the present invention is to provide a method for synchronous positioning and map construction of a monocular vision robot based on a re-tracking strategy; Part of the camera pose and the environment cannot be estimated and modeled. An innovative re-tracking strategy is proposed to improve the success rate of camera pose estimation and the completeness rate of map reconstruction.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Simultaneous localization and mapping method of monocular vision robot based on retracking strategy
  • Simultaneous localization and mapping method of monocular vision robot based on retracking strategy
  • Simultaneous localization and mapping method of monocular vision robot based on retracking strategy

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] The present invention will be further described below through specific embodiments and accompanying drawings.

[0048] refer to figure 1 , the concrete design of the flow chart of the present invention is as follows:

[0049] 1. Input the scene image captured by the camera:

[0050]The invention processes images collected by common digital cameras at a rate of 30fps. It should be noted that since the pure rotational motion has no time difference, the depth of the feature points cannot be estimated, so the camera is required to have a certain horizontal motion when the system starts to run, and the motion speed should not be too fast, so as to complete the initialization of the system.

[0051] 2. Determine whether tracking is lost

[0052] If the camera pose cannot be estimated from the previous frame of image, it is considered that the system tracking is lost, and step 4 is performed; otherwise, step 3 is performed.

[0053] 3. Extract ORB features and estimate cam...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a simultaneous localization and map construction method of a monocular vision robot based on a retracking strategy. The method comprises the following steps: 1) extracting ORB characteristics of each picture; 2) tracking camera postures by utilizing characteristic matching of the adjacent pictures; 3) carrying out relocation and retracking strategy on pictures which are not tracked; 4) if the relocation is successfully executed, estimating postures of a current camera; stopping the retracking strategy and deleting a temporary variable generated by the retracking strategy; 5) if the retracking strategy is successfully executed, generating a new track; 6) judging the quantity of the generated tracks; if the quantity is more than a threshold value, eliminating an initial track; 7) carrying out closed-loop detection on each key frame and carrying out track fusion after the detection is successful; 8) when a localization system is finished, screening the tracks to obtain one track with the accurate posture. The simultaneous localization and map construction method disclosed by the invention has the advantages that the complete camera track can be located under the conditions of rapidness in movement, shielding, insufficient textures and illumination changes.

Description

technical field [0001] The invention belongs to the field of autonomous positioning and navigation of mobile robots based on a single camera, and in particular relates to a monocular vision synchronous positioning and map construction method based on a re-tracking strategy. Background technique [0002] With the development of computer technology and artificial intelligence, the research of robots has received more and more attention and investment, and intelligent autonomous mobile robots have become an important research direction and research hotspot in the field of robotics. Simultaneous localization and mapping (SLAM) problem refers to a mobile robot in an unknown environment, using its own sensors (such as lidar, odometer, camera, ultrasonic, etc.) to create a map consistent with the environment, and At the same time, the map is used to estimate the position and attitude of the robot. This problem is considered to be the key issue of whether the robot can truly realiz...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G01C21/20G01C11/00
CPCG01C11/00G01C21/20
Inventor 刘宏黄伟波宋章军张国栋杨冰吴观明
Owner PEKING UNIV SHENZHEN GRADUATE SCHOOL
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products