Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Monocular SLAM scale recovery method

A monocular and scale technology, applied in image data processing, instrumentation, computing, etc., can solve problems such as monocular SLAM scale uncertainty, and achieve high precision and good results

Pending Publication Date: 2020-10-30
SUZHOU UNIV +1
View PDF8 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The technical problem to be solved by the present invention is to provide a method for monocular SLAM scale recovery, which can solve the problem of monocular SLAM scale uncertainty in the human intestinal environment

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Monocular SLAM scale recovery method
  • Monocular SLAM scale recovery method
  • Monocular SLAM scale recovery method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments, so that those skilled in the art can better understand the present invention and implement it, but the examples given are not intended to limit the present invention.

[0042] In ORB-SLAM2, the median value of the map point depth generated in the first frame is used as the unit size 1 to complete the initialization of the map size. If you want to restore the scale, you must know in advance the size of some objects in the real scene (with unit information) and their corresponding size in the map (without unit information), and calculate the scale factor to restore the scale of all objects in the scene information.

[0043] refer to figure 1 As shown, the present invention discloses a method for monocular SLAM scale recovery, comprising the following steps:

[0044] S1. Make a calibration box, the calibration box is provided with a rectangular th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a monocular SLAM scale recovery method, which comprises the following steps: manufacturing a calibration box, wherein a rectangular through hole is formed in the calibration box in a penetrating mode; placing a calibration box at the visual field of the monocular camera, wherein the monocular camera models a target object after passing through a through hole of the calibration box; enabling the monocular camera to perform image acquisition on the inner wall of the calibration box, and performing region segmentation to obtain upper and lower surface images of the inner wall of the calibration box in the first few key frames generated by the SLAM; obtaining three-dimensional map point coordinates of the upper and lower images of the inner wall of the calibration box according to the corresponding relation between the feature points and the three-dimensional map points in the SLAM; fitting three-dimensional map point coordinates of the upper and lower surfaces of the inner wall of the calibration box by using two-plane horizontal behavior constraint conditions, and calculating and obtaining distances between the upper and lower surfaces of the inner wall of thecalibration box in a three-dimensional map; calculating a scale factor; and recovering the whole three-dimensional map scale by using the scale factor F. The monocular SLAM scale in the human intestinal environment can be automatically recovered, the effect is good, and the precision is high.

Description

technical field [0001] The invention relates to the technical field of surgical robot navigation, in particular to a method for restoring monocular SLAM scale. Background technique [0002] In the process of taking photos with a monocular camera, the actual distance from the object to the camera cannot be known only by a single photo. In monocular vision SLAM, the distance between the object and the camera is solved by triangulating the matched feature points in adjacent key frames. The distance of the camera, the measured distance is only a value, without any unit, and the scale is uncertain, so it only restores the structural frame of the object, not the actual size of the object. [0003] At present, other sensors are mainly added to restore the scale in the large scene environment, such as combining IMU, GPS and lidar, etc.; using the scale information provided by additional sensors can restore the absolute scale with high accuracy. Due to the limitation of sensor size, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/11G06T7/13G06T7/80
CPCG06T7/11G06T7/13G06T7/80Y02T10/40
Inventor 郁树梅郭文康孙荣川干旻峰孙立宁
Owner SUZHOU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products