IMU-based slam motion blur pose tracking algorithm

A tracking algorithm and pose technology, applied in computing, image analysis, image enhancement, etc., can solve problems such as camera positioning and tracking of lost and motion blurred segments, and achieve improved accuracy, high use and promotion value, and broad application prospects Effect

Active Publication Date: 2022-04-15
NANJING UNIV OF POSTS & TELECOMM
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] To sum up, how to provide an IMU-based SLAM motion blur pose tracking algorithm to solve the problem that SLAM cannot perform camera positioning and tracking loss on the motion blur segment in the image sequence has become the common expectation of technicians in the industry. one of the problems solved

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • IMU-based slam motion blur pose tracking algorithm
  • IMU-based slam motion blur pose tracking algorithm
  • IMU-based slam motion blur pose tracking algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0064] Such as figure 1 As shown, the present invention discloses an IMU-based SLAM motion blur pose tracking algorithm, which is improved based on the ORB-SLAM2 framework, and uses the measured values ​​of the IMU to track the camera pose.

[0065] Specifically, it includes the following steps:

[0066] S1. Perform ORB feature extraction on the input image sequence, judge whether the image sequence belongs to a normal image or a motion-blurred image according to the number of extracted feature points, and choose one to perform step S2 or S3 according to the judgment result;

[0067] S2. If the judgment result is a normal image, use the uniform motion model to estimate the initial pose of the camera, and then perform bundle adjustment of the motion parameters;

[0068] S3. If the judgment result is a motion blur image, use the IMU motion equation to obtain the estimated pose, then use the extended Kalman filter to obtain the optimized pose, and finally combine the estimated p...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention discloses an IMU-based SLAM motion fuzzy pose tracking algorithm, which includes the following steps: S1, extracting ORB features from the input image sequence, judging the type of the image sequence according to the number of feature points, and selecting one to perform S2 according to the judgment result Or S3 step; S2, if it is a normal image, use the uniform motion model to estimate the initial pose of the camera, and perform bundle adjustment of the motion parameters; S3, if it is a motion blurred image, use the IMU motion equation to obtain the estimated pose, and use the extended Kalman The filter obtains the optimized pose, and the estimated pose is combined with the optimized pose to obtain the final pose of the camera. The present invention aims at the problem that SLAM cannot perform camera positioning and tracking loss on the motion blur segment in the image sequence, combines and utilizes the kinematic equation of the inertial measurement unit and the extended Kalman filter to calculate and optimize the camera pose, so that SLAM can obtain continuous and reliable cameras Pose localization and tracking.

Description

technical field [0001] The invention relates to a tracking algorithm, in particular to an IMU-based SLAM motion fuzzy pose tracking algorithm, belonging to the fields of computer vision and robots. Background technique [0002] Simultaneous localization and mapping (SLAM) is a research hotspot in the field of computer vision and robotics in recent years. SLAM technology can construct and update maps in unknown environments, and track and locate in real time. Early SLAM methods used filtering to solve problems. Davinson et al. proposed a real-time single-camera MonoSLAM method, which uses extended Kalman filtering as the backend to track very sparse feature points at the front end. Eade et al. proposed a scale-variable monocular SLAM method, which uses particle filtering and top-down search to draw a large number of landmarks in real time. Most of these methods use filters to process image frames to correlate and estimate the positions of map points and camera poses. Since ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/246G06T7/277G06T7/73
CPCG06T7/246G06T7/277G06T7/73G06T2207/10016G06T2207/20076G06T2207/20024
Inventor 霍智勇陈钊
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products