Map Information Updating via Neural Inference for Fast VSLAM
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The VSLAM technology requires significant computational resources for bundle adjustment due to the need for large-scale computations in algorithms like the steepest descent and Gauss-Newton methods, which are necessary to maintain accurate map information.
Innovation Solution
A map information update method utilizing inference engines to reduce computational load by predicting map information updates through neural networks, reducing the need for iterative calculations typically required in gradient-based methods.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If gradient-based algorithms (steepest descent and Gauss-Newton methods) are used for bundle adjustment, then map information accuracy is improved, but computational complexity and processing time increase significantly
Solution Approach 1:
The patent replaces the traditional gradient-based mechanical optimization system (steepest descent and Gauss-Newton methods involving Hessian matrix calculations) with an inference-based system using neural networks. The neural network learns the complex relationship between reprojection errors and map information updates during training, then can quickly predict optimal updates without performing iterative gradient calculations during actual operation, thus substituting complex computational mechanics with a simpler inference process.
Solution Approach 2:
The patent applies preliminary action by pre-training neural networks offline using extensive simulation data and labeled examples of reprojection errors and corresponding map information updates. During actual operation, the trained neural network models are deployed to quickly infer optimal map information updates without performing time-consuming iterative calculations, effectively performing the complex learning work in advance before real-time operation.
2Measurement precision
If iterative correction processing is performed to minimize reprojection error, then map information accuracy is improved, but processing time and computational resources increase
Solution Approach 1:
The patent substitutes the iterative mechanical optimization process (requiring repeated calculations of reprojection errors, gradient descent steps, and convergence checks) with a single forward pass through pre-trained neural networks. The neural network has learned during training how to map reprojection errors to optimal corrections, enabling direct prediction of accurate map information updates without iterative trial-and-error processing.
Solution Approach 2:
The patent creates a computational model (neural network) that copies and internalizes the complex optimization logic learned from training data. Instead of reperforming the optimization calculations in real-time, the system uses the trained neural network model to replicate the optimal correction patterns that were discovered during training, significantly reducing processing time while maintaining accuracy.
3Manufacturing precision
If Hessian matrix generation and system of equations solving are performed, then optimization accuracy is improved, but hardware requirements and power consumption increase
Solution Approach 1:
The patent replaces the energy-intensive linear algebra operations (Hessian matrix construction, matrix inversion, system of equations solving) with neural network inference operations. The neural network has already encoded the complex optimization relationships during training, so during operation it only needs to perform forward propagation through fixed layers, which is computationally much lighter and significantly more energy-efficient than performing iterative linear algebra on large datasets.
Data Source
AI summary
A map information update method includes: obtaining one or more projection relationships; obtaining, for each projection relationship, reprojection error information; calculating, for each of one or more landmarks, a first sum value based on all items of reprojection error information associated with the landmark; calculating, for each of one or more keyframes, a second sum value based on all items of reprojection error information associated with the keyframe; inferring from the first sum value, for each landmark, a position information update value of an item of position information about the landmark, and updating the item of position information about the landmark using the position information update value; and inferring from the second sum value, for each keyframe, a pose information update value of an item of pose information about the keyframe, and updating the item of pose information about the keyframe using the pose information update value.


