The invention discloses a multi-
sensor fusion-based position and posture
estimation method for a working device of a mining
robot, which realizes accurate position and posture
estimation by installing a
body posture sensor and an environment sensing sensor and combining a kinematic model, visual
inertia state
estimation and a nonlinear least square optimization
algorithm. The method comprises the following steps: firstly, carrying out preliminary prediction on a kinematic model through feedback data of an
encoder and an
inclinometer, and constructing a local visual
inertia estimator by utilizing a camera and an MEMS to correct a prediction result; and then, a combined constraint modeling and optimization method is adopted to improve the precision of the
pose of each working mechanism. Besides, geometric features of the bucket are extracted through a semantic segmentation network and a
template matching technology, six-degree-of-freedom
pose estimation of the bucket is completed, finally data fusion of a body
pose sensor and an environment
perception sensor is performed through a
factor graph optimization
algorithm, and comprehensive pose estimation of the whole working device is achieved. The working pose of the mining
robot can be monitored in real time, the operation precision is improved, human errors are reduced, the working efficiency and safety can be optimized through
data analysis, and more effective support is provided for path planning of a working device of the mining
robot.