The invention relates to the technical field of
computer vision and robots, and provides an integrated navigation method and
system based on heterogeneous
feature data association, and the method comprises the following steps: preprocessing visual sensor data to obtain a camera inter-frame rotation variation and a camera inter-frame translation variation; the method comprises the steps of preprocessing
observation data to obtain acceleration variation and
angular velocity variation, calculating a motion scale factor according to rotation variation and translation variation between frames of a camera, constructing motion constraints according to the motion scale factor, the acceleration variation and the
angular velocity variation, and optimizing a
key frame selection mechanism according to the motion constraints. And constructing a bimodal tight
coupling objective function according to the
key frame, and performing nonlinear optimization on the bimodal tight
coupling objective function to obtain an optimized camera
pose and map point. According to the method, the coverage capability of robust features is remarkably improved, the adaptability and stability of the
system in a complex environment are enhanced, and
accurate estimation of key state variables is realized.