The invention provides a self-adaptive
visual navigation method,
system and device for a dynamic
pedestrian environment, and relates to the technical field of
artificial intelligence, and the method comprises the steps: obtaining an environment scene image through a
robot, and obtaining the
point cloud data of the environment; the
pedestrian detection and prediction module uses a pre-trained neural
network model to carry out real-time detection on pedestrians and associated articles in the environmental
point cloud data to obtain a
mask, and predicts the future position of the pedestrians according to the
mask; the dynamic scene-oriented
visual positioning module extracts features based on an input environment scene image, recovers three-dimensional coordinates of feature points in combination with
point cloud data, establishes an initial map, screens the extracted feature points according to a
mask result in each subsequent frame, and matches the extracted feature points with the feature points in the initial map to estimate
pose information of each frame; the dynamic map updating module is used for generating a
semantic map by using the received
pose information,
local map point cloud information,
semantic information and
pedestrian position information, dynamically fusing the future position of the pedestrian into the
semantic map, and updating by adopting a maximum
pooling mode of
time sequence change; the autonomous mixed path planning module ensures that the
robot reaches the target position based on adaptive path planning according to the updated
semantic map and the target position; the self-adaptive
visual navigation method not only improves the navigation efficiency and accuracy, but also reduces the cost of the
system, and has a wide application prospect.