The invention discloses a multi-
modal end-to-end
reinforcement learning four-footed
robot dog reconnaissance and control method for an
alley battle, and the method comprises the following steps: (1) generating a global path through an A *
algorithm, and carrying out the real-time planning through combining with a dynamic window
algorithm, thereby obtaining a local path; (2) inputting multi-
modal perception data (local path,
point cloud information, environment
depth map, motion state information and environment privilege information), training a teacher strategy by combining a parallel near-end strategy optimization
algorithm of a variational auto-
encoder, and generating a corresponding action instruction; (3) inputting multi-
modal data with
noise, minimizing the loss of the teacher strategy and updating the student strategy in combination with a belief
encoder; and (4) deploying the student strategy to a
robot dog, inputting path information, street battle environment information and motion state information in real time, and generating an action instruction. According to the invention, multi-
modal data and end-to-end
reinforcement learning are fused to realize efficient sensing of the
robot dog to the street battle environment, and the method is suitable for robot dog reconnaissance and control tasks in the street battle scene.