The invention discloses a
mobile robot autonomous exploration method based on deep
reinforcement learning, and the method comprises the steps: starting
laser radar equipment, a calculation unit and a
mobile robot body power supply in an unknown environment, and collecting the
point cloud data of the current environment through a
laser radar; storing the
point cloud data based on the complementary hole structure, constructing a three-dimensional
point cloud map, and constructing a two-dimensional grid occupation map after projection; constructing an information
graph based on the two-dimensional grid-occupying map, and sparsifying the information graph by using a bidirectional A *
algorithm to form a sparse information graph; a
reinforcement learning strategy network is constructed, a target function of the
reinforcement learning strategy network is designed, the input of the reinforcement learning strategy network is a sparse information graph, and the output of the reinforcement learning strategy network is a target path point at the next moment; a path planner generates a collision-free path according to the target path point, and a local planner generates a linear velocity value and an
angular velocity value of the current
robot according to the collision-free path; a
motion controller of the
robot generates a motion command according to the speed value, the
mobile robot is controlled to reach the target path point, and the steps are repeated until the
robot autonomous exploration task based on deep reinforcement learning is completed; the method has the advantages that a model-free deep reinforcement learning technology is adopted to learn an exploration strategy in a
simulation system, the method can be seamlessly transplanted to a real physical environment, higher-efficiency autonomous exploration can be realized, the adaptability to the environment is high, the application scene is wider, and a foundation is laid for completely autonomous operation of the mobile robot.