A crowd evacuation simulation method and system based on multi-agent deep reinforcement learning

Abstract

The invention discloses a crowd evacuation simulation method and system based on multi-agent deep reinforcement learning. The method comprises the steps of creating a simulation scene according to aninitial coordinate and a motion speed of an individual in crowd evacuation; arranging a counter at each evacuation exit of the evacuation scene, calculating the congestion degree of the exit accordingto the area and the number of people, wherein the congestion degree is feedback of return rewards when a path is trained in the deep reinforcement learning model; grouping all individuals according to the position of each individual away from the exit of the room in each sub-region, and selecting the individual at the foremost end of the local region in the group as an in-group leader; using a multi-agent deep deterministic policy gradient algorithm MADDPG for path planning of leaders, regarding the multiple leaders as multiple agents, enabling the multiple agents to cooperate with one another to select an optimal evacuation path, and enabling the leaders to evacuate according to the path planned through deep reinforcement learning; enabling each member within the group follows the leaderto evacuate under improved social forces.

Description

technical field [0001] The invention relates to the technical field of multi-agent reinforcement learning and computer simulation, in particular to a crowd evacuation simulation method and system based on multi-agent deep reinforcement learning. Background technique [0002] The statements in this section merely enhance the background related to the present disclosure and may not necessarily constitute prior art. [0003] With the continuous acceleration of the urbanization process, the buildings and the density of people in the city are also increasing rapidly, followed by a large number of people gathering in public places, and in densely populated public places, because people are not familiar with the environment, Once an emergency occurs, it is very easy to cause vicious events such as crowd congestion and stampede. If the crowd cannot be evacuated effectively, it will often lead to vicious accidents such as mass death and mass injury. How to effectively carry out disa...

AI Technical Summary

Problems solved by technology

[0006] Of course, the effect of crowd evacuation simulation using only the original social force model is often unsatisfactory. Crowd gathering due to psychological factors and social relations

Second, there is no clear path planning knowledge so that the exit selection cannot be made well in the event of congestion, which often leads to the phenomenon of exit congestion

Third, evacuation efficiency still needs to be improved

Images