A q-learning pedestrian evacuation simulation method and system based on artificial neural network

An artificial neural network and simulation method technology, applied in the field of Q-Learning pedestrian evacuation simulation method and system, to achieve the effect of avoiding memory, strong information fusion ability and fault tolerance, and avoiding blind pathfinding

Active Publication Date: 2019-03-19
SHANDONG NORMAL UNIV
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] In order to solve the above problems, the present invention provides a Q-Learning pedestrian evacuation simulation method and system based on artificial neural network. The present invention combines the advantages of reinforcement learning and artificial neural network for global path planning, making up for simple reinforcement learning. The bottom layer cooperates with the social force model to guide the movement, effectively realizing the rapid and effective wayfinding and more realistic evacuation of the crowd

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A q-learning pedestrian evacuation simulation method and system based on artificial neural network
  • A q-learning pedestrian evacuation simulation method and system based on artificial neural network
  • A q-learning pedestrian evacuation simulation method and system based on artificial neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0067] In order to solve the above problems, the present invention provides a first object of the present invention to provide a Q-Learning pedestrian evacuation simulation method based on an artificial neural network.

[0068] In order to achieve the above object, the present invention adopts the following technical scheme:

[0069] Such as figure 1 as shown,

[0070] A Q-Learning pedestrian evacuation simulation method based on artificial neural network, the method comprising:

[0071] (1) Import scene information, uniformly and randomly generate roadmaps in the scene, and extract roadmap points as candidate evacuation key points;

[0072] (2) Uniformly and randomly initialize the crowd in the scene, and set a counter at the exit to count the number of individuals evacuated at each exit;

[0073] (3) Divide the pedestrians to be evacuated into several groups according to the initialization parameters. Within each group, the individual fitness is calculated based on the di...

Embodiment 2

[0098] A second object of the present invention is to provide a computer-readable storage medium.

[0099] In order to achieve the above object, the present invention adopts the following technical scheme:

[0100] A computer-readable storage medium, in which a plurality of instructions are stored, and the instructions are suitable for being loaded by a processor of a mobile terminal device and performing the following processing:

[0101] Divide the pedestrians to be evacuated into several groups according to the initialization parameters, and select a leader in each group, and the remaining pedestrians to be evacuated are followers;

[0102] Within each group, the leader first learns and selects the optimal path obtained by global planning of the evacuation path based on the Q-Learning algorithm based on the neural network. Follow the leader for obstacle avoidance; until all the pedestrians to be evacuated are evacuated;

[0103] The optimal path learned by each group lead...

Embodiment 3

[0105] A third object of the present invention is to provide a mobile terminal.

[0106] In order to achieve the above object, the present invention adopts the following technical scheme:

[0107] A mobile terminal includes a processor and a computer-readable storage medium, the processor is used to implement instructions; the computer-readable storage medium is used to store multiple instructions, and the instructions are suitable for being loaded by the processor and performing the following processing:

[0108] Divide the pedestrians to be evacuated into several groups according to the initialization parameters, and select a leader in each group, and the remaining pedestrians to be evacuated are followers;

[0109] Within each group, the leader first learns and selects the optimal path obtained by global planning of the evacuation path based on the Q-Learning algorithm based on the neural network. Follow the leader for obstacle avoidance; until all the pedestrians to be ev...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a pedestrian evacuation simulation method and system adopting an artificial neural network-based Q-Learning algorithm. The method comprises the steps that to-be-evacuated pedestrians are divided into a plurality of groups according to initial related parameters, a leader is selected in each group, and the rest of the to-be-evacuated pedestrians are taken as followers; in each group, the leader preferentially learns and selects an optimal path obtained by performing global planning on evacuation paths through the artificial neural network-based Q-Learning algorithm, and the followers calculate a resultant force of the followers, the pedestrians in the group, the pedestrians between the groups, and environments according to a social force model, avoid barriers and follow the leader; and the to-be-evacuated pedestrians are all evacuated. According to the method and the system, global path planning is carried out in combination with the advantages of reinforcement learning and an artificial neural network; the deficiencies of pure reinforcement learning are made up for; a bottom layer matches with the social force model to guide a movement; and quick and effective way finding and relatively real evacuation of crowds can be realized.

Description

technical field [0001] The invention belongs to the technical field of crowd evacuation simulation, and in particular relates to a Q-Learning pedestrian evacuation simulation method and system based on an artificial neural network. Background technique [0002] In recent years, with the increase in the number of large public places, pedestrian crowding can be seen everywhere. In densely populated public places, the lack of pedestrian safety awareness and unfamiliarity with the surrounding environment have hidden great potential safety hazards, especially when disasters such as fires occur, the rapid and safe evacuation of people has become an urgent problem to be solved. For public places with a large flow of people and highly variable personnel composition, pedestrians often do not know enough about the environment, and it is difficult to simulate various scenarios at a low cost by using traditional evacuation drills. Using computer simulation technology to carry out scene...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/50G06Q10/04G06Q50/26
CPCG06F30/20G06Q10/047G06Q50/265
Inventor 刘弘秦欣张浩刘宝玺
Owner SHANDONG NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products