The invention provides a multi-agent
traffic signal control method based on hierarchical comparative learning, and the method comprises the steps: constructing a
traffic simulation environment according to a
traffic network, and modeling each intersection in the
traffic simulation environment as an independent agent; the
intelligent agent interacts with the SUMO
simulation environment, collects traffic state information,
signal control actions, instant rewards and traffic state information of the next state of each intersection, and stores the traffic state information, the
signal control actions, the instant rewards and the traffic state information of the next state into an experience playback buffer area; the method comprises the following steps of: grouping intelligent agents to generate regional pseudo labels; according to different region pseudo labels, region division is carried out, sub-graphs are constructed, intra-region
feature aggregation is carried out on the sub-graphs, and refined credit distribution of structure
perception is realized; and finally, joint optimization is carried out based on comparative learning and a QTRAN framework, so that efficient multi-agent cooperative control is realized. According to the invention, an optimal
signal timing strategy can be provided for each intersection, the road network
traffic efficiency is improved, and the vehicle queuing length and
waiting time are significantly reduced.