The invention discloses a deep
reinforcement learning-based cooperative control method for an expressway confluence area, and the method comprises the steps: building a LiikeSim-Python
joint simulation environment, and setting a coil
detector in the
simulation environment to obtain the
traffic flow data of the upstream and downstream of the expressway confluence area; an EM
algorithm based on
Gaussian mixture distribution is used as a traffic state classifier,
traffic flow data of the highway confluence area are used as input, and traffic states of the highway confluence area are divided; designing a
state space, an action space and a reward function; taking the
state space of the highway confluence area as input, taking the actions of the variable speed-limiting
intelligent agent and the ramp metering
intelligent agent as output, and constructing a
network model of multi-agent sharing experience under
time sequence characteristics; an independent experience
pool is set for each of the variable
speed limit agent and the ramp metering agent, and interaction experience of the agents and the
traffic simulation environment is collected with the
control period as the frequency; training an agent model by using the sampled samples; and realizing cooperative control of the highway confluence area by using the trained
intelligent agent model. According to the invention, the traffic travel
delay of the highway confluence area can be reduced.