The invention discloses a double-capacity water tank control method based on multi-target reward
Q learning, and belongs to the technical field of
machine learning and
automatic control. The method comprises the following steps: firstly, establishing a
discretization mathematical model of a double-capacity water tank liquid level
control system, and designing a multi-target reward function; secondly,
empirical data are stored only when the liquid level
tracking error exceeds the limit or the control quantity suddenly changes, and sampling weights are distributed according to award absolute values; and finally, updating the Q table based on the
time difference error, and performing closed-loop real-
time control on the double-tank water tank according to the dynamically adjusted PID parameter. According to the method, a five-dimensional reward function is designed, and multi-index
dynamic balance is realized through linear weighting; the empirical tuple is stored only when the liquid level
tracking error exceeds the limit, and the quick response requirement of the dynamic time-varying scene of the double-capacity water tank is met;
dimensionality reduction is performed on a continuous
state space by adopting a non-uniform grading strategy, so that the calculation complexity is remarkably reduced; a
perception-decision-execution integrated framework is constructed, and the dependence of a traditional control method on a
mathematical model of the water tank is abandoned.