The invention discloses a real-time control system for graded remote control of an unmanned vehicle. The real-time control system comprises a control end, a vehicle end, a map management module, a driving control module, a stereoimaging module, an environmental perception information display module, a system control module, a behavior decision module, an environmental perception module, an environmental construction module, a value evaluation module and an intelligent system database, wherein the behavior decision module is divided into five grades; the environmental construction module interacts with the environmental perception module and the value evaluation module and predicts the result of program implementation of each task; the behavior decision module selects an optimal task plan according to the result of the program implementation of each task, predicted by the environmental construction module and cost effectiveness evaluated by the value evaluation module, and then issues subtasks to the next-grade behavior decision module for processing. The real-time control system has the advantages that multilevel cognitive planning ensures that the plan can be adequately recalculated; multilevel perception information ensures that a reaction behavior can make reasonable emergency response at a minimum feedback time delay and the like.