The invention relates to a video-based teaching management system, including a central switch, the central switch is connected with a management platform, data server, pc terminal, handset terminal and monitor unit. The management platform comprises a main control module, a command retrieval module, an attendance storage module, an image analysis unit, a data statistics module, a data generation module, a data output module and a video retrieval interface. The image analysis unit comprises a command analysis processing module, an image retrieval module, an image comparison module and a data storage module. The monitoring unit comprises a first-level exchange, wherein the first-level exchange is connected with a first camera and a second camera. The first camera and the second camera all comprise a microprocessor, a GIS module, an image acquisition and processing module, a face image detection module, a face image extraction module, a storage unit, an I/O interface and a power supply interface, and an image acquisition module. The invention has the advantages of convenient teaching management, convenient attendance and convenient teaching management data retrieval.