The invention discloses an intelligent video monitoring system with privacy protection. The system comprises one or more intelligent video monitoring equipment modules, an IVSS platform server, and a video monitoring system terminal, wherein the intelligent video monitoring equipment modules can realize the intelligent and automation treatments of targets in a monitoring scene such as real-time detection, tracking, classification, behavior analysis and the like, and also realize performing scrambling treatment on contents related to the privacy so as to protect privacy information. According to the technical scheme provided by the invention, the intelligent monitoring method realizing privacy protection can automatically differentiate 'abnormities' in pictures, performs the detection, tracking, classification and behavior analysis on the moving targets, realizes the intelligent alarm, effectively avoids the occurrence of accidents, and can protect the monitored privacy information, and any privacy information is inaccessible to an authorized user.