A video control method and a system based on an XML comprises: 1) expanding a description scheme of a video stream, a program, a frame, a layer and an object in an MPEG-7 standard; 2) defining an XML video resource description file format; 3) processing the video file, creating an XML video description file corresponding to a video content, and implementing the control for the video internal resource and/or the video external resource based on the XML video resource description file; 4) responding the video in a web page, and parsing the corresponding XML video description file; 5) implementing interaction with the video during the video play process. The invention provides the video resource description file format based on the XML, and provides a video control method based on the XML and a system thereof, so that the user can interact with the corresponding objects in the video during watching video process. The invention not only increases the video entertainment, but also provides a technique support for other value-added application, and has great commercial value.