The invention provides an automatic video color coordination processing method and a processing system thereof. The automatic video color coordination processing method includes steps of cutting a video file into lens video sections, reading in a lens video section, performing color coordinating process on each frame in current lens video section according to a matching coordinated color template of a first frame and time and space neighborhood points of pixels of each frame, wherein the time and space neighborhood points comprise space neighborhood points and time neighborhood points, further, judging whether the current lens video section is the last lens video section of the video filer or not, if not, then executing the previous step, and if so, then completing the process of the video file. Besides, the invention further provides an automatic real-time video color coordination processing method. As all the frames in one lens video section correspond to the same coordinated color template, and the color coordinating result of the front frame is utilized as a foundation of color coordination of the current frame, space continuity and time continuity of color coordination of each frame in one lens video section are guaranteed.