A new system design of multimedia recognition, processing, and indexing utilizes several new researches and technologies in the field of multi-media processing. The system integrates mature technologies being used in video security surveillance, media post-production, digital video storage and management, military visual and tacking technologies. The system makes unique integration of these existing, new, and upcoming technologies that have not been used in this combined fashion before, therefore providing new usage and applications beyond the simple sum of the functions of each technology. These technologies as components in a system that is open standard, and therefore can improve itself by modifying and replacing the technology components. The design of the system targets primarily heavily produced media contents from news, entertainment, and education and training, but not limited to these contents. Other digital contents, from live broadcast, to web broadcast, to home video, web cam, etc. can certainly use many different components of the system, and to utilize the open standard platform for various usages.