The invention relates to a video compression collecting system and method. The video compression collecting system is used for imaging scenery on a modulation face of a passive light signal modulator through an objective, a high-precision displacement device is used for enabling the passive light signal modulator to generate a modulation effect with precise displacement and continuous conversion, video signals of the scenery are converted and modulated through the passive light signal modulator, and then integration and collection are conducted on the video signals through an area array detector. Compression image signals collected by the area array detector can be reconstructed, and original video signals of the scenery can be obtained. According to the video compression collecting method, an optical compression means is directly used for achieving parallel compression and collection of video data, and then original video data are reconstructed in a high-fidelity mode. According to the method, the video data collecting amount can be compressed in a large rate mode, the data management burden of video collection is relieved, and the method is particularly suitable for collecting high-resolution and high-frame frequency video signals.