The invention relates to a double-channel differential polarizing interference imaging spectrometer, which comprises a collimating lens, a Wollaston prism, a Savart polarizer, a linear polarizer, an imaging lens, a plane array detector, a connecting lead and a computer processing system, wherein after light emitted by a target passes through the double-channel differential polarizing interference imaging spectrometer, interference images of a parallel component and a vertical component of the target can be acquired by using the plane array detector; the interference images are input to the computer processing system through the connecting lead, and Fourier transformation and image fusion processing are respectively performed on the two interference images, so that spectral images of the parallel component and the vertical component of the target can be inversed; the difference of the two spectral images is a differential polarizing spectral image of the target; and the ratio of the difference of the two spectral images to the sum of the two spectral images is a linear polarizing spectral image of the target. The spectrometer has the advantages of simple and compact structure, high sampling precision, good stability, no rotary component, and capability of acquiring the differential polarizing spectral image and the linear polarizing spectral image of the target.