The invention provides an OCT conjugated mirror image removal device and method capable of eliminating multicolor errors. The device includes a CCD camera, a ruling grating, an upper computer, a piezoelectric ceramic, a beam splitter, a sample, an objective lens, a GRIN fiber collimator, and a super radiance light emitting diode. Through adoption of the device and the method, signal reconstructionis performed on an interference signal, fixed phase shift amount is corrected by utilizing the wavelength of a broadband light source, and a set of varying phase shift amount is calculated, and because the corrected phase shift amount is error-free, the reconstructed interference signal is not affected by the multicolor errors of the broadband light source. Rapid Fourier transform is performed onthe interference signal to eliminate a conjugated mirror image, and the detection depth of a system is doubled. Without increasing the amount of data of traditional phase shifting methods, the effectof the multicolor errors of the broadband light source is completely removed, and the error tolerance of the system is improved.