The invention discloses a metal surface roughness detection device based on the reflection-type terahertz time-domain spectroscopy. The device comprises a femtosecond laser (1), a beam splitter (2), an optical delay line (3), a reflecting mirror (4), a first optical fiber coupler (5), a first optical fiber (6-1), a second optical fiber (6-2), a terahertz transmitter (7), a sample table (8), a terahertz detector (9), a second optical fiber coupler (10) and a computer (11). The invention further discloses a detection method utilizing the device. The method comprises the steps of firstly, utilizing the device for obtaining the terahertz reflection spectrum of a standard test piece of a certain material, building a roughness detection model, then measuring the terahertz reflection spectrum of the piece to be tested, and applying the built roughness detection model for obtaining the roughness. On the basis of the terahertz wave principle, the surface roughness difference, corrosion, surface damage of metal with a cladding layer can be accurately detected, and the device and method have the advantages of being free of damage, contactless, rapid in analysis speed and the like.