The invention relates to a unit of recovering flue gas waste heat and dust in nonferrous metal smelting and belongs to a method of waste heat utilization and waste gas treatment. A waste heat recovery device and a dust recovery device are formed by connecting a counter flow heat exchange waste heat boiler A, a silicon nitride porous ceramic filter, a counter flow heat exchange waste heat boiler B, a counter flow heat exchanger waste heat boiler medium preheater, a plate type passage gas counter flow heat exchanger, a bag filter, and a draught fan through a pipeline or pipes; flue gas subjected to waste heat and dust recovery is subjected to sulfur recovery in a desulfurization shop, and the tail gas can be discharged standardly. The method includes the steps of primary waste heat recovery, filtration, dedusting and purification of high temperature flue gas, secondary waste heat recovery, tertiary waste heat recovery, quaternary waste heat recovery, low temperature filtration and dedusting, sulfur recovery and emission of tail gas under national standard. The device has the advantages that waste heat recovery is efficient, dust recovery is thorough, process control is simple, and recovery cost is low.