The invention relates to an iron rod rust removing device, in particular to an efficient rust-removing device for an iron rod for hardware machining. In order to solve technical problems in the prior art, the efficient rust-removing device being small in size, high in cost performance, free of professional requirements and manpower, convenient, rapid, efficient, safe and reliable, and having the advantage that the damage of the operating environment to the health of operating personnel is relatively small is provided. The efficient rust-removing device comprises an L-shaped bracket, a motor, a first bearing seat, a supporting rod, a water tank, a first one-way valve, a first rotating shaft, a first belt wheel, a second bearing seat, a lead screw, a clamping device and the like, wherein the motor and several other components are arranged at the inner top of the L-shaped bracket from left to right. Friction blocks perform reciprocating motion up and down and matched with the rotating iron rod for rust removing, so that the efficient rust-removing device provided by the invention achieves the effects of being small in size, high in cost performance, simple to operate, free of professional requirements and manpower, convenient, rapid and efficient.