The invention relates to a heating device for improving heating quality of steel billets and a using method thereof. The heating device comprises a heating furnace, a heat storage system blower, a flat flame system blower, a combustion-supporting air pipeline, a gas pipeline, a heat storage system draught fan, an air heat exchanger, a gas heat pipe exchanger, a smoke exhaust pipeline and a chimney. 2-4 ignition burners are arranged at a preheating section of a heating furnace, and 12-30 pairs of heat storage type burners and 4-12 flat flame burners are respectively arranged at a heating section and a soaking zone. The using method comprises the following steps of reasonable distribution of combustion-supporting air and gas flow rate of the heat storage type burners and the flat flame burners, sectional configuration of furnace temperature and heating time, preheating of combustion-supporting air and gas temperature through a high-temperature smoke gas and furnace tail gas in grades, alternative furnace feeding of cold and heat steel billets, intermittent movement of the steel billets, and vaporization cooling of the steel billets. The flow field in the furnace is modified through the system, the optimal configuration of flow rates of air and gas in the burner is realized through reasonable arrangement of gas and air pipeline systems, and the waste heat of high-temperature smoke gas of the heating furnace is gradiently utilized, thus the in-furnace time is shortened, the uniformity of heating the steel billets is improved, and the high-efficiency heating of the steel billets is realized.