The invention provides a heating method for controlling decarburization in a heavy rail billet furnace in a heat accumulation heating mode. The heating process comprises a pre-heating section, a heating section and a soaking section. A furnace pressure measurement point is positioned at the pre-heating section; the full furnace is controlled at positive pressure; when the billet temperature is controlled to be less than 1,000 DEG C, the atmosphere in the furnace is oxidizing atmosphere, and the air consumption coefficient is between 1.05 and 1.25; and when the billet temperature is controlledto be more than or equal to 1,000 DEG C, the atmosphere in the furnace is weak reducing atmosphere, the air consumption coefficient is between 0.9 and 1.0. Aiming at the operation and decarburizationcharacteristics of the heat accumulation heating furnace different from the traditional heating furnace, the segment control method is adopted on the control aspects of atmosphere in the furnace and temperature, and a limit low-oxygen concentration burning process is realized. The method has the advantages of low heated billet surface decarburization, low oxidized burning loss, high furnace energy utilization, low pollutant discharge, low production cost and the like, is simple, convenient and feasible, and can achieve good effect of saving materials and energy at the same time of improving the heating quality of products.