The invention provides a refractory material with enhanced toughness, and relates to the field of refractory materials. The refractory material with enhanced toughness comprises quartz sand, calcium oxide, magnesium oxide, manganese oxide, titanium oxide, niobium pentoxide, toughened fibers, tantalum pentoxide, a granulation binder and a forming binder, and specifically comprises 60 parts of the quartz sand, 8-10 parts of the calcium oxide, 6-8 parts of the magnesium oxide, 2-3 parts of the manganese oxide, 3-4 parts of the titanium oxide, 1-2 parts of the niobium pentoxide, 10-15 parts of thetoughened fibers, 1-1.5 parts of the tantalum pentoxide, 2-3 parts of the granulation binder and 0.5-0.7 part of the forming plasticizer. The refractory material with enhanced toughness is modified by adopting a toughening agent, and the modified refractory material has a good toughening effect. High fracture toughness of the refractory material is improved, and better mechanical impact resistance is achieved. Meanwhile, the mixture is treated by adopting a secondary granulation method, so that distribution of the toughened fibers, the granulation binder and the forming binder can be relatively concentrated in a small range.