A rechargeable alkali metal battery comprising: (A) an anode comprising an alkali metal layer and a dendrite penetration-resistant layer composed of multiple graphene sheets or platelets or exfoliated graphite flakes that are chemically bonded by a lithium- or sodium-containing species to form an integral layer that prevents dendrite penetration through the integral layer, wherein the lithium-containing species is selected from Li2CO3, Li2O, Li2C2O4, LiOH, LiX, ROCO2Li, HCOLi, ROLi, (ROCO2Li)2, (CH2OCO2Li)2, Li2S, LixSOy, Na2CO3, Na2O, Na2C2O4, NaOH, NaiX, ROCO2Na, HCONa, RONa, (ROCO2Na)2, (CH2OCO2Na)2, Na2S, Nax SOy, or a combination thereof, wherein X═F, Cl, I, or Br, R=a hydrocarbon group, x=0-1, y=1-4; (B) a cathode comprising a cathode layer; and (C) a separator and electrolyte component in contact with the anode and the cathode; wherein the dendrite penetration-resistant layer is disposed between the alkali metal layer and the separator.