The invention discloses an agent for removing phosphorus in sewage. The agent is composed of the following raw materials in parts by weight: 8-14 parts of adina rubella hance, 3-6 parts of gypsum, 2-5 parts of millet bran, 10-25 parts of bauxite, 16-32 parts of coal ash, 10-35 parts of quick lime, 24-40 parts of ferric sulfate, 6-15 parts of activated carbon and 5-12 parts of graphite. The invention also discloses a preparation method of the agent. The raw materials are wide in source, the preparation process is simple, and the production equipment is low in investment cost, so that the agent is suitable for large-scaled industrial production. In the product, adina rubella hance is adopted to adsorb phosphorus. Phosphorus-containing compounds in the sewage are adsorbed by the activated carbon and graphite. The bauxite, ferric sulfate and lime are polymerized to generate a hydroxyl polymeric colloid and a precipitate of hydroxide, so that free phosphorus, organic phosphorus and compounds thereof, hydrogen phosphate, dihydrogen phosphate and the like in the sewage can be adsorbed and associated. The agent is good in treatment effect, does not affect the water quality and has a good social benefit.