The invention discloses a process for recovering sulfur, lead, zinc and silver from oxygen-enriched directly leached residues of zinc concentrates or lead-zinc mixed ores, which comprises the following steps: adding the oxygen-enriched directly leached residues of zinc concentrates or lead-zinc mixed ores, which are not processed or subjected to drying, grinding and screening pretreatment, into a heating device in which mixed liquid of a sulfur extracting agent and an additive metered in a liquid-solid ratio of 8-15 is filled, after heating for reaction, filtering the obtained object while the obtained object is hot, and cooling and then filtering filter liquor so as to obtain a sulphur product; after filter residues are washed by using a sulfur extracting agent and ethanol, returning the obtained product to a lead system to recover lead and silver; after washing liquid is volatilized, cooled and recovered, returning the obtained object to use; after the sulfur extracting agent is filtered, regenerating, and returning the obtained object to a sulfur extracting process so as to cyclically participate in the reaction; and after a zinc-containing solution is filtered, returning the obtained product to a direct leaching system. The process is simple in process and equipment and high in sulfur recovery rate and product quality, has no pollution to the environment, both can realize the efficient and economic extraction of sulfur in floating sulfur residues, and can realize the respective efficient and economic recovery of zinc, lead and silver in floating sulfur residues.