The invention provides an all-fiber high-speed phase modulator based on acousto-optic action, which comprises a surface acoustic wave generating device and an optical fiber, the surface acoustic wave generating device is used for generating a surface acoustic wave band, the optical fiber is perpendicular to the propagation direction of the surface acoustic wave band and is arranged in an area where the surface acoustic wave band exists, and the surface acoustic wave band is coupled with the optical fiber. Strain is generated in the optical fiber, so that the refractive index in the optical fiber is changed, and high-speed phase modulation of the optical fiber is realized. The optical fiber is fixed at the position where the surface acoustic wave band exists in the direction perpendicular to the propagation direction of the surface acoustic wave band, so that the refractive index in the optical fiber is changed, the surface acoustic wave band is band-shaped, and the whole section of the optical fiber can be fixed at the position where the surface acoustic wave band exists, namely, the surface acoustic wave band can perform phase modulation on the whole section of the optical fiber at the same time; therefore, the modulation efficiency is high, the optical fiber phase modulation can be realized only by adopting one acoustic surface wave generation device, and the structure is simpler.