The invention relates to a self-adaptive optical system based on an all-optical neural network, which belongs to the technical field of self-adaptive optical systems and comprises an all-optical neural network solver, a photovoltaic conversion array and a high-voltage amplifier. According to the invention, the all-optical neural network solver formed by optical diffraction plates is used for solution and modulation of a target light beam, and the target light beam is converted to an optical signals. The self-adaptive optical system is used for replacing a wavefront sensing device, a signal resolving device, a digital-to-analog conversion device and the like in a traditional self-adaptive optical system, the response bandwidth can reach the KHz magnitude, the high-bandwidth wavefront control requirement under a non-cooperative target scene can be met, meanwhile, a traditional circuit is replaced by the optical path, and the cost is reduced. Operation from a target light beam to a deformable mirror driving electric signal is achieved with extremely low power consumption and extremely high response speed, the effect of real-time wavefront correction is achieved, and the self-adaptiveoptical system can be applied to military and other scenes with high response bandwidth requirements for light beam wavefront correction.