The invention discloses an image reconstruction system based on cross array of memristors, including an image input processing module, a sparse encode module and an image output processing module, wherein the sparse encoding module comprises a first memristor cross array, a calculation conversion unit and a second memristor crossover array. The system realizes the image pixel dictionary set through two memristors crossing arrays, and the sparse coding is performed based on the two memristor crossover arrays to realize image reconstruction. Because the memristor consumes very little power, theoverall power consumption of the system is reduced compared with the existing schemes. In addition, the memristor processes data quickly, and the size of the nano-memristor cross-array is small, whichis easy to integrate, and the important vectors in the sparse coding can be realized efficiently and conveniently, so that the coding speed is faster, the efficiency of the system is improved, but also a valuable reference direction is provided for large-scale hardware implementation.