The invention relates to a coal gangue sorting system based on image data processing, which includes a support shell, a support base, a driving roller, a conveyor belt, a traction mechanism, a distribution mechanism, a linkage mechanism, a sorting mechanism and a drive motor. The two ends of the protective shell are respectively equipped with supporting bases, and a driving roller is installed between the two supporting bases on the same side, and a driving motor is installed on the side wall of one of the supporting bases, and the output shaft of the driving motor is connected with the driving roller. The outer walls of the two driving rollers are sleeved with conveyor belts, the outer wall of the support seat at one end of the drive motor is provided with a traction mechanism, the middle of the support shell is provided with a distribution mechanism, and the inner wall of the support shell is provided with a linkage mechanism. Invented, the chaotic distribution of coal gangue on the conveyor belt can be regularized into a horizontal and parallel distribution, so that the coal gangue falling from the conveyor belt is located on one side of the gas nozzle, ensuring that each gas nozzle can be accurately sorted, avoiding A device is missed.