The invention discloses a stereoscopic video collection system. The system includes left and right view image sensors, which have controlled and adjustable display windows, and collect left and rightview images of a scene; a controllable guide rail, which is connected with the left and right view image sensors, and controls horizontal movement of the left and right view image sensors under driving of movement control commands; a processing and control device, which determines an optimal image fusion parallax range according to a display device parameter, calculates and obtains an image parallax graph according to collected left and right view images, then judges, according to the optimal image fusion parallax range and image parallax graph, whether the left and right view images need to be adjusted, and calculates parallax adjustment offset quantity when adjustment is needed, generating a movement control command according to the parallax adjustment offset quantity, and sending the same to the controllable guide rail, and directly outputs the left and right view images when adjustment is not needed; and a display device, which receives the left and right view images output by theprocessing and control device, and carries out stereoscopic display. The system imports a stereoscopic video display effect.