The invention provides a real-time three-dimensional double-hand gesture recognition method and system based on binocular vision. The real-time three-dimensional double-hand gesture recognition method based on binocular vision comprises the steps that initial calibration and correction are conducted on an image firstly, the outline of a gesture is extracted, two-dimension gesture recognition is conducted on the extracted gesture outline, the mass center of the gesture outline is calculated, stereo matching is conducted on the mass center obtained through calculation, three-dimensional hand gesture recognition is achieved, and corresponding gestures are displayed in a human-computer interaction module based on the three-dimensional hand gesture recognition. According to the real-time three-dimensional double-hand gesture recognition method and system based on binocular vision, binocular vision information can be utilized, and human-computer interaction, based on the three-dimensional space, of double-hand gesture change of a computer is achieved; meanwhile, extremely high real-time performance and extremely high effectiveness can be achieved, and requirements for hardware are lowered; in addition, the man-machine interaction effect is achieved, and the requirements for real-time performance and effectiveness are well met.