The invention belongs to the technical field of key distribution in secure communications, relates to a secure and high-speed key distribution scheme, and especially provides a secure and high-speed key distribution system and a method thereof based on a chaotic synchronization common channel feature. The system comprises a wideband random light source, a main fiber coupler, a common channel, an ultra-short pulse mode-locked laser, an Alice communicating party, and a Bob communicating party, wherein the Alice communicating party comprises a first optical feedback chaotic semiconductor laser, afirst fiber coupler, a first optical switch, a first privacy key module, a first register, and a first key filter; and the Bob communicating party comprises a second optical feedback chaotic semiconductor laser, a second fiber coupler, a second optical switch, a second privacy key module, a second register, and a second key filter. The invention is reasonable in structure, clever in design, effectively guarantees the key distribution security, and adequately uses the bandwidth advantage of a chaotic optical signal, which greatly improves the key distribution rate, and is appropriate for secure communication.