The invention relates to a novel photon probability mapping method based on terrace forming, which belongs to the technical field of mapping method. The method comprises the following steps: matchingaccording to channel conditions and generating an optimal Gaussian beam by a laser; performing probability matching by a probability matcher, and changing the shape of the Gaussian beam by a spatial phase array to obtain a novel beam formed in terrace; performing the 64QAM projection mapping on the data by the novel beam; concentrating and converging the 64 constellation point optical signals; performing pre-emphasis; amplifying the optical signals after passing through a channel, detecting by a photodetector, performing low-pass filter, orthogonalizing and normalizing, and performing data convergence and equalization; matching probabilistic solutions, removing step noise by wavelet transform analysis, performing constellation demapping; estimating channel conditions according to the received data, feeding back channel state information to the probability matcher, and performing real-time dynamic regulation on the probability matcher. The novel photon probability mapping method based on the terrace forming can effectively reduce the signal transmission power, reduces the bit error rate, improves the frequency band utilization, and lengthens the transmission distance.