The invention provides a method and
system for converting an
RGB image into a
depth map based on a variational auto-
encoder, and relates to the field of
image processing, and the method comprises the steps: constructing and training an
image conversion model which comprises a
feature extraction network, a probability
encoder, a self-adaptive sampling unit, a condition decoder and an uncertainty quantization unit, the
feature extraction network is used for extracting a feature map of the
RGB image, the probability
encoder is used for carrying out
feature extraction on the feature map and outputting a mean value and a variance of a
potential space, and the adaptive sampling unit is used for extracting
noise influence features from the
RGB image, determining a plurality of sampling noises and outputting the sampling noises to the RGB image. The condition decoder is used for generating a plurality of hypothetical depth maps corresponding to the RGB
image based on the mean value and variance of the
potential space and the plurality of sampling noises so as to generate a
depth map, and the uncertainty quantization unit is used for generating an uncertainty map corresponding to the RGB image; the
depth map corresponding to the to-be-converted RGB image is generated through the
image conversion model. The method has the
advantage of improving the reliability of depth map conversion.