This invention discloses an image specular highlight removal method based on weakly
supervised learning, comprising the following steps: First, the highlight region of the image is decomposed using a sparse non-negative matrix, and a highlight-free image is cropped from the non-highlight region as training data; then, the training data is input into three joint training modules connected end-to-end to perform highlight generation, highlight removal, and image reconstruction tasks respectively, and a recurrent
generative adversarial network (RGAN) architecture is used to
train the network and generate the final highlight-free image. This image specular highlight removal method based on weakly
supervised learning completes highlight removal by jointly training the highlight generation, highlight removal, and reconstruction modules, using a RGAN architecture. During training, the
loss function of subsequent modules is fed back to the preceding module, enabling training to be completed using only the highlight image and achieving good highlight removal results. Compared with traditional algorithms and existing weakly
supervised learning methods, it has the advantages of simple operation and excellent highlight removal effect.