Shoe virtual try-on method and device based on WeChat applet

Abstract

The invention discloses a shoe virtual try-on method and device based on a WeChat applet. The method comprises the steps of: inputting an image into a lightweight convolutional neural network, recognizing a predefined target in the image and the pose information of the predefined target, and enabling the predefined target to be a left foot and a right foot; according to the pose information, calculating adjustment parameters required for projecting a 3D model to the predefined target in the image through a full-connection network of a fitting pnp algorithm, and adjusting the 3D model accordingto the adjustment parameters to obtain an adjusted model; and projecting the adjusted model into the image, and rendering to generate a try-on image. According to the scheme, a lighter technical scheme is provided for solving the problems of WeChat applet resource limitation and insufficient local computing power, virtual try-on computing work can be completed locally, and excessive network operation overhead does not need to be occupied.

Description

technical field [0001] The present invention relates to the application field of AR technology, in particular to a method and device for AR imaging virtual shoe fitting. Background technique [0002] Nowadays, online shopping has become a trend. Consumers can learn about various products and choose their favorite products without leaving home, and pay conveniently and quickly. But there are problems: (1) Traditional e-commerce using shoe pictures and videos cannot be user-centered, and the display of products is shifted by the user's attention. (2) Users cannot judge whether the style of shoes purchased online is suitable for them, which may cause returns and reduce the conversion rate. Therefore, there is an urgent need to apply new technologies to online shoe shopping, so that users can more intuitively understand the effect of trying on shoes online. [0003] Augmented reality technology, referred to as AR technology, is a technology that calculates the position and ang...

AI Technical Summary

Problems solved by technology

[0006] The present invention is to overcome the disadvantages of the software application technical solution of the virtual reality shoe fitting in the prior art that need to download a special APP, the user operation is cumbersome, and it is not conducive to the online promotion of the merchant, and provides a method that reduces the local computing requirements of the mobile phone. A method for virtual shoe try-on based on a WeChat applet that can be implemented in a WeChat applet environment without downloading a dedicated APP, and a device for realizing the method

Images