Mobile terminal based real-time 3D fitting method

Abstract

The present invention discloses a mobile terminal based real-time 3D fitting method. The method comprises: obtaining a two-dimensional planar image of to-be-fitted clothing through a mobile terminal; rotating and cropping the two-dimensional planar image, and then performing registering and matching; in combination with physical characteristics of a person trying on clothing, identifying feature points of the to-be-fitted clothing; performing feature point identification positioning of different styles of clothing; generating a clothing style deformation coefficient and establishing 3D clothing models; embedding a 3D fitting human body model in the mobile terminal, and adaptively fusing the 3D clothing models of the to-be-fitted clothing to the 3D fitting human body model; according to physical parameters of the 3D fitting human body model, adaptively adjusting a 3D fitting effect of the to-be-fitted clothing; and performing real-time 360-degree touch display on the 3D fitting effect in a screen of the mobile terminal. According to the method disclosed by the present invention, the identification accuracy of a clothing outline can be improved, and the highly realistic 3D fitting effect is displayed in real time on the mobile terminal.

Description

Technical field [0001] The invention relates to the field of virtual wear technology, in particular to a real-time three-dimensional fitting method based on a mobile terminal. Background technique [0002] With the increasing level of technology, the application of virtual wearable technology to life scenes has become a necessity. [0003] Virtual wearable technology covers a wide range of technical research fields, and has deep technical research in face recognition, image recognition, machine learning, artificial intelligence, computer vision, 3D (3Dimensions) real-time rendering engine, etc. The existing virtual wearable technology is mainly limited by the depth information acquisition of the monocular camera, and the algorithm of 2D (2Dimensions, two-dimensional) partial coverage of 3D is also a major challenge in this technical field. The efficiency and effect of 3D real-time rendering will affect Experience effects, final overall efficiency and optimization on various platfo...

AI Technical Summary

Problems solved by technology

[0005] However, the spatial position information of the human body image recognized by the traditional virtual wearable technology is poor in accuracy, the size of the virtual clothing has a large deviation, the recognition of human body movements is low, and it is difficult to accurately superimpose the virtual clothing on the appropriate position of the human body image. It is more difficult to display realistic virtual clothing in line with actual human body movements, resulting in a very blunt virtual try-on display effect

[0006] Moreover, due to the limitation of the two-dimensional plane, the existing virtual fitting process only integrates the 2D clothes and the 2D fitting image of the person. The fusion image used is a 2D model, which cannot truly show the three-dimensional sense of space and the gravity of the clothes. etc. effect

[0007] In addition, the online fitting room software must manually model each clothing model in the background before it can be tried online; moreover, the traditional virtual try-on technology usually requires a manual model for each type of clothing, and the clothing library model The generation cycle is long, resulting in problems such as real-time dynamic update and high cost

Images