Intelligent terminal 3D watch try-on method and system based on augmented reality

Abstract

The invention relates to an intelligent terminal 3D watch try-on method and system based on augmented reality. Image information similar to hand color is extracted, hand image information is extracted from a background image, after contour extraction, convex hull detection is carried out, and according to a given threshold, whether it is a hand portion is determined; a contour is obtained again for the convex hull detection, and a convex hull at a waist is determined; according to internal parameters of different virtual scene video cameras, given by different intelligent terminal devices, relative transformation relations between coordinate points of the waist and the virtual scene video cameras are calculated; and a projection matrix is calculated, the obtained waist coordinate points are projected to a three-dimensional scene by use of the relative transformation relations between the coordinate points of the waist and the virtual scene video cameras, and a 3D model of a watch is projected to a waist position in the three-dimensional scene according to the projection matrix. According to the invention, application of pictures with identification information is unnecessary, what is needed is only one intelligent terminal, a waist image of a user is obtained in real time through a pick-up head, and after the waist image is processed through the intelligent terminal, a try-on effect can be displayed on a screen.

Description

technical field [0001] The invention relates to the field of e-commerce, in particular to a method and system for trying on a smart terminal 3D watch based on augmented reality. Background technique [0002] Over the past few years, with the rapid development of smart terminals and e-commerce, consumers are more and more fond of using e-commerce platforms on smart terminals to select their favorite goods. The difference between e-commerce and traditional commerce is that users can only view the products through the pictures provided by the platform, and it is difficult to judge whether the products are suitable for them. Therefore, various solutions for virtual try-on have been proposed in the practice of e-commerce. [0003] Augmented reality is a brand-new human-computer interaction technology. It is a technology that integrates computer disciplines such as image recognition and tracking, motion capture, and computer graphics. Using this technology, virtual 3D model animat...

AI Technical Summary

Problems solved by technology

At present, there are several ways to try on a watch: First, based on the picture uploading try-on method, the user uploads the hand picture taken to the service, and after the server processes, the watch picture selected by the user is aligned with the specific position of the wrist and displayed on the In the screen, the effect of trying on a watch can be achieved, but this method can only provide static try-on images, and the real-time performance is not strong; second, the logo-based augmented reality watch try-on technology needs to be downloaded and printed before use. A picture with logo information is placed on the wrist, and then the location information of the logo is recognized through the camera, and the virtual watch model is superimposed on the logo and displayed on the screen to achieve the effect of trying on

The disadvantage is that the user is required to obtain the logo picture in advance and then place it on the wrist, which is neither practical nor cumbersome.

Third, adopt a device that generates a virtual try-on experience, which uses one or more cameras to capture scene images, and synthesizes these images and the selected try-on products into a new image, which is displayed on the screen, but due to Need to use a single device for try-on experience, users cannot try-on experience anytime and anywhere

To achieve the effect of trying on a watch through an augmented reality virtual try-on device, hardware needs to be designed, the algorithm is complex, it is not easy to carry, the watch style is updated slowly, and the use cost is too high.

However, the watch try-on method based on image upload only provides static try-on images, and cannot display multiple angles in real time

Images