A virtual try-on system for simulated clothing

Abstract

This invention relates to the field of virtual try-on technology, specifically to a virtual try-on system for simulated clothing. The system includes a camera module for acquiring 3D data of the clothing unfolded and the human body standing, and sending this data to a processing module. The processing module preprocesses the 3D data, converting it into 3D models of the clothing and the human body, recording feature points of these models, and comparing these feature points to identify areas of discomfort. A display module combines the 3D models of the clothing and the human body, projects the combined model onto a display, and marks the locations of the areas of discomfort on the projection. The purpose of this invention is to provide a virtual try-on system for simulated clothing that features high precision, strong realism, and wide applicability.

Description

Technical Field

[0001] This invention relates to the field of virtual try-on technology, and more specifically to a virtual try-on system for simulated clothing. Background Technology

[0002] The development of computer technology and the widespread application of computer vision principles have made research on generating virtual try-on images using computer image processing technology increasingly popular. Virtual clothing try-on aims to visualize the effect of clothing on a person based on their image and the image of the clothing. This is of great significance for improving the user experience of e-commerce platforms and reducing the cost of model images for merchants.

[0003] With the rapid development of e-commerce, online shopping has become one of the mainstream consumption methods. However, when buying clothes online, consumers cannot actually try them on, leading to frequent problems such as unsuitable sizes and mismatched styles, resulting in high return rates and seriously affecting the shopping experience for consumers and the operational efficiency of merchants. To solve this problem, virtual try-on technology has emerged.

[0004] However, existing virtual try-on technologies are mainly based on two-dimensional image processing or simple three-dimensional model matching, which have the following limitations:

[0005] Insufficient precision: Two-dimensional image processing cannot accurately reflect the three-dimensional geometric features of clothing (such as wrinkles, bulges, stretching, etc.), resulting in a distorted fitting effect.

[0006] Poor realism: Existing technology struggles to simulate the complex interactions between clothing and the human body (such as fabric deformation and fit), resulting in a lack of realism in the fitting experience.

[0007] Low practicality: Some technologies require complex hardware (such as high-precision 3D scanners) or a large amount of computing resources, making them difficult to popularize and apply.

[0008] Poor user experience: Try-on results are usually displayed as static images or simple animations, which cannot intuitively show the mismatch between the clothing and the body (such as too tight or too loose). Summary of the Invention

[0009] In order to overcome the shortcomings and deficiencies of the existing technology, the purpose of this invention is to provide a virtual try-on system for simulated clothing, which has the characteristics of high precision, strong realism and wide applicability.

[0010] This invention is achieved through the following technical solution:

[0011] In a first aspect, the present invention discloses a virtual try-on system for simulated clothing, comprising:

[0012] The camera module is used to acquire three-dimensional data of clothing unfolded and human body standing, and send the three-dimensional data to the processing module.

[0013] The processing module is used to preprocess the above three-dimensional data, and convert the preprocessed three-dimensional data into three-dimensional models of clothing and human body, record the feature points of the above three-dimensional models, and compare the feature points of the above three-dimensional models to obtain discomfort points.

[0014] The display module is used to combine the 3D model of clothing and the 3D model of the human body and display the combination by projection, while marking the location of discomfort points on the display projection.

[0015] Secondly, the present invention discloses a virtual try-on method for simulated clothing, which includes the following steps:

[0016] S100. The camera module acquires 3D data of the clothing after it is unfolded and the human body after it is standing.

[0017] S200. Preprocess the 3D data;

[0018] S300. Convert the preprocessed 3D data into triangular meshes to represent the 3D models of clothing and the human body;

[0019] S400. Extract several feature points from the three-dimensional models of clothing and human body, and compare the above feature points to obtain the discomfort points;

[0020] S500. The display module combines the 3D model of clothing and the 3D model of the human body and displays the combination by projection, while marking the location of discomfort points on the display projection.

[0021] In conjunction with the second aspect, further, in step S100, point cloud data is used to represent the three-dimensional data of the clothing after it is unfolded and the human body after it is standing.

[0022] The three-dimensional data of clothing or the human body is represented as follows:

[0023]

[0024] in, These are the coordinates of a point in three-dimensional space. It represents the total number of points.

[0025] In conjunction with the second aspect, further, in step S200, the formula for preprocessing the three-dimensional data is as follows:

[0026]

[0027] in, For the first The coordinates of the points For point The neighborhood point set, For neighborhood point set The first in One point, for and The Euclidean distance between them The standard deviation of the Gaussian kernel. This is the normalization coefficient.

[0028] In conjunction with the second aspect, further, in step S300, the Delaunay triangulation algorithm is used to generate a triangular network:

[0029] .

[0030] In conjunction with the second aspect, further, in step S400, the discomfort points include the wrinkles, bulges, and elasticity of the clothing;

[0031] The formula for calculating wrinkle degree is:

[0032]

[0033] The formula for calculating the bulge is:

[0034]

[0035] The formula for calculating the stretchability is:

[0036]

[0037] in, For point and points The normal vector, For the difference between normal vectors, For point The number of neighboring points.

[0038] Thirdly, the present invention also discloses an electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the virtual try-on method for simulated clothing as described above.

[0039] Fourthly, the present invention also discloses a computer-readable storage medium having a computer program stored thereon, the program being executed by a processor to implement the virtual try-on method for simulated clothing as described above.

[0040] The beneficial effects of this invention are:

[0041] This invention provides a virtual try-on system, method, electronic device, and storage medium for simulated clothing. Through high-precision 3D modeling and feature point comparison analysis, it solves the problems of insufficient accuracy, poor realism, and low practicality in existing technologies, significantly improving the effect and user experience of virtual try-on. At the same time, the system has wide applicability and significant economic benefits, bringing dual value to both consumers and businesses. Attached Figure Description

[0042] The present invention will be further described with reference to the accompanying drawings, but the embodiments in the drawings do not constitute any limitation on the present invention. For those skilled in the art, other drawings can be obtained based on the following drawings without creative effort.

[0043] Figure 1 The flowchart illustrates the steps of the virtual try-on method provided in this embodiment of the invention. Detailed Implementation

[0044] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Many specific details are set forth in the following description to provide a thorough understanding of the present invention. However, the present invention can be practiced in many other ways different from those described herein, and those skilled in the art can make similar modifications without departing from the spirit of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0045] The development of computer technology and the widespread application of computer vision principles have made research on generating virtual try-on images using computer image processing technology increasingly popular. Virtual clothing try-on aims to visualize the effect of clothing on a person based on their image and the image of the clothing. This is of great significance for improving the user experience of e-commerce platforms and reducing the cost of model images for merchants.

[0046] With the rapid development of e-commerce, online shopping has become one of the mainstream consumption methods. However, when buying clothes online, consumers cannot actually try them on, leading to frequent problems such as unsuitable sizes and mismatched styles, resulting in high return rates and seriously affecting the shopping experience for consumers and the operational efficiency of merchants. To solve this problem, virtual try-on technology has emerged.

[0047] However, existing virtual try-on technologies are mainly based on two-dimensional image processing or simple three-dimensional model matching, which have the following limitations:

[0048] Insufficient precision: Two-dimensional image processing cannot accurately reflect the three-dimensional geometric features of clothing (such as wrinkles, bulges, stretching, etc.), resulting in a distorted fitting effect.

[0049] Poor realism: Existing technology struggles to simulate the complex interactions between clothing and the human body (such as fabric deformation and fit), resulting in a lack of realism in the fitting experience.

[0050] Low practicality: Some technologies require complex hardware (such as high-precision 3D scanners) or a large amount of computing resources, making them difficult to popularize and apply.

[0051] Poor user experience: Try-on results are usually displayed as static images or simple animations, which cannot intuitively show the mismatch between the clothing and the body (such as too tight or too loose).

[0052] To address the aforementioned problems, this embodiment discloses a virtual try-on system for simulated clothing, comprising:

[0053] The camera module is used to acquire three-dimensional data of the clothing after it is unfolded and the human body after it is standing, and send the three-dimensional data to the processing module. The camera module is preferably a 3D scanner or a depth camera.

[0054] The processing module is used to preprocess the above three-dimensional data, and convert the preprocessed three-dimensional data into three-dimensional models of clothing and human body, record the feature points of the above three-dimensional models, and compare the feature points of the above three-dimensional models to obtain discomfort points.

[0055] The display module is used to combine the 3D model of clothing and the 3D model of the human body and display the combination by projection, while marking the location of discomfort points on the display projection.

[0056] Please refer to Figure 1 This application illustrates a virtual try-on method for simulated clothing provided by some embodiments of the present application. The method can be executed on the system described above and includes the following steps:

[0057] S100. The camera module acquires 3D data of the clothing after it is unfolded and the human body after it is standing.

[0058] S200. Preprocess the 3D data;

[0059] S300. Convert the preprocessed 3D data into triangular meshes to represent the 3D models of clothing and the human body;

[0060] S400. Extract several feature points from the three-dimensional models of clothing and human body, and compare the above feature points to obtain the discomfort points;

[0061] S500. The display module combines the 3D model of clothing and the 3D model of the human body and displays the combination by projection, while marking the location of discomfort points on the display projection.

[0062] It should be noted that the principles of how to perform display projection and mark the positions of inappropriate points on the display projection in this embodiment are existing technologies and will not be elaborated here.

[0063] Furthermore, in step S100, point cloud data is used to represent the three-dimensional data of the clothing after it is unfolded and the human body after it is standing.

[0064] The three-dimensional data of clothing or the human body is represented as follows:

[0065]

[0066] in, These are the coordinates of a point in three-dimensional space. It represents the total number of points.

[0067] Furthermore, in step S200, the formula for preprocessing the three-dimensional data is as follows:

[0068]

[0069] in, For the first The coordinates of the points For point The neighborhood point set, For neighborhood point set The first in One point, for and The Euclidean distance between them The standard deviation of the Gaussian kernel. This is the normalization coefficient.

[0070] Furthermore, in step S300, the Delaunay triangulation algorithm is used to generate a triangular network:

[0071] .

[0072] Furthermore, in step S400, the discomfort points include the wrinkles, bulges, and elasticity of the clothing.

[0073] The formula for calculating wrinkle degree is:

[0074]

[0075] The formula for calculating the bulge is:

[0076]

[0077] The formula for calculating the stretchability is:

[0078]

[0079] in, For point and points The normal vector, For the difference between normal vectors, For point The number of neighboring points.

[0080] Some embodiments of this application also provide an electronic device, the electronic device including: a processor, a memory, a bus and a communication interface, the processor, the communication interface and the memory being connected via the bus; the memory stores a computer program that can run on the processor, and when the processor runs the computer program, it performs the method provided in any of the foregoing embodiments of this application.

[0081] The virtual try-on system for simulated clothing provided in the above embodiments of this application and the virtual try-on method for simulated clothing provided in the embodiments of this application are based on the same application concept and have the same beneficial effects as the methods adopted, operated or implemented.

[0082] The memory may include high-speed random access memory (RAM) and may also include non-volatile memory, such as at least one disk storage device. Communication between this system network element and at least one other network element is achieved through at least one communication interface (which can be wired or wireless), such as the Internet, wide area network, local area network, metropolitan area network, etc.

[0083] The bus can be an ISA bus, PCI bus, or EISA bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. The memory is used to store the program, and the processor executes the program after receiving an execution instruction. The virtual try-on method for simulated clothing disclosed in any of the foregoing embodiments of this application can be applied to a processor, or implemented by a processor.

[0084] The processor may be an integrated circuit chip with signal processing capabilities. In implementation, each step of the above method can be completed through integrated logic circuits in the processor's hardware or through software instructions. The processor can be a general-purpose processor, including a Central Processing Unit (CPU), a Network Processor (NP), etc.; it can also be a Digital Signal Processor (DSP), an Application-Specific Integrated Circuit (ASIC), an Off-the-shelf Programmable Gate Array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly embodied in the execution of a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software modules can be located in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. This storage medium is located in memory; the processor reads information from the memory and, in conjunction with its hardware, completes the steps of the above method.

[0085] The electronic device provided in this application embodiment and the intelligent control method for heavy object handling provided in this application embodiment are based on the same application concept and have the same beneficial effects as the methods they adopt, operate or implement.

[0086] This application also provides a computer-readable storage medium corresponding to the intelligent control method for heavy object handling provided in the aforementioned embodiments, wherein a computer program is stored thereon. The computer-readable storage medium is an optical disc, wherein the computer program (i.e., a program product) is stored thereon. When the computer program is run by a processor, it executes the intelligent control method for heavy object handling provided in any of the aforementioned embodiments.

[0087] It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other optical and magnetic storage media, which will not be elaborated here.

[0088] The computer-readable storage medium provided in the above embodiments of this application and the virtual try-on method for simulated clothing provided in the embodiments of this application are based on the same application concept and have the same beneficial effects as the methods adopted, run or implemented by the application stored therein.

[0089] It should be noted that in the above text, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0090] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0091] The embodiments of this application have been described above with reference to the accompanying drawings. These are merely specific implementations of this application, but this application is not limited to the specific implementations described above. The specific implementations described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

[0092] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit the scope of protection of the present invention. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the essence and scope of the technical solutions of the present invention.

Claims

1. A virtual try-on system for simulated clothing, characterized in that, include: The camera module is used to acquire three-dimensional data of clothing unfolded and human body standing, and send the three-dimensional data to the processing module. The processing module is used to preprocess the above three-dimensional data and convert the preprocessed three-dimensional data into three-dimensional models of clothing and human body, and record the feature points of the above three-dimensional models. Then, by comparing the feature points of the above 3D model, the unsuitable points are obtained; The display module is used to combine the 3D model of clothing and the 3D model of the human body and display the combination by projection, while marking the location of discomfort points on the display projection. The virtual try-on system is also used to perform the following steps: S100. The camera module acquires 3D data of the clothing after it is unfolded and the human body after it is standing. S200. Preprocess the 3D data; S300. Convert the preprocessed 3D data into triangular meshes to represent the 3D models of clothing and the human body; S400. Extract several feature points from the three-dimensional models of clothing and human body, and compare the above feature points to obtain the discomfort points; The S500 display module combines the 3D model of clothing and the 3D model of the human body and displays the combination on a projection, while marking the location of discomfort points on the projection. In step S100, point cloud data is used to represent the three-dimensional data of the clothing after it is unfolded and the human body after it is standing. The three-dimensional data of clothing or the human body is represented as follows: in, These are the coordinates of a point in three-dimensional space. It is the total number of points; In step S200, the formula for preprocessing the three-dimensional data is as follows: in, For the first The coordinates of the points For point The neighborhood point set, For neighborhood point set The first in One point, for and The Euclidean distance between them The standard deviation of the Gaussian kernel. These are the normalization coefficients; In step S400, the discomfort points include the wrinkles, bulges, and elasticity of the clothing; The formula for calculating wrinkle degree is: The formula for calculating the bulge is: The formula for calculating the stretchability is: in, For point and points The normal vector, For the difference between normal vectors, For point The number of neighboring points.

2. The virtual try-on system for simulated clothing according to claim 1, characterized in that, In step S300, the Delaunay triangulation algorithm is used to generate a triangular network: 。 3. An electronic device, characterized in that, It includes a memory, a processor, and a computer program stored in the memory and executable on the processor, the processor running the computer program to perform the steps performed in the virtual try-on system as described in claim 1 or 2.

4. A computer-readable storage medium having a computer program stored thereon, characterized in that, The program is executed by the processor to perform the steps described in the virtual try-on system as claimed in claim 1 or 2.

Images