Virtual fitting system of simulation clothes

Abstract

The invention relates to the technical field of virtual try-on, in particular to a virtual try-on system for simulating clothes, which is characterized in that a camera module of the system is used for acquiring three-dimensional data after the clothes are unfolded and a human body stands and sending the three-dimensional data to a processing module; the processing module is used for preprocessing the three-dimensional data, converting the preprocessed three-dimensional data into three-dimensional modeling of clothes and three-dimensional modeling of a human body, and recording feature points of the three-dimensional modeling; comparing the feature points of the three-dimensional modeling to obtain uncomfortable points; and the display module is used for combining the three-dimensional modeling of the clothes and the three-dimensional modeling of the human body, performing display projection on the combination, and marking the positions of the uncomfortable points on the display projection. The invention aims to provide a virtual fitting system for simulating clothes, which has the characteristics of high precision, strong reality and wide applicability.

Description

Technical Field

[0001] The present invention relates to the technical field of virtual fitting, and particularly relates to a virtual fitting system for simulated clothing. Background Art

[0002] With the development of computer technology and the wide application of the principle of computer vision, the research on generating virtual fitting images using computer image processing technology has become increasingly popular. Virtual clothing fitting aims to visualize the effect of clothing on a person based on the image of a person and the image of clothing, which is of great significance for improving the user consumption experience of e-commerce platforms and reducing the model image costs of merchants.

[0003] With the rapid development of e-commerce, online shopping has become one of the mainstream consumption methods. However, when purchasing clothing online, consumers cannot actually try it on, resulting in frequent problems such as inappropriate clothing sizes and mismatched styles, and a high return rate, which seriously affects the shopping experience of consumers and the operation efficiency of merchants. To solve this problem, virtual fitting technology has emerged.

[0004] However, the existing virtual fitting technologies are mainly based on two-dimensional image processing or simple three-dimensional model matching, and they have the following limitations: Insufficient accuracy: Two-dimensional image processing cannot accurately reflect the three-dimensional geometric features of clothing (such as wrinkles, bulges, stretching, etc.), resulting in a distorted fitting effect.

[0005] Poor realism: Existing technologies are difficult to simulate the complex interactions between clothing and the human body (such as fabric deformation, fit, etc.), and the fitting effect lacks realism.

[0006] Low practicability: Some technologies require complex hardware devices (such as high-precision 3D scanners) or a large amount of computing resources, and are difficult to be popularized and applied.

[0007] Poor user experience: The fitting results are usually displayed as static images or simple animations, and cannot intuitively show the mismatched points between clothing and the body (such as being too tight, too loose, etc.). Summary of the Invention

[0008] In order to overcome the shortcomings and deficiencies existing in the prior art, the purpose of the present invention is to provide a virtual fitting system for simulated clothing, which has the characteristics of high precision, strong realism, and wide applicability.

[0009] The present invention is achieved through the following technical solutions: In a first aspect, the present invention discloses a virtual fitting system for simulated clothing, which includes: A camera module, configured to acquire the three-dimensional data of the unfolded clothing and the standing human body, and send the above three-dimensional data to the processing module; A processing module, configured to preprocess the above-mentioned three-dimensional data, convert the preprocessed three-dimensional data into a three-dimensional model of the clothing and a three-dimensional model of the human body, record the feature points of the above-mentioned three-dimensional models; and compare the feature points of the above-mentioned three-dimensional models to obtain discomfort points. A display module, configured to combine the three-dimensional model of the clothing and the three-dimensional model of the human body and perform display projection on the combination, and at the same time mark the positions of the discomfort points on the display projection.

[0010] In a second aspect, the present invention discloses a virtual fitting method for simulated clothing, which includes the following steps: S100. The camera module acquires three-dimensional data after the clothing is unfolded and the human body stands. S200. Preprocess the three-dimensional data. S300. Convert the preprocessed three-dimensional data into triangular meshes to represent the three-dimensional model of the clothing and the three-dimensional model of the human body. S400. Extract a number of feature points from the three-dimensional models of the clothing and the human body, and compare the above-mentioned feature points to obtain discomfort points. S500. The display module combines the three-dimensional model of the clothing and the three-dimensional model of the human body and performs display projection on the combination, and at the same time marks the positions of the discomfort points on the display projection.

[0011] In combination with the second aspect, further, in step S100, point cloud data is used to represent the three-dimensional data after the clothing is unfolded and the human body stands. The three-dimensional data of the clothing or the human body is represented as: Wherein, are the point coordinates in three-dimensional space, is the total number of points.

[0012] In combination with the second aspect, further, in step S200, the formula for preprocessing the three-dimensional data is: Wherein, is the coordinate of the th point, is the neighborhood point set of point , is the th point in the neighborhood point set , is and the Euclidean distance between them, is the standard deviation of the Gaussian kernel, is the normalization coefficient.

[0013] In combination with the second aspect, further, in step S300, the Delaunay triangulation algorithm is used to generate a triangular network: .

[0014] In combination with the second aspect, further, in step S400, the discomfort points include the wrinkle degree, bulge degree, and stretch degree of the clothing; The calculation formula for the wrinkle degree is: The calculation formula for the bulge degree is: The calculation formula for the stretch degree is: Wherein, is the normal vector of point and point , is the difference between the normal vectors, is the number of neighborhood points of point .

[0015] In a third aspect, the present invention also discloses an electronic device, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor. The processor runs the computer program to implement the virtual try-on method for simulating clothing as described above.

[0016] In a fourth aspect, the present invention also discloses a computer-readable storage medium, on which a computer program is stored. The program is executed by the processor to implement the virtual try-on method for simulating clothing as described above.

[0017] Advantages of the present invention: A virtual try-on system, method, electronic device, and storage medium for simulating clothing according to the present invention solve the problems of insufficient accuracy, poor realism, and low practicability in the prior art through high-precision three-dimensional modeling and feature point comparison and analysis, and significantly improve the virtual try-on effect and user experience. At the same time, the system has wide applicability and significant economic benefits, and can bring double value to consumers and merchants. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The present invention is further described with reference to the accompanying drawings, but the embodiments in the drawings do not constitute any limitation to the present invention. For those of ordinary skill in the art, other drawings can be obtained according to the following drawings without creative efforts.

[0019] Figure 1 is a flowchart of the steps of the virtual try-on method provided by an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0020] To make the above objects, features, and advantages of the present invention more apparent and understandable, the following will provide a detailed description of the specific embodiments of the present invention in conjunction with the accompanying drawings. Many specific details are set forth in the following description to facilitate a full understanding of the present invention. However, the present invention can be implemented in many other ways different from those described herein, and those skilled in the art can make similar improvements without departing from the connotation of the present invention. Therefore, the present invention is not limited by the specific embodiments disclosed below.

[0021] With the development of computer technology and the wide application of computer vision principles, the research on generating virtual try-on images using computer image processing technology has become increasingly popular. Virtual clothing try-on aims to visualize the effect of clothing on a person based on the image of a person and the image of clothing, which is of great significance for improving the user consumption experience of e-commerce platforms and reducing the model image costs of merchants.

[0022] With the rapid development of e-commerce, online shopping has become one of the mainstream consumption methods. However, when purchasing clothes online, consumers cannot actually try them on, resulting in frequent problems such as inappropriate clothing sizes and mismatched styles, and a high return rate, which seriously affects the shopping experience of consumers and the operation efficiency of merchants. To solve this problem, virtual try-on technology has emerged.

[0023] However, the existing virtual try-on technologies are mainly based on two-dimensional image processing or simple three-dimensional model matching, and they have the following limitations: Insufficient accuracy: Two-dimensional image processing cannot accurately reflect the three-dimensional geometric features of clothing (such as wrinkles, bulges, stretching, etc.), resulting in a distorted try-on effect.

[0024] Poor realism: The existing technologies are difficult to simulate the complex interactions between clothing and the human body (such as fabric deformation, fit, etc.), and the try-on effect lacks realism.

[0025] Low practicality: Some technologies require complex hardware devices (such as high-precision 3D scanners) or a large amount of computing resources, making it difficult to popularize and apply.

[0026] Poor user experience: The try-on results are usually displayed as static images or simple animations, and cannot intuitively show the mismatched points between the clothing and the body (such as too tight or too loose).

[0027] To solve the above problems, this embodiment discloses a virtual try-on system for simulated clothing, which includes: A camera module for acquiring the three-dimensional data after the clothing is unfolded and the human body stands, and sending the above three-dimensional data to the processing module. The camera module is preferably a 3D scanner or a depth camera; A processing module, configured to preprocess the above three-dimensional data, convert the preprocessed three-dimensional data into a three-dimensional model of clothing and a three-dimensional model of the human body, record the feature points of the above three-dimensional models; and compare the feature points of the above three-dimensional models to obtain discomfort points; A display module, configured to combine the three-dimensional model of clothing and the three-dimensional model of the human body and perform display projection on the combination, and at the same time mark the position of the discomfort point on the display projection.

[0028] Please refer to Figure 1 , which shows a virtual fitting method for simulation clothing provided by some embodiments of the present application. This method can be executed on the system as described above. This method includes the following steps: S100. The camera module acquires three-dimensional data after the clothing is unfolded and the human body stands; S200. Preprocess the three-dimensional data; S300. Convert the preprocessed three-dimensional data into triangular meshes to represent the three-dimensional model of clothing and the three-dimensional model of the human body; S400. Extract several feature points from the three-dimensional models of clothing and the human body, and compare the above feature points to obtain discomfort points; S500. The display module combines the three-dimensional model of clothing and the three-dimensional model of the human body and performs display projection on the combination, and at the same time marks the position of the discomfort point on the display projection.

[0029] It should be noted that the principle of how to perform display projection and mark the position of the discomfort point on the display projection in this embodiment is the prior art and will not be elaborated here.

[0030] Further, in step S100, point cloud data is used to represent the three-dimensional data after the clothing is unfolded and the human body stands, The three-dimensional data of clothing or the human body is represented as: Among them, is the point coordinate in three-dimensional space, is the total number of points.

[0031] Further, in step S200, the formula for preprocessing the three-dimensional data is: Among them, is the coordinate of the th point, is the neighborhood point set of point , is the neighborhood point set in the th point, is and the Euclidean distance between is the standard deviation of the Gaussian kernel is the normalization coefficient

[0032] Further, in step S300, the Delaunay triangulation algorithm is used to generate a triangular network: .

[0033] Further, in step S400, the discomfort points include the wrinkle degree, bulge degree, and stretch degree of the clothing; The calculation formula for the wrinkle degree is: The calculation formula for the bulge degree is: The calculation formula for the stretch degree is: where is the normal vector of point and point is the difference between the normal vectors is the number of neighboring points of point Some embodiments of the present application also provide an electronic device, which includes: a processor, a memory, a bus, and a communication interface. The processor, communication interface, and memory are connected through the bus; a computer program that can run on the processor is stored in the memory, and when the processor runs the computer program, it executes the method provided in any of the foregoing embodiments of the present application.

[0034] Some embodiments of the present application also provide an electronic device, which includes: a processor, a memory, a bus, and a communication interface. The processor, communication interface, and memory are connected through the bus; a computer program that can run on the processor is stored in the memory, and when the processor runs the computer program, it executes the method provided in any of the foregoing embodiments of the present application.

[0035] The virtual try-on system for simulated clothing provided by the above embodiments of the present application and the virtual try-on method for simulated clothing provided by the embodiments of the present application are based on the same application concept and have the same beneficial effects of the adopted, run, or implemented methods.

[0036] Among them, the memory may include a high-speed random access memory (RAM: Random Access Memory), and may also include a non-volatile memory, such as at least one disk memory. The communication connection between the system network element and at least one other network element is realized through at least one communication interface (which can be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. can be used.

[0037] The bus can be an ISA bus, a PCI bus, an EISA bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. Among them, the memory is used to store programs. After receiving an execution instruction, the processor executes the program. The virtual fitting method of the simulation clothing disclosed in any implementation manner of the embodiments of the present application can be applied to the processor or be implemented by the processor.

[0038] The processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the integrated logic circuit in the hardware of the processor or by instructions in the form of software. The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU for short), a network processor (NP for short), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. It can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in combination with the embodiments of the present application can be directly embodied as being executed and completed by the hardware decoding processor, or be executed and completed by the combination of the hardware and software modules in the decoding processor. The software module can be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. This storage medium is located in the memory, and the processor reads the information in the memory and combines its hardware to complete the steps of the above method.

[0039] The electronic device provided in the embodiments of the present application and the intelligent control method for heavy object handling provided in the embodiments of the present application are based on the same application concept and have the same beneficial effects as the method adopted, run or implemented by it.

[0040] The embodiments of the present application also provide a computer-readable storage medium corresponding to the intelligent control method for heavy object handling provided in the foregoing embodiments. A computer program is stored thereon. The computer-readable storage medium is an optical disc, and a computer program (i.e., a program product) is stored thereon. When the computer program is run by the processor, it will execute the intelligent control method for heavy object handling provided in any of the foregoing embodiments.

[0041] It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory, or other optical and magnetic storage media, which will not be elaborated here one by one.

[0042] The computer-readable storage medium provided by the above embodiments of the present application and the virtual fitting method of the simulation clothing provided by the embodiments of the present application are based on the same application concept, and have the same beneficial effects as the methods adopted, run or implemented by the application programs stored therein.

[0043] It should be noted that in the above text, the term "including", "comprising" or any other variant thereof is intended to cover non-exclusive inclusion, such that a process, method, article or device including a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article or device. Without further limitation, an element defined by the phrase "including a..." does not exclude the presence of additional identical elements in the process, method, article or device including such element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in a reverse order according to the functions involved. For example, the methods described may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0044] Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disc) and includes several instructions for causing a terminal (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of the present application.

[0045] The embodiments of the present application have been described above in conjunction with the accompanying drawings, which are only specific implementation manners of the present application. However, the present application is not limited to the above specific implementation manners. The above specific implementation manners are merely illustrative rather than restrictive. Under the inspiration of the present application, those of ordinary skill in the art can also make many forms without departing from the purpose of the present application and the scope protected by the claims, and all of them fall within the protection scope of the present application.

[0046] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the protection scope of the present invention. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be modified or equivalently replaced without departing from the essence and scope of the technical solutions of the present invention.

Claims

1. A virtual fitting system for simulated clothing, characterized in that: include: A camera module, used to obtain three-dimensional data of the clothes after unfolding and the human body after standing, and send the three-dimensional data to the processing module; A processing module, used to pre-process the three-dimensional data, convert the pre-processed three-dimensional data into three-dimensional modeling of clothing and three-dimensional modeling of the human body, and record feature points of the three-dimensional modeling; The characteristic points of the above three-dimensional modeling are compared to obtain the discomfort points; A display module, used to combine the three-dimensional modeling of clothing and the three-dimensional modeling of the human body and display the combination, and mark the position of the discomfort point on the display projection; The virtual try-on system is also used to perform the following steps: S100. The camera module obtains three-dimensional data of clothing after unfolding and human body standing; S200 preprocesses the three-dimensional data; S300. The preprocessed three-dimensional data is converted into a triangular mesh, representing a three-dimensional model of clothing and a three-dimensional model of a human body; S400 extracts several feature points from clothing and human body three-dimensional model, and compares the feature points to obtain discomfort points; S500. The display module combines the three-dimensional modeling of the clothing and the three-dimensional modeling of the human body and displays the combination, and marks the position of the discomfort point on the display projection.

2. A virtual try-on system for simulated clothing according to claim 1, characterized in that: In step S100, point cloud data is used to represent the three-dimensional data of the unfolded clothing and the standing human body. The three-dimensional data of clothing or human body is represented as: in, are the coordinates of a point in three-dimensional space, is the total number of points.

3. A virtual try-on system for simulated clothing according to claim 2, characterized in that: In step S200, the formula for preprocessing the three-dimensional data is: in, For the The coordinates of the points, For point The neighborhood point set of Neighborhood point set The Points, for and The Euclidean distance between is the standard deviation of the Gaussian kernel, is the normalization coefficient.

4. A virtual try-on system for simulated clothing according to claim 3, characterized in that: In step S300, a triangulated network is generated using the Delaunay triangulation algorithm: 。 5. The virtual fitting system for simulated clothing according to claim 3, characterized in that: In step S400, the discomfort points include the wrinkles, bulges and stretch of the clothing; The calculation formula of wrinkle degree is: The calculation formula of the uplift is: The calculation formula of stretch degree is: in, For point and Point The normal vector of is the difference between the normal vectors, For point The number of neighboring points.

6. An electronic device, characterized in that: The system comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps executed in the virtual try-on system according to any one of claims 1 to 6.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that: The program is executed by a processor to implement the steps performed in the virtual try-on system according to any one of claims 1 to 6.

Images