Dynamic display real-time three-dimensional virtual fitting system and method

Abstract

The invention relates to the technical field of image data processing, in particular to a dynamically-displayed real-time three-dimensional virtual fitting system and method, and the dynamically-displayed real-time three-dimensional virtual fitting system comprises a data collection module, a human body modeling module, a virtual fitting module and a skeleton animation storage module. The data acquisition module is used for acquiring various body data of the consumer; constructing a 3D virtual human model corresponding to the consumer by using a human body modeling module according to the body data of the consumer; image data of clothes needing to be tried on by the consumer are uploaded, a three-dimensional model of the clothes is built by using the virtual try-on module, the three-dimensional model of the clothes is tried on the 3D virtual human model in a simulated mode, and animation of the 3D virtual human model is generated and dynamically displayed to the consumer for watching; therefore, the virtual fitting service can be provided for the consumer for reference and judgment, and the consumption experience is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of image data processing, and in particular to a dynamic display real-time three-dimensional virtual fitting system and method. Background Art

[0002] With the development of the national economy, the living standards of residents are gradually improving. With the popularization of the Internet, online shopping has become a major trend. More and more people are getting used to online shopping, and the traditional shopping model has been gradually abandoned. Compared with the traditional shopping model, online shopping can purchase goods from various regions, enriching shopping options, and there are more types to choose from. In addition, the prices of some goods on the online shopping platform are more affordable; and clothing is a product that people buy more frequently.

[0003] Although people can choose a variety of clothes according to their needs on online shopping platforms, they cannot try them on. They can only judge by looking at pictures or videos of models trying on clothes on the online shopping platforms. As a result, after receiving the goods, they may find that the size does not fit, the clothes do not look good on the body, etc., which affects the consumer experience. Summary of the invention

[0004] The purpose of the present invention is to provide a dynamic real-time three-dimensional virtual fitting system and method, which can provide consumers with virtual fitting services for reference and judgment, thereby improving consumer experience.

[0005] To achieve the above-mentioned object, in a first aspect, the present invention provides a dynamic real-time three-dimensional virtual fitting system, comprising a data acquisition module, a human body modeling module, a virtual fitting module and a skeletal animation storage module; the human body modeling module is connected to the data acquisition module, the virtual fitting module is connected to the human body modeling module, and the skeletal animation storage module is connected to the virtual fitting module;

[0006] The data collection module is used to collect various body data of the consumer and send the various body data to the human body modeling module;

[0007] The human body modeling module is used to receive various body data of the consumer sent by the data acquisition module, and to model and generate a 3D virtual human model corresponding to the consumer;

[0008] The virtual try-on module is used to build a three-dimensional clothing model based on the image data of the clothing uploaded by the consumer, and call the 3D virtual human model generated by the human body modeling module to simulate the try-on of the three-dimensional clothing model on the 3D virtual human model, and then call the skeletal animation data in the skeletal animation storage module to enable the 3D virtual human model to be dynamically displayed.

[0009] The skeleton animation storage module is used to pre-store various skeleton animation data.

[0010] Wherein, the data acquisition module includes a human image acquisition unit, a hairstyle and skin color acquisition unit and a sending unit; the sending unit is connected to the human image acquisition unit and the hairstyle and skin color acquisition unit respectively;

[0011] The human body image acquisition unit is used to collect various body shape data of consumers from multiple angles;

[0012] The hairstyle and skin color collection unit is used to collect the skin color and hairstyle data of the consumer;

[0013] The sending unit is used to uniformly send the various body shape data collected by the human image collection unit and the skin color and hairstyle data collected by the hairstyle and skin color collection unit to the human body modeling module.

[0014] Wherein, the human body modeling module includes a basic model building unit, a detail carving unit and a model storage unit; the detail carving unit is connected to the basic model building unit; the model storage unit is connected to the detail carving unit;

[0015] The basic model building unit is used to receive various body shape data sent by the sending unit, and splice the various body shape data to build a skeleton model, and perform flesh modeling on the skeleton model to form a basic model, and send the basic model to the detail carving unit;

[0016] The detail carving unit is used to receive the skin color and hairstyle data sent by the sending unit, adjust the material color attribute on the basic model, and perform three-dimensional modeling on the hairstyle and then add it to the basic model to form a 3D virtual human model corresponding to the consumer, and export it to the model storage unit;

[0017] The model storage unit is used to store the 3D virtual human model.

[0018] Wherein, the virtual try-on module includes a clothing modeling unit, a binding unit and an animation simulation unit; the binding unit is connected to the clothing modeling unit, and the animation simulation unit is connected to the binding unit;

[0019] The clothing modeling unit is used to receive clothing image data uploaded by consumers and create a three-dimensional model of clothing;

[0020] The binding unit is used to call the 3D virtual human model stored in the model storage unit to bind the three-dimensional model of the clothing to the skeleton of the 3D virtual human model;

[0021] The animation simulation unit is used to call the skeleton animation data in the skeleton animation storage module to construct the motion animation of the 3D virtual human model wearing clothes.

[0022] Wherein, the dynamic display real-time three-dimensional virtual fitting system further comprises a hairstyle storage module; the hairstyle storage module is connected to the human body modeling module;

[0023] The hairstyle storage module is used to collect and store various hairstyle three-dimensional models.

[0024] Wherein, the hairstyle storage module includes a hairstyle storage unit and an import unit;

[0025] The hairstyle storage unit is used to store the hairstyle three-dimensional model;

[0026] The import unit is used for providing a choice for the consumer, and directly importing the hairstyle three-dimensional model stored in the hairstyle storage unit into the human body modeling module to change the hairstyle of the consumer's 3D virtual human model.

[0027] In a second aspect, the present invention further provides a dynamic real-time three-dimensional virtual fitting method, comprising:

[0028] Using the data collection module to collect various physical data of consumers;

[0029] According to the consumer's various body data, a 3D virtual human model corresponding to the consumer is constructed using the human body modeling module;

[0030] Upload the image data of the clothing that consumers need to try on, use the virtual try-on module to build a three-dimensional model of the clothing, simulate the try-on of the three-dimensional model of the clothing on the 3D virtual human model, and then generate an animation of the 3D virtual human model and dynamically display it to consumers.

[0031] The present invention provides a dynamic display real-time three-dimensional virtual fitting system and method, which utilizes the data collection module to collect various body data of consumers; utilizes the human body modeling module to build a 3D virtual human model corresponding to the consumer according to the various body data of consumers; uploads image data of the clothing that the consumer needs to try on, utilizes the virtual fitting module to build a three-dimensional model of the clothing, simulates trying on the three-dimensional model of the clothing on the 3D virtual human model, and then generates an animation of the 3D virtual human model, which is dynamically displayed to consumers for viewing, thereby providing consumers with a virtual fitting service for reference and judgment, thereby improving consumer experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art are briefly introduced below.

[0033] Figure 1 It is a schematic structural diagram of the first embodiment of the present invention.

[0034] Figure 2 It is a structural diagram of a data acquisition module according to the first embodiment of the present invention.

[0035] Figure 3 Schematic diagram of the structure of the human body modeling module according to the first embodiment of the present invention.

[0036] Figure 4 4 is a schematic diagram of the structure of a virtual try-on module according to the first embodiment of the present invention.

[0037] Figure 5 It is a schematic structural diagram of the second embodiment of the present invention.

[0038] Figure 6 2 is a schematic diagram of the structure of a hairstyle storage module according to a second embodiment of the present invention.

[0039] Figure 7 It is a schematic structural diagram of the third embodiment of the present invention.

[0040] Figure 8 is a flow chart of the fourth embodiment of the present invention.

[0041] 101-data acquisition module, 102-human modeling module, 103-virtual try-on module, 104-skeletal animation storage module, 105-human image acquisition unit, 106-hair style and skin color acquisition unit, 107-sending unit, 108-basic model building unit, 109-detail carving unit, 110-model storage unit, 111-clothing modeling unit, 112-binding unit, 113-animation simulation unit, 201-hair style storage module, 202-hair style storage unit, 203-import unit, 301-map storage module, 302-environment simulation module. DETAILED DESCRIPTION

[0042] The first embodiment of the present application is:

[0043] See also Figure 1-Figure 4 ,in, Figure 1 It is a schematic structural diagram of the first embodiment of the present invention. Figure 2 It is a structural diagram of a data acquisition module according to the first embodiment of the present invention. Figure 3 Schematic diagram of the structure of the human body modeling module according to the first embodiment of the present invention. Figure 4 4 is a schematic diagram of the structure of a virtual try-on module according to the first embodiment of the present invention.

[0044] The present invention provides a dynamic display real-time three-dimensional virtual fitting system, comprising a data acquisition module 101, a human body modeling module 102, a virtual fitting module 103 and a skeleton animation storage module 104; the data acquisition module 101 comprises a human body image acquisition unit 105, a hairstyle and skin color acquisition unit 106 and a sending unit 107; the human body modeling module 102 comprises a basic model establishment unit 108, a detail carving unit 109 and a model storage unit 110; the virtual fitting module 103 comprises a clothing modeling unit 111, a binding unit 112 and an animation simulation unit 113; through the above scheme, a virtual fitting service can be provided to consumers for reference and judgment, thereby improving consumer experience.

[0045] According to this specific implementation, the human body modeling module 102 is connected to the data acquisition module 101, the virtual try-on module 103 is connected to the human body modeling module 102, and the skeletal animation storage module 104 is connected to the virtual try-on module 103;

[0046] The data collection module 101 is used to collect various body data of the consumer and send the various body data to the human body modeling module 102;

[0047] The human body modeling module 102 is used to receive various body data of the consumer sent by the data acquisition module 101, and to model and generate a 3D virtual human model corresponding to the consumer;

[0048] The virtual try-on module 103 is used to build a three-dimensional clothing model based on the image data of the clothing uploaded by the consumer, and call the 3D virtual human model generated by the human body modeling module 102 to simulate the try-on of the three-dimensional clothing model on the 3D virtual human model, and then call the skeletal animation data in the skeletal animation storage module 104 to enable the 3D virtual human model to be dynamically displayed.

[0049] The skeleton animation storage module 104 is used to pre-store various skeleton animation data.

[0050] The data acquisition module 101 uses a three-dimensional scanner to scan the human body to obtain accurate body data. The human body modeling module 102 completes the consumer body modeling according to the collected body data and constructs a 3D virtual human model corresponding to the consumer. The virtual try-on module 103 splices the two-dimensional images of the clothes that the consumer needs to try on from various angles to form a three-dimensional model of the clothes, and tries them on the 3D virtual human model, calling the skeletal animation data in the skeletal animation storage module 104 to dynamically display the 3D virtual human model for consumer reference, thereby providing consumers with virtual try-on services for their reference and judgment, thereby improving consumer experience.

[0051] The sending unit 107 is connected to the human body image acquisition unit 105 and the hairstyle and skin color acquisition unit 106 respectively;

[0052] The human body image acquisition unit 105 is used to collect various body shape data of the consumer from multiple angles;

[0053] The hairstyle and skin color collection unit 106 is used to collect the skin color and hairstyle data of the consumer;

[0054] The sending unit 107 is used to send the various body shape data collected by the human image collection unit 105 and the skin color and hairstyle data collected by the hairstyle and skin color collection unit 106 to the human body modeling module 102 in a unified manner.

[0055] The human body image acquisition unit 105 uses a three-dimensional scanner to collect various body shape data of the consumer, including height, cervical vertebrae height, acromion height, armpit height, chest height, waist height, hip height, perineum height, knee height, ankle height, upper arm length, forearm length, hand length, head circumference, upper neck circumference, lower neck circumference, shoulder width, back width, chest width, chest thickness, waist width, waist thickness, hip width, hip thickness, thigh circumference, calf circumference, ankle circumference, upper arm circumference, forearm circumference, wrist circumference, face shape and facial features; the hairstyle and skin color acquisition unit 106 is used to collect the skin color and hairstyle data of the consumer; after unified integration, it is sent to the human body modeling module 102 through the sending unit 107.

[0056] Secondly, the detail carving unit 109 is connected to the basic model building unit 108; the model storage unit 110 is connected to the detail carving unit 109;

[0057] The basic model building unit 108 is used to receive various body shape data sent by the sending unit 107, and splice the various body shape data to build a skeleton model, and perform flesh modeling on the skeleton model to form a basic model, and send the basic model to the detail carving unit 109;

[0058] The detail carving unit 109 is used to receive the skin color and hairstyle data sent by the sending unit 107, adjust the material color attribute on the basic model, and perform three-dimensional modeling on the hairstyle and then add it to the basic model to form a 3D virtual human model corresponding to the consumer, and export it to the model storage unit 110;

[0059] The model storage unit 110 is used to store the 3D virtual human model.

[0060] The basic model building unit 108 uses 3D modeling software, and the 3D modeling software can use Blender, Maya, 3ds Max, Zbrush, etc. After importing various body shape data into the 3D software, the 3D software splices to build a skeleton model, and then performs flesh modeling on the skeleton model. The flesh modeling mainly constructs some flesh contours of the consumer based on the body shape data. After forming a basic model, the detail carving unit 109 adjusts the material color attributes of the flesh to make the skin color similar to that of the consumer, and constructs a simple hairstyle 3D model with the collected hairstyle data, and combines it with the head of the basic model to form a 3D virtual human model corresponding to the consumer.

[0061] At the same time, the binding unit 112 is connected to the clothing modeling unit 111, and the animation simulation unit 113 is connected to the binding unit 112;

[0062] The clothing modeling unit 111 is used to receive clothing image data uploaded by consumers and create a three-dimensional model of clothing;

[0063] The binding unit 112 is used to call the 3D virtual human model stored in the model storage unit 110 to bind the three-dimensional model of the clothing to the skeleton of the 3D virtual human model;

[0064] The animation simulation unit 113 is used to call the skeleton animation data in the skeleton animation storage module 104 to construct the motion animation of the 3D virtual human model wearing clothes.

[0065] The clothing modeling unit 111 uses 3D modeling software to splice and model the clothing image data uploaded by the consumer to be tried on, forming a 3D model of the clothing, and the material color attributes of the 3D model of the clothing to make it consistent with the real clothing, or directly map it; then use the binding unit 112 to bind the 3D model of the clothing to the skeleton of the 3D virtual human model to ensure that the clothing can naturally follow the movement of the skeleton. The binding unit 112 can use tools such as Blender's Armature tool and Maya's HumanIK.

[0066] In the real-time three-dimensional virtual fitting system with dynamic display described in this embodiment, the data acquisition module 101 uses a three-dimensional scanner to scan the human body to obtain accurate body data, and the human body modeling module 102 completes the consumer body modeling according to the collected body data, and constructs a 3D virtual human model corresponding to the consumer; the virtual try-on module 103 splices the two-dimensional images of the clothes that the consumer needs to try on from various angles to form a three-dimensional model of the clothes, and tries them on the 3D virtual human model, and calls the skeletal animation data in the skeletal animation storage module 104 to make the 3D virtual human model dynamically displayed for the consumer's reference, thereby providing the consumer with a virtual try-on service for reference and judgment, thereby improving the consumer experience.

[0067] The second embodiment of the present application is:

[0068] Based on the first embodiment, please refer to Figure 5-Figure 6 ,in, Figure 5 It is a schematic structural diagram of the second embodiment of the present invention. Figure 6 2 is a schematic diagram of the structure of a hairstyle storage module according to a second embodiment of the present invention.

[0069] The real-time three-dimensional virtual fitting system with dynamic display provided by the present invention further includes a hairstyle storage module 201 ; the hairstyle storage module 201 includes a hairstyle storage unit 202 and an import unit 203 .

[0070] According to this specific implementation, the hairstyle storage module 201 is connected to the human body modeling module 102 .

[0071] The hairstyle storage module 201 is used to collect and store various hairstyle 3D models. The hairstyle storage module 201 can collect and store various hairstyle 3D models available on the market for consumers to choose from, so that consumers can freely match clothing and hairstyles, and can provide references for clothing try-ons as well as hairstyles.

[0072] Wherein, the hairstyle storage unit 202 is used to store the hairstyle three-dimensional model;

[0073] The import unit 203 is used for consumers to select and directly import the hairstyle three-dimensional model stored in the hairstyle storage unit 202 into the human body modeling module 102 to change the hairstyle of the consumer's 3D virtual human model. The hairstyle storage unit 202 is used to collect and store the three-dimensional models of various hairstyles on the market for consumers to choose. Then, the three-dimensional model of the hairstyle selected by the consumer is directly imported into the human body modeling module 102 by using the import unit 203 to change the hairstyle of the consumer's own 3D virtual human model, and freely match clothing and hairstyle, which can not only provide references for clothing try-on, but also provide references for hairstyles.

[0074] In the real-time three-dimensional virtual fitting system with dynamic display described in this embodiment, the hairstyle storage unit 202 is used to collect and store three-dimensional models of various hairstyles on the market for consumers to choose from, and then the three-dimensional model of the hairstyle selected by the consumer is directly imported into the human body modeling module 102 by using the import unit 203, so as to change the hairstyle of the consumer's own 3D virtual human model and freely match clothes and hairstyles, which can not only provide references for trying on clothes, but also provide references for hairstyles.

[0075] The third embodiment of the present application is:

[0076] Based on the second embodiment, please refer to Figure 7 ,in, Figure 7 It is a schematic structural diagram of the third embodiment of the present invention.

[0077] The real-time three-dimensional virtual fitting system with dynamic display provided by the present invention further includes a texture storage module 301 and an environment simulation module 302 .

[0078] For this specific implementation, the map storage module 301 is connected to the virtual try-on module 103;

[0079] The texture storage module 301 is used to store various clothing patterns.

[0080] The sticker storage module 301 is used to store various patterns. The patterns can be designed and uploaded by users themselves, so that consumers can choose to match them with the selected clothes and then try them on virtually, providing consumers with the function of customizing clothes.

[0081] Wherein, the environment simulation module 302 is connected to the virtual try-on module 103;

[0082] The environment simulation module 302 is used to simulate various fitting environments for consumers to refer to whether the clothing is suitable in the corresponding environment.

[0083] The environment simulation module 302 uses 3D modeling software to construct various environments encountered in life, and then lets the 3D virtual human model wear the clothes that the consumer needs to try on, and makes animation displays in the simulated environment to see whether the clothes are appropriate to wear in these environments.

[0084] In the real-time three-dimensional virtual fitting system with dynamic display described in this embodiment, the texture storage module 301 is used to store various patterns for consumers to choose and match with the selected clothing, and then conduct virtual fitting, providing consumers with the function of customizing clothing. The environment simulation module 302 uses 3D modeling software to construct various environments that consumers may encounter in life, and then let the 3D virtual human model wear the clothing that consumers need to try on, and make animation displays in the simulated environment to see whether the clothing is appropriate in these environments.

[0085] The fourth embodiment of the present application is:

[0086] See also Figure 8 ,in, Figure 8 is a flow chart of the fourth embodiment of the present invention.

[0087] The present invention provides a dynamic display real-time three-dimensional virtual fitting method, comprising:

[0088] S1 uses the data collection module 101 to collect various body data of the consumer;

[0089] S2 constructs a 3D virtual human model corresponding to the consumer using the human body modeling module 102 according to the consumer's body data;

[0090] S3 uploads the image data of the clothing that the consumer needs to try on, uses the virtual try-on module 103 to build a three-dimensional model of the clothing, simulates trying on the three-dimensional model of the clothing on the 3D virtual human model, and then generates an animation of the 3D virtual human model, which is dynamically displayed to the consumer.

[0091] What is disclosed above is only one or more preferred embodiments of the present application, and cannot be used to limit the scope of rights of the present application. Ordinary technicians in this field can understand that all or part of the processes of implementing the above embodiments and equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A dynamic real-time three-dimensional virtual fitting system, characterized in that: It includes a data acquisition module, a human body modeling module, a virtual try-on module and a skeletal animation storage module; the human body modeling module is connected to the data acquisition module, the virtual try-on module is connected to the human body modeling module, and the skeletal animation storage module is connected to the virtual try-on module; The data collection module is used to collect various body data of the consumer and send the various body data to the human body modeling module; The human body modeling module is used to receive various body data of the consumer sent by the data acquisition module, and to model and generate a 3D virtual human model corresponding to the consumer; The virtual try-on module is used to build a three-dimensional clothing model based on the image data of the clothing uploaded by the consumer, and call the 3D virtual human model generated by the human body modeling module to simulate the try-on of the three-dimensional clothing model on the 3D virtual human model, and then call the skeletal animation data in the skeletal animation storage module to enable the 3D virtual human model to be dynamically displayed. The skeletal animation storage module is used to pre-store various skeletal animation data.

2. A dynamic display real-time three-dimensional virtual fitting system as claimed in claim 1, characterized in that: The data acquisition module includes a human image acquisition unit, a hairstyle and skin color acquisition unit and a sending unit; the sending unit is connected to the human image acquisition unit and the hairstyle and skin color acquisition unit respectively; The human body image acquisition unit is used to collect various body shape data of consumers from multiple angles; The hairstyle and skin color collection unit is used to collect the skin color and hairstyle data of the consumer; The sending unit is used to uniformly send the various body shape data collected by the human image collection unit and the skin color and hairstyle data collected by the hairstyle and skin color collection unit to the human body modeling module.

3. A dynamic display real-time three-dimensional virtual fitting system as claimed in claim 2, characterized in that: The human body modeling module includes a basic model building unit, a detail carving unit and a model storage unit; the detail carving unit is connected to the basic model building unit; the model storage unit is connected to the detail carving unit; The basic model building unit is used to receive various body shape data sent by the sending unit, and splice the various body shape data to build a skeleton model, and perform flesh modeling on the skeleton model to form a basic model, and send the basic model to the detail carving unit; The detail carving unit is used to receive the skin color and hairstyle data sent by the sending unit, adjust the material color attribute on the basic model, and perform three-dimensional modeling on the hairstyle and then add it to the basic model to form a 3D virtual human model corresponding to the consumer, and export it to the model storage unit; The model storage unit is used to store the 3D virtual human model.

4. A dynamic display real-time three-dimensional virtual fitting system as claimed in claim 3, characterized in that: The virtual try-on module includes a clothing modeling unit, a binding unit and an animation simulation unit; the binding unit is connected to the clothing modeling unit, and the animation simulation unit is connected to the binding unit; The clothing modeling unit is used to receive clothing image data uploaded by consumers and create a three-dimensional model of clothing; The binding unit is used to call the 3D virtual human model stored in the model storage unit to bind the three-dimensional model of the clothing to the skeleton of the 3D virtual human model; The animation simulation unit is used to call the skeleton animation data in the skeleton animation storage module to construct the motion animation of the 3D virtual human model wearing clothes.

5. A dynamic display real-time three-dimensional virtual fitting system as claimed in claim 4, characterized in that: The dynamic display real-time three-dimensional virtual fitting system also includes a hairstyle storage module; the hairstyle storage module is connected to the human body modeling module; The hairstyle storage module is used to collect and store various hairstyle three-dimensional models.

6. A dynamic display real-time three-dimensional virtual fitting system as claimed in claim 5, characterized in that: The hairstyle storage module includes a hairstyle storage unit and an import unit; The hairstyle storage unit is used to store the hairstyle three-dimensional model; The import unit is used for providing a choice for the consumer, and directly importing the hairstyle three-dimensional model stored in the hairstyle storage unit into the human body modeling module to change the hairstyle of the consumer's 3D virtual human model.

7. A dynamic real-time 3D virtual fitting method, applied to a dynamic real-time 3D virtual fitting system as claimed in any one of claims 1 to 6, characterized in that: include: Using the data collection module to collect various physical data of consumers; According to the consumer's various body data, a 3D virtual human model corresponding to the consumer is constructed using the human body modeling module; Upload the image data of the clothing that consumers need to try on, use the virtual try-on module to build a three-dimensional model of the clothing, simulate the try-on of the three-dimensional model of the clothing on the 3D virtual human model, and then generate an animation of the 3D virtual human model and dynamically display it to consumers.

Images