Virtual fitting method and device, equipment and storage medium

Abstract

The invention provides a virtual fitting method and device, equipment and a storage medium, and relates to the technical field of artificial intelligence. A virtual fitting method comprises the following steps: generating a human body three-dimensional model according to a portrait photo, generating a clothing three-dimensional model capable of displaying clothing deformation according to a multi-angle clothing photo, and generating a 3D fitting model capable of dynamically displaying a fitting effect from the human body three-dimensional model and the clothing three-dimensional model through a simulation animation system. By means of the mode, when the 3D fitting model is dynamically displayed, the clothes and the human body are better attached, the presentation effect of clothes matching is improved, and the use experience of a user is improved.

Description

Technical Field

[0001] The present application belongs to the field of artificial intelligence technology, and specifically relates to a virtual fitting method, device, equipment and storage medium. Background Art

[0002] With the continuous improvement of living standards, people have higher and higher requirements for clothing matching. However, the matching process requires repeated fittings, which takes a lot of time and energy.

[0003] The existing technology faces the problem that the above-mentioned matching process requires repeated trying on of clothes, which takes a lot of time and energy. The commonly used method is: generating a virtual dressing recommendation model based on clothing information and user information, showing the clothing matching effect to users more intuitively, and greatly reducing the time required for matching.

[0004] However, when the virtual outfit recommendation model generated by the above method displays more complex movements, the clothing and the human body are not close enough and cannot display the deformation of the clothing caused by human body movements, which reduces the presentation effect of clothing matching and the user experience. Summary of the invention

[0005] In order to solve the above problems in the prior art, the present application provides a virtual fitting method, device, equipment and storage medium.

[0006] In a first aspect, the present application provides a virtual fitting method, the method comprising:

[0007] Get portrait information and clothing information;

[0008] Generate a human body three-dimensional model according to the portrait information, and generate a clothing three-dimensional model according to the clothing information, wherein the clothing three-dimensional model can display clothing deformation caused by movement;

[0009] The human body three-dimensional model and the clothing three-dimensional model are sent to a simulation animation system to obtain a 3D dynamic fitting model generated by the simulation animation system, wherein the 3D fitting model is used to display a user's dynamic virtual fitting effect.

[0010] In a possible implementation, generating a clothing three-dimensional model according to the clothing information includes:

[0011] Acquire an initial clothing three-dimensional model according to the clothing information, wherein the initial clothing three-dimensional model is used to display a static virtual fitting effect of the user;

[0012] According to the initial clothing three-dimensional model, a plurality of clothing piece models are obtained, wherein the clothing piece models are clothing models with texture features and physical properties, and are used to show clothing deformation caused by actions;

[0013] A three-dimensional clothing model is generated according to the multiple clothing piece models.

[0014] In a possible implementation, the step of acquiring a plurality of clothing piece models according to the initial clothing three-dimensional model includes:

[0015] Acquire multiple garment cutting pieces and cutting positions of the garments laid flat at different angles according to the initial garment three-dimensional model;

[0016] For each garment piece, obtaining the material of the garment piece;

[0017] According to the material of the garment piece, a corresponding mass-spring model is obtained;

[0018] Acquire a clothing piece model according to the clothing piece and the mass-spring model;

[0019] A clothing three-dimensional model is generated according to each clothing piece model and the corresponding cutting position.

[0020] In a possible implementation manner, the acquiring clothing information includes:

[0021] Get clothing pictures from multiple angles through the camera;

[0022] The clothing information is obtained according to the clothing pictures from multiple angles.

[0023] In a possible implementation, the acquiring of clothing images from multiple angles by using a camera includes:

[0024] Acquire clothing pictures from multiple angles through a camera in a clothing acquisition device;

[0025] The clothing acquisition device comprises a camera fixing device, a counterweight, a platform and a mannequin. The camera fixing device and the counterweight are connected and arranged relatively to each other and can rotate around the platform. A mannequin wearing clothing is arranged on the platform.

[0026] In a possible implementation, the method further includes:

[0027] Acquire clothing features of the clothing to be matched, wherein the clothing features include at least one of clothing type, clothing pattern, clothing color, clothing material, and clothing length, wherein the clothing to be matched is selected by a user from a clothing three-dimensional model library;

[0028] Acquire recommended clothing according to the collocation knowledge base, and acquire corresponding recommended clothing three-dimensional models according to the recommended clothing, wherein the recommended clothing is included in the clothing three-dimensional model library;

[0029] The human body three-dimensional model and the recommended clothing three-dimensional model are sent to the simulation animation system to obtain a 3D dynamic fitting model generated by the simulation animation system.

[0030] In a possible implementation manner, after acquiring the 3D dynamic fitting model generated by the simulation animation system, the method further includes:

[0031] The 3D fitting model is rendered by a rendering engine, and the rendered 3D dynamic fitting model is displayed by a display device.

[0032] In a second aspect, the present application provides a virtual fitting control device, including: an acquisition module, a model module and a simulation module, wherein:

[0033] The acquisition module is used to acquire portrait information and clothing information;

[0034] The model module is used to generate a human body three-dimensional model according to the portrait information, and to generate a clothing three-dimensional model according to the clothing information, wherein the clothing three-dimensional model can display clothing deformation caused by movement;

[0035] The simulation module is used to send the human body three-dimensional model and the clothing three-dimensional model to the simulation animation system, and obtain the 3D dynamic fitting model generated by the simulation animation system, wherein the 3D fitting model is used to display the user's dynamic virtual fitting effect.

[0036] In a possible implementation manner, the model module is further used to:

[0037] Acquire an initial clothing three-dimensional model according to the clothing information, wherein the initial clothing three-dimensional model is used to display a static virtual fitting effect of the user;

[0038] According to the initial clothing three-dimensional model, a plurality of clothing piece models are obtained, wherein the clothing piece models are clothing models with texture features and physical properties, and are used to show clothing deformation caused by actions;

[0039] A three-dimensional clothing model is generated according to the multiple clothing piece models.

[0040] In a possible implementation manner, the model module is further used to:

[0041] Acquire multiple garment cutting pieces and cutting positions of the garments laid flat at different angles according to the initial garment three-dimensional model;

[0042] For each garment piece, obtaining the material of the garment piece;

[0043] According to the material of the garment piece, a corresponding mass-spring model is obtained;

[0044] Acquire a clothing piece model according to the clothing piece and the mass-spring model;

[0045] A clothing three-dimensional model is generated according to each clothing piece model and the corresponding cutting position.

[0046] In a possible implementation manner, the acquisition module is further used to:

[0047] Get clothing pictures from multiple angles through the camera;

[0048] The clothing information is obtained according to the clothing pictures from multiple angles.

[0049] In a possible implementation manner, the acquisition module is further used to:

[0050] Acquire clothing pictures from multiple angles through a camera in a clothing acquisition device;

[0051] The clothing acquisition device comprises a camera fixing device, a counterweight, a platform and a mannequin. The camera fixing device and the counterweight are connected and arranged relatively to each other and can rotate around the platform. A mannequin wearing clothing is arranged on the platform.

[0052] In a possible implementation manner, the simulation module is further used to:

[0053] Acquire clothing features of the clothing to be matched, wherein the clothing features include at least one of clothing type, clothing pattern, clothing color, clothing material, and clothing length, wherein the clothing to be matched is selected by a user from a clothing three-dimensional model library;

[0054] Acquire recommended clothing according to the collocation knowledge base, and acquire corresponding recommended clothing three-dimensional models according to the recommended clothing, wherein the recommended clothing is included in the clothing three-dimensional model library;

[0055] The human body three-dimensional model and the recommended clothing three-dimensional model are sent to the simulation animation system to obtain a 3D dynamic fitting model generated by the simulation animation system.

[0056] In a possible implementation manner, the simulation module is further used to:

[0057] The 3D fitting model is rendered by a rendering engine, and the rendered 3D dynamic fitting model is displayed by a display device.

[0058] In a third aspect, the present application provides an electronic device, including: at least one processor and a memory, wherein:

[0059] The memory is used to store computer-executable instructions;

[0060] The at least one processor is used to execute the computer-executable instructions stored in the memory, so that the at least one processor performs the virtual fitting method as described in any one of the first aspects.

[0061] In a fourth aspect, the present application provides a computer storage medium, wherein the computer storage medium stores computer execution instructions, and the computer execution instructions, when executed by a processor, are used to implement any of the aforementioned virtual fitting methods.

[0062] In a fifth aspect, the present application also provides a computer program product, including a computer program, which, when executed by a processor, can implement the steps of the virtual fitting method as described in any of the above items.

[0063] The present application provides a virtual fitting method, device, equipment and storage medium, which generates a human body three-dimensional model based on a portrait photo, generates a clothing three-dimensional model that can display clothing deformation based on multi-angle clothing photos, and then generates a 3D fitting model that can dynamically display the fitting effect by combining the human body three-dimensional model and the clothing three-dimensional model through a simulation animation system. Through the above method, the clothing and the human body are more closely matched when the 3D fitting model is dynamically displayed, which improves the presentation effect of clothing matching and increases the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0065] Figure 1 A structural schematic diagram of a fitting system provided in an embodiment of the present application;

[0066] Figure 2 A schematic top view of a clothing collection device provided in an embodiment of the present application;

[0067] Figure 3 A schematic diagram of a virtual fitting method provided in an embodiment of the present application Figure 1 ;

[0068] Figure 4 A schematic diagram of a virtual fitting method provided in an embodiment of the present application Figure 2 ;

[0069] Figure 5 A schematic diagram of a virtual fitting method provided in an embodiment of the present application Figure 3 ;

[0070] Figure 6 A schematic diagram of the structure of a virtual fitting control device provided in an embodiment of the present application;

[0071] Figure 7A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0072] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0073] In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions in this application will be clearly and completely described below in conjunction with the drawings in this application. Obviously, the described embodiments are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0074] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in sequences other than those illustrated or described herein, for example.

[0075] In the embodiments of the present application, the words "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0076] As people's living standards continue to improve, people's requirements for clothing matching are getting higher and higher. However, it is not possible to see the effect of clothes on people by observation alone, so people often try on clothes repeatedly to find the right match, which takes a lot of time and energy.

[0077] The common means used by current technology to address the above problems is to generate a corresponding three-dimensional outfit recommendation model based on clothing information and user information, and directly show the clothing matching effect to users, avoiding users spending a lot of time trying on clothes. However, when the current three-dimensional outfit recommendation model shows complex movements, the clothing and the human body are not fit well, and it is unable to show the deformation of the clothing caused by human body movements, which reduces the presentation effect of clothing matching and the user experience.

[0078] The present application provides a virtual fitting method, which generates a human body 3D model based on a portrait photo, generates a clothing 3D model that can display clothing deformation based on multi-angle clothing photos, and then generates a 3D fitting model that can dynamically display the fitting effect by combining the human body 3D model and the clothing 3D model through a simulation animation system. Through the above method, the clothing and the human body are more closely matched when the 3D fitting model is dynamically displayed, which improves the presentation effect of clothing matching and increases the user experience.

[0079] Next, the technical solution shown in the present application is described in detail through specific embodiments. It should be noted that the following embodiments can exist independently or in combination with each other, and the same or similar contents will not be described repeatedly in different embodiments.

[0080] Figure 1 This is a schematic diagram of the structure of a fitting system provided in an embodiment of the present application. Figure 1 As shown, the fitting system includes: a collection system, a model system, a dressing recommendation system and a display system, among which:

[0081] The collection system includes a portrait collection device and a clothing collection device, wherein the portrait collection device is used to collect portrait information and the clothing collection device is used to collect clothing information;

[0082] The model system includes a human body model, a clothing model and a simulation animation system. The human body model is used to generate a human body three-dimensional model according to the collected portrait information. The clothing model is used to generate a clothing three-dimensional model according to the collected clothing information. The simulation animation system is used to import the human body three-dimensional model into the clothing three-dimensional model to generate a 3D dynamic fitting model, wherein the generated clothing three-dimensional model will be stored in a clothing three-dimensional model library;

[0083] The outfit recommendation system is used to provide a 3D dynamic fitting model consisting of the outfit to be matched and the outfit to be matched according to the outfit to be matched selected by the user;

[0084] The display system is used to display the 3D dynamic fitting model to the user.

[0085] The specific operation processes of the above four modules will be described in detail in the subsequent embodiments, so they will not be described in detail here.

[0086] Figure 2 This is a schematic diagram of the structure of a clothing collection device provided in an embodiment of the present application. Figure 2 As shown, the clothing acquisition device comprises: a camera fixing device, a counterweight, a platform and a mannequin, wherein:

[0087] The camera fixing device is used to fix the camera, and the camera is used to collect clothing photos, and the collected clothing photos are sent to the collection system;

[0088] The counterweight and the camera fixing device are connected and arranged relatively to each other and can rotate around the platform;

[0089] The mannequin is located on the platform and is used to place clothing. Through the rotating structure composed of a counterweight, a camera fixing device and a platform, and the mannequin for placing clothing, clothing photos can be collected from multiple angles.

[0090] Furthermore, user photos can also be obtained through a clothing collection device, where the user stands on a mannequin, and then the user photos are collected through a camera at a single angle or multiple angles.

[0091] Figure 3 A schematic diagram of a virtual fitting method provided in an embodiment of the present application Figure 1 .like Figure 3 As shown, the method includes:

[0092] S301, obtaining portrait information and clothing information.

[0093] In this step, the portrait information is a user picture used to generate a three-dimensional human body model, and the clothing information is a clothing picture used to generate a three-dimensional clothing model.

[0094] Since the user's body shape is not constant, in order to more realistically display the effect of wearing clothes, the three-dimensional clothing model generated according to the clothing information is required to be more closely matched with the three-dimensional human body model. Therefore, this embodiment uses a clothing acquisition device to collect clothing photos from multiple angles, that is, the clothing acquisition device obtains clothing information from multiple angles, and then the model system generates an initial three-dimensional clothing model based on the clothing information from multiple angles, and the three-dimensional clothing model can be more closely matched with the three-dimensional human body model.

[0095] Furthermore, the user information can be uploaded directly or obtained through a clothing collection device. When the clothing collection device is used to collect user information, the user information only needs to be collected from a single angle, such as the front.

[0096] S302: Generate a three-dimensional human body model according to the portrait information, and generate a three-dimensional clothing model according to the clothing information, wherein the three-dimensional clothing model can display clothing deformation caused by movement.

[0097] In this step, in order to make the clothing display effect more realistic, the clothing effect is generally displayed dynamically, that is, by displaying the clothing deformation caused by the three-dimensional clothing model following the movement of the three-dimensional human body model, the wearing effect of the user and the clothing is more vividly displayed. However, the traditional three-dimensional clothing model cannot display clothing deformation, so that when the fitting model is dynamically displayed, the clothing cannot fit the human body to show the human body movement, which affects the clothing display effect. Therefore, this embodiment generates a three-dimensional clothing model that can display the clothing deformation caused by movement through the model system of the fitting system.

[0098] Furthermore, the human body three-dimensional model of this embodiment is also generated in the model system in the fitting system. The model system includes: a human body model and a clothing model. The user information is uploaded to the human body model, and the human body three-dimensional model output by the human body model is obtained. The clothing information is uploaded to the clothing model, and the clothing three-dimensional model output by the clothing model that can display the clothing deformation caused by the action is obtained. The subsequent embodiments will give a detailed description of the process of how the clothing model generates the clothing three-dimensional model, and no more explanation will be given here.

[0099] Furthermore, in the model system, the above-mentioned clothing three-dimensional model and human body three-dimensional model are combined and then sent to the display system.

[0100] S303: Send the human body three-dimensional model and the clothing three-dimensional model to a simulation animation system, and obtain a 3D dynamic fitting model generated by the simulation animation system, wherein the 3D fitting model is used to display a dynamic virtual fitting effect of the user.

[0101] In this step, the model system also includes a simulation animation system, which is used to combine the clothing three-dimensional model and the human body three-dimensional model.

[0102] Furthermore, the 3D dynamic fitting model is the final output of the model system, and the 3D dynamic fitting model can dynamically display the matching effect of the user and the clothing. After the 3D dynamic fitting model is obtained, it is sent to the display system to be displayed to the corresponding user.

[0103] Optionally, the display system includes a display device, and the display device is used to display a 3D dynamic fitting model to a user.

[0104] Furthermore, the 3D dynamic fitting model can be displayed in two ways: automatic and passive. When the 3D dynamic fitting model is displayed in an automatic way, a display action can be set, and then the 3D dynamic fitting model can be operated according to the display action. For example, the display action is set to turn, walk, jump and wave, and the 3D dynamic fitting model is displayed to the user by repeatedly performing the display actions of turning, walking, jumping and waving.

[0105] The passive display of the 3D dynamic fitting model executes corresponding display actions according to the user's display instructions.

[0106] The present application provides a virtual fitting method, which generates a human body 3D model based on a portrait photo, generates a clothing 3D model that can display clothing deformation based on multi-angle clothing photos, and then generates a 3D fitting model that can dynamically display the fitting effect by combining the human body 3D model and the clothing 3D model through a simulation animation system. Through the above method, the clothing and the human body are more closely matched when the 3D fitting model is dynamically displayed, which improves the presentation effect of clothing matching and increases the user experience.

[0107] Figure 4 A schematic diagram of a virtual fitting method provided in an embodiment of the present application Figure 2 This embodiment describes in detail how to obtain a three-dimensional clothing model. Figure 4 As shown, the method includes:

[0108] S401. Acquire an initial three-dimensional clothing model according to the clothing information, wherein the initial three-dimensional clothing model is used to display a static virtual fitting effect of a user.

[0109] In this step, the clothing model includes an initial clothing model and a piece model, the initial clothing model is used to generate an initial clothing 3D model, and the piece model is used to generate a clothing 3D model.

[0110] Furthermore, when the acquisition system receives the multi-angle clothing information acquired by the clothing acquisition device, the multi-angle clothing information is sent to the initial clothing model. Figure 3 The 3D reconstruction technology generates an initial 3D clothing model based on multi-angle clothing information. The initial 3D clothing model can statically display the virtual fitting effect.

[0111] S402, obtaining a plurality of clothing pieces and cutting positions laid flat at different angles according to the initial clothing three-dimensional model, obtaining a corresponding mass-spring model according to the material of the clothing pieces, and obtaining a clothing piece model according to the clothing pieces and the mass-spring model.

[0112] In this step, the initial clothing 3D model generated by the initial clothing model is similar to a rigid model, which cannot display the clothing deformation caused by human body movements, such as clothing texture features, expansion and contraction, etc. Therefore, this embodiment integrates the mass spring model into the clothing model to obtain a clothing 3D model that can display clothing deformation.

[0113] Among them, the mass-spring model represents the shape of clothing fabric through differential equations and combines the material properties of the fabric, such as mass, hardness and elasticity. Therefore, the three-dimensional clothing model that introduces the mass-spring model can show the clothing deformation caused by human body movements.

[0114] Specifically, the cutting position is used to indicate the connection relationship between multiple garment pieces, and the initial garment three-dimensional model can be formed by combining the garment pieces and the cutting position.

[0115] Optionally, the garment pieces may also be acquired based on the garment information, and the acquisition steps are: generating a flat garment based on the garment information at multiple angles, and then acquiring a plurality of garment pieces and corresponding cutting positions based on the flat garment.

[0116] Furthermore, a corresponding mass spring model is selected according to the material of the clothing, and different mass spring models have different parameters. The mass spring model is combined with the clothing piece to obtain a clothing piece model.

[0117] Optionally, since users have different body shapes, in order to make the clothing of the 3D dynamic fitting model fit the human body, it is necessary to adjust the data of the clothing three-dimensional model according to the user's body shape, that is, adjust the data of the clothing three-dimensional model according to the human body three-dimensional model data. The steps are: adjusting the clothing pieces according to the user's body size or the body size of the human body three-dimensional model, combining the adjusted clothing pieces with the selected mass spring model to obtain the adjusted clothing piece model.

[0118] For example, the size of the clothing piece is XL, the user's body size is L, the size of all clothing pieces is adjusted to L, and then the adjusted clothing pieces are combined with the corresponding mass-spring model to obtain a clothing piece model of size L.

[0119] In a possible implementation, garment pieces can be obtained from a garment piece library, wherein the garment piece library is established based on experience. A corresponding garment piece template is obtained from the garment piece library according to the pattern of the garment, wherein the garment piece template includes information such as cutting positions. Multiple garment pieces are then obtained based on the garment piece template and the initial garment three-dimensional model.

[0120] S403: Generate a three-dimensional clothing model according to each clothing piece model and the corresponding cutting position.

[0121] In this step, the clothing piece model is a clothing piece that can display the physical properties of clothing fabric, and the cutting position is used to indicate the connection relationship between the clothing pieces, that is, to indicate the connection relationship between the clothing piece models.

[0122] Furthermore, after the clothing piece model is generated, multiple clothing piece models can be stitched together according to the clothing piece model and the corresponding cutting positions to generate a three-dimensional clothing model, which can display the clothing texture and the clothing deformation caused by movement.

[0123] For example, according to the initial clothing 3D model, four clothing pieces A, B, C and D are obtained, and clothing piece A corresponds to four cutting positions: a 1 、a 2 、a 3 and a 4 , clothing piece B corresponds to 2 cutting positions: b 1 and b 2 , clothing piece C corresponds to 1 cutting position: c 3 , clothing piece D corresponds to 1 cutting position: d 4The material of the clothing is cashmere, and the corresponding mass spring model E is obtained. The mass spring model E is combined with the four clothing pieces A, B, C and D to obtain clothing piece models A, B, C and D. Finally, the clothing piece models are sewn together according to the cutting position, that is, the a of the clothing piece model A is 1 and clothing piece model B 1 , a of clothing piece model A 2 and clothing piece model B 2 , a of clothing piece model A 3 and c of clothing piece model C 3 and a of clothing piece model A 4 and clothing piece model D 4 Stitch together to get a three-dimensional model of the clothing.

[0124] The present application provides a virtual fitting method, which obtains clothing information based on multi-angle photos, generates a static initial clothing three-dimensional model based on the clothing information, obtains a cutting model through the initial clothing three-dimensional model, and generates a clothing three-dimensional model based on the cutting model and the corresponding cutting position. Through the above method, the clothing three-dimensional model can dynamically display the fitting effect and can show the clothing deformation caused by human body movements. It makes the clothing fit the human body more closely, improves the presentation effect of clothing matching, and increases the user experience.

[0125] Figure 5 A schematic diagram of a virtual fitting method provided in an embodiment of the present application Figure 3 This embodiment describes in detail how to recommend a pairing. Figure 5 As shown, the method includes:

[0126] S501. Acquire clothing features of clothing to be matched, wherein the clothing features include at least one of clothing type, clothing pattern, clothing color, clothing material, and clothing length, wherein the clothing to be matched is selected by a user from a clothing three-dimensional model library.

[0127] In this step, the user's clothing matching depends on his or her own experience, and each matching requires a lot of time to select from a large number of clothes. Therefore, this embodiment uses the outfit recommendation system in the fitting system to provide suitable matching clothes based on the clothes to be matched selected by the user and display them to the user for selection.

[0128] Specifically, the outfit recommendation system includes a clothing feature recognition module, through which clothing features such as clothing type, clothing style, clothing color, clothing material and clothing length can be identified.

[0129] In a possible implementation, in order to make the recommended clothing more reasonable, the recommendation can be made in combination with the weather or season of the day, so the weather conditions of the day can also be obtained. Then, the recommended clothing is selected according to the weather conditions of the day and the clothing features.

[0130] S502: Acquire recommended clothing according to a matching knowledge base, and acquire corresponding recommended clothing three-dimensional models according to the recommended clothing, wherein the recommended clothing is included in the clothing three-dimensional model library.

[0131] In this step, the collocation knowledge base is used to indicate the collocation combinations between garments with different clothing features. All garments in the collocation knowledge base can be found in the clothing 3D model library. According to the clothing features of the garments to be matched, the recommended garments are obtained from the collocation knowledge base, and then the recommended garment 3D models of the recommended garments and the garment combinations to be matched are obtained from the clothing 3D model library.

[0132] For example, if the recommended clothing is red skirt A, the corresponding clothing features are obtained through the clothing feature recognition module: short skirt, red and jeans. Substitute the clothing features of short skirt, red and jeans into the matching knowledge base to obtain the recommended clothing: shirt A. Find the models of red skirt A and shirt A from the clothing 3D model library, and obtain the recommended clothing 3D model composed of red skirt A and shirt A.

[0133] S503: Send the human body three-dimensional model and the recommended clothing three-dimensional model to the simulation animation system, and obtain a 3D dynamic fitting model generated by the simulation animation system.

[0134] In the simulation animation system, the human body 3D model is imported into the recommended clothing 3D model to obtain a 3D dynamic fitting model, wherein the recommended clothing 3D model has been adjusted according to the user's size. The 3D dynamic fitting model is then sent to the display system and displayed to the user through the display device.

[0135] Furthermore, in order to better display the clothing matching effect, a rendering engine is added to the display system, and the 3D dynamic fitting model is rendered in the rendering engine, so that when the 3D dynamic fitting model is displayed under different backgrounds, a real light and shadow effect can be generated, thereby increasing the effect of clothing matching display. Therefore, the 3D fitting model is rendered by the rendering engine, and the rendered 3D dynamic fitting model is displayed by the display device.

[0136] The present application provides a virtual fitting method, which obtains recommended clothing from a matching knowledge base according to clothing features such as clothing type, clothing pattern, clothing color, clothing material, and clothing length of the clothing to be matched, and then obtains the corresponding recommended clothing 3D model from the clothing 3D model library, and sends it to the simulation animation system to obtain a 3D dynamic fitting model. In the above manner, the matching effect of the clothing to be matched with various types of clothing is displayed through the 3D dynamic fitting model, which reduces the time users spend trying on clothes themselves and increases their willingness to use.

[0137] Figure 6 This is a schematic diagram of the structure of a virtual fitting control device provided in an embodiment of the present application. Figure 6 As shown, it includes: an acquisition module 601, a model module 602 and a simulation module 603, wherein:

[0138] The acquisition module 601 is used to acquire portrait information and clothing information;

[0139] The model module 602 is used to generate a human body three-dimensional model according to the portrait information, and to generate a clothing three-dimensional model according to the clothing information, wherein the clothing three-dimensional model can display clothing deformation caused by movement;

[0140] The simulation module 603 is used to send the human body 3D model and the clothing 3D model to the simulation animation system, and obtain the 3D dynamic fitting model generated by the simulation animation system, wherein the 3D fitting model is used to display the user's dynamic virtual fitting effect.

[0141] In a possible implementation, the model module 602 is further used to:

[0142] Acquire an initial clothing three-dimensional model according to the clothing information, wherein the initial clothing three-dimensional model is used to display a static virtual fitting effect of the user;

[0143] According to the initial clothing three-dimensional model, a plurality of clothing piece models are obtained, wherein the clothing piece models are clothing models with texture features and physical properties, and are used to show clothing deformation caused by actions;

[0144] A three-dimensional clothing model is generated according to the multiple clothing piece models.

[0145] In a possible implementation, the model module 602 is further used to:

[0146] Acquire multiple garment cutting pieces and cutting positions of the garments laid flat at different angles according to the initial garment three-dimensional model;

[0147] For each garment piece, obtaining the material of the garment piece;

[0148] According to the material of the garment piece, a corresponding mass-spring model is obtained;

[0149] Acquire a clothing piece model according to the clothing piece and the mass-spring model;

[0150] A clothing three-dimensional model is generated according to each clothing piece model and the corresponding cutting position.

[0151] In a possible implementation manner, the acquisition module 601 is further configured to:

[0152] Get clothing pictures from multiple angles through the camera;

[0153] The clothing information is obtained according to the clothing pictures from multiple angles.

[0154] In a possible implementation manner, the acquisition module 601 is further configured to:

[0155] Acquire clothing pictures from multiple angles through a camera in a clothing acquisition device;

[0156] The clothing acquisition device comprises a camera fixing device, a counterweight, a platform and a mannequin. The camera fixing device and the counterweight are connected and arranged relatively to each other and can rotate around the platform. A mannequin wearing clothing is arranged on the platform.

[0157] In a possible implementation manner, the simulation module 603 is further configured to:

[0158] Acquire clothing features of the clothing to be matched, wherein the clothing features include at least one of clothing type, clothing pattern, clothing color, clothing material, and clothing length, wherein the clothing to be matched is selected by a user from a clothing three-dimensional model library;

[0159] Acquire recommended clothing according to the collocation knowledge base, and acquire corresponding recommended clothing three-dimensional models according to the recommended clothing, wherein the recommended clothing is included in the clothing three-dimensional model library;

[0160] The human body three-dimensional model and the recommended clothing three-dimensional model are sent to the simulation animation system to obtain a 3D dynamic fitting model generated by the simulation animation system.

[0161] In a possible implementation manner, the simulation module 603 is further configured to:

[0162] The 3D fitting model is rendered by a rendering engine, and the rendered 3D dynamic fitting model is displayed by a display device.

[0163] Figure 7 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 7As shown, the device 70 includes: at least one processor 701 and a memory 702, wherein:

[0164] The memory 702 is used to store computer-executable instructions;

[0165] The at least one processor 701 is used to execute the computer-executable instructions stored in the memory 702, so that the at least one processor 701 executes the technical solution of the aforementioned virtual fitting method.

[0166] Among them, at least one processor 701 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.

[0167] Optionally, in a specific implementation, the processor 701 and the memory 702 are implemented independently, and the processor 701 and the memory 702 can be connected to each other through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, etc., but it does not mean that there is only one bus or one type of bus.

[0168] Optionally, in a specific implementation, if the processor 701 and the memory 702 are integrated on a chip, the processor 701 and the memory 702 can communicate through an internal interface.

[0169] The present application also provides a computer storage medium, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the technical solution of the aforementioned virtual fitting method is implemented.

[0170] The computer-readable storage medium may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The computer-readable storage medium may be any available medium that can be accessed by a general or special purpose computer.

[0171] An exemplary readable storage medium is coupled to a processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can be located in an application specific integrated circuit (Application Specific Integrated Circuits, referred to as: ASIC). Of course, the processor and the readable storage medium can also exist as discrete components in the control device of the clothing processing device.

[0172] The division of the units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, which may be electrical, mechanical or other forms.

[0173] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0174] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0175] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc., which can store program codes.

[0176] Those skilled in the art can understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, disk or optical disk and other media that can store program codes.

[0177] So far, the technical solution of the present application has been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present application is obviously not limited to these specific embodiments, and the above embodiments are only used to illustrate the technical solution of the present application rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein by equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A virtual fitting method, It is characterized in that The method comprises: Get portrait information and clothing information; Generate a human body three-dimensional model according to the portrait information, and generate a clothing three-dimensional model according to the clothing information, wherein the clothing three-dimensional model can display clothing deformation caused by movement; The human body three-dimensional model and the clothing three-dimensional model are sent to a simulation animation system to obtain a 3D dynamic fitting model generated by the simulation animation system, wherein the 3D fitting model is used to display a user's dynamic virtual fitting effect.

2. The method according to claim 1, It is characterized in that Generating a clothing three-dimensional model according to the clothing information includes: Acquire an initial clothing three-dimensional model according to the clothing information, wherein the initial clothing three-dimensional model is used to display a static virtual fitting effect of the user; According to the initial clothing three-dimensional model, a plurality of clothing piece models are obtained, wherein the clothing piece models are clothing models with texture features and physical properties, and are used to show clothing deformation caused by actions; A three-dimensional clothing model is generated according to the multiple clothing piece models.

3. The method according to claim 2, It is characterized in that The step of obtaining a plurality of clothing piece models according to the initial clothing three-dimensional model comprises: Acquire multiple garment cutting pieces and cutting positions of the garments laid flat at different angles according to the initial garment three-dimensional model; For each garment piece, obtaining the material of the garment piece; According to the material of the garment piece, a corresponding mass-spring model is obtained; Acquire a clothing piece model according to the clothing piece and the mass-spring model; A clothing three-dimensional model is generated according to each clothing piece model and the corresponding cutting position.

4. The method according to claim 1, It is characterized in that The obtaining of clothing information includes: Get clothing pictures from multiple angles through the camera; The clothing information is obtained according to the clothing pictures from multiple angles.

5. The method according to claim 4, It is characterized in that The method of obtaining clothing pictures from multiple angles through a camera includes: Acquire clothing pictures from multiple angles through a camera in a clothing acquisition device; The clothing acquisition device comprises a camera fixing device, a counterweight, a platform and a mannequin. The camera fixing device and the counterweight are connected and arranged relatively to each other and can rotate around the platform. A mannequin wearing clothing is arranged on the platform.

6. The method according to claim 1, It is characterized in that The method further comprises: Acquire clothing features of the clothing to be matched, wherein the clothing features include at least one of clothing type, clothing pattern, clothing color, clothing material, and clothing length, wherein the clothing to be matched is selected by a user from a clothing three-dimensional model library; Acquire recommended clothing according to the collocation knowledge base, and acquire corresponding recommended clothing three-dimensional models according to the recommended clothing, wherein the recommended clothing is included in the clothing three-dimensional model library; The human body three-dimensional model and the recommended clothing three-dimensional model are sent to the simulation animation system to obtain a 3D dynamic fitting model generated by the simulation animation system.

7. The method according to any one of claims 1 to 6, It is characterized in that After obtaining the 3D dynamic fitting model generated by the simulation animation system, the method further includes: The 3D fitting model is rendered by a rendering engine, and the rendered 3D dynamic fitting model is displayed by a display device.

8. A virtual fitting control device, It is characterized in that include: Get blocks, model blocks, and simulation blocks, where: The acquisition module is used to acquire portrait information and clothing information; The model module is used to generate a human body three-dimensional model according to the portrait information, and to generate a clothing three-dimensional model according to the clothing information, wherein the clothing three-dimensional model can display clothing deformation caused by movement; The simulation module is used to send the human body three-dimensional model and the clothing three-dimensional model to the simulation animation system, and obtain the 3D dynamic fitting model generated by the simulation animation system, wherein the 3D fitting model is used to display the user's dynamic virtual fitting effect.

9. An electronic device, It is characterized in that include: at least one processor and memory, wherein: The memory is used to store computer-executable instructions; The at least one processor is configured to execute the computer-executable instructions stored in the memory, so that the at least one processor performs the method according to any one of claims 1 to 7.

10. A computer storage medium, It is characterized in that The computer storage medium stores computer executable instructions, which are used to implement the method according to any one of claims 1 to 7 when executed by a processor.

Images