Electronic commerce service system and method using virtual fitting function
The e-commerce system addresses high return rates by using virtual fitting technology to predict clothing fit based on user measurements, reducing returns and environmental impact through accurate online sizing and fit evaluation.
Patent Information
- Application Number
- PCT/KR2024/001139
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-18
- Filing Date
- 2024-01-24
- Publication Date
- 2024-11-21
AI Technical Summary
The high return rate of clothing products purchased online due to sizing and fit issues, leading to increased logistics costs and environmental pollution from packaging waste, as consumers cannot physically try on clothes before buying.
An e-commerce service system and method utilizing a virtual fitting function that analyzes and predicts the physical wearing state of clothing products based on user body measurements, creating a virtual fitting image through AI-driven simulation, reflecting product specifications like size, material, and elasticity, to evaluate fit and deformation.
Reduces return rates by providing accurate fit predictions, enabling consumers to make informed purchases, and facilitates a collaboration between online shopping malls and manufacturers for tailored clothing, while minimizing environmental impact by reducing unnecessary returns and packaging.
Smart Images

Figure KR2024001139_21112024_PF_FP_ABST
Abstract
Description
E-commerce service system and method using virtual fitting function
[0001] The present invention relates to an electronic commerce service system and method using a virtual fitting function, and more particularly, to an electronic commerce service system and method using a virtual fitting function that can reduce the return rate of clothing products by analyzing and predicting the physical wearing state based on information related to the clothing product and avatar information measuring the user's body when purchasing the clothing product online.
[0002] In recent years, the shopping style related to product purchases has expanded rapidly from purchasing products in offline stores to purchasing products through online shopping malls, and the related market is also showing high growth.
[0003] To purchase products from an online shopping mall, a consumer uses a terminal to access the online shopping mall via the Internet.
[0004] At this time, when a consumer accesses an online shopping mall through a terminal, the online shopping mall displays the products that the online shopping mall has on the consumer's terminal, and the consumer searches for the product he or she needs by checking the detailed information such as the product description, function, price, and sales conditions from the database built in the online shopping mall.
[0005] Additionally, online shopping malls that provide information on various shopping malls compare prices of the products selected by the consumer and guide the consumer to the store with the lowest price.
[0006] However, although purchasing clothing products through online shopping malls as mentioned above has the advantage of allowing consumers to shop comfortably, it is difficult to actually try on the products, and the information on the sizes of the clothing provided is only the size information, making it difficult to select the size of the product you wish to purchase.
[0007] Additionally, unlike offline purchases, online purchases have the problem that consumers cannot try on the clothing products themselves, making it difficult for them to check information about the material or condition of the product.
[0008] In addition, after online purchases, there is a very high rate of returns due to differences between the actual fit of the product and the model fit shown online, which increases logistics and distribution costs due to returns.
[0009] Additionally, there is a problem of causing environmental pollution due to the packaging materials generated from packaging and returns required for shipping products.
[0010] In order to solve these problems, the present invention aims to provide an e-commerce service system and method using a virtual fitting function that can reduce the return rate of clothing products by analyzing and predicting the physical wearing state based on the relevant information of the clothing product and avatar information measuring the user's body when purchasing the clothing product online.
[0011] One embodiment of the present invention is an electronic commerce service system utilizing a virtual fitting function, which connects to a transaction service server to perform electronic commerce for products provided from an arbitrary seller terminal, analyzes the user's body information from an image of the user's body to create a user avatar, and displays a virtual fitting image provided from the transaction service server; A method for managing electronic commerce between a seller terminal selling any product and the user terminal, wherein when a fitting of a product is requested from the user terminal, product specification information including color, product design information, size information, function information, material information, and elasticity information related to the product and user avatar information are received from the user terminal and the seller terminal to generate a virtual fitting image, and fitting is performed through a simulation corresponding to a state in which the user physically wears the product by reflecting the size information, function information, material information, elasticity information, and wrinkling information of the product specification information through an artificial intelligence-based fitting prediction model, and a physical wearing state through fitting - wherein the physical wearing state is a state in which the product is stretched or wrinkled due to the user directly wearing the product - is analyzed and predicted to generate a virtual fitting image reflected in the user avatar, and during the fitting simulation reflecting the product specification information, a virtual fitting image is generated by reflecting an arbitrary background image and an environmental image to the user avatar, and the deformation state of the product based on the virtual fitting image is determined based on the size of the product, the size, function, material, and elasticity information of the product according to the motion of the user avatar. A transaction service server that analyzes elasticity and wrinkling and generates and outputs product fitting evaluation information based on the deformation results of the product;And a seller terminal that connects to the transaction service server and provides one or more products and product information of the products, and performs electronic commerce between the user terminal and the product;
[0012] The user terminal according to the above embodiment is characterized by including an input unit for receiving user information and e-commerce information from a user; a 3D measurement unit for photographing the user's body and outputting it as a 3D image; a display unit for outputting the photographed 3D image, a user avatar, and a virtual fitting image provided from a transaction service server; a control unit for executing an avatar generation application program to analyze an object from the 3D image information of the 3D measurement unit, and generating a user avatar by reflecting depth information of the analyzed object as user body information, executing an e-commerce application program to request a fitting of a product from the transaction service server, and controlling e-commerce to be performed with a seller terminal; and a data communication unit for transmitting and receiving the user information, e-commerce information, user avatar information, fitting request information, and virtual fitting image.
[0013] In addition, the user terminal according to the above embodiment further includes a photographing unit that photographs a one-dimensional or two-dimensional information display means that displays arbitrary product information; and the control unit analyzes seller information and product information from the photographed information display means, requests a transaction service server to fit a product based on the product information, and controls the seller terminal to perform electronic commerce based on the seller information.
[0014] The 3D measurement unit according to the above embodiment is characterized in that it calculates depth information with respect to an object using either SL (Structured Light) or ToF (Time of Flight), and outputs body size information of the user based on the calculated depth information.
[0015] In addition, the control unit according to the above embodiment is characterized in that it corrects the generated user avatar using a digital twin program and stores the correction result in the user terminal.
[0016] In addition, the transaction service server according to the above embodiment includes a data communication unit that transmits and receives product information including user information, e-commerce information, user avatar information, fitting request information, seller information, product specification information, and virtual fitting image information with one or more of a user terminal, a seller terminal, a manufacturer terminal, and an SNS server; a member management unit that manages user authentication and seller authentication based on the user information and the seller information; a product management unit that stores the product information and product specification information including product design information including color, size information, function information, material information, elasticity information, and wrinkling information; an e-commerce unit that manages to enable e-commerce for any product between the user terminal and the seller terminal; And when a fitting for a product is requested from the user terminal, the fitting management unit is characterized by including: user avatar information and product information received from the user terminal and the seller terminal, product specification information of the corresponding product stored in the product management unit, and any background and environmental information during a fitting simulation reflecting the product specification information, using an artificial intelligence-based fitting prediction model to simulate the deformation of the product according to the motion of the user avatar by reflecting the size information, function information, material information, elasticity information, and wrinkling information of the product specification information, thereby performing fitting, and generating a corrected user avatar reflecting the deformation prediction information of the product corresponding to the physical wearing state through the fitting, and realizing the corrected user avatar using a realization model, and generating the realized user avatar as a virtual fitting image, and analyzing the deformation state of the product according to the size of the product, the size, function, material, elasticity, and wrinkling of the product according to the motion of the user avatar, and generating and outputting fitting evaluation information of the product based on the deformation result of the product.
[0017] In addition, the fitting management unit according to the above embodiment, when a fitting for a product is requested, includes: an avatar information input unit that receives user avatar information from a user terminal; a product information input unit that receives the product information and product specification information; a product information analysis unit that analyzes product design information including color, size information, function information, material information, and elasticity information from the product specification information; an artificial intelligence fitting unit that generates a virtual fitting image using an artificial intelligence-based fitting prediction model, and performs fitting through a simulation corresponding to a state in which a user physically wears the product by reflecting arbitrary background and environmental information during a fitting simulation reflecting the product specification information, the size information, function information, material information, elasticity information, and wrinkle information of the product specification information according to the motion of the user avatar, and corrects the user avatar by reflecting deformation prediction information of the product corresponding to the physical wearing state through the fitting, and realisticizes the corrected user avatar using a realistic model, and generates the realistic user avatar as a virtual fitting image; And it is characterized by including a fitting evaluation unit that analyzes the deformation state of the product based on the virtual fitting image, the size of the product, the size of the product according to the movement of the user avatar, the function, the material, the elasticity, and the wrinkling of the product, and converts the fitting evaluation information of the product based on the deformation result of the product into an arbitrary format and outputs it.
[0018] In addition, the artificial intelligence fitting unit according to the above embodiment is characterized in that it checks whether SNS information is input from a user terminal, transmits a virtual fitting image generated upon confirmation of input of the SNS information to an SNS server corresponding to the SNS information, and outputs response information received from the SNS server to a fitting evaluation unit.
[0019] In addition, the fitting evaluation unit according to the above embodiment is characterized by additionally generating product customizing information based on the generated fitting evaluation information and outputting the information to a user terminal.
[0020] In addition, the fitting evaluation unit according to the above embodiment is characterized in that, when a purchase request corresponding to customization information is input from a user terminal, the customization information, user information, and product specification information for custom production are transmitted to the manufacturer terminal through the e-commerce unit to request e-commerce.
[0021] In addition, one embodiment of the present invention is an electronic commerce service method using a virtual fitting function, comprising: a) a step of generating a user avatar by analyzing a user's body information from an image of the user's body taken by a user terminal; b) a step of performing electronic commerce for a product provided by an arbitrary seller terminal by connecting the user terminal to a transaction service server; c) a step of managing an electronic commerce between the user terminal and the seller terminal, wherein the transaction service server determines whether a fitting of a product is requested from the user terminal, and when the fitting of the product is requested, the transaction service server receives product specification information including color, product design information, size information, function information, material information, and elasticity information related to the product and user avatar information from the user terminal and the seller terminal; d) a step in which the transaction service server performs fitting through a simulation corresponding to a state in which the user physically wears the product by reflecting the size information, function information, material information, elasticity information, and wrinkling information of the product specification information to the deformation of the product according to the motion of the user avatar through an artificial intelligence-based fitting prediction model, and generates a corrected user avatar reflecting the deformation prediction information of the product corresponding to the physical wearing state through fitting, and realizing the corrected user avatar using a realization model, and generating the realized user avatar as a virtual fitting image; and e) a step in which the transaction service server analyzes the deformation state of the product based on the size of the product, the size, function, material, elasticity, and wrinkling of the product according to the motion of the user avatar, and generates and outputs fitting evaluation information of the product based on the deformation result of the product.
[0022] In addition, step a) according to the above embodiment is characterized by including: a-1) a body scanning step in which a user terminal photographs a user's body and outputs it as a three-dimensional image; and a-2) a step in which the user terminal analyzes an object from the photographed three-dimensional image information and reflects the depth information of the analyzed object as the user's body information to generate a user avatar, correcting the user avatar using a digital twin program, and storing the user avatar reflecting the correction result in the user terminal.
[0023] In addition, step b) according to the above embodiment is characterized by further including a step of the user terminal photographing a one-dimensional or two-dimensional information display means displaying arbitrary product information, analyzing seller information and product information from the photographed information display means, requesting a transaction service server to fit a product based on the product information, and performing electronic commerce based on the seller terminal and the seller information.
[0024] In addition, step e) according to the above embodiment is characterized by including a step in which the transaction service server confirms whether SNS information is input from a user terminal, transmits a virtual fitting image generated upon confirmation of input of the SNS information to an SNS server corresponding to the SNS information, and reflects response information received from the SNS server in the fitting evaluation information of the product.
[0025] In addition, step e) according to the above embodiment is characterized in that the transaction service server additionally generates product customizing information based on the generated fitting evaluation information and outputs it to the user terminal.
[0026] In addition, the electronic commerce service method according to the above embodiment is characterized by further including the step of f) performing electronic commerce by transmitting product specification information for the electronic commerce section, the customization information for custom production, and user information to the seller terminal or the manufacturer terminal when the transaction service server determines whether a product order has been completed and either ready-made information or customization information of the product is input from the user terminal.
[0027] The present invention has the advantage of reducing the return rate of clothing products by analyzing and predicting the physical wearing state based on information related to the clothing product and avatar information measuring the user's body when purchasing the clothing product online.
[0028] In addition, the present invention has the advantage of being able to apply various fashion items based on the user's body measurement data by providing information similar to the offline wearing state.
[0029] In addition, the present invention has the advantage of providing a collaboration system between a shopping mall selling ready-made clothes and a manufacturer that manufactures custom-made clothes using customized information for the user, by providing a fitting information management platform based on avatar information measuring the user's body.
[0030] In addition, the present invention has the advantage of being able to manage individual fitting information based on avatar information measuring the user's body, and to produce and manage SNS content information through wearing various clothing products.
[0031] Figure 1 is a block diagram showing the configuration of an e-commerce service system using a virtual fitting function according to one embodiment of the present invention.
[0032] FIG. 2 is an exemplary diagram illustrating the operation of an e-commerce service system using a virtual fitting function according to the embodiment of FIG. 1.
[0033] FIG. 3 is a block diagram showing a user terminal configuration of an e-commerce service system using a virtual fitting function according to the embodiment of FIG. 1.
[0034] FIG. 4 is an exemplary diagram illustrating the operation of an e-commerce service system using a virtual fitting function according to the embodiment of FIG. 1.
[0035] FIG. 5 is another example diagram illustrating the operation of an e-commerce service system using a virtual fitting function according to the embodiment of FIG. 1.
[0036] Fig. 6 is a block diagram showing the transaction service server configuration of an e-commerce service system using a virtual fitting function according to the embodiment of Fig. 1.
[0037] Figure 7 is a block diagram showing the configuration of the fitting management unit of the transaction service server according to the embodiment of Figure 6.
[0038] FIG. 8 is a flowchart illustrating an e-commerce service method using a virtual fitting function according to one embodiment of the present invention.
[0039] FIG. 9 is a flowchart illustrating a user body measurement process of an e-commerce service method using a virtual fitting function according to the embodiment of FIG. 8.
[0040] FIG. 10 is a flowchart illustrating an artificial intelligence-based fitting process of an e-commerce service method using a virtual fitting function according to the embodiment of FIG. 8.
[0041] Fig. 11 is a flowchart illustrating a product ordering process of an e-commerce service method using a virtual fitting function according to the embodiment of Fig. 8.
[0042] Hereinafter, the present invention will be described in detail with reference to preferred embodiments of the present invention and the accompanying drawings, on the premise that the same reference numerals in the drawings indicate the same components.
[0043] Prior to describing the specific content for implementing the present invention, it should be noted that components not directly related to the technical gist of the present invention have been omitted within the scope of not dispersing the technical gist of the present invention.
[0044] In addition, the terms or words used in this specification and claims should be interpreted as meanings and concepts that conform to the technical idea of the invention based on the principle that the inventor can define the concept of appropriate terms to explain his invention in the best way.
[0045] In this specification, the expression that a certain part "includes" a certain component means that it can further include other components rather than excluding other components.
[0046] In addition, terms such as "‥part", "‥device", "‥module" mean a unit that processes at least one function or operation, and this can be distinguished by hardware, software, or a combination of both.
[0047] In addition, the term "at least one" is defined as a term including singular and plural, and it is obvious that each component can exist in singular or plural and can mean singular or plural even if the term "at least one" does not exist.
[0048] Hereinafter, a preferred embodiment of an e-commerce service system and method using a virtual fitting function according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.
[0049] FIG. 1 is a block diagram showing the configuration of an e-commerce service system using a virtual fitting function according to an embodiment of the present invention, FIG. 2 is an exemplary diagram showing the operation of the e-commerce service system using the virtual fitting function according to the embodiment of FIG. 1, FIG. 3 is a block diagram showing the configuration of a user terminal of the e-commerce service system using the virtual fitting function according to the embodiment of FIG. 1, FIG. 4 is an exemplary diagram showing the operation of the e-commerce service system using the virtual fitting function according to the embodiment of FIG. 1, FIG. 5 is another exemplary diagram showing the operation of the e-commerce service system using the virtual fitting function according to the embodiment of FIG. 1, FIG. 6 is a block diagram showing the configuration of a transaction service server of the e-commerce service system using the virtual fitting function according to the embodiment of FIG. 1, and FIG. 7 is a block diagram showing the configuration of a fitting management unit of the transaction service server according to the embodiment of FIG. 6.
[0050] Referring to FIGS. 1 to 7, an e-commerce service system utilizing a virtual fitting function according to an embodiment of the present invention may be configured to include a user terminal (100), a transaction service server (200), a seller terminal (300), a manufacturer terminal (400), and an SNS server (500) so as to reduce the return rate of clothing products by analyzing and predicting the physical wearing state based on the relevant information of the clothing product and avatar information measuring the user's body when purchasing the clothing product online.
[0051] A user terminal (100) can connect to a transaction service server (200) through a network and perform electronic commerce for products provided from one or more seller terminals (300).
[0052] Here, the electronic commerce between the user terminal (100) and the seller terminal (300) may be identical to the known electronic commerce process.
[0053] In addition, the user terminal (100) is configured to create a user avatar (610) so that the user (600) can perform a virtual fitting for products such as clothing that cannot actually be worn online among products, and may be configured as a desktop PC, a notebook PC, a tablet PC, a mobile terminal capable of installing an application, or an embedded terminal capable of capturing 3D images.
[0054] In addition, the user terminal (100) does not require a special location or device, and the user can take pictures directly using the camera he or she has.
[0055] In this embodiment, for convenience of explanation, a mobile terminal (e.g., a smartphone) equipped with a Lidar sensor, ToF (Time of Flight), 3D camera SDK, etc. is described as an embodiment, but the present invention is not limited thereto.
[0056] In addition, the user terminal (100) may be configured to analyze the user's body information from an image of the user's body (600) to generate a user avatar (610), receive a virtual fitting image provided from a transaction service server (200), and display the received virtual fitting image, and may include an input unit (110), a 3D measurement unit (120), a display unit (130), a control unit (140), a data communication unit (150), and a photographing unit (160).
[0057] The input unit (110) can receive user information from a user (600), e-commerce information, and setting information for creating and transmitting a user avatar (600).
[0058] The 3D measurement unit (120) is configured to capture a user's (600) body and output it as a 3D image. It can calculate depth information with respect to an object using either SL (Structured Light) or ToF (Time of Flight), and can be configured with a 3D camera, a 2D camera equipped with a Lidar sensor, etc.
[0059] Additionally, the 3D measurement unit (120) can output the user's body size information based on the depth information with the produced object.
[0060] Here, the user's body size may include height, arm length, leg length, head size, waist circumference, torso circumference, head circumference, neck circumference, foot size, hand size, etc.
[0061] The display unit (130) can output a three-dimensional image captured including depth information, a user avatar (610), and a virtual fitting image provided from a transaction service server (200).
[0062] The control unit (140) can execute an application program for e-commerce to perform e-commerce with a seller terminal (300) through a transaction service server (200).
[0063] Additionally, if the e-commerce target product is a clothing product, the control unit (140) can request the transaction service server (200) to fit the product.
[0064] In addition, when fitting of a product is requested, the control unit (140) can analyze an object from 3D image information measured by the 3D measurement unit (120) and generate a user avatar (610) based on depth information corresponding to the analyzed object, i.e., the user's body information.
[0065] Here, the fitting request is a request for evaluation of the wearing condition and fit, elasticity, and wrinkling of the clothing, for example, arm length, leg length, torso circumference, and waist circumference, etc., in a virtual physical state by matching the clothing product to be purchased to the user avatar (610) generated in the user terminal (100), and the physical wearing condition is a state in which the product is stretched or wrinkled due to the user directly wearing the product.
[0066] That is, when a fitting request is input, the control unit (140) executes an avatar creation application program to analyze a 3D image object captured from the 3D image information of the 3D measurement unit (120), and reflects the depth information of the analyzed object into the user's body information to create a user avatar (610).
[0067] Additionally, the control unit (140) can correct the generated user avatar (610) using a digital twin program, and store the corrected user avatar (610) in the user terminal (100).
[0068] Here, the digital twin program creates a virtual model of assets such as physical objects, spaces, environments, people, and processes using software, so that they can operate or perform the same actions as they do in the real world, and allows for the identification and resolution of potential problems through simulations before creating an actual product.
[0069] In addition, the digital twin program can be installed and operated on a user terminal (100), but can also be installed and operated on a transaction service server (200), seller terminal (300), or manufacturer terminal (400) connected through a network.
[0070] Additionally, the control unit (140) can use a user avatar (610) that is already saved, and can also update it with a newly created user avatar (610) when a user requests additional creation.
[0071] In addition, when a virtual fitting image is received from the transaction service server (200), the control unit (140) may request transmission of the received virtual fitting image to the SNS server (500) based on any SNS information input by the user.
[0072] Additionally, the control unit (140) can transmit response information regarding virtual fitting images received from the SNS server (500) to the transaction service server (200).
[0073] In addition, the control unit (140) can analyze the image of the information display means (800, 800a, 800b) captured by the shooting unit (160) to extract seller information and product information.
[0074] Here, the information display means (800, 800a, 800b) may be configured as a one-dimensional information display means, for example, a 'barcode', or a two-dimensional information display means, for example, a 'QR code'.
[0075] Meanwhile, in this embodiment, for the convenience of explanation, a one-dimensional or two-dimensional information display means is described as an example, but it is not limited thereto, and any information display means that can display product information and seller information may be included.
[0076] Additionally, the control unit (140) can request fitting of the product to the transaction service server (200) based on the extracted product information.
[0077] In addition, the control unit (140) can control to perform electronic commerce with the corresponding seller terminal (300) through the transaction service server (200) based on the extracted seller information.
[0078] The data communication unit (150) can transmit and receive user information, e-commerce information, user avatar (610) information, fitting request information, virtual fitting images, etc. to and from a transaction service server (200), a seller terminal (300), a manufacturer terminal (400), or an SNS server (500).
[0079] The photographing unit (160) is a configuration that outputs an image taken of a one-dimensional or two-dimensional information display means that displays arbitrary product information, and may be formed of a camera made of a CCD sensor, a CMOS sensor, or any sensor that converts an optical signal into an electrical signal.
[0080] That is, the shooting unit (160) can output an image of an information display means (800, 800a) such as a 'QR code' from a product tag (710, 710a) attached to a product (700, 700a) offline.
[0081] In addition, the photographing unit (160) can output an image of an information display means (800) displayed on one side of online advertising information (900) displayed on a display screen, and an information display means (800a, 800b) displayed on one side of outdoor advertising information (900a, 900b) installed and exposed at an arbitrary location.
[0082] In addition, when a fitting of a product, for example, a fitting of a clothing product, is requested from a user terminal (100), the transaction service server (200) can receive product specification information and user avatar (610) information related to the product from the user terminal (100) and the seller terminal (300).
[0083] In addition, the transaction service server (200) can generate a virtual fitting image and perform fitting by reflecting the deformation of the product according to the movement of the user avatar (610) according to the product specification information through an artificial intelligence-based fitting prediction model.
[0084] In addition, the transaction service server (200) can analyze and predict the physical wearing status through fitting, generate a virtual fitting image reflected in the user avatar (610), and generate and output product fitting evaluation information.
[0085] To this end, the transaction service server (200) may be configured to include a data communication unit (210), a member management unit (220), a product management unit (230), an e-commerce unit (240), and a fitting management unit (250).
[0086] The data communication unit (210) can transmit and receive product information including user information, e-commerce information, user avatar (610) information, fitting request information, seller information, product specification information, virtual fitting images, etc., to and from a user terminal (100), a seller terminal (300), a manufacturer server (400), an SNS server (500), etc.
[0087] The member management unit (220) can manage user authentication and seller authentication based on user information input from a user terminal (100) and seller information input from a seller terminal (300).
[0088] The product management unit (230) can receive, store, and manage product specification information such as product information, product design information including color, size information, function information for attaching and detaching parts of the product (e.g., arms, legs, hats, etc.), material information, elasticity information, and wrinkling information from the seller terminal (300).
[0089] The electronic commerce section (240) is a configuration that manages electronic commerce for products between a user terminal (100) and a seller terminal (300), and between a user terminal (100) and a manufacturer terminal (400), and may be configured as a known electronic commerce means.
[0090] When a fitting request for a product is made from a user terminal (100), the fitting management unit (250) can receive user avatar (610) information of the user terminal (100) and information about the product for which fitting is requested from the seller terminal (300).
[0091] In addition, the fitting management unit (250) can create a virtual fitting image based on the received user avatar (610) information and product information, and the product specification information of the corresponding product stored in the product management unit (230).
[0092] That is, the fitting management unit (250) can generate a corrected user avatar (610) by reflecting the product deformation prediction information corresponding to the physical wearing state according to the movement of the user avatar (610) through an artificial intelligence-based fitting prediction model.
[0093] To this end, the fitting management unit (250) can analyze the deformation of a product through fitting that reflects product specification information to the actions of the user avatar (610).
[0094] Here, the artificial intelligence-based fitting prediction model can be seen as a type of analysis model created through a method called deep learning among machine learning.
[0095] Therefore, the artificial intelligence-based fitting prediction model can also be used as an expression of a deep learning model or a deep learning analysis model.
[0096] Additionally, machine learning is an application of artificial intelligence that enables complex systems to automatically learn and improve from experience without being explicitly programmed.
[0097] Additionally, the accuracy and effectiveness of machine learning models may partially depend on the data used to train them.
[0098] In addition, the fitting management unit (250) can create a virtual fitting image that reflects the results of product deformation analysis through fitting to the user avatar (610).
[0099] That is, the fitting management unit (250) can perform a fitting by using a realistic model to correct a user avatar (610) by reflecting the product deformation analysis results, and thereby create a virtual fitting image of the realistic user avatar (610).
[0100] Here, the realistic model can be composed of an artificial intelligence-based program, a generative adversarial network (GAN), which compares various data and generates a virtual fitting image with a similar appearance to the real thing.
[0101] Additionally, the fitting management unit (250) can generate and output fitting evaluation information for a product based on a virtual fitting image.
[0102] To this end, the fitting management unit (250) may be configured to include an avatar information input unit (251), a product information input unit (252), a product information analysis unit (253), an artificial intelligence fitting unit (254), and a fitting evaluation unit (255).
[0103] When fitting for a product is requested, the avatar information input unit (251) can receive user avatar (610) information from the user terminal (100).
[0104] When a fitting request for any product is made from a user terminal (100), the product information input unit (252) can receive product information and product specification information for the corresponding product from the seller terminal (300) and the product management unit (230).
[0105] The product information analysis unit (253) can receive and analyze product design information including color, size information, function information, material information, elasticity information, and wrinkling information from product specification information.
[0106] The artificial intelligence fitting unit (254) can perform a simulation corresponding to the user's physical wearing state through fitting that reflects product information and product specification information according to the movements of the user avatar (610) through an artificial intelligence-based fitting prediction model.
[0107] In addition, the artificial intelligence fitting unit (254) can reflect the product deformation prediction information predicted through simulation to the user avatar (610) and correct it, analyze the product deformation result reflecting the product specification information through fitting, and generate a virtual fitting image reflecting the product deformation prediction information to the user avatar (610).
[0108] In addition, the artificial intelligence fitting unit (254) can generate a virtual fitting image by reflecting various background images and environmental images during a fitting simulation that reflects product specification information to the user avatar (610).
[0109] In addition, the artificial intelligence fitting unit (254) performs a realistic model that creates a virtual fitting image with a similar appearance to the real one by comparing various data to a user avatar (610) that has been corrected by reflecting the product deformation analysis results, and thereby performs fitting by creating a virtual fitting image from a realistic user avatar (610).
[0110] The fitting evaluation unit (255) can analyze the fitting evaluation information of a product based on a virtual fitting image, for example, the size of the product corresponding to the user avatar (610), and the deformation state of the product based on the size, material, elasticity, wrinkling, etc. of the product corresponding to the movement of the user avatar (610).
[0111] In addition, the fitting evaluation unit (255) can transmit the deformation state of the analyzed product and a virtual fitting image generated to reflect the deformation state to the user terminal (100).
[0112] In addition, the fitting evaluation unit (255) can check whether SNS information for transmitting a virtual fitting image is input from the user terminal (100) through the SNS server (500), and transmit a virtual fitting image generated based on the input SNS information to the SNS server (500).
[0113] In addition, when the fitting evaluation unit (255) receives response information from the SNS server (500) regarding a virtual fitting image, it can reflect it in the fitting evaluation information of the product corresponding to the virtual fitting image.
[0114] In addition, the fitting evaluation unit (255) converts the results of analyzing the deformation state of the product into a visual format such as a virtual fitting image and text, and the converted information can be output through the user terminal (100).
[0115] Additionally, the fitting evaluation unit (255) can additionally generate product customizing information based on the generated fitting evaluation information.
[0116] That is, the fitting evaluation unit (255) can generate optimal customization information that fits the user's body size based on information of the user avatar (610) when some sizes of the product, for example, arm length, pants length, waist circumference, and chest circumference, are too large or too small.
[0117] In addition, the fitting evaluation unit (255) can output the generated customization information to the user terminal (100), and when a purchase request is input in response to the generated customization information from the user terminal (100), the unit can search for manufacturers capable of manufacturing for the custom-made request, and then output one or more of the searched manufacturer terminals (400) to the user terminal (100).
[0118] In addition, the fitting evaluation unit (255) can transmit the customization information, user information, and product specification information from the user terminal (100) to the selected manufacturer terminal (400), and request the e-commerce unit (240) to conduct e-commerce for custom-made clothing production between the user terminal (100) and the manufacturer terminal (400).
[0119] The seller terminal (300) can connect to a transaction service server (200) through a network to provide one or more products and product information of the products, and can perform electronic commerce with the user terminal (100) and the products.
[0120] In addition, the seller terminal (300) can provide product specification information such as product design information including color of the product, size information, function information, material information, elasticity information, and wrinkling information along with product information to the transaction service server (200).
[0121] The manufacturer terminal (400) is connected to the transaction service server (200) through a network, and when a custom manufacturing request is made based on the customization information of the user terminal (100) through the transaction service server (200), the manufacturer terminal (400) receives the customization information, user information, and product specification information from the user terminal (100) or the transaction service server (200) so that a clothing product, i.e., a custom-made suit, can be manufactured.
[0122]
[0123] The following describes an e-commerce service method using a virtual fitting function according to one embodiment of the present invention.
[0124] FIG. 8 is a flowchart illustrating an e-commerce service method using a virtual fitting function according to an embodiment of the present invention, FIG. 9 is a flowchart illustrating a user body measurement process of an e-commerce service method using a virtual fitting function according to the embodiment of FIG. 8, FIG. 10 is a flowchart illustrating an artificial intelligence-based fitting process of an e-commerce service method using a virtual fitting function according to the embodiment of FIG. 8, and FIG. 11 is a flowchart illustrating a product ordering process of an e-commerce service method using a virtual fitting function according to the embodiment of FIG. 8.
[0125] Referring to FIGS. 1 and 11, an e-commerce service method using a virtual fitting function according to an embodiment of the present invention measures and analyzes (S100) the user's body information from an image of the user's (600) body taken by a user terminal (100).
[0126] That is, in step S100, the user terminal (100) performs a body scan (S110) to take a picture of the body of the user (600) and output it as a 3D image.
[0127] In addition, the user terminal (100) analyzes an object from the captured 3D image information and generates a user avatar (610) that reflects the depth information of the analyzed object as the user's body information, corrects the user avatar (610) using a digital twin program (S120), and stores the user avatar (610) that reflects the correction result in the user terminal (100) (S130).
[0128] At this time, the user terminal (100) can calculate the user's body size information based on the analyzed depth information and reflect the calculated user's body size information in the user avatar (610).
[0129] In addition, when a one-dimensional or two-dimensional information display means (800, 800a, 800b) that displays arbitrary product information captured through a camera unit (160) is input, the user terminal (100) can analyze the input information display means (800, 800a, 800b) image to extract seller information and product information.
[0130] In addition, the user terminal (100) can request fitting of the product to the transaction service server (200) based on the extracted product information and seller information and request electronic commerce with the seller terminal (300) of the product.
[0131] Additionally, the user terminal (100) can connect to the transaction service server (200) and perform electronic commerce (S200) on products provided from any seller terminal (300).
[0132] Continuing, the transaction service server (200) manages the electronic commerce of step S200 to take place between the user terminal (100) and the seller terminal (300), and determines whether fitting of a product is requested from the user terminal (100) (S300).
[0133] As a result of the judgment in step S300, when a fitting of a product is requested from the user terminal (100), the transaction service server (200) receives product specification information and user avatar (610) information related to the product from the user terminal (100) and the seller terminal (300) (S400), and can create a virtual fitting image based on the received information.
[0134] Here, product specification information may include product design information including color, size information, function information, material information, elasticity information, wrinkling information, etc.
[0135] Continuing, the transaction service server (200) can generate a corrected user avatar (610) that reflects the product deformation prediction information corresponding to the physical wearing state according to the movement of the user avatar (610) through an artificial intelligence-based fitting prediction model, realize the corrected user avatar (610) using a realization model, and perform fitting by generating the realized user avatar (610) as a virtual fitting image (S500).
[0136] To explain this in more detail, in step S500, the transaction service server (200) performs a simulation corresponding to the state in which the user physically wears the product through fitting that reflects product information and product specification information according to the actions of the user avatar (610) through an artificial intelligence-based fitting prediction model, and reflects the product deformation prediction information predicted through the simulation to the user avatar (610) for correction (S510).
[0137] In addition, the transaction service server (200) performs realization using a realization model that compares various data to a corrected user avatar (610) reflecting the product deformation analysis results and creates a virtual fitting image with a similar appearance to the real thing (S520), and through this, creates a realized user avatar (610) as a virtual fitting image (S530).
[0138] Additionally, at step S510, the transaction service server (200) may generate a virtual fitting image by reflecting various background images and environmental images during a fitting simulation that reflects product specification information on the user avatar (610).
[0139] Continuing, the transaction service server (200) generates product fitting evaluation information based on the product deformation result as the user avatar (610) performs any action, and outputs the generated product fitting evaluation information to be displayed through the user terminal (100) (S600).
[0140] In addition, at step S600, the transaction service server (200) can check whether SNS information for transmitting a virtual fitting image is input from the user terminal (100) through the SNS server (500), and transmit a virtual fitting image generated based on the input SNS information to the SNS server (500).
[0141] In addition, when the transaction service server (200) receives response information for a virtual fitting image from the SNS server (500), it can reflect the received response information in the fitting evaluation information of the product corresponding to the virtual fitting image.
[0142] In addition, step S600 can additionally generate product customizing information, i.e., optimized size information, based on the fitting evaluation information generated by the transaction service server (200), search for manufacturer information according to customizing, and output one or more pieces of manufacturer information to the user terminal (100).
[0143] At this time, the transaction service server (200) may provide separate condition information, such as a different price and return conditions from ready-made products (ready-made clothing), along with manufacturer information to the user terminal (100).
[0144] In addition, at step S600, when a purchase request corresponding to customizing information is input from a user terminal (100), the transaction service server (200) can extract the customizing information, user information, and product specification information for custom production and transmit them to the manufacturer terminal (400).
[0145] After performing step S600, the transaction service server (200) determines whether the product order is completed (S700).
[0146] As a result of the judgment at step S700, if product order completion information is input from the user terminal (100), e-commerce is performed through a product order for the corresponding product (S800).
[0147] That is, at step S800, it is determined whether either ready-made clothing order information based on ready-made product information or custom-made clothing order information based on customization information is entered (S810).
[0148] As a result of the judgment in step S810, if it is ready-made clothing order information, the transaction service server (200) transmits product specification information and user information for e-commerce to the seller terminal (300) so that e-commerce is performed between the seller terminal (300) and the user terminal (100) (S820).
[0149] In addition, if the judgment result of step S810 is custom-made clothing order information, the transaction service server (200) transmits customizing information, product specification information, and user information for e-commerce to the manufacturer terminal (400) so that e-commerce is performed between the manufacturer terminal (400) and the user terminal (100) (S830).
[0150] Therefore, when purchasing clothing products online, the return rate of clothing products can be reduced by analyzing and predicting the physical wearing status based on the relevant information of the clothing product and the avatar information measuring the user's body.
[0151] Additionally, by providing information similar to the offline state of wearing, various fashion items can be applied based on the user's body measurement data.
[0152] In addition, by providing a fitting information management platform based on avatar information measuring the user's body, a collaborative system can be provided between a shopping mall selling ready-made clothes and a manufacturer that manufactures custom-made clothes using information customized to the user.
[0153] Additionally, individual fitting information can be managed based on avatar information measuring the user's body, and SNS content information can be produced and managed through wearing various clothing products.
[0154] As described above, although the present invention has been described with reference to preferred embodiments, it will be understood by those skilled in the art that the present invention can be variously modified and changed within the scope and spirit of the present invention as set forth in the claims below.
[0155] In addition, the drawing numbers described in the patent claims of the present invention are not limited thereto and are described only for the sake of clarity and convenience of explanation, and in the process of explaining the embodiments, the thickness of lines or the size of components depicted in the drawings may be exaggerated for the sake of clarity and convenience of explanation.
[0156] Additionally, the terms described above are defined in consideration of their functions in the present invention, and their interpretation should be based on the contents throughout this specification.
[0157] In addition, even if not explicitly illustrated or described, it is obvious that a person having ordinary skill in the art to which the present invention pertains can make various modifications including the technical ideas of the present invention from the description of the present invention, and this still falls within the scope of the present invention.
[0158] In addition, the above embodiments described with reference to the attached drawings are described for the purpose of explaining the present invention, and the scope of the present invention is not limited to these embodiments.
[0159] [Explanation of symbols]
[0160] 100: User terminal 110: Input unit
[0161] 120: 3D measurement section 130: Display section
[0162] 140: Control unit 150: Data communication unit
[0163] 160: Filming Department 200: Transaction Service Server
[0164] 210: Data Communication Department 220: Membership Management Department
[0165] 230: Product Management Department 240: E-Commerce Department
[0166] 250: Fitting Management Department 251: Avatar Information Input Department
[0167] 252: Product information input section 253: Product information analysis section
[0168] 254: Artificial Intelligence Fitting Department 255: Fitting Evaluation Department
[0169] 300: Seller terminal 400: Manufacturer terminal
[0170] 500: SNS server 600: User
[0171] 610: User Avatar 700, 700a: Product
[0172] 710, 710a: Product tag 800, 800a, 800b: Information display means
[0173] 900: Online advertising information 900a, 900b: Outdoor advertising information
Claims
1. A user terminal (100) that connects to a transaction service server (200) to perform electronic commerce for products provided from an arbitrary seller terminal (300), analyzes the user's body information from an image of the user's body (600) to create a user avatar (610), and displays a virtual fitting image provided from the transaction service server (200); Manage electronic commerce between a seller terminal (300) selling any product and the user terminal (100), and when fitting of a product is requested from the user terminal (100), By receiving product specification information including color, product design information, size information, function information, material information, and elasticity information related to the product from the user terminal (100) and the seller terminal (300) and user avatar (610) information, a virtual fitting image is generated, and fitting is performed through a simulation corresponding to a state in which the user physically wears the product by reflecting the size information, function information, material information, elasticity information, and wrinkling information of the product specification information through an artificial intelligence-based fitting prediction model, and a physical wearing state through fitting - wherein the physical wearing state is a state in which stretching and wrinkling of the product occur when the user directly wears the product - is analyzed and predicted to generate a virtual fitting image reflected in the user avatar (610), and during the fitting simulation reflecting the product specification information, a virtual fitting image is generated by reflecting an arbitrary background image and an environment image to the user avatar (610), and the deformation state of the product based on the virtual fitting image is determined by reflecting the size of the product, the function, material, and elasticity information of the product according to the motion of the user avatar (610). A transaction service server (200) that analyzes according to elasticity and wrinkling, and generates and outputs product fitting evaluation information based on the deformation results of the product; and An electronic commerce service system utilizing a virtual fitting function, including a seller terminal (300) that connects to the above transaction service server (200) to provide one or more products and product information of the products, and performs electronic commerce of the products with a user terminal (100).
2. In paragraph 1, The above user terminal (100) includes an input unit (110) that receives user information and e-commerce information from a user (600); A 3D measuring unit (120) that photographs the body of the user (600) and outputs it as a 3D image; A display unit (130) that outputs the above-described three-dimensional image, a user avatar (610), and a virtual fitting image provided from a transaction service server (200); A control unit (140) that executes an avatar creation application program to analyze an object from the 3D image information of the 3D measurement unit (120), reflects the depth information of the analyzed object as the user's body information to create a user avatar (610), executes an application program for e-commerce to request a fitting of a product to a transaction service server (200), and performs e-commerce with a seller terminal (300); and An electronic commerce service system using a virtual fitting function, characterized by including a data communication unit (150) for transmitting and receiving the user information, electronic commerce information, user avatar (610) information, fitting request information, and virtual fitting image.
3. In paragraph 2, The above user terminal (100) further includes a photographing unit (160) that photographs a one-dimensional or two-dimensional information display means displaying arbitrary product information; An electronic commerce service system using a virtual fitting function, characterized in that the control unit (140) analyzes seller information and product information from a photographed information display means, requests a fitting of a product based on the product information to a transaction service server (200), and controls the seller terminal (300) to perform electronic commerce based on the seller information.
4. In paragraph 3, An electronic commerce service system using a virtual fitting function, characterized in that the above 3D measurement unit (120) calculates depth information with an object using either SL (Structured Light) or ToF (Time of Flight), and outputs user body size information based on the calculated depth information.
5. In paragraph 3, An electronic commerce service system using a virtual fitting function, characterized in that the control unit (140) corrects the generated user avatar (610) using a digital twin program and stores the correction result in the user terminal (100).
6. In paragraph 1, The above transaction service server (200) includes a data communication unit (210) that transmits and receives product information including user information, e-commerce information, user avatar (610) information, fitting request information, seller information, product specification information, and virtual fitting image information to and from one or more of a user terminal (100), a seller terminal (300), a manufacturer terminal (400), and an SNS server (500); A member management unit (220) that manages user authentication and seller authentication based on the above user information and seller information; A product management unit (230) that stores product specification information including the above product information, product design information including color, size information, function information, material information, elasticity information, and wrinkling information; An electronic commerce unit (240) that manages electronic commerce for any product between the user terminal (100) and the seller terminal (300); and When a fitting for a product is requested from the user terminal (100), the user avatar (610) information and product information received from the user terminal (100) and the seller terminal (300), the product specification information of the corresponding product stored in the product management unit (230), and any background and environmental information during a fitting simulation reflecting the product specification information are used to perform fitting through a simulation corresponding to a state in which the user physically wears the product by reflecting the size information, function information, material information, elasticity information, and wrinkling information of the product specification information according to the motion of the user avatar (610), and a corrected user avatar (610) reflecting the deformation prediction information of the product corresponding to the physical wearing state through fitting is generated, and the corrected user avatar (610) is made into a real-life model, and the real-life user avatar (610) is generated as a virtual fitting image, and the deformation state of the product is determined based on the size of the product, the size, function, material, and motion of the user avatar (610). An electronic commerce service system utilizing a virtual fitting function, characterized by including a fitting management unit (250) that analyzes according to elasticity and wrinkling, and generates and outputs fitting evaluation information of a product based on the deformation results of the product.
7. In paragraph 6, The above fitting management unit (250) includes an avatar information input unit (251) that receives user avatar (610) information from a user terminal (100) when fitting for a product is requested; A product information input unit (252) that receives the above product information and product specification information; A product information analysis unit (253) that analyzes product design information including color, size information, function information, material information, and elasticity information from the above product specification information; An artificial intelligence fitting unit (254) that generates a virtual fitting image using an artificial intelligence-based fitting prediction model, and performs fitting through a simulation corresponding to a state in which a user physically wears the product by reflecting size information, function information, material information, elasticity information, and wrinkle information of the product specification information according to the movement of a user avatar (610) during a fitting simulation reflecting the product specification information, and corrects the user avatar (610) by reflecting the product deformation prediction information corresponding to the physical wearing state through fitting, and realisticizes the corrected user avatar (610) using a realistic model, and generates the realistic user avatar (610) as a virtual fitting image; and An electronic commerce service system using a virtual fitting function, characterized by including a fitting evaluation unit (255) that analyzes the deformation state of a product based on the virtual fitting image, the size of the product, the size of the product according to the movement of the user avatar (610), the function, the material, the elasticity, and the wrinkling of the product, and converts the fitting evaluation information of the product based on the deformation result of the product into an arbitrary format and outputs it.
8. In paragraph 7, An electronic commerce service system using a virtual fitting function, characterized in that the artificial intelligence fitting unit (254) checks whether SNS information is input from a user terminal (100), transmits a virtual fitting image generated upon confirmation of input of the SNS information to an SNS server (500) corresponding to the SNS information, and outputs response information received from the SNS server (500) to a fitting evaluation unit (255).
9. In paragraph 7, An electronic commerce service system using a virtual fitting function, characterized in that the above fitting evaluation unit (255) additionally generates product customizing information based on the generated fitting evaluation information and outputs it to a user terminal (100).
10. In paragraph 9, An electronic commerce service system using a virtual fitting function, characterized in that when a purchase request corresponding to customizing information is input from a user terminal (100), the fitting evaluation unit (255) transmits the customizing information, user information, and product specification information for custom manufacturing to a manufacturer terminal (400) through the electronic commerce unit (240) to request electronic commerce. 11.a) A step of generating a user avatar (610) by analyzing the user's body information from an image of the user's (600) body taken by the user terminal (100); b) A step in which the user terminal (100) connects to the transaction service server (200) and performs electronic commerce for products provided from any seller terminal (300); c) A step in which the transaction service server (200) manages electronic commerce between a user terminal (100) and a seller terminal (300), determines whether a fitting of a product is requested from the user terminal (100), and, when the fitting of the product is requested, the transaction service server (200) receives product specification information including color, product design information, size information, function information, material information, and elasticity information related to the product and user avatar (610) information from the user terminal (100) and the seller terminal (300); d) a step in which the transaction service server (200) performs fitting through a simulation corresponding to a state in which the user physically wears the product by reflecting the size information, function information, material information, elasticity information, and wrinkle information of the product specification information to the deformation of the product according to the movement of the user avatar (610) through an artificial intelligence-based fitting prediction model, and generates a corrected user avatar (610) reflecting the deformation prediction information of the product corresponding to the physical wearing state through fitting, and realizing the corrected user avatar (610) using a realization model, and generating the realized user avatar (610) as a virtual fitting image; and e) An electronic commerce service method using a virtual fitting function, including a step of analyzing the deformation state of a product based on the virtual fitting image by the transaction service server (200) according to the size, function, material, elasticity, and wrinkling of the product according to the movement of the user avatar (610), and generating and outputting the fitting evaluation information of the product based on the deformation result of the product.
12. In paragraph 11, The above step a) is a body scan step in which a user terminal (100) takes a picture of the body of the user (600) and outputs it as a 3D image; and a-2) A method for providing an electronic commerce service using a virtual fitting function, characterized by comprising the steps of: analyzing an object from 3D image information captured by the user terminal (100) and generating a user avatar (610) that reflects the depth information of the analyzed object as the user's body information; correcting the user avatar (610) using a digital twin program; and storing the user avatar (610) reflecting the correction result in the user terminal (100).
13. In paragraph 11, The above step b) is to photograph a one-dimensional or two-dimensional information display means that displays arbitrary product information by the user terminal (100), An electronic commerce service method using a virtual fitting function, characterized in that it further includes a step of analyzing seller information and product information from the photographed information display means, requesting a fitting of a product based on the product information to a transaction service server (200), and performing electronic commerce based on the seller information with a seller terminal (300).
14. In paragraph 11, The above step e) checks whether the transaction service server (200) inputs SNS information from the user terminal (100), When the input of the above SNS information is confirmed, the generated virtual fitting image is transmitted to the SNS server (500) corresponding to the above SNS information. An electronic commerce service method using a virtual fitting function, characterized in that it further includes a step of reflecting the response information received from the SNS server (500) into the product fitting evaluation information.
15. In paragraph 11, An electronic commerce service method using a virtual fitting function, characterized in that the step e) above additionally generates product customizing information based on the generated fitting evaluation information by the transaction service server (200) and outputs it to the user terminal (100).
16. In paragraph 15, The above e-commerce service method, f) the transaction service server (200) determines whether the product order is completed, An electronic commerce service method using a virtual fitting function, characterized in that it further includes a step of performing electronic commerce by transmitting product specification information for an electronic commerce section (240), the customization information for custom production, and user information to a seller terminal (300) or a manufacturer terminal (400) when either ready-made information or customization information of a product is input from a user terminal (100).
Citation Information
Patent Citations
System and method for customizing styling service
KR1020140123634A
Method for detecting an object structure and apparatus for carrying out the method
KR1020210031841A
Method and apparatus for data-free network quantization and compression with adversarial knowledge distillation
KR1020210119298A
Digital twin avatar provision system based on 3D anthropometric data for e-commerce
KR102506352B1
E-commerce service system and method using virtual fitting function
KR102614621B1
