Method and system for realizing virtual fitting room of shopping mall based on AR (Augmented Reality) technology

Abstract

The invention discloses a shopping mall virtual fitting room implementation method and system based on the AR technology, and belongs to the technical field of e-commerce and computer vision, and the method comprises the steps: carrying out the real-time high-precision three-dimensional human body modeling based on a common camera; performing intelligent cloth physical simulation fused with a machine learning algorithm; multi-terminal cross-platform consistency rendering is supported; and carrying out personalized clothing recommendation in combination with user body type data. The virtual try-on effect of the user can be truly presented, multi-device terminal access is supported, the shopping experience is remarkably improved, and the refunding and changing rate is reduced.

Description

Technical Field

[0001] This invention relates to the fields of e-commerce and computer vision technology, specifically to a method and system for implementing a virtual fitting room for an online store based on AR technology. Background Technology

[0002] Current online shopping suffers from the inability to try on clothes in real time, while physical store fitting rooms present problems such as long queues and hygiene concerns. Existing virtual fitting technologies suffer from low modeling accuracy, unrealistic fabric simulation, and poor cross-platform compatibility. Furthermore, traditional solutions rely on dedicated hardware, which is costly and difficult to popularize. Summary of the Invention

[0003] The technical objective of this invention is to address the above-mentioned shortcomings by providing a method and system for implementing a virtual fitting room in an online store based on AR technology. This system can realistically present the virtual fitting effect for users, support access from multiple devices, significantly improve the shopping experience, and reduce the return and exchange rate.

[0004] The technical solution adopted by this invention to solve its technical problem is:

[0005] A method for implementing a virtual fitting room in an online store based on AR technology, the implementation of which includes:

[0006] Real-time high-precision 3D human body modeling based on ordinary cameras;

[0007] Intelligent fabric physics simulation incorporating machine learning algorithms;

[0008] Supports consistent rendering across multiple terminals and platforms;

[0009] Personalized clothing recommendations based on user body shape data.

[0010] This method targets e-commerce platforms and brick-and-mortar retailers, addressing the limitations of real-time virtual try-on in traditional online shopping and the limited fitting room resources in physical stores. Through technologies such as 3D human body modeling, real-time AR rendering, and intelligent fabric simulation, it achieves a realistic virtual try-on experience for users, supports access from multiple devices, significantly improves the shopping experience, and reduces return rates.

[0011] Furthermore, the specific implementation of this method is as follows:

[0012] (1) Adaptive human body modeling: Using smartphone cameras or ordinary depth sensors, multi-frame fusion technology is used to construct a user's 3D model and automatically identify body features;

[0013] (2) Intelligent fabric simulation: Integrating a fabric physics engine based on machine learning, automatically simulating the drape, wrinkle effect and dynamic swing characteristics of different fabrics based on the clothing material database.

[0014] (3) AR environment fusion: The virtual clothing and the physical environment are visually fused through SLAM (Simultaneous Localization and Mapping) technology, and multi-angle lighting compensation is supported to make the try-on effect realistic and natural.

[0015] (4) Personalized recommendations: Based on user body data, historical fitting records and fashion trend analysis, intelligently recommend suitable styles and matching schemes;

[0016] (5) Cross-platform rendering optimization: A hierarchical rendering strategy is adopted, using the lightweight ARCore / ARKit framework on mobile devices and supporting 4K ray tracing rendering on PCs to ensure consistent experience across multiple terminals.

[0017] Furthermore, the body shape features include shoulder width, waist circumference, leg length, etc.; the recognition accuracy is ±1cm.

[0018] Furthermore, the clothing material database includes materials such as cotton, silk, and polyester.

[0019] This invention also claims a virtual fitting room implementation system for an online store based on AR technology, comprising:

[0020] A real-time high-precision 3D human body modeling subsystem based on ordinary cameras;

[0021] A smart fabric physics simulation engine that integrates machine learning algorithms;

[0022] Supports a consistent rendering architecture across multiple terminals and platforms;

[0023] A personalized clothing recommendation algorithm that combines user body shape data.

[0024] This system provides a high-precision, low-latency cross-platform virtual try-on system, enabling real-time 3D human body reconstruction based on ordinary cameras, intelligent fabric physics simulation algorithms, realistic material rendering in multi-light source environments, and supports access from multiple terminals including mobile devices, PCs, and AR glasses, thus enhancing the user's shopping experience.

[0025] Furthermore, to realize a virtual fitting room for the online store, the system specifically includes the following:

[0026] (1) Adaptive human body modeling system: Using smartphone cameras or ordinary depth sensors, multi-frame fusion technology is used to construct a three-dimensional model of the user and automatically identify body features;

[0027] (2) Intelligent fabric simulation engine:

[0028] It integrates a machine learning-based fabric physics engine to automatically simulate the drape, wrinkle effect, and dynamic movement characteristics of different fabrics based on a clothing material database.

[0029] (3) AR environment fusion technology:

[0030] The virtual clothing is visually integrated with the physical environment through SLAM (Simultaneous Localization and Mapping) technology, and multi-angle lighting compensation is supported to make the try-on effect realistic and natural.

[0031] (4) Personalized recommendation module:

[0032] Based on user body shape data, historical fitting records, and fashion trend analysis, the system intelligently recommends suitable styles and matching schemes.

[0033] (5) Cross-platform rendering optimization:

[0034] It adopts a tiered rendering strategy, using the lightweight ARCore / ARKit framework on mobile devices and supporting 4K-level ray tracing rendering on PCs to ensure a consistent experience across multiple devices.

[0035] Furthermore, the body shape features include shoulder width, waist circumference, leg length, etc.; the recognition accuracy is ±1cm.

[0036] Furthermore, the clothing material database includes materials such as cotton, silk, and polyester.

[0037] The present invention also claims a device for implementing a virtual fitting room for an online store based on AR technology, comprising: at least one memory and at least one processor;

[0038] The at least one memory is used to store a machine-readable program;

[0039] The at least one processor is used to call the machine-readable program to implement the above method.

[0040] The present invention also claims a computer-readable medium storing computer instructions that, when executed by a processor, implement the above-described method.

[0041] Compared with existing technologies, the AR-based virtual fitting room implementation method and system for online stores of the present invention has the following advantages:

[0042] This method primarily utilizes an augmented reality (AR)-based virtual fitting room system for online stores to enhance the user shopping experience, improve fitting efficiency, and reduce the pressure on physical store fitting rooms. It supports real-time rendering of tens of thousands of SKUs, enabling users to virtually try on clothes and reducing return and exchange rates. Attached Figure Description

[0043] Figure 1 This is a flowchart illustrating a method for implementing a virtual fitting room in an online store based on AR technology, according to an embodiment of the present invention.

[0044] Figure 2 This is a flowchart illustrating the specific implementation process of a virtual fitting room for an online store based on AR technology, provided by an embodiment of the present invention. Detailed Implementation

[0045] The present invention will be further described below with reference to specific embodiments.

[0046] This invention provides a method for implementing a virtual fitting room in an online store based on AR technology. The method includes:

[0047] Real-time high-precision 3D human body modeling based on ordinary cameras;

[0048] Intelligent fabric physics simulation incorporating machine learning algorithms;

[0049] Supports consistent rendering across multiple terminals and platforms;

[0050] Personalized clothing recommendations based on user body shape data.

[0051] Combined with appendix Figure 1 As shown, the specific implementation of this method is as follows:

[0052] (1) Adaptive human body modeling: Using smartphone cameras or ordinary depth sensors, multi-frame fusion technology is used to construct a user's 3D model and automatically identify body features;

[0053] (2) Intelligent fabric simulation: Integrating a fabric physics engine based on machine learning, automatically simulating the drape, wrinkle effect and dynamic swing characteristics of different fabrics based on the clothing material database.

[0054] (3) AR environment fusion: The virtual clothing and the physical environment are visually fused through SLAM (Simultaneous Localization and Mapping) technology, and multi-angle lighting compensation is supported to make the try-on effect realistic and natural.

[0055] (4) Personalized recommendations: Based on user body data, historical fitting records and fashion trend analysis, intelligently recommend suitable styles and matching schemes;

[0056] (5) Cross-platform rendering optimization: A hierarchical rendering strategy is adopted, using the lightweight ARCore / ARKit framework on mobile devices and supporting 4K ray tracing rendering on PCs to ensure consistent experience across multiple terminals.

[0057] The body features include shoulder width, waist circumference, and leg length; the recognition accuracy is ±1cm.

[0058] The clothing material database includes materials such as cotton, silk, and polyester.

[0059] This method targets e-commerce platforms and brick-and-mortar retailers, addressing the limitations of real-time virtual try-on in traditional online shopping and the limited fitting room resources in physical stores. Through technologies such as 3D human body modeling, real-time AR rendering, and intelligent fabric simulation, it achieves a realistic virtual try-on experience for users, supports access from multiple devices, significantly improves the shopping experience, and reduces return rates.

[0060] This invention also provides a virtual fitting room system for e-commerce based on AR technology, comprising:

[0061] A real-time high-precision 3D human body modeling subsystem based on ordinary cameras;

[0062] A smart fabric physics simulation engine that integrates machine learning algorithms;

[0063] Supports a consistent rendering architecture across multiple terminals and platforms;

[0064] A personalized clothing recommendation algorithm that combines user body shape data.

[0065] This system provides a high-precision, low-latency cross-platform virtual try-on system, enabling real-time 3D human body reconstruction based on ordinary cameras, intelligent fabric physics simulation algorithms, realistic material rendering in multi-light source environments, and supports access from multiple terminals including mobile devices, PCs, and AR glasses, thus enhancing the user's shopping experience.

[0066] This system, designed to create a virtual fitting room for the online store, includes the following:

[0067] (1) Adaptive human body modeling system: Using smartphone cameras or ordinary depth sensors, multi-frame fusion technology is used to construct a three-dimensional model of the user and automatically identify body features;

[0068] (2) Intelligent fabric simulation engine:

[0069] It integrates a machine learning-based fabric physics engine to automatically simulate the drape, wrinkle effect, and dynamic movement characteristics of different fabrics based on a clothing material database.

[0070] (3) AR environment fusion technology:

[0071] The virtual clothing is visually integrated with the physical environment through SLAM (Simultaneous Localization and Mapping) technology, and multi-angle lighting compensation is supported to make the try-on effect realistic and natural.

[0072] (4) Personalized recommendation module:

[0073] Based on user body shape data, historical fitting records, and fashion trend analysis, the system intelligently recommends suitable styles and matching schemes.

[0074] (5) Cross-platform rendering optimization:

[0075] It adopts a tiered rendering strategy, using the lightweight ARCore / ARKit framework on mobile devices and supporting 4K-level ray tracing rendering on PCs to ensure a consistent experience across multiple devices.

[0076] The body features include shoulder width, waist circumference, and leg length; the recognition accuracy is ±1cm.

[0077] The clothing material database includes materials such as cotton, silk, and polyester.

[0078] This invention also provides an AR-based virtual fitting room implementation device for an online store, comprising: at least one memory and at least one processor;

[0079] The at least one memory is used to store a machine-readable program;

[0080] The at least one processor is used to call the machine-readable program to implement the AR-based virtual fitting room implementation method for online stores as described in the above embodiments.

[0081] This invention also provides a computer-readable medium storing computer instructions. When executed by a processor, the computer instructions cause the processor to perform the AR-based virtual fitting room implementation method for an online store described in the above embodiments. Specifically, a system or apparatus equipped with a storage medium storing software program code that implements the functions of any of the above embodiments can be provided, and the computer (or CPU or MPU) of the system or apparatus can read and execute the program code stored in the storage medium.

[0082] In this case, the program code read from the storage medium can itself implement the function of any of the above embodiments, and therefore the program code and the storage medium storing the program code constitute part of the present invention.

[0083] Examples of storage media used to provide program code include floppy disks, hard disks, magneto-optical disks, optical disks (such as CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD+RW), magnetic tapes, non-volatile memory cards, and ROMs. Alternatively, program code can be downloaded from a server computer via a communication network.

[0084] Furthermore, it should be clear that not only can the program code read by the computer be executed, but also the operating system or other components operating on the computer can be instructed based on the program code to perform some or all of the actual operations, thereby realizing the function of any of the embodiments described above.

[0085] Furthermore, it is understood that the program code read from the storage medium is written to the memory set in the expansion board inserted into the computer or to the memory set in the expansion unit connected to the computer. Then, based on the instructions of the program code, the CPU or other components installed on the expansion board or expansion unit execute some and all of the actual operations, thereby realizing the function of any of the embodiments described above.

[0086] The present invention has been shown and described in detail above with reference to the accompanying drawings and preferred embodiments. However, the present invention is not limited to these disclosed embodiments. Based on the above embodiments, those skilled in the art will know that more embodiments of the present invention can be obtained by combining the code review methods in the different embodiments. These embodiments are also within the protection scope of the present invention.

Claims

1. A method for implementing a virtual fitting room in an online store based on AR technology, characterized in that, The implementation of this method includes: Real-time high-precision 3D human body modeling based on ordinary cameras; Intelligent fabric physics simulation incorporating machine learning algorithms; Supports consistent rendering across multiple terminals and platforms; Personalized clothing recommendations based on user body shape data.

2. The method for implementing a virtual fitting room for an online store based on AR technology according to claim 1, characterized in that, The specific implementation of this method is as follows: (1) Adaptive human body modeling: Using smartphone cameras or ordinary depth sensors, multi-frame fusion technology is used to construct a user's 3D model and automatically identify body features; (2) Intelligent fabric simulation: Integrating a fabric physics engine based on machine learning, automatically simulating the drape, wrinkle effect and dynamic swing characteristics of different fabrics based on the clothing material database. (3) AR environment fusion: The visual fusion of virtual clothing and physical environment is achieved through SLAM technology, supporting multi-angle lighting compensation; (4) Personalized recommendations: Based on user body data, historical fitting records and fashion trend analysis, intelligently recommend suitable styles and matching schemes; (5) Cross-platform rendering optimization: A hierarchical rendering strategy is adopted, using the lightweight ARCore / ARKit framework on mobile devices and supporting 4K ray tracing rendering on PCs to ensure consistent experience across multiple terminals.

3. The method for implementing a virtual fitting room in an online store based on AR technology according to claim 2, characterized in that, The body features include shoulder width, waist circumference, and leg length; the recognition accuracy is ±1cm.

4. The method for implementing a virtual fitting room for an online store based on AR technology according to claim 2, characterized in that, The clothing material database includes cotton, silk, and polyester materials.

5. A virtual fitting room system for an online store based on AR technology, characterized in that, include: A real-time high-precision 3D human body modeling subsystem based on ordinary cameras; A smart fabric physics simulation engine that integrates machine learning algorithms; Supports a consistent rendering architecture across multiple terminals and platforms; A personalized clothing recommendation algorithm that combines user body shape data.

6. The AR-based virtual fitting room system for online stores according to claim 1, characterized in that, This system, designed to create a virtual fitting room for the online store, includes the following: (1) Adaptive human body modeling system: Using smartphone cameras or ordinary depth sensors, multi-frame fusion technology is used to construct a three-dimensional model of the user and automatically identify body features; (2) Intelligent fabric simulation engine: It integrates a machine learning-based fabric physics engine to automatically simulate the drape, wrinkle effect, and dynamic movement characteristics of different fabrics based on a clothing material database. (3) AR environment fusion technology: The SLAM technology enables the visual fusion of virtual clothing with the physical environment, supports multi-angle lighting compensation, and makes the try-on effect realistic and natural. (4) Personalized recommendation module: Based on user body shape data, historical fitting records, and fashion trend analysis, the system intelligently recommends suitable styles and matching schemes. (5) Cross-platform rendering optimization: It adopts a tiered rendering strategy, using the lightweight ARCore / ARKit framework on mobile devices and supporting 4K-level ray tracing rendering on PCs to ensure a consistent experience across multiple devices.

7. The AR-based virtual fitting room system for online stores according to claim 1, characterized in that, The body features include shoulder width, waist circumference, and leg length; the recognition accuracy is ±1cm.

8. The AR-based virtual fitting room system for online stores according to claim 1, characterized in that, The clothing material database includes cotton, silk, and polyester materials.

9. A device for realizing a virtual fitting room in an online store based on AR technology, characterized in that, include: At least one memory and at least one processor; The at least one memory is used to store a machine-readable program; The at least one processor is configured to invoke the machine-readable program to implement the method according to any one of claims 1 to 7.

10. A computer-readable medium, characterized in that, The computer-readable medium stores computer instructions that, when executed by a processor, implement the method described in any one of claims 1 to 7.

Images