Mobile virtual clothing try-on system

Abstract

The present invention is a technology that allows users to virtually try on clothes and accessories on themselves without entering fitting rooms. This system operates via mobile devices and provides accurate clothing size recommendations based on personal body measurements. The system includes image capturing devices represented by a camera and connection diagram (4) for scanning the user and clothing items, warmled infrared (5) and light detection and ranging (Lidar) sensors (6) developed to enhance the quality of data obtained from said image capturing devices and capture precise body dimensions and movements, a computer unit (3) with a compact processor for processing the obtained data, an LCD screen mechanism (8) for display and user interaction, and at least two transformers (1, 2) to supply power to said components. Through this system, users can avoid issues such as going to stores, size mismatches, extra shipping costs, and the risk of infection during trials, seeing the desired clothes on themselves.

Description

[0001] DESCRIPTION

[0002] MOBILE VIRTUAL CLOTHING TRY-ON SYSTEM

[0003] TECHNICAL FIELD

[0004] The present invention relates to virtual reality and augmented reality technologies. Specifically, the invention pertains to a system and method that allows users to virtually try on clothes and accessories using digital image processing technology via mobile devices without the need for physical fitting rooms.

[0005] BACKGROUND ART

[0006] In the traditional shopping process, customers select various clothes in a store and try them on in fitting rooms to find the most suitable size. This process not only takes time but also brings disadvantages such as size mismatches and hygiene issues. It is inevitable that customers encounter clothes tried by many others, which raises health concerns.

[0007] Recently, interest in digital solutions to replace this traditional method has been continuously increasing. Due to the negative aspects of physical clothing trials, customers are turning to virtual fitting rooms and online size matching services. These digital solutions, together with machine learning, artificial intelligence, and augmented reality technologies, promise a more efficient and hygienic shopping process, offering users a more comfortable and easier experience.

[0008] The existing technologies that enable virtual clothing trials integrated into e-commerce platforms and in-store kiosks, such as augmented reality fitting rooms and 3D clothing simulation, face challenges such as practical use, affordability of hardware and software costs, realism and accuracy, and / or complexity of user interfaces, which can hinder widespread adoption.

[0009] Patent application US20230388446A1 mentions a device and method providing a virtual try-on image. This device includes a camera interface connected to a camera photographing the user, a display interface connected to a display device, and a processor. The processor generates data representing the user's pose, selects an appropriate pose image, synthesizes the user object in this image with the clothing object, produces a virtual try-on image, and displays it on the display device through the display interface. Patent application US2022258049A1 discloses an augmented reality (AR) and artificial intelligence (Al)-based interactive virtual try-on system offering real-time virtual clothing try- on, fit, and modular adjustments. Here, a user with a mobile device can define retail adjustments on virtual clothing using an AR-based visual interface.

[0010] Utility model application TR2021 / 003475 describes a virtual cabin system in the shopping sector that allows the selection of appropriate clothes and shoes for the user's body using 3D camera sensors and thermal sensors without physically going to the store. Another utility model application, TR201 1 / 05298, reports a virtual dressing system allowing brides-to-be who come to the store to see the wedding dress models they desire on themselves in motion. This system describes the transfer of the dress recorded in the photo shooting unit to an interface, the transmission of the image of the individual detected for body movements and form by the camera to the interface via the data line, and the placement of products such as the dress obtained in the photo shooting unit on the processed image of the individual on the interface.

[0011] The Mixed Reality Mirror released by Amazon provides a mixed reality dressing experience by combining real-time images with virtual clothing and adjustments.

[0012] In terms of previous technical applications, comprehensive body scanning for a completely accurate and realistic representation of clothes on different body types, including different sizes, shapes, and personal styles, personalized suggestions, and affordability issues are still questioned. Additionally, ensuring accessibility and user-friendliness without requiring complex and user-unfriendly special conditions or equipment for such virtual systems and seamless integration with online and retail environments is critically important.

[0013] Consequently, there remains a need for innovative structures and systems offering advantageous solutions focusing on improving realism, personalization, and inventory management while seamlessly integrating with retail systems. This can also reduce returns due to poor fit or dissatisfaction by providing customers with a more intuitive and satisfactory shopping experience.

[0014] BRIEF DESCRIPTION OF THE INVENTION

[0015] The main purpose of the present invention is to provide a system that allows users to try on clothes and accessories without the need for physical fitting rooms. Another purpose of the invention is to offer accurate clothing size recommendations based on the user's personal body measurements.

[0016] Another purpose of the invention is to reduce common shopping problems such as size mismatches, return rates, shipping costs, and the inconvenience of physical store visits.

[0017] Another purpose of the invention is to minimize the health risks associated with traditional shopping environments.

[0018] Another purpose of the invention is to enhance the efficiency and enjoyment of the shopping experience by integrating advanced technologies such as augmented reality, body scanning, and artificial intelligence into an accessible device.

[0019] To overcome the problems reported in the prior art and achieve the aforementioned purposes, the present invention provides a mobile virtual clothing try-on system that allows users to virtually try on clothes and accessories on themselves through mobile phones without entering physical fitting rooms, regardless of location, thus providing high added value in the retail and fashion industry.

[0020] This unique system integrates hardware components such as cameras, sensors, and display panels with advanced software algorithms and artificial intelligence / machine learning to analyze users' body measurements and place selected clothing items on users' images or digital avatars.

[0021] The system automatically recognizes the person displayed on the camera and performs real-time calculations of all body measurements, such as shoulder, chest, waist, length between waist and shoulder, length between waist and feet, arm diameter, and arm length. Based on the selected clothing model and previously entered body measurements, it calculates which size the user can take or how well the selected size will fit, and informs the user accordingly. Compatible data based on the selected material is instantly displayed on the user in the form of a virtual try-on with the help of image matching and artificial intelligence.

[0022] By eliminating the need for physical contact and reducing or ending the time spent in stores, the present invention provides a device aimed at making the shopping experience more efficient, personalized, and safe. The system bridges the gap between online and in-store shopping, offering a seamless and interactive application experience. The system surpasses traditional virtual try-on solutions by successfully combining advanced detection technologies such as IR and Lidar sensors and lighting systems like WarmLed, ensuring the capture of user body measurements with greater accuracy compared to common errors in existing technologies.

[0023] Moreover, the system includes a specially selected compact computer unit capable of rapidly processing complex algorithms, significantly improving the user experience by providing real-time feedback. The integration of innovative approaches such as QR Code and Barcode Readers for clothing selection also ensures a smooth and efficient shopping experience.

[0024] The system uses a personalized, accessible, and user-friendly interface for each individual user. This accessibility distinguishes the system from currently available more complex or user-unfriendly solutions.

[0025] In conclusion, the synergy and holistic unique structure between the components and software of the present invention provide a more accurate, efficient, and user-friendly solution compared to existing technologies, offering significant improvement in virtual retail and personal shopping with a system representing its operation and ultimately providing an easy-to-use, accessible device.

[0026] BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 is a schematic view of the components within the mobile virtual clothing try-on system according to the invention. Figures 2 and 3 show schematic views of the mobile virtual clothing try-on devices according to second and third embodiments of the invention.

[0028] List of Reference Numbers:

[0029] 1. 12V Transformer

[0030] 2. 5V Transformer

[0031] 3. Central Processing Unit (Computer)

[0032] 4. Camera and Connection Diagram

[0033] 5. IR sensor

[0034] 6. Detection and Distance sensors

[0035] 7. LCD Screen Connection Cable

[0036] 8. LCD Panel

[0037] 9. 220V AC Power Line 10. QR Code Reader

[0038] 1 1 . Barcode Reader

[0039] DETAILED DESCRIPTION OF THE INVENTION

[0040] Figure 1 shows the mobile virtual clothing try-on system and the layout of the components within a device suitable for this arrangement according to the invention. To provide a realistic and effective virtual clothing try-on experience, the main components of the device include transformers (1 , 2) for power distribution, Camera and Connection Diagram (4) for capturing user images, and a computer (3) serving as the central processing unit with an algorithm that automatically calculates the obtained body measurements using artificial intelligence.

[0041] At the same time, it also shows the layout of IR and Lidar Sensors (5-6) for accurate body scanning, LCD Screen Connection Cable (7), and LCD Panel (8) for displaying virtual try- on results. Additional elements include a 220V AC Power Line (9) for the main power source and QR Code Reader (10) and Barcode Reader (11 ) for scanning and inputting clothing items into the system.

[0042] The core of the system is a compact processor, i.e., a computer unit (3). This unit processes users' body measurements, interacts with the clothing database to provide suitable clothing recommendations, and processes camera images to enable virtual clothing try-ons. Here, a computer with a 28nm-based 1.5G Quad-Core CPU and 4Gb DRR4 RAM, for example, 4K Micro HDMI, USB 3.0, BLE Bluetooth 5.0, dual-band 2.4 / 5.0 GHz Wireless LAN, USB- C power input, and PoE-compatible True Gigabit Ethernet, is preferred to obtain PC-like capabilities. Examples of such compact computers include, but are not limited to, Raspberry Pi 4GB, Arduino, or BeagleBone.

[0043] The system also includes image capture devices represented by Camera and Connection Diagram (4) to scan the user and clothing items. The camera captures the images of the users, and these images are transmitted via the connection diagram to be analyzed by the Raspberry Pi. The body measurements of the users are calculated from these images. This arrangement can also be configured to include different types of cameras or sensors such as depth cameras or 3D scanners to improve measurement and fitting accuracy.

[0044] The system integrates sensing and imaging technologies to perform detection and interaction by capturing precise body dimensions and movements using infrared (IR) and Light Detection and Ranging (Lidar) sensors (5, 6). Here, preferably IR and WarmLed Lidar Sensors are used. These sensors precisely determine the user's dimensions and position, making clothes appear more realistic when virtually tried on. This ensures that the necessary high-quality and accurate image is obtained by averaging the light level in areas with low light or bright reflection.

[0045] The system includes two different transformers to provide power to various components according to voltage requirements. The 12V Transformer (1 ) provides energy for components requiring higher power, while the 5V Transformer (2) is used for those with lower power requirements, increasing energy efficiency and ensuring components operate with the correct voltage. Here, alternative voltage transformers or power supply units can also be used according to hardware specifications.

[0046] The system includes an LCD screen mechanism (LCD Panel) (8) connected via an LCD Screen Connection Cable (7) for simultaneous display and user interaction. For different user experiences or space constraints, this setup can be replaced or complemented with OLED screens or projection systems.

[0047] The user interface of the system is designed for simplicity and ease of use, allowing customers to select clothes through a touch screen or mobile application. Additionally, the system includes user interface devices such as QR Code Reader (10) and Barcode Reader (11 ), enabling users to easily input and scan their selected clothes into the system, making it possible to quickly try on clothes virtually while shopping in-store or online, thus improving the shopping experience. Here, optionally, NFC readers or touch screen interfaces providing flexibility for users to interact with the system and select items for try-on can be included.

[0048] Each component in the mobile virtual clothing try-on system plays a critical role. In a preferred embodiment, the 12V T ransformer (1 ) and 5V T ransformer (2) ensure that all parts receive the necessary power levels for optimal functionality. The Raspberry Pi 4GB (3), serving as the brain of the system, processes images and sensor data to create a personalized virtual try-on experience. The Camera and Connection Diagram (4) capture the user's image, which is then analyzed with data from the IR Sensors (5) and WarmLed Lidar Sensors (6) to accurately map the user's body measurements. This detailed information ensures the clothing fits precisely. The LCD Screen Connection Cable (7) facilitates the display of these virtual fittings on the LCD Panel (8), allowing users to see how selected clothes fit on their avatars. The power requirements of the system are managed by the 220V AC Power Line (9), ensuring stable and reliable performance. Finally, the QR Code Reader (10) and Barcode Reader (1 1 ) streamline the clothing selection process, enabling users to easily scan and try on various clothing items virtually. The comprehensive integration of hardware and software components results in a highly effective and user-friendly virtual clothing try-on system.

[0049] Regarding the operation of the system, said compact computer (3) serves as the central processing unit (CPU) responsible for analyzing data collected from cameras or depth sensors, referred to as Camera and Connection Diagram (4). The compact computer (3) processes this data to create accurate digital representations of the user's body, such as a detailed three-dimensional avatar, necessary for virtual clothing placement. Selected clothes are virtually placed using advanced algorithms simulating the drape and fit of the clothing on different body types.

[0050] The system operation begins with the user standing in front of the camera setup. IR Sensors (5) and WarmLed Lidar Sensors (5-6) equipped with advanced imaging technology scan the user's body to collect precise measurements. This data is directly transmitted to the compact computer (3) through known wired or wireless units from the prior art, which then calculates the user's size and shape based on the obtained measurements.

[0051] After processing the user's body data, the compact computer (3) matches this information with the sizes of the selected virtual clothing. The software within the compact computer (3) uses algorithms to adjust the clothing items to fit the user's image or digital avatar, ensuring a realistic and accurate fit.

[0052] The user interface supported by devices such as the QR Code Reader (10) and Barcode Reader (1 1 ) allows users to effortlessly select clothes. Once a clothing item is selected, the system places the virtual item on the user's image or avatar displayed on the LCD Panel (8), providing a realistic representation of how the clothing will look on the user.

[0053] The seamless integration of hardware and software components ensures that the virtual clothing try-on system delivers a user-friendly, accurate, and effective virtual application experience. Thus, the system simplifies the shopping process by reducing the need for physical trials and offering convenience and personalized options to the user.

[0054] Figures 2 and 3 show schematic views of the mobile virtual clothing try-on device according to second and third embodiments of the invention. Here, QR and barcode recognition systems are optionally displayed. According to a second approach of the invention, a method for virtual clothing try-on using the mobile virtual clothing try-on system is reported. This method can be constituted by the following steps according to need and demand:

[0055] User Detection: When a user approaches the system, sensors detect their presence and initiate the try-on process.

[0056] Clothing Selection: The user selects the clothes to try on using the activated interface; this stage may involve scanning barcodes and / or QR codes for the relevant clothing or selecting items presented in the digital catalog on the touch screen.

[0057] Body Scanning: IR and Lidar sensors scan the user's body and capture detailed measurements to be processed by the compact computer (3).

[0058] Data Processing: The Raspberry Pi processes the body measurements and selected clothing data.

[0059] Virtual Try-On: The system virtually adjusts the selected clothing items on the user's body dimensions displayed on the LCD panel.

[0060] Display Result: The final representation of the virtual try-on displayed on the LCD Panel.

[0061] User Interaction: Throughout the process, users interact with the system through a user- friendly interface, providing feedback, making selections, and personalizing their experience.

[0062] In summary, this method initially detects users as they approach, and the interface is activated for clothing selection. The user can select clothing by scanning QR codes or interacting with the digital catalog on the touch screen. This initiates the body scanning stage, where IR and Lidar sensors accurately capture the user's dimensions necessary for the virtual application process.

[0063] Next, the computer processes the captured body data to align-match the selected clothing items with the user's dimensions. It calculates how each item should be adjusted to fit the user's unique measurements. This includes advanced algorithms that ensure the virtual clothing fits the user's body in terms of size, shape, and drape.

[0064] Finally, the virtual try-on showing how the selected clothing will look on the body is displayed on the LCD panel. The final simulation displayed on the LCD panel shows the user how the selected clothes will look on their body from various angles and in different environments, enhancing the decision-making process and significantly improving the shopping experience. This stage is interactive, allowing users to change items, styles, or adjust sizes in real-time based on feedback. The user interface of the system provides ease of use, enabling consumers to navigate different options effortlessly and make informed decisions about clothing choices without needing physical trials.

[0065] The virtual clothing try-on system of the invention can find applications in various environments. For instance, it enhances retail and e-commerce platforms by enabling virtual trials, thereby reducing physical interaction and inventory usage. This leads to a significant reduction in product return rates due to better size matching and satisfaction with the fit. Additionally, it saves time for both consumers and businesses by simplifying the shopping process. Personalized shopping experiences are enriched with personalized equipment and style suggestions catering to individual preferences and body types, making shopping more efficient and enjoyable.

[0066] The system of the invention significantly enhances the accuracy of virtual trials compared to existing solutions by using advanced body scanning technologies to capture precise user measurements. The data processed with algorithms supported by artificial intelligence and machine learning shows the user the most suitable size and how the outfit will look on them.

[0067] Moreover, by reducing the need for store visits and physical contact, the system minimizes health hazard risks, contributing to addressing health safety concerns in today's society, which is increasingly health-conscious, especially post-pandemic.

[0068] Although specific examples and applications of the present invention have been described herein, it is evident that various other changes and modifications can be made by those skilled in the art without departing from the essence and scope of the invention. Therefore, the appended claims ensure that such changes and modifications are also included within the protection scope without departing from the essence and scope of the invention.

Claims

CLAIMS1 . A mobile virtual clothing try-on system, characterized by comprising image capturing devices represented by a camera and connection diagram (4) for scanning the user and clothing items, infrared (IR) and light detection and ranging (Lidar) sensors (5, 6) for capturing precise body dimensions and movements, a computer unit (3) with a compact processor and artificial intelligence algorithm for processing the obtained data, an LCD screen mechanism (8) for display and user interaction, and at least two transformers (1 , 2) to supply power to said components.

2. A system according to claim 1 , further characterized by comprising a QR code reader (10) and / or a barcode reader (11 ) which allows users to select clothing items for virtual try-on.

3. The system according to claim 1 , further characterized by comprising an LCD screen connection cable (7) for connection to said LCD panel (8).

4. The system according to claim 1 , further characterized by comprising a 220V AC power line (9) for power supply.

5. The system according to claim 1 , further characterized by comprising said light detection and ranging sensors (6) with Warmled Lidar sensors.

6. The system according to claim 1 , further characterized by comprising said computer unit (3) containing a Raspberry Pi 4GB compact processor processing users' body measurements, interacting with the clothing database to provide suitable clothing recommendations, and processing camera images to enable virtual clothing try-on.

7. The system according to claim 1 , further characterized by comprising said transformers as a 12V transformer (1 ) and a 5V transformer (2) to supply differentiated power to the system components according to operational voltage requirements.

8. The system according to claim 1 , further characterized by comprising said image capturing devices (4) with high-resolution depth cameras or 3D scanners.

9. The system according to claim 1 , further characterized by comprising said screen mechanism (8) with OLED screens or projection systems.

10. The system according to claim 1 , further characterized by comprising a user interface allowing customers to select clothing through a touch screen or mobile application for simplicity and ease of use.

11. The system according to claim 1 , further characterized by comprising algorithms supported by artificial intelligence and machine learning.

12. A method for virtual clothing try-on using the mobile virtual clothing try-on system according to any of the preceding claims, characterized by comprising the following steps: capturing an image of a user using an image capturing unit (4); scanning the user's body dimensions using a set of body measurement sensors (5, 6) including infrared and light detection and ranging sensors; processing the captured image and body dimensions using a central processing unit (3) to place the selected virtual clothing items on the user's image; and displaying the obtained virtual try-on image on a display unit (8) such as an LCD panel.

13. The method according to claim 12, further characterized by comprising the step of increasing the accuracy of body dimension scanning using Warmled Lidar sensors (6).

14. The method according to claim 11 , further characterized by comprising the step of selecting virtual clothing items for try-on by scanning identifiers using a QR code reader and a barcode reader.

15. The method according to claim 12, further characterized by comprising the step of selecting virtual clothing items for try-on by selecting items presented in a digital catalog on a touch screen.

16. The method according to claim 12, further characterized by comprising the step of adjusting virtual clothing items based on real-time user interactions to simulate different styles or patterns.

17. The method according to claim 12, further characterized by comprising the step of power management by distributing power to system components using a 12V transformer (1 ) and a 5V transformer (2) according to operational voltage requirements.

Images