Virtual testing application for advancing sustainability in design and production of jewelry and luxury products based on ai and ar

Abstract

This invention is an application based on artificial intelligence and augmented reality that helps people try accessories, jewelry, and watches before ordering and paying for them, so the sellers and designers will not waste any materials, and (1) there will not be any returns and loss of time for both seller and buyer thus it reduces the need to stock which (2) results in advancing sustainability in luxury products. It has the feature of measuring and calculating the sizes of fingers and wrists of the hands and also the neck, when the user is buying a product, by preparing the 3D file of it from the website or anywhere, the user can open it and by giving camera access to the program, the camera proceeds and the product appears on the screen so the user can fix it on any part of the body and observe it from any view.

Description

Virtual Testing Application for Advancing Sustainability in Design and Production of Jewelry and Luxury Products based on AI and AR

[0001] In this modern age that we live in, shopping is a must because our needs grow daily and as technology develops, the shopping process improves too. People always seek quality and cannot afford much time for it since life gets busier. So having technology by their side to experience a comfortable shopping process is necessary for them, especially when buying clothes or any wearable products from websites or choosing them from catalogs and trying them on their bodies before shopping. Knowing sizes is necessary and fixating it with the body and its parts while we need to first determine about it before ordering it and also not to waste any material, money, and time most importantly when we try to order some exclusive product based on our needs and personal comments. Designers and sellers need this technology too so in this invention, artificial intelligence and Augmented reality came together to solve these problems and give a comforting experience of shopping to both the sellers and buyers.

[0002] This invention incorporates a sustainable development concept into (1) design, the production cycle, and the shopping process by reducing waste of material, money, time, and cost according to (2) the interaction between the user and product provider.

[0003] G05D 101 / 00 - A44C 27 / 00

[0004] KR1020080102789

[0005] VIRTUAL MIRROR DISPLAYING AN IMAGE WHOSE LEFT AND RIGHT ARE SWITCHED WHEREIN THE IMAGE IS A TARGET OBJECT IN WHICH A VIRTUAL PRODUCT IS WORN

[0006] A virtual mirror is provided to enable a customer to wear a product which the user doesn't buy or design and see the product result of the design even though the product does not exist. CONSTITUTION: A virtual mirror includes a camera apparatus(2), an image synthesizer(3) and a display apparatus(4). A camera apparatus 3D motion tracks a target object in an apparatus which displays an image whose left and right are reversed in real time by using an enhancing reality technique wherein the image is the target object in which a virtual product is worn. An image synthesizer synthesizes a virtual product image and an actual image input from the camera apparatus. A display apparatus displays an enhanced image input from the image synthesizer by an image whose left and right are switched.

[0007] The mentioned invention is a device while our claimed patent is an application that can be downloaded and installed on devices.

[0008] EP2046223

[0009] VIRTUAL PENETRATING MIRROR DEVICE FOR VISUALIZING VIRTUAL OBJECTS IN ANGIOGRAPHIC APPLICATIONS

[0010] A virtual mirror device for visualizing virtual objects in angiographic applications, having an interactive virtual mirror, a 3D or 4D medical image of a patient's anatomy co-registered with a calibrated 2D X-ray image of the patient's anatomy, and a displaying device provided such that the 2D X-ray image of the patient's anatomy, the co-registered 3D or 4D medical image of the patient's anatomy and the interactive virtual mirror viewed from the viewpoint of the X-ray source of the X-ray imaging system, are presented in a common coordinate system, providing full integration and combined visualization of the reconstruction of 3D or 4D medical image of the patient's anatomy, the 2D X-ray image of the patient's anatomy and the virtual mirror onto the displaying device.

[0011] The mentioned invention virtualizes objects like ours but our claimed patent opens 3D files of jewelry while the mentioned device shows blood vessels.

[0012] EP2046224

[0013] VIRTUAL PENETRATING MIRROR DEVICE FOR VISUALIZING OF VIRTUAL OBJECTS WITHIN AN AUGMENTED REALITY ENVIRONMENT

[0014] A virtual penetrating mirror (1) for visualizing at least one virtual object (5) within an augmented reality environment, with a tracking system (4) and a displaying device (3), is provided by means of visualizing an image of at least one virtual mirror, an image of the at least one virtual object and an image (16) of the virtual object reflected by the virtual mirror on the display (2). The virtual mirror (1) is movable by means of a tracked interaction device (11). The image of the virtual object reflected by the virtual mirror on display is displayed in-situ. The virtual mirror is able to reflect surfaces, rendered volumes and digitally reconstructed radiograph images. The virtual mirror is able to provide images of the virtual object reflected by the virtual mirror on display, in real time, whereby the virtual mirror or the virtual object or both of them are in movement with or without a varying view point (31). The virtual object with the related image of the virtual object reflected by virtual mirror on display is aligned and superimposed onto a real-time image of a real surrounding body (6).

[0015] This mentioned invention is similar to ours but we also used artificial intelligence in addition to augmented reality to vast the abilities of our application which exclusively functions for jewelry.

[0016] CN112116430

[0017] Virtual wearing system, control method thereof, virtual fitting system and virtual wearing mirror

[0018] The invention discloses a virtual wearing system, a control method thereof, a virtual fitting system and a virtual wearing mirror. The virtual wearing system comprises at least one virtual wearing mirror; the virtual wearing mirror comprises a mirror surface display device and a bottom plate device; the mirror surface display device at least comprises an image display device; the image display device at least comprises an image display area and a touch screen control area; a camera module arranged on the bottom plate device and a scanning module arranged on the mirror surface display device are used for measuring body type data of a user; and the virtual wearing system further comprises a virtual wearing server which is connected with the at least one virtual wearing mirror, and feeds backa figure image of try-on clothes to the image display device after receiving the body shape data of the user and the parameters of the clothes to be worn. In the prior art, when a user purchases clothes, the picture provided by a merchant is greatly different from the figure of the user, the user is likely to change the commodity, and the shopping interest of the user is influenced. With the virtual wearing system, control method thereof, the virtual fitting system and the virtual wearing mirror of the invention adopted, the above technical problems can be solved.

[0019] This invention is similar to ours but it is a device and our claimed patent is an application, also our claimed patent measures the sizes with artificial reality, so their methods are different.

[0020] MYPI 2013700207

[0021] AUGMENTED REALITY SYSTEM AND METHOD FOR A VIRTUAL MIRROR APPLICATION

[0022] THE PRESENT INVENTION PROVIDES A SYSTEM FOR AN AUGMENTED REALITY ?VIRTUAL MIRROR? APPLICATION THAT INCORPORATES THE USE OF A USER?S VOICE AND GESTURE TO CONTROL VARIOUS AUGMENTED REALITY (AR) FUNCTIONS. THE SYSTEM (200) OF THE PRESENT INVENTION FURTHER INCLUDES THE FUNCTIONALITY OF AUTHENTICATING A NETWORK USER ACCESS. THE VOICE CONTROL FUNCTIONALITY ENABLES A USER (10) TO CONTROL, ORIENTATE AND INTERACT WITH RENDERED AUGMENTED REALITY (AR) CONTENT USING SPECIFIC INTELLIGENT VOICE COMMANDS WHILE THE GESTURE CONTROL FUNCTIONALITY ON THE OTHER HAND ENABLES A USER (10) TO CONTROL, ORIENTATE AND TO INTERACT WITH RENDERED AR CONTENT USING SPECIFIC PHYSICAL GESTURES BY THE HUMAN BODY, I.E. THE USER?S SPECIFIC BODY PARTS (10A, 10B).

[0023] This application is controlled by the user’s voice but our claimed patent is controlled only by touching.

[0024] BG3999

[0025] AUGMENTED REALITY THREE-DIMENSIONAL VIRTUAL MIRROR

[0026] The augmented reality 3D virtual mirror comprises the following elements: Element 1: Databases with information from the virtual environment: - list of goods available online; - list of companies - producers and traders in the respective product area; Element 2: A device on which software is installed (it can be a mobile phone, tablet, computer, augmented reality glasses / AR / , projector, processor with three-dimensional / 3D / laser virtual projection, etc.); Element 3: Software application with option for: - virtual disguise 3D and AR; - virtual scanning through a kinetic camera and processing of user data; - synthesis of preferences and processing of any kind of useful information for and by consumers and traders; - image processing from two-dimensional to three-dimensional; Element 4: Hardware containing: - Processor; - Kinetic camera; - Possibility for wireless and wired connection; Element 5: Augmented reality glasses. Through a built-in / installed system for connectivity and data transmission connection (wirelessly, wired, etc.) the elements communicate with each other for active dynamic exchange of information and data.

[0027] Our claimed invention and this one both work with 3 dimensional files and augmented reality but their methods are different because this patent processes images but our patent displays it for the users to try it.

[0028] United States Patent 11151019

[0029] Method and system for dynamically testing a product and process in a virtual testing environment

[0030] Systems and methods for dynamically testing product and process of production environment in virtual testing environment are disclosed. A testing system may retrieve production data related to each production activity corresponding to events executing in real-time. Each production activity is related to product and process of production environment. Further, testing system generates each scenario of production environment in virtual testing environment in real-time, based on sequencing of each event and creates, in the virtual testing environment, virtual process and virtual product corresponding to process and product of production environment, based on at least the events, generated scenarios, and historical data. Finally, testing system re-plays each production activity in virtual testing environment for testing virtual process and virtual product. The method may comprise testing using real-time scenarios of production environment, allowing a user to view testing process and perform selective actions while testing.

[0031] The mentioned system is not an application and not exclusively designed for a certain product while our claimed invention is for accessories and uses AI and AR.

[0032] An AI and AR-based application allows virtual testing of jewelry, accessories, and watches, enabling users to measure sizes and try products before online shopping. The "My Size" slide offers options to measure hand and neck sizes, with instructions on how to take photos for accurate measurements. Users can then view the sizes calculated by AI and use them for online orders. The application requires a 3D file of the products to try them virtually. By opening the file, users can adjust the size and position of the product on their body, with options to record videos, take pictures, and access measured sizes. The app also allows users to rotate the camera and edit the product's placement. Additional features include information about the application and choices such as "Open File," "About app," and related tutorials.

[0033] Nowadays online shopping is one of the most important ways for people to shop and it benefits their time, it is also crucial that the customers do their shopping with more relief and confidence, and since their time matters to them, the product they buy is better to have decent size and mount they want so that they do not have to return it or waste their money.

[0034] In the field of jewelry, customers need to know the size of their fingers, hands, and neck because, in online shopping, they do not have this chance to wear the product and try it before buying it, and can only see its pictures, and they cannot be sure about the proper size of it.

[0035] Also, there are times when people want to order something exclusively designed for themselves, and to be in touch with the designer, to not waste any material, the designers first design a three-dimensional file of the product and the customer needs to try it and give it a good comment.

[0036] On the other hand, when the sellers and designers have some products to offer to people and they still did not produce them but merely have the design of it, it is better for the customers to first try the product before finalizing their shopping.Solution of Problem

[0037] The implemented technologies:

[0038] Artificial Intelligence

[0039] This innovative application uses deep learning and machine vision to process images. To get the right results our AI algorithms require sufficient data to learn from and also use tasks like pattern recognition, object detection, and image segmentation to process images and machine learning happens through the training process.

[0040] Augmented Reality

[0041] This application uses a combination of different Augmented Reality technologies to combine virtual information with the real world like SLAM(Simultaneous location and mapping), depth tracking, and image processing which allows the application to bring rendered digital content to our physical spaces and creates an immersive experience.

[0042] The primary steps:

[0043] First, we download the software from the internet and then install it on any device.

[0044] The first time we opened the program, we allowed it to access our camera and gallery.

[0045] Then the next step is to measure the sizes of the left and right hand’s fingers, wrist, and also around the neck, there are four options on this “My Size” page, which are:

[0046] - determining the size of the right-hand

[0047] - determining the size of the left-hand

[0048] - determining the round of the neck’s size

[0049] - measuring later

[0050] By clicking each option, for example, the first one which measures the right hand, another page comes up on which there is a picture of a hand, and the user by clicking on each finger and also the wrist, the camera opens and measures the intended part. While the camera is activated, a horizontal line appears on the screen, and it gets placed on the exact area we want to measure. Two pictures are required for the exact measurement, one is from the above and another is from the side. The user shows his or her finger in front of the camera, the horizontal line gets placed on the finger and the user takes the picture, then the user rotates his or her finger 90 degrees and takes the second shot. The program calculates the sizes automatically. Measuring the size of the wrist is also the same. For the neck, the first picture has the same process as the mentioned ones, the horizontal line must be placed in the middle of the neck, and for the next frame, the user needs to rotate the camera 90 degrees to take the demanded image.

[0051] After taking all the pictures and the program’s automatic calculations with the help of Artificial Intelligence, the next slide appears and shows all the pictures with their related sizes written on them in millimeters; additionally, the user can edit and replace the images whenever he or she wants. During these steps, there is an option shown as i that can show the tutorial on how the user can take the required images.

[0052] Also, the last option of measuring later brings the user to the main page.

[0053] How the program works:

[0054] There are two ways to use this software:

[0055] 1- one way is to have the three-dimensional file of the intended product already in the device, open the program, and by the option Open, choosing the file, it will be displayed on the activated camera. (the rest is explained in the following)

[0056] 2- Another way is when we purchase from an online shop. Before finalizing the process, we download the 3D file of the product, click the share option, and choose the claimed application.

[0057] After both mentioned steps, the front camera gets activated anyway and the product appears on the screen by Augmented Reality and can move with the user’s touch also its size can get bigger or smaller due to the user’s intended area, for example, if it is a necklace, the user fixates it on his or her neck. There is a Fix option at the bottom of the screen and by clicking on it, the product will not move even if the user moves the camera in any direction. Even the back of the product and all the aspects of it can be seen.

[0058] There is an option to reverse the camera and give the device to another person to take shots and record videos of the person who wants to buy the product. The chance to record videos and take photos is available at any level.

[0059] After tapping on the Fix option, the Edit option appears, allowing users to change the location or size of the product.

[0060] This application can display and support all three-dimensional files so the users will feel free to display any product that the users want to have but still have not bought or they tend to order it to be designed and made because of this the artificial reality feature of the program.Advantage Effects of the Invention

[0061] • An assured experience of online shopping for customers

[0062] • Preventing loss of time and money due to returning the product

[0063] • Having the sizes of the various parts of the body for buying anytime

[0064] • The chance of ordering an exclusive and specific product according to the customer’s sizes and determined comments on the primary designed 3D file.

[0065] • A good chance for sellers and designers to communicate with their customers with their designed 3D files before making the final products for them.

[0066] Shows the “My Size” slide.

[0067] Shows the slide related to measuring the sizes of the hands.

[0068] Shows the screen on which the camera is activated to measure the sizes.

[0069] Shows the main slide of the application.

[0070] Shows the “My Size” slide on which its options are displayed:

[0071] 1- My Size sign

[0072] 2- The opening and guiding sentence says that the users can measure the sizes of their both hands with their fingers and wrists by choosing the options below:

[0073] 3- Measuring the size of the fingers and wrist of the right hand

[0074] 4- Measuring the size of the fingers and wrist of the left hand

[0075] 5- Measuring the size of the neck

[0076] 6- Measuring later

[0077] Shows the slide related to measuring the sizes of the left hand.

[0078] 7- Clicking on each finger to measure it.

[0079] 8- Clicking on the wrist to measure it.

[0080] Shows the screen on which the camera and some options are activated to measure the sizes:

[0081] 9- Exiting the page to go back to the main page

[0082] 10- The tutorial of how the required shots should be taken.

[0083] 11- The line which must placed on the intended part to measure it correctly.

[0084] 12- The click which takes the picture.

[0085] Shows the main slide of the application which performs the main mission of this application and its options:

[0086] 13- By clicking on this option, four other options appear:

[0087] – Open File

[0088] – My Size

[0089] – About App

[0090] – Exit

[0091] 14- About the program

[0092] 15- Displays the sizes and the ability to change them

[0093] 16- This option is “Fix” and by clicking on it the product will be fixated on the screen and that part of the body, and then turned into “Edit” which gives the chance to refix the product.

[0094] 17- Rotating the camera from the front to the other.

[0095] 18- Recording videos and taking pictures.Examples

[0096] There are two conditions for this application to participate and function in, one is to measure the sizes of the user which happens when the user installs and opens the application, the first page presents after allowing it to have access to the camera, then four options of measuring left, right hands, their wrists, and fingers, also there is this choice to measure them later.

[0097] The other condition is, for example, if the user wants to buy a bracelet from a website or a catalog. After downloading the three-dimensional file, we open it with the program and hold the phone on which the front camera is activated in front of us like a mirror and the picture of the bracelet is there in the midst of the screen, we fix the bracelet on our wrist and click on the fix so it will not move, then we can rotate and move our hand in any direction to observe every side of it, if the fixated bracelet is not fit, by the option Edit, we can change it.

[0098] Then, when we made our decision to buy the bracelet according to the measured sizes of our wrist, so we could use it to finalize our shopping process.

[0099] This innovation is expected to have broad applications in industries such as jewelry, fashion accessories, product design, and 3D design. It will also greatly impact online retail, e-commerce, and the buying and selling of goods.

Claims

An Application for virtual testing of jewelry, accessories, and watches based on artificial intelligence and augmented reality which has two main functions measuring size and trying products before remote and online shopping.According to claim 1, the first slide of the application is “My Size” and has four options:1- Measuring the sizes of the right hand’s fingers and wrists2- Measuring the sizes of the left hand’s fingers and wrists3- Measuring the size of the neck4- Measuring laterAccording to claim 2, by clicking on the first two options of the “My Size” slide, a hand will appear on the screen, and by touching each finger or the wrist the accessed camera activates and a horizontal line appears on the screen.According to claim 3, the right corner of the screen has an option “i” that shows users how to prepare the required photos.According to claim 4, the horizontal line will be placed within each body part, and the user has to take two pictures, one from the front view and then by rotating the finger in the horizontal direction, another from above.According to claim 5, after taking all the pictures, they will be displayed on the screen with their sizes calculated by artificial intelligence written on them, and organized to be used for online ordering.According to claim 1, the 3-dimensional file of the products is needed to try them by this application.According to claim 7, to try the products with the prepared 3D file from before, the option “Open File” on the main page of the application should be clicked on and the intended file should be chosen.According to claim 8, to try the product before ordering the product from a website, the 3D file must be downloaded, and by clicking the “Share” option, it will be opened by the application.According to claim 9, after opening the 3D file in the application, the camera gets activated and the product will be displayed on the screen.According to claim 10, the product can be bigger or smaller and be in any size the user wants by touching and controlling it to be the right size of the intended part.According to claim 11, after finding the right place of the product, by clicking on the “Fix” option, the product gets fixated on the intended body part, and will not move so the user can observe it from any side.According to claim 12, the “Fix” option turns into “Edit” so the user can change the place of the product.According to Claim 13, there are other options on this page to access other aspects of the application.According to claim 14, there is an option for recording videos and taking pictures of the product.According to claim 14, the camera can also rotate from front to back while the user is testing the product.According to claim 14, there is the “S” option at the bottom of the page to access the slide of the measured sizes.According to claim 14, there is an option “i” to inform the users more about the application and its functions.According to claim 14, there is an option at the right corner of the page which by choosing it, four other choices of Open File, My size, About app, and Exit.

Images