system

The system addresses the challenge of outfit coordination and design commercialization by allowing users to create accounts, set characteristics, and utilize AI for outfit suggestions, facilitating the combination of existing items with new products and enabling custom design commercialization.

JP2026041298APending Publication Date: 2026-03-10SOFTBANK GROUP CORP
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-08-26
Publication Date
2026-03-10

AI Technical Summary

Technical Problem

Conventional online shopping systems face challenges in helping users find coordinated outfits that match their style, preferences, and specific occasions, often lacking the ability to consider combinations with items they already own, and limit the means for users to create original designs.

Method used

A system that allows users to create an account, register their interests, and set basic characteristics, utilizing an AI stylist for outfit suggestions, and includes a server for managing user information and product searches, enabling the registration of existing items and suggesting combinations, as well as supporting the commercialization of original designs.

Benefits of technology

Enables users to easily find outfits that suit their style, combine existing items with new products, and commercialize their original designs, providing a comprehensive solution for outfit coordination and custom product creation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026041298000001_ABST
    Figure 2026041298000001_ABST
Patent Text Reader

Abstract

Provide a system. A method for users to create a new account and register their interests; a means for users to create their own avatar and configure its basic characteristics; a means for the server to store user information and manage authentication information; The device will run an AI stylist and provide initial coordination suggestions. A means for the server to search for the corresponding product from the database and transmit it to the terminal; The system includes a means for the terminal to reflect the suggested coordination on an avatar and display a preview.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional online shopping systems have the problem that it is difficult for users to find a coordinated outfit that matches their style, preferences, and specific occasions when selecting products. Furthermore, they often lack a function that considers combinations with items the user already owns, which can result in a lack of consistency between newly purchased items. Furthermore, the means by which users can create original designs are limited, making it difficult for them to commercialize their ideas. [Means for solving the problem]

[0005] The present invention provides a means for users to create a new account and register their interests, create their own avatar, and set basic characteristics. It also includes a server for storing user information and managing authentication information, and a device for running an AI stylist and providing initial outfit suggestions. This allows users to easily find outfits that suit their style. It also includes a means for users to select outfits appropriate for specific occasions and a server for searching and suggesting corresponding products from multiple options, allowing users to quickly find appropriate items for the occasion. The system's means for users to register their existing items in the system and the device's means for suggesting combinations of existing items with new products ensure consistency with the user's existing items. The system also provides a means for users to input their own design ideas if they cannot find a specific product. The system includes a server for storing users' design specifications and sending the design data to partner companies capable of manufacturing, as well as a means for displaying the design as a virtual item and allowing users to wear it on their avatar. This allows users to commercialize their original designs.

[0006] "User" refers to an individual or corporation that uses this system to search for, select, purchase, or create original designs for products.

[0007] "Account" refers to data including authentication information (such as name, email address, and password) required for a User to access the System.

[0008] "Avatar" refers to a virtual character that a user creates on the system, which has the user's characteristics such as body shape, hairstyle, and skin color.

[0009] "AI stylist" refers to artificial intelligence that suggests optimal outfits based on the user's preferences and past preference data.

[0010] "TPO" stands for Time, Place, Occasion and refers to the standard of appropriate attire for a particular occasion.

[0011] "Server" refers to a computer system that stores user information, product information, coordinate data, etc., and manages communications with user terminals.

[0012] "Terminal" refers to a device (smartphone, tablet, PC, etc.) that a user uses to access and operate the system.

[0013] "Database" refers to a system for structuring and storing information managed by the system, such as user information, product information, and coordination data.

[0014] "Owned items" refer to items such as clothes, shoes, and bags that the user already owns, and can be registered and managed within the system.

[0015] "Original design" refers to a unique clothing design created by a user based on their own ideas.

[0016] "Manufacturing partner companies" refer to companies that manufacture products based on users' original designs. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] The present invention is a system that allows users to try out outfits and purchase products using their own avatars in a virtual boutique. The system also provides functions for suggesting combinations with items the user already owns and for commercializing original designs.

[0039] Basic system configuration

[0040] 1. User registration and login function

[0041] When a user creates a new account, they enter their name, email address, password, and interests.

[0042] The terminal sends the input information to the server, and the server stores the user information in a database.

[0043] The server sends a confirmation email to the user's email address, and the user clicks on the link in the email to authenticate their account.

[0044] 2. Avatar Creation and Stylist Assistance

[0045] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page.

[0046] The device will generate an avatar based on your input and display a preview.

[0047] The user checks and edits the avatar and finally saves it.

[0048] Based on the information stored on the device, an AI stylist will be activated to suggest the best outfit.

[0049] 3. Product search and combination suggestions

[0050] A user searches for items that fit a specific occasion (e.g., formal, casual).

[0051] The terminal transmits the input conditions to the server, and the server retrieves information on the corresponding product from the database and transmits it to the terminal.

[0052] Users register photos of their clothes, shoes, and bags and send that information to the server.

[0053] The device suggests combinations of new products with items the user has on hand, and displays a preview of the suggested coordination reflected on the avatar.

[0054] 4. Original design function

[0055] The user accesses a page for inputting an original design and inputs the color, material, and design specifications.

[0056] The device will check the design and display a preview.

[0057] The server stores the user's design specifications and transmits the design data to manufacturing partner companies as needed.

[0058] The server obtains quotes and delivery date information from manufacturing partner companies and notifies the user.

[0059] 5. Purchase and Delivery Procedures

[0060] Users add their favorite items to their cart.

[0061] The terminal displays the cart contents and total amount, and the user completes the purchase.

[0062] The server works with the payment system to process the payment.

[0063] The server stores the user's order information and initiates the delivery process.

[0064] The server will send a shipping notification to the user via a dedicated app or email.

[0065] Specific examples

[0066] Example 1: Creating a new account

[0067] 1. A user visits the new account creation page and enters their name, email address, password, and interests such as casual style.

[0068] 2. The device sends this information to the server.

[0069] 3. The server stores the user information in a database and sends a confirmation email.

[0070] 4. The user clicks the link in the email to authenticate their account.

[0071] Example 2: Avatar creation and initial outfit suggestions

[0072] 1. The user enters height, hairstyle, skin color, etc. on the avatar creation page.

[0073] 2. The device generates an avatar and displays a preview to the user.

[0074] 3. The user is happy with the avatar and hits the save button.

[0075] 4. The device activates an AI stylist to suggest jeans and T-shirts based on the user's preferences.

[0076] 5. The server retrieves the relevant product information from the database and sends it to the terminal.

[0077] 6. The device reflects the coordinated outfit on the avatar and displays a preview to the user.

[0078] Example 3: Product search and purchase

[0079] 1. A user is looking for clothing suitable for a formal occasion and selects a specific brand.

[0080] 2. The device sends the selection to the server.

[0081] 3. The server searches the database for the brand's formal wear and sends it to the device.

[0082] 4. The user adds the items they like to their cart and checks out.

[0083] 5. The server connects to the payment system to process the payment and initiate the delivery procedure.

[0084] 6. The server sends a shipping notification to the user, and the terminal displays the delivery status to the user in real time.

[0085] The above is a concrete example of the system. This configuration allows users to easily find outfits and products that suit them, and they can also combine them with existing items. Furthermore, by supporting the realization of original designs, custom-made items can be easily obtained.

[0086] The processing flow will be explained below.

[0087] User registration and login functionality

[0088] Step 1:

[0089] A user visits a new account creation page and enters their name, email address, password, and interests.

[0090] Step 2:

[0091] The device sends the input to the server.

[0092] Step 3:

[0093] The server stores the received user information in a database.

[0094] Step 4:

[0095] The server sends a confirmation email to the user's email address.

[0096] Step 5:

[0097] The user clicks the link in the confirmation email to verify their account.

[0098] Step 6:

[0099] The user enters their email address and password on the login page.

[0100] Step 7:

[0101] The device sends the input to the server.

[0102] Step 8:

[0103] The server queries the database to verify the authentication information.

[0104] Step 9:

[0105] If the server authenticates the user, it starts a session and redirects them to the dashboard.

[0106] Step 10:

[0107] The terminal displays the user's login status.

[0108] Avatar Creation and Stylist Assist

[0109] Step 1:

[0110] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page.

[0111] Step 2:

[0112] The device will generate an avatar based on your input and display a preview.

[0113] Step 3:

[0114] The user checks the avatar and makes corrections if necessary.

[0115] Step 4:

[0116] The user saves the final avatar settings.

[0117] Step 5:

[0118] The device will activate an AI stylist based on the information stored on it.

[0119] Step 6:

[0120] An AI stylist will create the initial outfit based on the user's preferences.

[0121] Step 7:

[0122] The server retrieves the relevant product data from the database and sends it to the terminal.

[0123] Step 8:

[0124] The device will reflect the suggested outfit on the avatar and display a preview.

[0125] Product search and combination suggestions

[0126] Step 1:

[0127] The user selects clothing appropriate for a particular occasion.

[0128] Step 2:

[0129] The device sends the selection to the server.

[0130] Step 3:

[0131] The server searches the database based on multiple brands, place of manufacture, fabric, etc., and retrieves the relevant products.

[0132] Step 4:

[0133] The server transmits product information to the terminal.

[0134] Step 5:

[0135] Users upload images of their clothes, shoes, and bags and register them in the system.

[0136] Step 6:

[0137] The server stores the information about the items in your possession in a database.

[0138] Step 7:

[0139] The device suggests combinations of new products with the user's existing items.

[0140] Step 8:

[0141] The device will reflect the suggested outfit on the avatar and display a preview.

[0142] Original design function

[0143] Step 1:

[0144] The user accesses a page for inputting an original design and inputs the color, material, and design specifications.

[0145] Step 2:

[0146] The device will check the design and display a preview.

[0147] Step 3:

[0148] The terminal transmits the design data to the server.

[0149] Step 4:

[0150] The server stores the user's design specifications and transmits the design data to partner companies that can manufacture the product.

[0151] Step 5:

[0152] The server obtains quotes and delivery date information from manufacturing partner companies.

[0153] Step 6:

[0154] The server notifies the user of the estimate and delivery date information.

[0155] Step 7:

[0156] The user gives final approval.

[0157] Step 8:

[0158] The server notifies partner companies that production has begun.

[0159] Purchase and shipping procedures

[0160] Step 1:

[0161] Users add their favorite items to their cart.

[0162] Step 2:

[0163] The terminal displays the cart contents and total amount.

[0164] Step 3:

[0165] The user begins the checkout process and enters shipping and payment information.

[0166] Step 4:

[0167] The device sends the input to the server.

[0168] Step 5:

[0169] The server connects to the payment system and processes the payment.

[0170] Step 6:

[0171] If the server confirms the payment, it saves the order information and starts the delivery process.

[0172] Step 7:

[0173] The server sends a shipping notification to the user.

[0174] Step 8:

[0175] The terminal displays the purchase status to the user in real time.

[0176] Example 1

[0177] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0178] When users purchase fashion items online, they often face challenges in finding the right items. Coordinating existing and new items is also difficult, making it difficult to get suggestions that match their style. Furthermore, limited options for custom-made items and original designs make it difficult to meet individual needs.

[0179] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0180] In this invention, the server includes means for saving user information and managing authentication information, means for searching for relevant products from a database and sending them to the terminal, and means for saving the user's design specifications and sending the design data to partner companies that can manufacture them. This allows users to easily find outfits that suit them, combine existing items with new items, and even create custom-made items and original designs.

[0181] A "user" is a person who uses the system, creates an account, and purchases fashion items and receives coordination suggestions through a virtual character image.

[0182] A "virtual person" is a digital avatar that a user creates based on their own characteristics, such as height, hairstyle, and skin color, and is used to preview outfits.

[0183] "Server" refers to a computer device that manages information for the entire system, stores and authenticates user information, searches for products from a database, and stores and transmits design data.

[0184] "Terminal" refers to a device, such as a PC or smartphone, through which a user accesses the system and performs operations such as sending input information and displaying a preview of an outfit.

[0185] The "Artificial Intelligence Stylist" is an AI model that analyzes the user's preferences and characteristics and suggests the optimal coordination.

[0186] A "database" is an information management system that stores product information and user information and makes them searchable.

[0187] "Purpose of use" refers to the purpose of the fashion style or item that a user desires for a particular occasion or situation.

[0188] "Cooperating companies" refer to external manufacturing partners that manufacture products based on the user's original designs.

[0189] "Preview" is a function that allows the user to visually confirm the state in which the coordinates and design items selected by the user are applied to the virtual person image.

[0190] The present invention relates to a system that allows users to try out outfits and purchase products using their own virtual persona in a virtual boutique. The system also provides functions for suggesting combinations with items the user already owns and for commercializing original designs.

[0191] Basic system configuration

[0192] User registration and login functionality

[0193] A user creates a new account and enters information such as their name, email address, password, and interests. The device sends this information to the server, which stores it in a database. The server also manages authentication information and sends a confirmation email to the user. The user clicks on a link in the email to authenticate their account.

[0194] Virtual persona creation and stylist assistance

[0195] The user enters characteristics such as height, hairstyle, and skin color on the virtual person creation page. The device receives this information, generates a virtual person, and displays a preview. The user checks, edits, and saves the virtual person, and the device sends this information to the server. The server then runs an AI stylist to suggest the best outfits for the user.

[0196] Product search and combination suggestions

[0197] When a user searches for an item that meets a specific purpose, the device sends the search criteria to the server. The server retrieves the relevant products from the database and sends them to the device. The user registers photos of items they own (clothes, shoes, bags, etc.), and the device sends this information to the server. Based on this, the server suggests new product combinations, and the device reflects these combinations on a virtual person image and displays a preview.

[0198] Original design function

[0199] The user accesses the original design page and inputs color, material, and design specifications. The device confirms this and displays a design preview. The server saves the design specifications and sends the design data to cooperating companies as needed. The server obtains quotes and delivery date information from cooperating companies and notifies the user.

[0200] Purchase and shipping procedures

[0201] The user adds the items they like to their cart and completes the purchase. The terminal displays the cart contents and total amount, and the server connects with the payment system to process the payment. The server saves the order information and starts the delivery process. The user receives a shipping notification by email or via a dedicated app, and can check the delivery status in real time.

[0202] Specific examples

[0203] Example 1: Creating a new account

[0204] A user accesses the new account creation page and enters their name, email address, password, and interests such as casual style. The device sends this information to the server, which stores the user information in a database and sends a confirmation email. The user clicks on the link in the email to authenticate their account.

[0205] Example 2: Creating a virtual persona and initial outfit suggestions

[0206] The user enters height, hairstyle, skin color, etc. on the virtual person creation page. The device generates a virtual person and displays a preview to the user. When the user is satisfied with the virtual person, they press the save button. The device activates an AI stylist, which suggests jeans and a T-shirt based on the user's preferences. The server retrieves the relevant product information from the database and sends it to the device. The device reflects the coordination on the virtual person and displays a preview to the user.

[0207] Example 3: Product search and purchase

[0208] The user searches for clothing suitable for a formal occasion and selects a particular brand. The device sends the selection to the server, which retrieves the relevant product information from a database and sends it to the device. The user adds the items they like to their cart and completes the purchase. The server connects with the payment system to process the payment and initiate the delivery process. The server sends a shipping notification to the user, and the device displays the delivery status to the user in real time.

[0209] This invention allows users to easily find outfits and products that suit them, and also allows them to combine existing items. It also makes it possible to create items with original designs.

[0210] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0211] Step 1:

[0212] A user visits a new account creation page. The user enters their name, email address, password, and interests. This data is sent as input to the device. The device packages this input data in JSON format and sends it to the server.

[0213] Step 2:

[0214] The server analyzes the received user information and saves it in a database. The server performs data calculations to verify whether the email address format is correct and whether the password meets the specified format, and if there are no problems, saves it in the database. Saving it in the database is the output.

[0215] Step 3:

[0216] The server sends a confirmation email to the registered email address. The server generates an authentication link and sends an email containing that link to the user. The confirmation email is the output.

[0217] Step 4:

[0218] The user clicks on the link in the confirmation email and authenticates their account. The server receives this action and updates the user status as "authenticated", allowing the user to log in. The output is a database update.

[0219] Step 5:

[0220] The user accesses the virtual person creation page and inputs characteristics such as height, hairstyle, and skin color. This input data is sent to the terminal, which processes the data in batches to generate a virtual person. A preview of the generated virtual person is output.

[0221] Step 6:

[0222] The user checks the virtual person image and modifies it if necessary. When the user finally clicks the button to save the virtual person image, the data is sent from the device to the server. The saved data is output.

[0223] Step 7:

[0224] The server sends the received virtual person data as input to the AI ​​model, which generates an appropriate outfit based on the user's characteristics and past data. The calculation results of this AI model are output as outfit suggestions.

[0225] Step 8:

[0226] The user searches for an item that meets a specific purpose. The search criteria entered by the user are sent by the terminal to the server. The server searches the database for relevant product information and sends the results to the terminal. The search results are output.

[0227] Step 9:

[0228] The user registers a photo of an item they own. This photo data is sent to the server by the device. The server analyzes the image and stores it in a database as different item information. The image analysis results are output.

[0229] Step 10:

[0230] The server proposes combinations of items in hand with new products. The server uses an AI model to calculate appropriate combinations. The results are sent to the device, which reflects the results on the virtual person and displays a preview. The proposed combinations are the output.

[0231] Step 11:

[0232] The user accesses a page to input their original design. The user inputs the color, material, and design specifications, and the data is sent from the terminal to the server. The server saves the design data in a database and sends it to partner companies as needed. The saved design data becomes the output.

[0233] Step 12:

[0234] The server obtains quotes and delivery date information from partner companies. The server notifies the user of this information, and the terminal displays it to the user. The quote information is output.

[0235] Step 13:

[0236] The user adds the items they like to the cart. The device manages the contents of the cart and sends the information to the server. The cart information is output.

[0237] Step 14:

[0238] The user completes the purchase procedure. The user enters payment information, and that data is sent from the terminal to the server. The server then works with the payment system to process the payment. The payment result is output.

[0239] Step 15:

[0240] The server saves the user's order information and starts the delivery process. The server then sends the information to the delivery company and notifies the user of the delivery status. The user can check the delivery status in real time. The delivery notification is the output.

[0241] (Application example 1)

[0242] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0243] While there are many systems available today that allow users to try on outfits using their own avatars in a virtual environment, there are still insufficient systems that can comprehensively manage a user's inventory, provide virtual try-ons, real-time outfit suggestions, and even create and commercialize original designs. There is also a need for comprehensive management of real-time try-ons, original item designs, purchase procedures, and delivery procedures within a virtual boutique. Therefore, it is essential to provide an integrated system that enhances user convenience.

[0244] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0245] In this invention, the server includes means for a user to create a new account and register interests, means for a user to create their own avatar and set basic characteristics, means for the server to save user information and manage authentication information, means for a terminal to operate an AI stylist and make initial outfit suggestions, means for the server to search for relevant products from a database and send them to the terminal, means for the terminal to reflect the suggested outfit on the avatar and display a preview, means for the user to input an original design, means for the server to save the user's design specifications and send the data to a manufacturing partner, and means for the terminal to preview the original design. This allows a user to try out combinations of existing items with new products in a virtual environment, receive outfit suggestions, easily commercialize their original design, and consistently manage purchase and delivery procedures.

[0246] A "user" is an individual who uses the virtual boutique system to create an avatar, try on outfits, purchase products, and create original designs.

[0247] A "new account" is individual user information created by a user when using the virtual boutique system for the first time.

[0248] "Interests" refers to information about a user's fashion style, preferences, and areas of interest that the user registers when using the system.

[0249] An "avatar" is a virtual character that a user creates within the virtual boutique system to represent themselves.

[0250] "AI Stylist" is a system equipped with artificial intelligence that suggests outfits based on the user's interests and the items they own.

[0251] The "server" is a computer system that manages and stores user information and design data, verifies authentication information, and searches and suggests product data.

[0252] A "database" is a large-scale data storage system connected to a server, and stores user information, product data, design data, and the like.

[0253] "Items in hand" are fashion-related items such as clothes and accessories that the user already owns.

[0254] An "original design" is a fashion item design that a user creates independently within the virtual boutique system.

[0255] A "manufacturing partner" is a company or factory that produces actual products based on a user's original design.

[0256] "Virtual try-on" is a function that allows a user to check how an item selected in the virtual boutique system looks by having an avatar try it on.

[0257] "Purchase procedure" refers to a series of procedures required for a user to purchase a product selected by the user through the virtual boutique system.

[0258] "Delivery procedure" refers to the process of arranging and managing logistics so that the products purchased by the user can be delivered to their home.

[0259] The present invention is an integrated system that allows users to try out outfits and purchase products using their own avatar in a virtual boutique. This system also provides functions for suggesting combinations with items the user already owns and for commercializing original designs. Specific embodiments for realizing this system are described below.

[0260] User registration and login functionality

[0261] A user creates a new account and registers their name, email address, password, and interests. The device sends this information to the server, which stores it in a database. The server then sends a confirmation email to the user's email address, and the user clicks on a link in the email to authenticate their account.

[0262] Avatar creation and stylist assistance features

[0263] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page, and the device generates an avatar based on the input and displays a preview. The user can then confirm and save the avatar. Based on the saved information, the device activates an AI stylist to suggest the best outfits.

[0264] Product search and combination suggestion function

[0265] The user searches for items that suit a specific time, place, and occasion, and the device sends the search criteria to the server, which then retrieves information about the relevant products from a database and sends it to the device. The user registers photos of their current clothes, shoes, and bags, and sends that information to the server. The device then suggests combinations of new products with the user's current items, and displays a preview of the suggested outfits reflected on an avatar.

[0266] Original design function

[0267] The user accesses a page to input their original design and enters the color, material, and design specifications. The device checks the design content and displays a preview. The server saves the user's design specifications and sends the design data to manufacturing partners as needed. The server obtains quotes and delivery date information from manufacturing partners and notifies the user.

[0268] Purchasing and shipping functions

[0269] The user adds the items they like to the cart, and the terminal displays the cart contents and total amount. The user completes the purchase procedure, and the server processes the payment in conjunction with the payment system. The server saves the user's order information and starts the delivery procedure. The server sends a shipping notification to the user via a dedicated app or email, and the terminal displays the delivery status in real time.

[0270] Hardware and software used

[0271] Hardware: Smartphone (e.g. iPhone (registered trademark), ANDROID (registered trademark) device)

[0272] Software: Python, REST API, PIL (Python Imaging Library), AI model

[0273] Specific examples

[0274] A specific example of operations in which a user creates a new account, creates an avatar, tries on a specific item, and purchases it is as follows.

[0275] 1. Create a new account

[0276] A user visits a new account creation page and enters their name, email address, password, and interests. The device sends this information to the server, which stores the user information in a database. The server then sends the user a confirmation email, and the user clicks on a link in the email to authenticate their account.

[0277] 2. Create an avatar

[0278] The user enters height, hairstyle, skin color, etc. on the avatar creation page. The device generates an avatar based on the input and displays a preview. The user can then confirm and save the avatar.

[0279] 3. Virtual try-on

[0280] Users search for items suited to a particular occasion and then have their avatar try on the items to see a preview.

[0281] 4. Purchase procedure

[0282] The user adds the items they like to their cart and completes the purchase. The server then connects with the payment system to process the payment and begin the delivery process. The server then sends a shipping notification to the user via a dedicated app or email, and the device displays the delivery status in real time.

[0283] Prompt Sentence Examples

[0284] A system that searches for items suited to a specific TPO (e.g., formal, casual) and suggests combinations of clothes, shoes, and bags that you already own.

[0285] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0286] Step 1:

[0287] Create a new account

[0288] Input: User enters name, email address, password, and interests.

[0289] Specific operation: The terminal receives the input information and sends it to the server.

[0290] Data processing: The server stores the received user information in a database.

[0291] Output: The server sends a confirmation email to the user's email address.

[0292] Step 2:

[0293] User Authentication

[0294] Input: User clicks on the link in the confirmation email.

[0295] Specific behavior: The server verifies that the link was clicked and changes the account to an authenticated state.

[0296] Data processing: Update authentication information to the database.

[0297] Output: The account is authenticated and the user can log in.

[0298] Step 3:

[0299] Avatar Creation

[0300] Input: The user enters characteristics such as body shape, hairstyle, and skin tone on the avatar creation page.

[0301] Specific operation: The device receives the input and sends the data to the avatar generation API.

[0302] Data processing: The server generates an avatar based on the avatar generation API.

[0303] Output: A preview of the generated avatar will be displayed on the device.

[0304] Step 4:

[0305] Stylist Assist

[0306] Input: User confirms and saves registered avatar.

[0307] Specific operation: The device sends avatar information to the AI ​​stylist.

[0308] Data processing: An AI stylist suggests outfits based on the user's interests and data.

[0309] Output: The suggested outfits are displayed on the device.

[0310] Step 5:

[0311] Product search and combination suggestions

[0312] Input: User searches for items that fit a specific TPO.

[0313] Specific operation: The device sends search criteria to the server.

[0314] Data processing: The server retrieves the relevant product information from the database.

[0315] Output: The relevant product information is sent to the terminal and displayed.

[0316] Step 6:

[0317] Register your items

[0318] Input: The user registers photos of their clothes, shoes, and bags.

[0319] Specific operation: The device sends the photo data to the server.

[0320] Data processing: The server analyzes the data sent and stores the item information in a database.

[0321] Output: The registered items are now available in the system.

[0322] Step 7:

[0323] Coordinate preview

[0324] Input: The user confirms the suggested outfit.

[0325] Specific operation: The device reflects the coordinate information on the avatar.

[0326] Data processing: Processing is performed to reflect the data on the avatar.

[0327] Output: A preview of the outfit reflected on the device is displayed.

[0328] Step 8:

[0329] Original design creation

[0330] Input: User enters color, material, and design specifications.

[0331] Specific operation: The device sends the entered design specifications to the server.

[0332] Data processing: The server stores the design data and sends it to the manufacturing partner.

[0333] Output: A preview of your design will be displayed on your device.

[0334] Step 9:

[0335] Get quotes and delivery information

[0336] Input: The server sends the design data to the manufacturing partner.

[0337] What it does: Receive quotes and delivery information from manufacturing partners.

[0338] Data processing: Formatting received information for presentation to the user.

[0339] Output: The user is notified of the estimate and delivery date.

[0340] Step 10:

[0341] Purchase and shipping procedures

[0342] Input: The user adds the items they like to their cart and checks out.

[0343] Specific operation: The terminal displays the cart contents and total amount. The terminal sends the payment information to the server.

[0344] Data processing: The server connects to the payment system and processes the payment.

[0345] Output: The user is notified of the purchase confirmation and shipping information.

[0346] Step 11:

[0347] Delivery notification and real-time tracking

[0348] Input: The server initiates the delivery procedure.

[0349] Specific operation: The server sends the order data to the delivery company.

[0350] Data processing: Receive real-time tracking information from the delivery company.

[0351] Output: Real-time updated delivery status is displayed on the terminal.

[0352] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0353] The present invention relates to a system that allows users to try out outfits and purchase products using their own avatars in a virtual boutique. This system incorporates an emotion engine that recognizes the user's emotions and also has the function of adjusting outfit suggestions based on the user's emotions.

[0354] Basic system configuration

[0355] 1. User registration and login function

[0356] When a user creates a new account, they enter their name, email address, password, and interests.

[0357] The terminal sends the input information to the server, and the server stores the user information in a database.

[0358] The server sends a confirmation email to the user's email address, and the user clicks on the link in the email to authenticate their account.

[0359] 2. Avatar Creation and Stylist Assistance

[0360] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page.

[0361] The device will generate an avatar based on your input and display a preview.

[0362] The user checks and edits the avatar and finally saves it.

[0363] Based on the information stored on the device, an AI stylist will be activated to suggest the best outfit.

[0364] 3. Product search and combination suggestions

[0365] A user searches for items that fit a specific occasion (e.g., formal, casual).

[0366] The terminal transmits the input conditions to the server, and the server retrieves information on the corresponding product from the database and transmits it to the terminal.

[0367] Users register photos of their clothes, shoes, and bags and send that information to the server.

[0368] The device suggests combinations of new products with items the user has on hand, and displays a preview of the suggested coordination reflected on the avatar.

[0369] 4. Original design function

[0370] The user accesses a page for inputting an original design and inputs the color, material, and design specifications.

[0371] The device will check the design and display a preview.

[0372] The server stores the user's design specifications and transmits the design data to manufacturing partner companies as needed.

[0373] The server obtains quotes and delivery date information from manufacturing partner companies and notifies the user.

[0374] 5. Purchase and Delivery Procedures

[0375] Users add their favorite items to their cart.

[0376] The terminal displays the cart contents and total amount, and the user completes the purchase.

[0377] The server works with the payment system to process the payment.

[0378] If the server confirms the payment, it saves the order information and starts the delivery process.

[0379] The server will send a shipping notification to the user via a dedicated app or email.

[0380] Additional configuration of the emotion engine

[0381] 1. Emotion recognition using an emotion engine

[0382] When a user uses the system, the emotion engine analyzes the user's input and behavior (for example, the time spent viewing an item and the frequency of clicks) and analyzes the emotion at that time.

[0383] The device sends the emotion engine analysis data to the server.

[0384] 2. Emotion-based outfit suggestions

[0385] The server receives the analysis results from the emotion engine and dynamically adjusts the conditions for searching for products from the database.

[0386] The server transmits data to the terminal that suggests the most suitable product for the user based on the adjusted conditions.

[0387] The device will reflect the updated coordination suggestions on the avatar and display a preview.

[0388] Specific examples

[0389] Example 1: Coordination suggestions based on the user's mood using an emotion engine

[0390] 1. A user logs into the system and indicates that their recent mood is "fatigued."

[0391] 2. The emotion engine analyzes the user's behavior and determines that a relaxed style is appropriate.

[0392] 3. The server retrieves the relevant product information from the database based on the relaxation style and sends it to the terminal.

[0393] 4. Your device will then preview your avatar in a relaxed outfit (e.g., a loose top and pants).

[0394] Example 2: Flow from purchase to delivery

[0395] 1. The user likes the suggested outfit and adds it to their cart.

[0396] 2. The terminal displays the cart contents and total amount, and the user completes the purchase.

[0397] 3. The server connects to the payment system and processes the payment.

[0398] 4. After the payment is confirmed, the server saves the order information and starts the shipping process.

[0399] 5. The server sends a shipping notification to the user via email or a dedicated app.

[0400] 6. The terminal displays the delivery status to the user in real time.

[0401] The above is a concrete example of the system. This configuration allows users to find outfits and products that suit their emotions and moods, and allows for a smooth purchase process. Furthermore, original designs are possible, and custom-made items tailored to individual users can be provided.

[0402] The processing flow will be explained below.

[0403] Specific processing steps of a system that combines emotion engines

[0404] User registration and login functionality

[0405] Step 1:

[0406] A user visits a new account creation page and enters their name, email address, password, and interests.

[0407] Step 2:

[0408] The device sends the input to the server.

[0409] Step 3:

[0410] The server stores the received user information in a database.

[0411] Step 4:

[0412] The server sends a confirmation email to the user's email address.

[0413] Step 5:

[0414] The user clicks the link in the confirmation email to verify their account.

[0415] Step 6:

[0416] The user enters their email address and password on the login page.

[0417] Step 7:

[0418] The device sends the input to the server.

[0419] Step 8:

[0420] The server queries the database to verify the authentication information.

[0421] Step 9:

[0422] If the server authenticates the user, it starts a session and redirects them to the dashboard.

[0423] Step 10:

[0424] The terminal displays the user's login status.

[0425] Avatar Creation and Stylist Assist

[0426] Step 1:

[0427] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page.

[0428] Step 2:

[0429] The device will generate an avatar based on your input and display a preview.

[0430] Step 3:

[0431] The user checks the avatar and makes corrections if necessary.

[0432] Step 4:

[0433] The user saves the final avatar settings.

[0434] Step 5:

[0435] The device will activate an AI stylist based on the information stored on it.

[0436] Step 6:

[0437] An AI stylist will create the initial outfit based on the user's preferences.

[0438] Step 7:

[0439] The server retrieves the relevant product data from the database and sends it to the terminal.

[0440] Step 8:

[0441] The device will reflect the suggested outfit on the avatar and display a preview.

[0442] Emotion recognition and coordination suggestions using an emotion engine

[0443] Step 1:

[0444] The emotion engine is activated when a user logs in and interacts with the system.

[0445] Step 2:

[0446] The emotion engine analyzes the user's input, browsing behavior, click frequency, etc. to estimate their current emotion.

[0447] Step 3:

[0448] The device sends the emotion engine analysis data to the server.

[0449] Step 4:

[0450] The server receives the emotion analysis results and stores them in a database.

[0451] Step 5:

[0452] The server dynamically changes the search criteria for related products based on the analysis results.

[0453] Step 6:

[0454] The server searches the database using the changed conditions and retrieves the relevant product information.

[0455] Step 7:

[0456] The server transmits product information to the terminal.

[0457] Step 8:

[0458] The device will reflect the suggested outfit on the avatar and display a preview.

[0459] Product search and combination suggestions

[0460] Step 1:

[0461] The user selects clothing appropriate for a particular occasion.

[0462] Step 2:

[0463] The device sends the selection to the server.

[0464] Step 3:

[0465] The server searches the database based on multiple brands, place of manufacture, fabric, etc., and retrieves the relevant products.

[0466] Step 4:

[0467] The server transmits product information to the terminal.

[0468] Step 5:

[0469] Users upload images of their clothes, shoes, and bags and register them in the system.

[0470] Step 6:

[0471] The server stores the information about the items in your possession in a database.

[0472] Step 7:

[0473] The device suggests combinations of new products with the user's existing items.

[0474] Step 8:

[0475] The device will reflect the suggested outfit on the avatar and display a preview.

[0476] Original design function

[0477] Step 1:

[0478] The user accesses a page for inputting an original design and inputs the color, material, and design specifications.

[0479] Step 2:

[0480] The device will check the design and display a preview.

[0481] Step 3:

[0482] The terminal transmits the design data to the server.

[0483] Step 4:

[0484] The server stores the user's design specifications and transmits the design data to partner companies that can manufacture the product.

[0485] Step 5:

[0486] The server obtains quotes and delivery date information from manufacturing partner companies.

[0487] Step 6:

[0488] The server notifies the user of the estimate and delivery date information.

[0489] Step 7:

[0490] The user gives final approval.

[0491] Step 8:

[0492] The server notifies partner companies that production has begun.

[0493] Purchase and shipping procedures

[0494] Step 1:

[0495] Users add their favorite items to their cart.

[0496] Step 2:

[0497] The terminal displays the cart contents and total amount.

[0498] Step 3:

[0499] The user begins the checkout process and enters shipping and payment information.

[0500] Step 4:

[0501] The device sends the input to the server.

[0502] Step 5:

[0503] The server connects to the payment system and processes the payment.

[0504] Step 6:

[0505] If the server confirms the payment, it saves the order information and starts the delivery process.

[0506] Step 7:

[0507] The server sends a shipping notification to the user.

[0508] Step 8:

[0509] The terminal displays the purchase status to the user in real time.

[0510] Example 2

[0511] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0512] Today's consumers demand customized fashion suggestions that reflect their individual style and mood, but existing systems struggle to reflect the user's emotions and moods. Furthermore, there are limited systems that allow users to virtually try on new items by combining existing items with new items. Furthermore, there is a lack of an easy way to incorporate original designs when a specific product cannot be found.

[0513] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0514] In this invention, the server includes: means for a user to create a new account and register interests; means for a user to create a virtual representation of themselves and set basic characteristics; means for the server to save user information and manage authentication information; means for the terminal to operate an artificial intelligence outfit suggestion engine and make an initial outfit suggestion; means for the server to search for relevant items from an information storage device and send them to the terminal; means for the terminal to reflect the suggested outfit in the virtual representation and display a preview; means for an emotion analysis engine to analyze the user's input and behavior and adjust the outfit suggestion based on the user's emotions; means for a user to select outfits appropriate for a specific time, place, and occasion; means for the server to search for and suggest relevant items from a plurality of options; means for the user to register items the user has in the system; means for the terminal to suggest combinations of items they have in stock and new items; means for the user to input their own design ideas if they cannot find a specific item; means for the server to save the user's design specifications and send the design data to partner companies that can manufacture the items; and means for the terminal to display the items as virtual items and for the user to wear them on the virtual representation to confirm them. This makes it possible to propose customized fashion items that match the user's emotions and moods, and also makes it possible to smoothly combine items with existing items and reflect original designs.

[0515] "User" refers to an individual who uses the System to create an account and attempt to create a virtual representation or coordination.

[0516] "New Account" refers to an account created when a User registers with the System for the first time.

[0517] "Interests" refers to information entered by a user during the registration process that indicates a particular fashion style or preference.

[0518] "Virtual Representation" refers to the digital representation (avatar) of oneself that a user creates within the system.

[0519] "Basic characteristics" refers to attributes such as body shape, hairstyle, skin color, etc. of the user's virtual representation.

[0520] "Authentication information" refers to information that allows a system to recognize and authorize a user, such as a username and password.

[0521] "Artificial intelligence coordination suggestion engine" refers to an artificial intelligence model that suggests optimal fashion coordination based on data entered by the user.

[0522] "Information storage device" refers to a database or storage for saving user information and product data.

[0523] An "emotion analysis engine" is an engine that analyzes user input and behavioral data to determine the emotions at that time.

[0524] "Time, place, occasion" refers to the criteria for selecting clothing appropriate for a particular situation.

[0525] "Choice" refers to a selection of multiple items that the server proposes to the user.

[0526] "Item" refers to fashion-related products such as clothing and accessories that users can select, register, and purchase within the system.

[0527] "Design Idea" refers to an original clothing design newly proposed by a user.

[0528] "Design specifications" refers to specific details of the design proposed by the user, such as color, material, and shape of the design.

[0529] "Manufacturing partner companies" refer to companies that work with the system to actually manufacture the user's design.

[0530] "Virtual item" refers to a digital item that virtually represents an item designed by a user within the system.

[0531] The present invention relates to a system that allows users to try out fashion coordination using their own virtual representation (avatar) in a virtual store and purchase products based on the coordination. This system incorporates an emotion analysis engine that recognizes the user's emotions and also has the function of adjusting coordination suggestions based on the user's emotions.

[0532] 1. User registration and login function

[0533] When a user creates a new account, they enter their name, email address, password, and interests. The device sends the information to the server, which stores the user's information in a database. The server then sends a confirmation email to the user's email address, and the user clicks on a link in the email to authenticate their account. HTTPS is used for communication between the server and the device.

[0534] As a specific example of usage, a user enters "Name: Yamada Taro, Email address: yamada@example.com, Interests: Casual fashion", and the server stores this information in a PostgreSQL database.

[0535] 2. Avatar Creation and Stylist Assistance

[0536] Users access the avatar creation page and input characteristics such as body shape, hairstyle, and skin color. The device generates an avatar in real time based on the input and displays a preview. After the user checks and edits the avatar and finally saves it, the device sends the avatar information to the server.

[0537] To operate the AI ​​stylist, the server runs a generative AI model (e.g., GPT-4 (registered trademark)) to generate optimal outfit suggestions based on the stored avatar information.

[0538] 3. Product search and combination suggestions

[0539] When a user searches for an item suitable for a specific time, place, or occasion, the device sends the search criteria to the server, which retrieves the relevant product information from the information storage device and sends it to the device. The server uses SQL search queries in this process.

[0540] Similarly, users register their personal items (clothes, shoes, bags, etc.) in the system, and their devices send this information to the server. The server uses the registered data to suggest combinations of the personal items with new products, and the device displays a preview of the suggested outfits on the user's avatar.

[0541] 4. Original design function

[0542] The user accesses the original design page and inputs color, material, and design specifications. The device checks these design details and displays a preview. The server saves the user's design specifications in a database and sends the design data via API to partner companies that can manufacture the product. The server also obtains quotes and delivery date information from partner companies and notifies the user.

[0543] For example, a user might enter specifications such as "red cashmere sweater, size medium, V-neck design," which the server then sends to a manufacturing partner.

[0544] 5. Purchase and Delivery Procedures

[0545] If the user likes the suggested outfit and adds it to the cart, the terminal displays the cart contents and total amount, and the user proceeds with the purchase.The server then connects to a payment system (e.g., Stripe) to process the payment.

[0546] Once payment is confirmed, the server saves the order information and starts the delivery process. The server also sends a shipping notification to the user via a dedicated app or email. The terminal displays this information to the user so that the user can check the delivery status in real time.

[0547] Additional configuration of the sentiment analysis engine

[0548] When a user uses the system, the emotion analysis engine analyzes the user's input and behavior (for example, the amount of time spent viewing an item or how often they click) to determine their emotions at the time. The device then sends the emotion analysis engine's analysis data to the server, which then uses this data to suggest the most suitable outfits for the user.

[0549] An example of a prompt sentence in this case may be "Suggest a relaxing outfit suitable for a user who has been feeling a bit tired recently."

[0550] The above is a specific embodiment of the present invention. With this configuration, users can receive fashion suggestions customized to their emotions and moods, and can easily combine existing items and incorporate original designs.

[0551] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0552] Step 1:

[0553] A user creates a new account. The user enters their name, email address, password, and interests (input data: name, email address, password, interests).

[0554] The terminal receives the input data and sends it to the server (action: form submission).

[0555] The server saves the received data in the database (data processing: saving user data).

[0556] The server sends a confirmation email to the user's email address (Output:Confirmation email).

[0557] Step 2:

[0558] The user clicks on a link in a confirmation email to authenticate their account (Input: Email Link Clicked).

[0559] The server receives the link click and authenticates the account (data calculation: code verification).

[0560] The server verifies the authentication and notifies the user (Output: Authentication complete message).

[0561] Step 3:

[0562] The user accesses the avatar creation page and inputs characteristics such as body shape, hairstyle, and skin color (input data: avatar characteristics).

[0563] The device generates an avatar based on the input data and displays a preview (operation: real-time generation and display of avatar).

[0564] The user checks and edits the avatar and finally saves it (input data: edited avatar features).

[0565] The device sends the final avatar information to the server (output: avatar information).

[0566] Step 4:

[0567] The server receives the saved avatar information and runs the AI ​​stylist (input: avatar information).

[0568] The server uses a generative AI model (e.g., GPT-4) to generate optimal outfit suggestions (data calculation: generating outfit suggestions).

[0569] The server sends the proposal results to the terminal (output: coordination proposal).

[0570] Step 5:

[0571] The user inputs search criteria to search for items suitable for a specific time, place, or occasion (input: search criteria).

[0572] The terminal sends the search conditions to the server (action: send search conditions).

[0573] The server retrieves the relevant product information from the information storage device and sends it to the terminal (data calculation: SQL search query execution, output: product information).

[0574] Step 6:

[0575] The user registers the items they have in their possession in the system (input: information about the items they have in their possession).

[0576] The device sends information about the items in hand to the server (action: sending item information).

[0577] The server uses the registered data to generate combinations of items in hand and new products (data calculation: item combination proposal).

[0578] The server sends the proposal results to the terminal (output: item combination proposals).

[0579] Step 7:

[0580] The user accesses the original design page and inputs the color, material, and design specifications (input: design specifications).

[0581] The device checks the input data and displays a preview (action: preview design).

[0582] The server stores the design specifications in a database and sends the design data to partner companies that can manufacture the product (data processing: sending design data, output: design specifications).

[0583] Step 8:

[0584] The server obtains quotes and delivery date information from manufacturing partner companies and notifies the user (operation: obtain and notify quote and delivery date information, output: quote and delivery date information).

[0585] Step 9:

[0586] The user adds the suggested outfit to their cart (input: add to cart).

[0587] The terminal displays the contents of the cart and the total amount, and the user completes the purchase process (operation: displaying cart contents and completing the purchase process).

[0588] The server works with the payment system (e.g., Stripe) to process the payment (data calculation: payment processing, output: payment completion information).

[0589] Step 10:

[0590] If the server confirms the payment, it saves the order information and starts the delivery procedure (data processing: saving the order information and starting the delivery procedure).

[0591] The server sends a shipping notification to the user via a dedicated app or email (Action: Send shipping notification, Output: Shipping notification).

[0592] Step 11:

[0593] The sentiment analysis engine analyzes the user's input and behavior (e.g., time spent viewing an item and frequency of clicks) and analyzes the emotions expressed at that time (input: user behavior data, data calculation: sentiment analysis).

[0594] The device sends the analysis data from the emotion analysis engine to the server (action: sending emotion data).

[0595] The server proposes optimal outfits to the user based on the emotion analysis results (data calculation: emotion-based suggestions, output: updated outfit suggestions).

[0596] The terminal reflects the updated outfit suggestions in a virtual representation of the user and displays a preview (action: outfit preview display).

[0597] (Application example 2)

[0598] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0599] Since the process of trying on outfits and purchasing products in a virtual store is linked to the user's emotions and the items they own, it is necessary to increase user satisfaction. Another challenge is to provide realistic, appropriate, and prompt outfit suggestions based on the user's emotions. Furthermore, it is necessary to improve the integration and flexibility of the entire system so that outfit selection and combination suggestions tailored to specific occasions best fit the user's actual situation.

[0600] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for the terminal to collect user behavior data and analyze emotions using an emotion engine, means for the server to dynamically adjust the conditions for coordination suggestions based on the analysis results, and means for generating design ideas suitable for the user based on the analysis by the emotion engine. This makes it possible to generate appropriate coordination suggestions and design ideas based on the user's emotions, thereby increasing user satisfaction.

[0601] A "user" is an individual who uses the system to try out their own outfits in the virtual boutique and purchase products.

[0602] "Create a new account" refers to the process required for a user to register for the first time on the system, by entering their name, email address, password, and interests.

[0603] "Interests" is information that indicates a user's preferences and interests, and is data that is used to suggest products in the system.

[0604] An "avatar" is a digital character that a user uses as their own representative within the system, and the user can set characteristics such as body shape, hairstyle, and skin color.

[0605] A "server" is a computer system that stores and manages user information and product data and controls the operation of the entire system.

[0606] "Authentication information" refers to the verification data required for a user to access a system, and primarily refers to an email address and password.

[0607] "AI Stylist" is a system function that uses artificial intelligence to suggest optimal outfits to users.

[0608] "Coordination suggestions" is the process by which the system presents the user with multiple combinations of clothes and accessories.

[0609] A "terminal" is a device used by a user to operate the system, and includes a smartphone, tablet, etc.

[0610] A "database" is an information system that systematically stores and manages various data used in a system.

[0611] "Behavioral data" is a record of a series of operations and interactions a user performs within the system, including, for example, the amount of time spent viewing items and the frequency of clicks.

[0612] An "emotion engine" is an algorithm that analyzes a user's behavioral data and estimates the user's current emotional state.

[0613] The "analysis results" are information about the user's emotional state derived by the emotion engine based on behavioral data.

[0614] A "design idea" is a product design concept that a user has devised himself or herself, and includes color, material, design specifications, etc.

[0615] "Manufacturing partner companies" are external companies that manufacture actual products based on the user's design ideas.

[0616] "Dynamic adjustment" is the process of changing system conditions and settings in real time in response to the user's current state or new data.

[0617] To implement this invention, it is necessary to develop a smartphone-based application and build a system that includes functions provided through interactions between a server, a terminal, and a user. The main components of the system and their specific processing are described below.

[0618] 1. User registration and login

[0619] When a user creates a new account, they enter their name, email address, password, and interests. The device sends these details to the server, which uses MongoDB to store the user information in a database. The server then sends a confirmation email to the user's email address, and the user authenticates the account by clicking a link.

[0620] 2. Avatar creation and AI stylist operation

[0621] When a user sets their body shape, hairstyle, skin color, etc. on the avatar creation page, the device processes the input data using TENSORFLOW (registered trademark).js to generate an avatar. The generated avatar is previewed and the user can confirm and edit it. The saved information is then sent to the server, where the server-side AI stylist (OpenAI (registered trademark) GPT-4 API) uses it to make initial outfit suggestions.

[0622] 3. Product search and combination suggestions

[0623] When a user selects an outfit for a particular occasion, the device sends that selection to the server. The server retrieves the corresponding product information from the database and returns the data to the device. The user also registers photos of items they own, which are also sent to the server. The server then suggests combinations of the items they own with new products, reflects them on the avatar, and displays a preview.

[0624] 4. Original design function

[0625] If a user cannot find a specific product, they can input their own design idea. A preview generated on the device is displayed and the design content is sent to the server. The server stores this information and sends the design data to partner companies that can manufacture the product. Estimates and delivery date information are also obtained from the server and notified to the user.

[0626] 5. Purchase and Delivery Procedures

[0627] When the user adds their favorite items to the cart, the terminal displays the cart contents and total amount. The user completes the purchase procedure, and the server processes the payment in cooperation with a payment system (e.g., Stripe or PayPal). After the payment is confirmed, the server saves the order information and starts the shipping process. A shipping notification is sent to the user via a dedicated app or email, and the terminal displays the delivery status in real time.

[0628] 6. Implementation of emotion engine and dynamic adjustment of coordination suggestions

[0629] When a user uses the system, the device collects the user's behavioral data (such as the amount of time spent viewing items and how often they click). This data is sent to an emotion engine (OpenAI GPT-4 API) that analyzes the user's emotional state. The analysis results are sent to the server, which dynamically adjusts the conditions for coordinating outfit suggestions based on the results. This enables more appropriate and personalized suggestions.

[0630] Examples of concrete examples and prompts

[0631] Example: Relaxed style suggestions using an emotion engine

[0632] Example prompt sentence:

[0633] If the user appears tired, suggest a relaxed style outfit, such as a loose top and relaxed pants.

[0634] When this prompt text is sent to the OpenAI GPT-4 API, the generated coordination suggestions are reflected on the device via the server and displayed to the user.

[0635] This system configuration makes it possible to dynamically suggest outfits and generate original designs based on the user's emotional state, thereby increasing user satisfaction.

[0636] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0637] Step 1:

[0638] A user creates a new account. Specifically, the user enters their name, email address, password, and interests into an input form. The entered data is sent from the device to the server, which receives it and stores it in a MongoDB database. The server then sends a confirmation email to the user's email address, which contains a link for account authentication. The user clicks the link in the email to complete the authentication.

[0639] Step 2:

[0640] The user creates an avatar. The user enters their characteristics, such as body shape, hairstyle, and skin color, on the avatar creation page on their device. This characteristic data is processed using TensorFlow.js to generate the user's avatar. The generated avatar is displayed as a preview, allowing the user to check and edit it. The final saved avatar data is sent to the server.

[0641] Step 3:

[0642] The AI ​​stylist makes an initial outfit suggestion. The server obtains the user's avatar data and interest data and sends a request to the OpenAI GPT-4 API. The generated outfit suggestion is received by the server and sent to the device. The device reflects the suggestion on the avatar and displays it as a preview to the user.

[0643] Step 4:

[0644] The user performs a product search. Using a terminal, the user inputs search criteria for clothing appropriate for a specific time, place, and occasion (e.g., formal, casual). The input criteria are sent to the server, which retrieves relevant product information from a database. The retrieved product information is sent to the terminal and suggested to the user.

[0645] Step 5:

[0646] The user registers the items they own. They then take photos of their clothes, shoes, and bags on their device and upload them to the system. The uploaded data is sent to the server and stored in a database. Based on the stored data, the server generates combination suggestions for new products and their own items and sends them to the device.

[0647] Step 6:

[0648] The emotion engine performs emotion analysis. When a user uses the system, the device collects user behavior data (e.g., time spent viewing items, frequency of clicks). This data is sent to the emotion engine, which uses the OpenAI GPT-4 API to analyze the user's emotional state. The analysis results are then sent to the server.

[0649] Step 7:

[0650] The server adjusts the outfit suggestions based on the user's emotional state. The server dynamically adjusts the product search criteria based on the analysis results from the emotion engine. New product information is searched for in the database based on the adjusted criteria and sent to the device. The device then reflects the updated outfit suggestions on the avatar and displays them as a preview to the user.

[0651] Step 8:

[0652] The user enters their original design. If the user cannot find a specific product, they access a page for entering design ideas and enter color, material, and design specifications. The input information is previewed on the device and finally sent to the server. The server stores the design specifications in a database and sends the design data to partner companies that can manufacture the product. Quotes and delivery date information are sent from the partner companies to the server, and are finally notified to the user.

[0653] Step 9:

[0654] The user completes the purchase and shipping process. The user adds the suggested items to the cart and completes the purchase process. The terminal displays the cart contents and total amount, and when the user presses the purchase button, the server works with the payment system to process the payment. Once the payment is confirmed, the server saves the order information and begins the shipping process. A shipping notification is sent to the user's terminal, allowing the user to check the delivery status in real time.

[0655] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0656] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0657] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0658] [Second embodiment]

[0659] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0660] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0661] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0662] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0663] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0664] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0665] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0666] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0667] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0668] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0669] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0670] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0671] The present invention is a system that allows users to try out outfits and purchase products using their own avatars in a virtual boutique. The system also provides functions for suggesting combinations with items the user already owns and for commercializing original designs.

[0672] Basic system configuration

[0673] 1. User registration and login function

[0674] When a user creates a new account, they enter their name, email address, password, and interests.

[0675] The terminal sends the input information to the server, and the server stores the user information in a database.

[0676] The server sends a confirmation email to the user's email address, and the user clicks on the link in the email to authenticate their account.

[0677] 2. Avatar Creation and Stylist Assistance

[0678] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page.

[0679] The device will generate an avatar based on your input and display a preview.

[0680] The user checks and edits the avatar and finally saves it.

[0681] Based on the information stored on the device, an AI stylist will be activated to suggest the best outfit.

[0682] 3. Product search and combination suggestions

[0683] A user searches for items that fit a specific occasion (e.g., formal, casual).

[0684] The terminal transmits the input conditions to the server, and the server retrieves information on the corresponding product from the database and transmits it to the terminal.

[0685] Users register photos of their clothes, shoes, and bags and send that information to the server.

[0686] The device suggests combinations of new products with items the user has on hand, and displays a preview of the suggested coordination reflected on the avatar.

[0687] 4. Original design function

[0688] The user accesses a page for inputting an original design and inputs the color, material, and design specifications.

[0689] The device will check the design and display a preview.

[0690] The server stores the user's design specifications and transmits the design data to manufacturing partner companies as needed.

[0691] The server obtains quotes and delivery date information from manufacturing partner companies and notifies the user.

[0692] 5. Purchase and Delivery Procedures

[0693] Users add their favorite items to their cart.

[0694] The terminal displays the cart contents and total amount, and the user completes the purchase.

[0695] The server works with the payment system to process the payment.

[0696] The server stores the user's order information and initiates the delivery process.

[0697] The server will send a shipping notification to the user via a dedicated app or email.

[0698] Specific examples

[0699] Example 1: Creating a new account

[0700] 1. A user visits the new account creation page and enters their name, email address, password, and interests such as casual style.

[0701] 2. The device sends this information to the server.

[0702] 3. The server stores the user information in a database and sends a confirmation email.

[0703] 4. The user clicks the link in the email to authenticate their account.

[0704] Example 2: Avatar creation and initial outfit suggestions

[0705] 1. The user enters height, hairstyle, skin color, etc. on the avatar creation page.

[0706] 2. The device generates an avatar and displays a preview to the user.

[0707] 3. The user is happy with the avatar and hits the save button.

[0708] 4. The device activates an AI stylist to suggest jeans and T-shirts based on the user's preferences.

[0709] 5. The server retrieves the relevant product information from the database and sends it to the terminal.

[0710] 6. The device reflects the coordinated outfit on the avatar and displays a preview to the user.

[0711] Example 3: Product search and purchase

[0712] 1. A user is looking for clothing suitable for a formal occasion and selects a specific brand.

[0713] 2. The device sends the selection to the server.

[0714] 3. The server searches the database for the brand's formal wear and sends it to the device.

[0715] 4. The user adds the items they like to their cart and checks out.

[0716] 5. The server connects to the payment system to process the payment and initiate the delivery procedure.

[0717] 6. The server sends a shipping notification to the user, and the terminal displays the delivery status to the user in real time.

[0718] The above is a concrete example of the system. This configuration allows users to easily find outfits and products that suit them, and they can also combine them with existing items. Furthermore, by supporting the realization of original designs, custom-made items can be easily obtained.

[0719] The processing flow will be explained below.

[0720] User registration and login functionality

[0721] Step 1:

[0722] A user visits a new account creation page and enters their name, email address, password, and interests.

[0723] Step 2:

[0724] The device sends the input to the server.

[0725] Step 3:

[0726] The server stores the received user information in a database.

[0727] Step 4:

[0728] The server sends a confirmation email to the user's email address.

[0729] Step 5:

[0730] The user clicks the link in the confirmation email to verify their account.

[0731] Step 6:

[0732] The user enters their email address and password on the login page.

[0733] Step 7:

[0734] The device sends the input to the server.

[0735] Step 8:

[0736] The server queries the database to verify the authentication information.

[0737] Step 9:

[0738] If the server authenticates the user, it starts a session and redirects them to the dashboard.

[0739] Step 10:

[0740] The terminal displays the user's login status.

[0741] Avatar Creation and Stylist Assist

[0742] Step 1:

[0743] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page.

[0744] Step 2:

[0745] The device will generate an avatar based on your input and display a preview.

[0746] Step 3:

[0747] The user checks the avatar and makes corrections if necessary.

[0748] Step 4:

[0749] The user saves the final avatar settings.

[0750] Step 5:

[0751] The device will activate an AI stylist based on the information stored on it.

[0752] Step 6:

[0753] An AI stylist will create the initial outfit based on the user's preferences.

[0754] Step 7:

[0755] The server retrieves the relevant product data from the database and sends it to the terminal.

[0756] Step 8:

[0757] The device will reflect the suggested outfit on the avatar and display a preview.

[0758] Product search and combination suggestions

[0759] Step 1:

[0760] The user selects clothing appropriate for a particular occasion.

[0761] Step 2:

[0762] The device sends the selection to the server.

[0763] Step 3:

[0764] The server searches the database based on multiple brands, place of manufacture, fabric, etc., and retrieves the relevant products.

[0765] Step 4:

[0766] The server transmits product information to the terminal.

[0767] Step 5:

[0768] Users upload images of their clothes, shoes, and bags and register them in the system.

[0769] Step 6:

[0770] The server stores the information about the items in your possession in a database.

[0771] Step 7:

[0772] The device suggests combinations of new products with the user's existing items.

[0773] Step 8:

[0774] The device will reflect the suggested outfit on the avatar and display a preview.

[0775] Original design function

[0776] Step 1:

[0777] The user accesses a page for inputting an original design and inputs the color, material, and design specifications.

[0778] Step 2:

[0779] The device will check the design and display a preview.

[0780] Step 3:

[0781] The terminal transmits the design data to the server.

[0782] Step 4:

[0783] The server stores the user's design specifications and transmits the design data to partner companies that can manufacture the product.

[0784] Step 5:

[0785] The server obtains quotes and delivery date information from manufacturing partner companies.

[0786] Step 6:

[0787] The server notifies the user of the estimate and delivery date information.

[0788] Step 7:

[0789] The user gives final approval.

[0790] Step 8:

[0791] The server notifies partner companies that production has begun.

[0792] Purchase and shipping procedures

[0793] Step 1:

[0794] Users add their favorite items to their cart.

[0795] Step 2:

[0796] The terminal displays the cart contents and total amount.

[0797] Step 3:

[0798] The user begins the checkout process and enters shipping and payment information.

[0799] Step 4:

[0800] The device sends the input to the server.

[0801] Step 5:

[0802] The server connects to the payment system and processes the payment.

[0803] Step 6:

[0804] If the server confirms the payment, it saves the order information and starts the delivery process.

[0805] Step 7:

[0806] The server sends a shipping notification to the user.

[0807] Step 8:

[0808] The terminal displays the purchase status to the user in real time.

[0809] Example 1

[0810] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0811] When users purchase fashion items online, they often face challenges in finding the right items. Coordinating existing and new items is also difficult, making it difficult to get suggestions that match their style. Furthermore, limited options for custom-made items and original designs make it difficult to meet individual needs.

[0812] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0813] In this invention, the server includes means for saving user information and managing authentication information, means for searching for relevant products from a database and sending them to the terminal, and means for saving the user's design specifications and sending the design data to partner companies that can manufacture them. This allows users to easily find outfits that suit them, combine existing items with new items, and even create custom-made items and original designs.

[0814] A "user" is a person who uses the system, creates an account, and purchases fashion items and receives coordination suggestions through a virtual character image.

[0815] A "virtual person" is a digital avatar that a user creates based on their own characteristics, such as height, hairstyle, and skin color, and is used to preview outfits.

[0816] "Server" refers to a computer device that manages information for the entire system, stores and authenticates user information, searches for products from a database, and stores and transmits design data.

[0817] "Terminal" refers to a device, such as a PC or smartphone, through which a user accesses the system and performs operations such as sending input information and displaying a preview of an outfit.

[0818] The "Artificial Intelligence Stylist" is an AI model that analyzes the user's preferences and characteristics and suggests the optimal coordination.

[0819] A "database" is an information management system that stores product information and user information and makes them searchable.

[0820] "Purpose of use" refers to the purpose of the fashion style or item that a user desires for a particular occasion or situation.

[0821] "Cooperating companies" refer to external manufacturing partners that manufacture products based on the user's original designs.

[0822] "Preview" is a function that allows the user to visually confirm the state in which the coordinates and design items selected by the user are applied to the virtual person image.

[0823] The present invention relates to a system that allows users to try out outfits and purchase products using their own virtual persona in a virtual boutique. The system also provides functions for suggesting combinations with items the user already owns and for commercializing original designs.

[0824] Basic system configuration

[0825] User registration and login functionality

[0826] A user creates a new account and enters information such as their name, email address, password, and interests. The device sends this information to the server, which stores it in a database. The server also manages authentication information and sends a confirmation email to the user. The user clicks on a link in the email to authenticate their account.

[0827] Virtual persona creation and stylist assistance

[0828] The user enters characteristics such as height, hairstyle, and skin color on the virtual person creation page. The device receives this information, generates a virtual person, and displays a preview. The user checks, edits, and saves the virtual person, and the device sends this information to the server. The server then runs an AI stylist to suggest the best outfits for the user.

[0829] Product search and combination suggestions

[0830] When a user searches for an item that meets a specific purpose, the device sends the search criteria to the server. The server retrieves the relevant products from the database and sends them to the device. The user registers photos of items they own (clothes, shoes, bags, etc.), and the device sends this information to the server. Based on this, the server suggests new product combinations, and the device reflects these combinations on a virtual person image and displays a preview.

[0831] Original design function

[0832] The user accesses the original design page and inputs color, material, and design specifications. The device confirms this and displays a design preview. The server saves the design specifications and sends the design data to cooperating companies as needed. The server obtains quotes and delivery date information from cooperating companies and notifies the user.

[0833] Purchase and shipping procedures

[0834] The user adds the items they like to their cart and completes the purchase. The terminal displays the cart contents and total amount, and the server connects with the payment system to process the payment. The server saves the order information and starts the delivery process. The user receives a shipping notification by email or via a dedicated app, and can check the delivery status in real time.

[0835] Specific examples

[0836] Example 1: Creating a new account

[0837] A user accesses the new account creation page and enters their name, email address, password, and interests such as casual style. The device sends this information to the server, which stores the user information in a database and sends a confirmation email. The user clicks on the link in the email to authenticate their account.

[0838] Example 2: Creating a virtual persona and initial outfit suggestions

[0839] The user enters height, hairstyle, skin color, etc. on the virtual person creation page. The device generates a virtual person and displays a preview to the user. When the user is satisfied with the virtual person, they press the save button. The device activates an AI stylist, which suggests jeans and a T-shirt based on the user's preferences. The server retrieves the relevant product information from the database and sends it to the device. The device reflects the coordination on the virtual person and displays a preview to the user.

[0840] Example 3: Product search and purchase

[0841] The user searches for clothing suitable for a formal occasion and selects a particular brand. The device sends the selection to the server, which retrieves the relevant product information from a database and sends it to the device. The user adds the items they like to their cart and completes the purchase. The server connects with the payment system to process the payment and initiate the delivery process. The server sends a shipping notification to the user, and the device displays the delivery status to the user in real time.

[0842] This invention allows users to easily find outfits and products that suit them, and also allows them to combine existing items. It also makes it possible to create items with original designs.

[0843] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0844] Step 1:

[0845] A user visits a new account creation page. The user enters their name, email address, password, and interests. This data is sent as input to the device. The device packages this input data in JSON format and sends it to the server.

[0846] Step 2:

[0847] The server analyzes the received user information and saves it in a database. The server performs data calculations to verify whether the email address format is correct and whether the password meets the specified format, and if there are no problems, saves it in the database. Saving it in the database is the output.

[0848] Step 3:

[0849] The server sends a confirmation email to the registered email address. The server generates an authentication link and sends an email containing that link to the user. The confirmation email is the output.

[0850] Step 4:

[0851] The user clicks on the link in the confirmation email and authenticates their account. The server receives this action and updates the user status as "authenticated", allowing the user to log in. The output is a database update.

[0852] Step 5:

[0853] The user accesses the virtual person creation page and inputs characteristics such as height, hairstyle, and skin color. This input data is sent to the terminal, which processes the data in batches to generate a virtual person. A preview of the generated virtual person is output.

[0854] Step 6:

[0855] The user checks the virtual person image and modifies it if necessary. When the user finally clicks the button to save the virtual person image, the data is sent from the device to the server. The saved data is output.

[0856] Step 7:

[0857] The server sends the received virtual person data as input to the AI ​​model, which generates an appropriate outfit based on the user's characteristics and past data. The calculation results of this AI model are output as outfit suggestions.

[0858] Step 8:

[0859] The user searches for an item that meets a specific purpose. The search criteria entered by the user are sent by the terminal to the server. The server searches the database for relevant product information and sends the results to the terminal. The search results are output.

[0860] Step 9:

[0861] The user registers a photo of an item they own. This photo data is sent to the server by the device. The server analyzes the image and stores it in a database as different item information. The image analysis results are output.

[0862] Step 10:

[0863] The server proposes combinations of items in hand with new products. The server uses an AI model to calculate appropriate combinations. The results are sent to the device, which reflects the results on the virtual person and displays a preview. The proposed combinations are the output.

[0864] Step 11:

[0865] The user accesses a page to input their original design. The user inputs the color, material, and design specifications, and the data is sent from the terminal to the server. The server saves the design data in a database and sends it to partner companies as needed. The saved design data becomes the output.

[0866] Step 12:

[0867] The server obtains quotes and delivery date information from partner companies. The server notifies the user of this information, and the terminal displays it to the user. The quote information is output.

[0868] Step 13:

[0869] The user adds the items they like to the cart. The device manages the contents of the cart and sends the information to the server. The cart information is output.

[0870] Step 14:

[0871] The user completes the purchase procedure. The user enters payment information, and that data is sent from the terminal to the server. The server then works with the payment system to process the payment. The payment result is output.

[0872] Step 15:

[0873] The server saves the user's order information and starts the delivery process. The server then sends the information to the delivery company and notifies the user of the delivery status. The user can check the delivery status in real time. The delivery notification is the output.

[0874] (Application example 1)

[0875] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0876] While there are many systems available today that allow users to try on outfits using their own avatars in a virtual environment, there are still insufficient systems that can comprehensively manage a user's inventory, provide virtual try-ons, real-time outfit suggestions, and even create and commercialize original designs. There is also a need for comprehensive management of real-time try-ons, original item designs, purchase procedures, and delivery procedures within a virtual boutique. Therefore, it is essential to provide an integrated system that enhances user convenience.

[0877] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0878] In this invention, the server includes means for a user to create a new account and register interests, means for a user to create their own avatar and set basic characteristics, means for the server to save user information and manage authentication information, means for a terminal to operate an AI stylist and make initial outfit suggestions, means for the server to search for relevant products from a database and send them to the terminal, means for the terminal to reflect the suggested outfit on the avatar and display a preview, means for the user to input an original design, means for the server to save the user's design specifications and send the data to a manufacturing partner, and means for the terminal to preview the original design. This allows a user to try out combinations of existing items with new products in a virtual environment, receive outfit suggestions, easily commercialize their original design, and consistently manage purchase and delivery procedures.

[0879] A "user" is an individual who uses the virtual boutique system to create an avatar, try on outfits, purchase products, and create original designs.

[0880] A "new account" is individual user information created by a user when using the virtual boutique system for the first time.

[0881] "Interests" refers to information about a user's fashion style, preferences, and areas of interest that the user registers when using the system.

[0882] An "avatar" is a virtual character that a user creates within the virtual boutique system to represent themselves.

[0883] "AI Stylist" is a system equipped with artificial intelligence that suggests outfits based on the user's interests and the items they own.

[0884] The "server" is a computer system that manages and stores user information and design data, verifies authentication information, and searches and suggests product data.

[0885] A "database" is a large-scale data storage system connected to a server, and stores user information, product data, design data, and the like.

[0886] "Items in hand" are fashion-related items such as clothes and accessories that the user already owns.

[0887] An "original design" is a fashion item design that a user creates independently within the virtual boutique system.

[0888] A "manufacturing partner" is a company or factory that produces actual products based on a user's original design.

[0889] "Virtual try-on" is a function that allows a user to check how an item selected in the virtual boutique system looks by having an avatar try it on.

[0890] "Purchase procedure" refers to a series of procedures required for a user to purchase a product selected by the user through the virtual boutique system.

[0891] "Delivery procedure" refers to the process of arranging and managing logistics so that the products purchased by the user can be delivered to their home.

[0892] The present invention is an integrated system that allows users to try out outfits and purchase products using their own avatar in a virtual boutique. This system also provides functions for suggesting combinations with items the user already owns and for commercializing original designs. Specific embodiments for realizing this system are described below.

[0893] User registration and login functionality

[0894] A user creates a new account and registers their name, email address, password, and interests. The device sends this information to the server, which stores it in a database. The server then sends a confirmation email to the user's email address, and the user clicks on a link in the email to authenticate their account.

[0895] Avatar creation and stylist assistance features

[0896] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page, and the device generates an avatar based on the input and displays a preview. The user can then confirm and save the avatar. Based on the saved information, the device activates an AI stylist to suggest the best outfits.

[0897] Product search and combination suggestion function

[0898] The user searches for items that suit a specific time, place, and occasion, and the device sends the search criteria to the server, which then retrieves information about the relevant products from a database and sends it to the device. The user registers photos of their current clothes, shoes, and bags, and sends that information to the server. The device then suggests combinations of new products with the user's current items, and displays a preview of the suggested outfits reflected on an avatar.

[0899] Original design function

[0900] The user accesses a page to input their original design and enters the color, material, and design specifications. The device checks the design content and displays a preview. The server saves the user's design specifications and sends the design data to manufacturing partners as needed. The server obtains quotes and delivery date information from manufacturing partners and notifies the user.

[0901] Purchasing and shipping functions

[0902] The user adds the items they like to the cart, and the terminal displays the cart contents and total amount. The user completes the purchase procedure, and the server processes the payment in conjunction with the payment system. The server saves the user's order information and starts the delivery procedure. The server sends a shipping notification to the user via a dedicated app or email, and the terminal displays the delivery status in real time.

[0903] Hardware and software used

[0904] Hardware: Smartphone (e.g. iPhone, Android device)

[0905] Software: Python, REST API, PIL (Python Imaging Library), AI model

[0906] Specific examples

[0907] A specific example of operations in which a user creates a new account, creates an avatar, tries on a specific item, and purchases it is as follows.

[0908] 1. Create a new account

[0909] A user visits a new account creation page and enters their name, email address, password, and interests. The device sends this information to the server, which stores the user information in a database. The server then sends the user a confirmation email, and the user clicks on a link in the email to authenticate their account.

[0910] 2. Create an avatar

[0911] The user enters height, hairstyle, skin color, etc. on the avatar creation page. The device generates an avatar based on the input and displays a preview. The user can then confirm and save the avatar.

[0912] 3. Virtual try-on

[0913] Users search for items suited to a particular occasion and then have their avatar try on the items to see a preview.

[0914] 4. Purchase procedure

[0915] The user adds the items they like to their cart and completes the purchase. The server then connects with the payment system to process the payment and begin the delivery process. The server then sends a shipping notification to the user via a dedicated app or email, and the device displays the delivery status in real time.

[0916] Prompt Sentence Examples

[0917] A system that searches for items suited to a specific TPO (e.g., formal, casual) and suggests combinations of clothes, shoes, and bags that you already own.

[0918] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0919] Step 1:

[0920] Create a new account

[0921] Input: User enters name, email address, password, and interests.

[0922] Specific operation: The terminal receives the input information and sends it to the server.

[0923] Data processing: The server stores the received user information in a database.

[0924] Output: The server sends a confirmation email to the user's email address.

[0925] Step 2:

[0926] User Authentication

[0927] Input: User clicks on the link in the confirmation email.

[0928] Specific behavior: The server verifies that the link was clicked and changes the account to an authenticated state.

[0929] Data processing: Update authentication information to the database.

[0930] Output: The account is authenticated and the user can log in.

[0931] Step 3:

[0932] Avatar Creation

[0933] Input: The user enters characteristics such as body shape, hairstyle, and skin tone on the avatar creation page.

[0934] Specific operation: The device receives the input and sends the data to the avatar generation API.

[0935] Data processing: The server generates an avatar based on the avatar generation API.

[0936] Output: A preview of the generated avatar will be displayed on the device.

[0937] Step 4:

[0938] Stylist Assist

[0939] Input: User confirms and saves registered avatar.

[0940] Specific operation: The device sends avatar information to the AI ​​stylist.

[0941] Data processing: An AI stylist suggests outfits based on the user's interests and data.

[0942] Output: The suggested outfits are displayed on the device.

[0943] Step 5:

[0944] Product search and combination suggestions

[0945] Input: User searches for items that fit a specific TPO.

[0946] Specific operation: The device sends search criteria to the server.

[0947] Data processing: The server retrieves the relevant product information from the database.

[0948] Output: The relevant product information is sent to the terminal and displayed.

[0949] Step 6:

[0950] Register your items

[0951] Input: The user registers photos of their clothes, shoes, and bags.

[0952] Specific operation: The device sends the photo data to the server.

[0953] Data processing: The server analyzes the data sent and stores the item information in a database.

[0954] Output: The registered items are now available in the system.

[0955] Step 7:

[0956] Coordinate preview

[0957] Input: The user confirms the suggested outfit.

[0958] Specific operation: The device reflects the coordinate information on the avatar.

[0959] Data processing: Processing is performed to reflect the data on the avatar.

[0960] Output: A preview of the outfit reflected on the device is displayed.

[0961] Step 8:

[0962] Original design creation

[0963] Input: User enters color, material, and design specifications.

[0964] Specific operation: The device sends the entered design specifications to the server.

[0965] Data processing: The server stores the design data and sends it to the manufacturing partner.

[0966] Output: A preview of your design will be displayed on your device.

[0967] Step 9:

[0968] Get quotes and delivery information

[0969] Input: The server sends the design data to the manufacturing partner.

[0970] What it does: Receive quotes and delivery information from manufacturing partners.

[0971] Data processing: Formatting received information for presentation to the user.

[0972] Output: The user is notified of the estimate and delivery date.

[0973] Step 10:

[0974] Purchase and shipping procedures

[0975] Input: The user adds the items they like to their cart and checks out.

[0976] Specific operation: The terminal displays the cart contents and total amount. The terminal sends the payment information to the server.

[0977] Data processing: The server connects to the payment system and processes the payment.

[0978] Output: The user is notified of the purchase confirmation and shipping information.

[0979] Step 11:

[0980] Delivery notification and real-time tracking

[0981] Input: The server initiates the delivery procedure.

[0982] Specific operation: The server sends the order data to the delivery company.

[0983] Data processing: Receive real-time tracking information from the delivery company.

[0984] Output: Real-time updated delivery status is displayed on the terminal.

[0985] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0986] The present invention relates to a system that allows users to try out outfits and purchase products using their own avatars in a virtual boutique. This system incorporates an emotion engine that recognizes the user's emotions and also has the function of adjusting outfit suggestions based on the user's emotions.

[0987] Basic system configuration

[0988] 1. User registration and login function

[0989] When a user creates a new account, they enter their name, email address, password, and interests.

[0990] The terminal sends the input information to the server, and the server stores the user information in a database.

[0991] The server sends a confirmation email to the user's email address, and the user clicks on the link in the email to authenticate their account.

[0992] 2. Avatar Creation and Stylist Assistance

[0993] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page.

[0994] The device will generate an avatar based on your input and display a preview.

[0995] The user checks and edits the avatar and finally saves it.

[0996] Based on the information stored on the device, an AI stylist will be activated to suggest the best outfit.

[0997] 3. Product search and combination suggestions

[0998] A user searches for items that fit a specific occasion (e.g., formal, casual).

[0999] The terminal transmits the input conditions to the server, and the server retrieves information on the corresponding product from the database and transmits it to the terminal.

[1000] Users register photos of their clothes, shoes, and bags and send that information to the server.

[1001] The device suggests combinations of new products with items the user has on hand, and displays a preview of the suggested coordination reflected on the avatar.

[1002] 4. Original design function

[1003] The user accesses a page for inputting an original design and inputs the color, material, and design specifications.

[1004] The device will check the design and display a preview.

[1005] The server stores the user's design specifications and transmits the design data to manufacturing partner companies as needed.

[1006] The server obtains quotes and delivery date information from manufacturing partner companies and notifies the user.

[1007] 5. Purchase and Delivery Procedures

[1008] Users add their favorite items to their cart.

[1009] The terminal displays the cart contents and total amount, and the user completes the purchase.

[1010] The server works with the payment system to process the payment.

[1011] If the server confirms the payment, it saves the order information and starts the delivery process.

[1012] The server will send a shipping notification to the user via a dedicated app or email.

[1013] Additional configuration of the emotion engine

[1014] 1. Emotion recognition using an emotion engine

[1015] When a user uses the system, the emotion engine analyzes the user's input and behavior (for example, the time spent viewing an item and the frequency of clicks) and analyzes the emotion at that time.

[1016] The device sends the emotion engine analysis data to the server.

[1017] 2. Emotion-based outfit suggestions

[1018] The server receives the analysis results from the emotion engine and dynamically adjusts the conditions for searching for products from the database.

[1019] The server transmits data to the terminal that suggests the most suitable product for the user based on the adjusted conditions.

[1020] The device will reflect the updated coordination suggestions on the avatar and display a preview.

[1021] Specific examples

[1022] Example 1: Coordination suggestions based on the user's mood using an emotion engine

[1023] 1. A user logs into the system and indicates that their recent mood is "fatigued."

[1024] 2. The emotion engine analyzes the user's behavior and determines that a relaxed style is appropriate.

[1025] 3. The server retrieves the relevant product information from the database based on the relaxation style and sends it to the terminal.

[1026] 4. Your device will then preview your avatar in a relaxed outfit (e.g., a loose top and pants).

[1027] Example 2: Flow from purchase to delivery

[1028] 1. The user likes the suggested outfit and adds it to their cart.

[1029] 2. The terminal displays the cart contents and total amount, and the user completes the purchase.

[1030] 3. The server connects to the payment system and processes the payment.

[1031] 4. After the payment is confirmed, the server saves the order information and starts the shipping process.

[1032] 5. The server sends a shipping notification to the user via email or a dedicated app.

[1033] 6. The terminal displays the delivery status to the user in real time.

[1034] The above is a concrete example of the system. This configuration allows users to find outfits and products that suit their emotions and moods, and allows for a smooth purchase process. Furthermore, original designs are possible, and custom-made items tailored to individual users can be provided.

[1035] The processing flow will be explained below.

[1036] Specific processing steps of a system that combines emotion engines

[1037] User registration and login functionality

[1038] Step 1:

[1039] A user visits a new account creation page and enters their name, email address, password, and interests.

[1040] Step 2:

[1041] The device sends the input to the server.

[1042] Step 3:

[1043] The server stores the received user information in a database.

[1044] Step 4:

[1045] The server sends a confirmation email to the user's email address.

[1046] Step 5:

[1047] The user clicks the link in the confirmation email to verify their account.

[1048] Step 6:

[1049] The user enters their email address and password on the login page.

[1050] Step 7:

[1051] The device sends the input to the server.

[1052] Step 8:

[1053] The server queries the database to verify the authentication information.

[1054] Step 9:

[1055] If the server authenticates the user, it starts a session and redirects them to the dashboard.

[1056] Step 10:

[1057] The terminal displays the user's login status.

[1058] Avatar Creation and Stylist Assist

[1059] Step 1:

[1060] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page.

[1061] Step 2:

[1062] The device will generate an avatar based on your input and display a preview.

[1063] Step 3:

[1064] The user checks the avatar and makes corrections if necessary.

[1065] Step 4:

[1066] The user saves the final avatar settings.

[1067] Step 5:

[1068] The device will activate an AI stylist based on the information stored on it.

[1069] Step 6:

[1070] An AI stylist will create the initial outfit based on the user's preferences.

[1071] Step 7:

[1072] The server retrieves the relevant product data from the database and sends it to the terminal.

[1073] Step 8:

[1074] The device will reflect the suggested outfit on the avatar and display a preview.

[1075] Emotion recognition and coordination suggestions using an emotion engine

[1076] Step 1:

[1077] The emotion engine is activated when a user logs in and interacts with the system.

[1078] Step 2:

[1079] The emotion engine analyzes the user's input, browsing behavior, click frequency, etc. to estimate their current emotion.

[1080] Step 3:

[1081] The device sends the emotion engine analysis data to the server.

[1082] Step 4:

[1083] The server receives the emotion analysis results and stores them in a database.

[1084] Step 5:

[1085] The server dynamically changes the search criteria for related products based on the analysis results.

[1086] Step 6:

[1087] The server searches the database using the changed conditions and retrieves the relevant product information.

[1088] Step 7:

[1089] The server transmits product information to the terminal.

[1090] Step 8:

[1091] The device will reflect the suggested outfit on the avatar and display a preview.

[1092] Product search and combination suggestions

[1093] Step 1:

[1094] The user selects clothing appropriate for a particular occasion.

[1095] Step 2:

[1096] The device sends the selection to the server.

[1097] Step 3:

[1098] The server searches the database based on multiple brands, place of manufacture, fabric, etc., and retrieves the relevant products.

[1099] Step 4:

[1100] The server transmits product information to the terminal.

[1101] Step 5:

[1102] Users upload images of their clothes, shoes, and bags and register them in the system.

[1103] Step 6:

[1104] The server stores the information about the items in your possession in a database.

[1105] Step 7:

[1106] The device suggests combinations of new products with the user's existing items.

[1107] Step 8:

[1108] The device will reflect the suggested outfit on the avatar and display a preview.

[1109] Original design function

[1110] Step 1:

[1111] The user accesses a page for inputting an original design and inputs the color, material, and design specifications.

[1112] Step 2:

[1113] The device will check the design and display a preview.

[1114] Step 3:

[1115] The terminal transmits the design data to the server.

[1116] Step 4:

[1117] The server stores the user's design specifications and transmits the design data to partner companies that can manufacture the product.

[1118] Step 5:

[1119] The server obtains quotes and delivery date information from manufacturing partner companies.

[1120] Step 6:

[1121] The server notifies the user of the estimate and delivery date information.

[1122] Step 7:

[1123] The user gives final approval.

[1124] Step 8:

[1125] The server notifies partner companies that production has begun.

[1126] Purchase and shipping procedures

[1127] Step 1:

[1128] Users add their favorite items to their cart.

[1129] Step 2:

[1130] The terminal displays the cart contents and total amount.

[1131] Step 3:

[1132] The user begins the checkout process and enters shipping and payment information.

[1133] Step 4:

[1134] The device sends the input to the server.

[1135] Step 5:

[1136] The server connects to the payment system and processes the payment.

[1137] Step 6:

[1138] If the server confirms the payment, it saves the order information and starts the delivery process.

[1139] Step 7:

[1140] The server sends a shipping notification to the user.

[1141] Step 8:

[1142] The terminal displays the purchase status to the user in real time.

[1143] Example 2

[1144] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1145] Today's consumers demand customized fashion suggestions that reflect their individual style and mood, but existing systems struggle to reflect the user's emotions and moods. Furthermore, there are limited systems that allow users to virtually try on new items by combining existing items with new items. Furthermore, there is a lack of an easy way to incorporate original designs when a specific product cannot be found.

[1146] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1147] In this invention, the server includes: means for a user to create a new account and register interests; means for a user to create a virtual representation of themselves and set basic characteristics; means for the server to save user information and manage authentication information; means for the terminal to operate an artificial intelligence outfit suggestion engine and make an initial outfit suggestion; means for the server to search for relevant items from an information storage device and send them to the terminal; means for the terminal to reflect the suggested outfit in the virtual representation and display a preview; means for an emotion analysis engine to analyze the user's input and behavior and adjust the outfit suggestion based on the user's emotions; means for a user to select outfits appropriate for a specific time, place, and occasion; means for the server to search for and suggest relevant items from a plurality of options; means for the user to register items the user has in the system; means for the terminal to suggest combinations of items they have in stock and new items; means for the user to input their own design ideas if they cannot find a specific item; means for the server to save the user's design specifications and send the design data to partner companies that can manufacture the items; and means for the terminal to display the items as virtual items and for the user to wear them on the virtual representation to confirm them. This makes it possible to propose customized fashion items that match the user's emotions and moods, and also makes it possible to smoothly combine items with existing items and reflect original designs.

[1148] "User" refers to an individual who uses the System to create an account and attempt to create a virtual representation or coordination.

[1149] "New Account" refers to an account created when a User registers with the System for the first time.

[1150] "Interests" refers to information entered by a user during the registration process that indicates a particular fashion style or preference.

[1151] "Virtual Representation" refers to the digital representation (avatar) of oneself that a user creates within the system.

[1152] "Basic characteristics" refers to attributes such as body shape, hairstyle, skin color, etc. of the user's virtual representation.

[1153] "Authentication information" refers to information that allows a system to recognize and authorize a user, such as a username and password.

[1154] "Artificial intelligence coordination suggestion engine" refers to an artificial intelligence model that suggests optimal fashion coordination based on data entered by the user.

[1155] "Information storage device" refers to a database or storage for saving user information and product data.

[1156] An "emotion analysis engine" is an engine that analyzes user input and behavioral data to determine the emotions at that time.

[1157] "Time, place, occasion" refers to the criteria for selecting clothing appropriate for a particular situation.

[1158] "Choice" refers to a selection of multiple items that the server proposes to the user.

[1159] "Item" refers to fashion-related products such as clothing and accessories that users can select, register, and purchase within the system.

[1160] "Design Idea" refers to an original clothing design newly proposed by a user.

[1161] "Design specifications" refers to specific details of the design proposed by the user, such as color, material, and shape of the design.

[1162] "Manufacturing partner companies" refer to companies that work with the system to actually manufacture the user's design.

[1163] "Virtual item" refers to a digital item that virtually represents an item designed by a user within the system.

[1164] The present invention relates to a system that allows users to try out fashion coordination using their own virtual representation (avatar) in a virtual store and purchase products based on the coordination. This system incorporates an emotion analysis engine that recognizes the user's emotions and also has the function of adjusting coordination suggestions based on the user's emotions.

[1165] 1. User registration and login function

[1166] When a user creates a new account, they enter their name, email address, password, and interests. The device sends the information to the server, which stores the user's information in a database. The server then sends a confirmation email to the user's email address, and the user clicks on a link in the email to authenticate their account. HTTPS is used for communication between the server and the device.

[1167] As a specific example of usage, a user enters "Name: Yamada Taro, Email address: yamada@example.com, Interests: Casual fashion", and the server stores this information in a PostgreSQL database.

[1168] 2. Avatar Creation and Stylist Assistance

[1169] Users access the avatar creation page and input characteristics such as body shape, hairstyle, and skin color. The device generates an avatar in real time based on the input and displays a preview. After the user checks and edits the avatar and finally saves it, the device sends the avatar information to the server.

[1170] To operate the AI ​​stylist, the server runs a generative AI model (e.g., GPT-4) to generate optimal outfit suggestions based on the stored avatar information.

[1171] 3. Product search and combination suggestions

[1172] When a user searches for an item suitable for a specific time, place, or occasion, the device sends the search criteria to the server, which retrieves the relevant product information from the information storage device and sends it to the device. The server uses SQL search queries in this process.

[1173] Similarly, users register their personal items (clothes, shoes, bags, etc.) in the system, and their devices send this information to the server. The server uses the registered data to suggest combinations of the personal items with new products, and the device displays a preview of the suggested outfits on the user's avatar.

[1174] 4. Original design function

[1175] The user accesses the original design page and inputs color, material, and design specifications. The device checks these design details and displays a preview. The server saves the user's design specifications in a database and sends the design data via API to partner companies that can manufacture the product. The server also obtains quotes and delivery date information from partner companies and notifies the user.

[1176] For example, a user might enter specifications such as "red cashmere sweater, size medium, V-neck design," which the server then sends to a manufacturing partner.

[1177] 5. Purchase and Delivery Procedures

[1178] If the user likes the suggested outfit and adds it to the cart, the terminal displays the cart contents and total amount, and the user proceeds with the purchase.The server then connects to a payment system (e.g., Stripe) to process the payment.

[1179] Once payment is confirmed, the server saves the order information and starts the delivery process. The server also sends a shipping notification to the user via a dedicated app or email. The terminal displays this information to the user so that the user can check the delivery status in real time.

[1180] Additional configuration of the sentiment analysis engine

[1181] When a user uses the system, the emotion analysis engine analyzes the user's input and behavior (for example, the amount of time spent viewing an item or how often they click) to determine their emotions at the time. The device then sends the emotion analysis engine's analysis data to the server, which then uses this data to suggest the most suitable outfits for the user.

[1182] An example of a prompt sentence in this case may be "Suggest a relaxing outfit suitable for a user who has been feeling a bit tired recently."

[1183] The above is a specific embodiment of the present invention. With this configuration, users can receive fashion suggestions customized to their emotions and moods, and can easily combine existing items and incorporate original designs.

[1184] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1185] Step 1:

[1186] A user creates a new account. The user enters their name, email address, password, and interests (input data: name, email address, password, interests).

[1187] The terminal receives the input data and sends it to the server (action: form submission).

[1188] The server saves the received data in the database (data processing: saving user data).

[1189] The server sends a confirmation email to the user's email address (Output:Confirmation email).

[1190] Step 2:

[1191] The user clicks on a link in a confirmation email to authenticate their account (Input: Email Link Clicked).

[1192] The server receives the link click and authenticates the account (data calculation: code verification).

[1193] The server verifies the authentication and notifies the user (Output: Authentication complete message).

[1194] Step 3:

[1195] The user accesses the avatar creation page and inputs characteristics such as body shape, hairstyle, and skin color (input data: avatar characteristics).

[1196] The device generates an avatar based on the input data and displays a preview (operation: real-time generation and display of avatar).

[1197] The user checks and edits the avatar and finally saves it (input data: edited avatar features).

[1198] The device sends the final avatar information to the server (output: avatar information).

[1199] Step 4:

[1200] The server receives the saved avatar information and runs the AI ​​stylist (input: avatar information).

[1201] The server uses a generative AI model (e.g., GPT-4) to generate optimal outfit suggestions (data calculation: generating outfit suggestions).

[1202] The server sends the proposal results to the terminal (output: coordination proposal).

[1203] Step 5:

[1204] The user inputs search criteria to search for items suitable for a specific time, place, or occasion (input: search criteria).

[1205] The terminal sends the search conditions to the server (action: send search conditions).

[1206] The server retrieves the relevant product information from the information storage device and sends it to the terminal (data calculation: SQL search query execution, output: product information).

[1207] Step 6:

[1208] The user registers the items they have in their possession in the system (input: information about the items they have in their possession).

[1209] The device sends information about the items in hand to the server (action: sending item information).

[1210] The server uses the registered data to generate combinations of items in hand and new products (data calculation: item combination proposal).

[1211] The server sends the proposal results to the terminal (output: item combination proposals).

[1212] Step 7:

[1213] The user accesses the original design page and inputs the color, material, and design specifications (input: design specifications).

[1214] The device checks the input data and displays a preview (action: preview design).

[1215] The server stores the design specifications in a database and sends the design data to partner companies that can manufacture the product (data processing: sending design data, output: design specifications).

[1216] Step 8:

[1217] The server obtains quotes and delivery date information from manufacturing partner companies and notifies the user (operation: obtain and notify quote and delivery date information, output: quote and delivery date information).

[1218] Step 9:

[1219] The user adds the suggested outfit to their cart (input: add to cart).

[1220] The terminal displays the contents of the cart and the total amount, and the user completes the purchase process (operation: displaying cart contents and completing the purchase process).

[1221] The server works with the payment system (e.g., Stripe) to process the payment (data calculation: payment processing, output: payment completion information).

[1222] Step 10:

[1223] If the server confirms the payment, it saves the order information and starts the delivery procedure (data processing: saving the order information and starting the delivery procedure).

[1224] The server sends a shipping notification to the user via a dedicated app or email (Action: Send shipping notification, Output: Shipping notification).

[1225] Step 11:

[1226] The sentiment analysis engine analyzes the user's input and behavior (e.g., time spent viewing an item and frequency of clicks) and analyzes the emotions expressed at that time (input: user behavior data, data calculation: sentiment analysis).

[1227] The device sends the analysis data from the emotion analysis engine to the server (action: sending emotion data).

[1228] The server proposes optimal outfits to the user based on the emotion analysis results (data calculation: emotion-based suggestions, output: updated outfit suggestions).

[1229] The terminal reflects the updated outfit suggestions in a virtual representation of the user and displays a preview (action: outfit preview display).

[1230] (Application example 2)

[1231] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1232] Since the process of trying on outfits and purchasing products in a virtual store is linked to the user's emotions and the items they own, it is necessary to increase user satisfaction. Another challenge is to provide realistic, appropriate, and prompt outfit suggestions based on the user's emotions. Furthermore, it is necessary to improve the integration and flexibility of the entire system so that outfit selection and combination suggestions tailored to specific occasions best fit the user's actual situation.

[1233] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for the terminal to collect user behavior data and analyze emotions using an emotion engine, means for the server to dynamically adjust the conditions for coordination suggestions based on the analysis results, and means for generating design ideas suitable for the user based on the analysis by the emotion engine. This makes it possible to generate appropriate coordination suggestions and design ideas based on the user's emotions, thereby increasing user satisfaction.

[1234] A "user" is an individual who uses the system to try out their own outfits in the virtual boutique and purchase products.

[1235] "Create a new account" refers to the process required for a user to register for the first time on the system, by entering their name, email address, password, and interests.

[1236] "Interests" is information that indicates a user's preferences and interests, and is data that is used to suggest products in the system.

[1237] An "avatar" is a digital character that a user uses as their own representative within the system, and the user can set characteristics such as body shape, hairstyle, and skin color.

[1238] A "server" is a computer system that stores and manages user information and product data and controls the operation of the entire system.

[1239] "Authentication information" refers to the verification data required for a user to access a system, and primarily refers to an email address and password.

[1240] "AI Stylist" is a system function that uses artificial intelligence to suggest optimal outfits to users.

[1241] "Coordination suggestions" is the process by which the system presents the user with multiple combinations of clothes and accessories.

[1242] A "terminal" is a device used by a user to operate the system, and includes a smartphone, tablet, etc.

[1243] A "database" is an information system that systematically stores and manages various data used in a system.

[1244] "Behavioral data" is a record of a series of operations and interactions a user performs within the system, including, for example, the amount of time spent viewing items and the frequency of clicks.

[1245] An "emotion engine" is an algorithm that analyzes a user's behavioral data and estimates the user's current emotional state.

[1246] The "analysis results" are information about the user's emotional state derived by the emotion engine based on behavioral data.

[1247] A "design idea" is a product design concept that a user has devised himself or herself, and includes color, material, design specifications, etc.

[1248] "Manufacturing partner companies" are external companies that manufacture actual products based on the user's design ideas.

[1249] "Dynamic adjustment" is the process of changing system conditions and settings in real time in response to the user's current state or new data.

[1250] To implement this invention, it is necessary to develop a smartphone-based application and build a system that includes functions provided through interactions between a server, a terminal, and a user. The main components of the system and their specific processing are described below.

[1251] 1. User registration and login

[1252] When a user creates a new account, they enter their name, email address, password, and interests. The device sends these details to the server, which uses MongoDB to store the user information in a database. The server then sends a confirmation email to the user's email address, and the user authenticates the account by clicking a link.

[1253] 2. Avatar creation and AI stylist operation

[1254] When a user sets their body shape, hairstyle, skin color, etc. on the avatar creation page, the device uses TensorFlow.js to process the input data and generate an avatar. The generated avatar is previewed and the user can confirm and edit it. The saved information is then sent to the server, where the server-side AI stylist (OpenAI GPT-4 API) uses it to make initial outfit suggestions.

[1255] 3. Product search and combination suggestions

[1256] When a user selects an outfit for a particular occasion, the device sends that selection to the server. The server retrieves the corresponding product information from the database and returns the data to the device. The user also registers photos of items they own, which are also sent to the server. The server then suggests combinations of the items they own with new products, reflects them on the avatar, and displays a preview.

[1257] 4. Original design function

[1258] If a user cannot find a specific product, they can input their own design idea. A preview generated on the device is displayed and the design content is sent to the server. The server stores this information and sends the design data to partner companies that can manufacture the product. Estimates and delivery date information are also obtained from the server and notified to the user.

[1259] 5. Purchase and Delivery Procedures

[1260] When the user adds their favorite items to the cart, the terminal displays the cart contents and total amount. The user completes the purchase procedure, and the server processes the payment in cooperation with a payment system (e.g., Stripe or PayPal). After the payment is confirmed, the server saves the order information and starts the shipping process. A shipping notification is sent to the user via a dedicated app or email, and the terminal displays the delivery status in real time.

[1261] 6. Implementation of emotion engine and dynamic adjustment of coordination suggestions

[1262] When a user uses the system, the device collects the user's behavioral data (such as the amount of time spent viewing items and how often they click). This data is sent to an emotion engine (OpenAI GPT-4 API) that analyzes the user's emotional state. The analysis results are sent to the server, which dynamically adjusts the conditions for coordinating outfit suggestions based on the results. This enables more appropriate and personalized suggestions.

[1263] Examples of concrete examples and prompts

[1264] Example: Relaxed style suggestions using an emotion engine

[1265] Example prompt sentence:

[1266] If the user appears tired, suggest a relaxed style outfit, such as a loose top and relaxed pants.

[1267] When this prompt text is sent to the OpenAI GPT-4 API, the generated coordination suggestions are reflected on the device via the server and displayed to the user.

[1268] This system configuration makes it possible to dynamically suggest outfits and generate original designs based on the user's emotional state, thereby increasing user satisfaction.

[1269] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1270] Step 1:

[1271] A user creates a new account. Specifically, the user enters their name, email address, password, and interests into an input form. The entered data is sent from the device to the server, which receives it and stores it in a MongoDB database. The server then sends a confirmation email to the user's email address, which contains a link for account authentication. The user clicks the link in the email to complete the authentication.

[1272] Step 2:

[1273] The user creates an avatar. The user enters their characteristics, such as body shape, hairstyle, and skin color, on the avatar creation page on their device. This characteristic data is processed using TensorFlow.js to generate the user's avatar. The generated avatar is displayed as a preview, allowing the user to check and edit it. The final saved avatar data is sent to the server.

[1274] Step 3:

[1275] The AI ​​stylist makes an initial outfit suggestion. The server obtains the user's avatar data and interest data and sends a request to the OpenAI GPT-4 API. The generated outfit suggestion is received by the server and sent to the device. The device reflects the suggestion on the avatar and displays it as a preview to the user.

[1276] Step 4:

[1277] The user performs a product search. Using a terminal, the user inputs search criteria for clothing appropriate for a specific time, place, and occasion (e.g., formal, casual). The input criteria are sent to the server, which retrieves relevant product information from a database. The retrieved product information is sent to the terminal and suggested to the user.

[1278] Step 5:

[1279] The user registers the items they own. They then take photos of their clothes, shoes, and bags on their device and upload them to the system. The uploaded data is sent to the server and stored in a database. Based on the stored data, the server generates combination suggestions for new products and their own items and sends them to the device.

[1280] Step 6:

[1281] The emotion engine performs emotion analysis. When a user uses the system, the device collects user behavior data (e.g., time spent viewing items, frequency of clicks). This data is sent to the emotion engine, which uses the OpenAI GPT-4 API to analyze the user's emotional state. The analysis results are then sent to the server.

[1282] Step 7:

[1283] The server adjusts the outfit suggestions based on the user's emotional state. The server dynamically adjusts the product search criteria based on the analysis results from the emotion engine. New product information is searched for in the database based on the adjusted criteria and sent to the device. The device then reflects the updated outfit suggestions on the avatar and displays them as a preview to the user.

[1284] Step 8:

[1285] The user enters their original design. If the user cannot find a specific product, they access a page for entering design ideas and enter color, material, and design specifications. The input information is previewed on the device and finally sent to the server. The server stores the design specifications in a database and sends the design data to partner companies that can manufacture the product. Quotes and delivery date information are sent from the partner companies to the server, and are finally notified to the user.

[1286] Step 9:

[1287] The user completes the purchase and shipping process. The user adds the suggested items to the cart and completes the purchase process. The terminal displays the cart contents and total amount, and when the user presses the purchase button, the server works with the payment system to process the payment. Once the payment is confirmed, the server saves the order information and begins the shipping process. A shipping notification is sent to the user's terminal, allowing the user to check the delivery status in real time.

[1288] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1289] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1290] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1291] [Third embodiment]

[1292] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1293] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1294] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1295] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1296] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1297] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1298] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1299] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1300] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1301] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1302] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1303] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1304] The present invention is a system that allows users to try out outfits and purchase products using their own avatars in a virtual boutique. The system also provides functions for suggesting combinations with items the user already owns and for commercializing original designs.

[1305] Basic system configuration

[1306] 1. User registration and login function

[1307] When a user creates a new account, they enter their name, email address, password, and interests.

[1308] The terminal sends the input information to the server, and the server stores the user information in a database.

[1309] The server sends a confirmation email to the user's email address, and the user clicks on the link in the email to authenticate their account.

[1310] 2. Avatar Creation and Stylist Assistance

[1311] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page.

[1312] The device will generate an avatar based on your input and display a preview.

[1313] The user checks and edits the avatar and finally saves it.

[1314] Based on the information stored on the device, an AI stylist will be activated to suggest the best outfit.

[1315] 3. Product search and combination suggestions

[1316] A user searches for items that fit a specific occasion (e.g., formal, casual).

[1317] The terminal transmits the input conditions to the server, and the server retrieves information on the corresponding product from the database and transmits it to the terminal.

[1318] Users register photos of their clothes, shoes, and bags and send that information to the server.

[1319] The device suggests combinations of new products with items the user has on hand, and displays a preview of the suggested coordination reflected on the avatar.

[1320] 4. Original design function

[1321] The user accesses a page for inputting an original design and inputs the color, material, and design specifications.

[1322] The device will check the design and display a preview.

[1323] The server stores the user's design specifications and transmits the design data to manufacturing partner companies as needed.

[1324] The server obtains quotes and delivery date information from manufacturing partner companies and notifies the user.

[1325] 5. Purchase and Delivery Procedures

[1326] Users add their favorite items to their cart.

[1327] The terminal displays the cart contents and total amount, and the user completes the purchase.

[1328] The server works with the payment system to process the payment.

[1329] The server stores the user's order information and initiates the delivery process.

[1330] The server will send a shipping notification to the user via a dedicated app or email.

[1331] Specific examples

[1332] Example 1: Creating a new account

[1333] 1. A user visits the new account creation page and enters their name, email address, password, and interests such as casual style.

[1334] 2. The device sends this information to the server.

[1335] 3. The server stores the user information in a database and sends a confirmation email.

[1336] 4. The user clicks the link in the email to authenticate their account.

[1337] Example 2: Avatar creation and initial outfit suggestions

[1338] 1. The user enters height, hairstyle, skin color, etc. on the avatar creation page.

[1339] 2. The device generates an avatar and displays a preview to the user.

[1340] 3. The user is happy with the avatar and hits the save button.

[1341] 4. The device activates an AI stylist to suggest jeans and T-shirts based on the user's preferences.

[1342] 5. The server retrieves the relevant product information from the database and sends it to the terminal.

[1343] 6. The device reflects the coordinated outfit on the avatar and displays a preview to the user.

[1344] Example 3: Product search and purchase

[1345] 1. A user is looking for clothing suitable for a formal occasion and selects a specific brand.

[1346] 2. The device sends the selection to the server.

[1347] 3. The server searches the database for the brand's formal wear and sends it to the device.

[1348] 4. The user adds the items they like to their cart and checks out.

[1349] 5. The server connects to the payment system to process the payment and initiate the delivery procedure.

[1350] 6. The server sends a shipping notification to the user, and the terminal displays the delivery status to the user in real time.

[1351] The above is a concrete example of the system. This configuration allows users to easily find outfits and products that suit them, and they can also combine them with existing items. Furthermore, by supporting the realization of original designs, custom-made items can be easily obtained.

[1352] The processing flow will be explained below.

[1353] User registration and login functionality

[1354] Step 1:

[1355] A user visits a new account creation page and enters their name, email address, password, and interests.

[1356] Step 2:

[1357] The device sends the input to the server.

[1358] Step 3:

[1359] The server stores the received user information in a database.

[1360] Step 4:

[1361] The server sends a confirmation email to the user's email address.

[1362] Step 5:

[1363] The user clicks the link in the confirmation email to verify their account.

[1364] Step 6:

[1365] The user enters their email address and password on the login page.

[1366] Step 7:

[1367] The device sends the input to the server.

[1368] Step 8:

[1369] The server queries the database to verify the authentication information.

[1370] Step 9:

[1371] If the server authenticates the user, it starts a session and redirects them to the dashboard.

[1372] Step 10:

[1373] The terminal displays the user's login status.

[1374] Avatar Creation and Stylist Assist

[1375] Step 1:

[1376] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page.

[1377] Step 2:

[1378] The device will generate an avatar based on your input and display a preview.

[1379] Step 3:

[1380] The user checks the avatar and makes corrections if necessary.

[1381] Step 4:

[1382] The user saves the final avatar settings.

[1383] Step 5:

[1384] The device will activate an AI stylist based on the information stored on it.

[1385] Step 6:

[1386] An AI stylist will create the initial outfit based on the user's preferences.

[1387] Step 7:

[1388] The server retrieves the relevant product data from the database and sends it to the terminal.

[1389] Step 8:

[1390] The device will reflect the suggested outfit on the avatar and display a preview.

[1391] Product search and combination suggestions

[1392] Step 1:

[1393] The user selects clothing appropriate for a particular occasion.

[1394] Step 2:

[1395] The device sends the selection to the server.

[1396] Step 3:

[1397] The server searches the database based on multiple brands, place of manufacture, fabric, etc., and retrieves the relevant products.

[1398] Step 4:

[1399] The server transmits product information to the terminal.

[1400] Step 5:

[1401] Users upload images of their clothes, shoes, and bags and register them in the system.

[1402] Step 6:

[1403] The server stores the information about the items in your possession in a database.

[1404] Step 7:

[1405] The device suggests combinations of new products with the user's existing items.

[1406] Step 8:

[1407] The device will reflect the suggested outfit on the avatar and display a preview.

[1408] Original design function

[1409] Step 1:

[1410] The user accesses a page for inputting an original design and inputs the color, material, and design specifications.

[1411] Step 2:

[1412] The device will check the design and display a preview.

[1413] Step 3:

[1414] The terminal transmits the design data to the server.

[1415] Step 4:

[1416] The server stores the user's design specifications and transmits the design data to partner companies that can manufacture the product.

[1417] Step 5:

[1418] The server obtains quotes and delivery date information from manufacturing partner companies.

[1419] Step 6:

[1420] The server notifies the user of the estimate and delivery date information.

[1421] Step 7:

[1422] The user gives final approval.

[1423] Step 8:

[1424] The server notifies partner companies that production has begun.

[1425] Purchase and shipping procedures

[1426] Step 1:

[1427] Users add their favorite items to their cart.

[1428] Step 2:

[1429] The terminal displays the cart contents and total amount.

[1430] Step 3:

[1431] The user begins the checkout process and enters shipping and payment information.

[1432] Step 4:

[1433] The device sends the input to the server.

[1434] Step 5:

[1435] The server connects to the payment system and processes the payment.

[1436] Step 6:

[1437] If the server confirms the payment, it saves the order information and starts the delivery process.

[1438] Step 7:

[1439] The server sends a shipping notification to the user.

[1440] Step 8:

[1441] The terminal displays the purchase status to the user in real time.

[1442] Example 1

[1443] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1444] When users purchase fashion items online, they often face challenges in finding the right items. Coordinating existing and new items is also difficult, making it difficult to get suggestions that match their style. Furthermore, limited options for custom-made items and original designs make it difficult to meet individual needs.

[1445] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1446] In this invention, the server includes means for saving user information and managing authentication information, means for searching for relevant products from a database and sending them to the terminal, and means for saving the user's design specifications and sending the design data to partner companies that can manufacture them. This allows users to easily find outfits that suit them, combine existing items with new items, and even create custom-made items and original designs.

[1447] A "user" is a person who uses the system, creates an account, and purchases fashion items and receives coordination suggestions through a virtual character image.

[1448] A "virtual person" is a digital avatar that a user creates based on their own characteristics, such as height, hairstyle, and skin color, and is used to preview outfits.

[1449] "Server" refers to a computer device that manages information for the entire system, stores and authenticates user information, searches for products from a database, and stores and transmits design data.

[1450] "Terminal" refers to a device, such as a PC or smartphone, through which a user accesses the system and performs operations such as sending input information and displaying a preview of an outfit.

[1451] The "Artificial Intelligence Stylist" is an AI model that analyzes the user's preferences and characteristics and suggests the optimal coordination.

[1452] A "database" is an information management system that stores product information and user information and makes them searchable.

[1453] "Purpose of use" refers to the purpose of the fashion style or item that a user desires for a particular occasion or situation.

[1454] "Cooperating companies" refer to external manufacturing partners that manufacture products based on the user's original designs.

[1455] "Preview" is a function that allows the user to visually confirm the state in which the coordinates and design items selected by the user are applied to the virtual person image.

[1456] The present invention relates to a system that allows users to try out outfits and purchase products using their own virtual persona in a virtual boutique. The system also provides functions for suggesting combinations with items the user already owns and for commercializing original designs.

[1457] Basic system configuration

[1458] User registration and login functionality

[1459] A user creates a new account and enters information such as their name, email address, password, and interests. The device sends this information to the server, which stores it in a database. The server also manages authentication information and sends a confirmation email to the user. The user clicks on a link in the email to authenticate their account.

[1460] Virtual persona creation and stylist assistance

[1461] The user enters characteristics such as height, hairstyle, and skin color on the virtual person creation page. The device receives this information, generates a virtual person, and displays a preview. The user checks, edits, and saves the virtual person, and the device sends this information to the server. The server then runs an AI stylist to suggest the best outfits for the user.

[1462] Product search and combination suggestions

[1463] When a user searches for an item that meets a specific purpose, the device sends the search criteria to the server. The server retrieves the relevant products from the database and sends them to the device. The user registers photos of items they own (clothes, shoes, bags, etc.), and the device sends this information to the server. Based on this, the server suggests new product combinations, and the device reflects these combinations on a virtual person image and displays a preview.

[1464] Original design function

[1465] The user accesses the original design page and inputs color, material, and design specifications. The device confirms this and displays a design preview. The server saves the design specifications and sends the design data to cooperating companies as needed. The server obtains quotes and delivery date information from cooperating companies and notifies the user.

[1466] Purchase and shipping procedures

[1467] The user adds the items they like to their cart and completes the purchase. The terminal displays the cart contents and total amount, and the server connects with the payment system to process the payment. The server saves the order information and starts the delivery process. The user receives a shipping notification by email or via a dedicated app, and can check the delivery status in real time.

[1468] Specific examples

[1469] Example 1: Creating a new account

[1470] A user accesses the new account creation page and enters their name, email address, password, and interests such as casual style. The device sends this information to the server, which stores the user information in a database and sends a confirmation email. The user clicks on the link in the email to authenticate their account.

[1471] Example 2: Creating a virtual persona and initial outfit suggestions

[1472] The user enters height, hairstyle, skin color, etc. on the virtual person creation page. The device generates a virtual person and displays a preview to the user. When the user is satisfied with the virtual person, they press the save button. The device activates an AI stylist, which suggests jeans and a T-shirt based on the user's preferences. The server retrieves the relevant product information from the database and sends it to the device. The device reflects the coordination on the virtual person and displays a preview to the user.

[1473] Example 3: Product search and purchase

[1474] The user searches for clothing suitable for a formal occasion and selects a particular brand. The device sends the selection to the server, which retrieves the relevant product information from a database and sends it to the device. The user adds the items they like to their cart and completes the purchase. The server connects with the payment system to process the payment and initiate the delivery process. The server sends a shipping notification to the user, and the device displays the delivery status to the user in real time.

[1475] This invention allows users to easily find outfits and products that suit them, and also allows them to combine existing items. It also makes it possible to create items with original designs.

[1476] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1477] Step 1:

[1478] A user visits a new account creation page. The user enters their name, email address, password, and interests. This data is sent as input to the device. The device packages this input data in JSON format and sends it to the server.

[1479] Step 2:

[1480] The server analyzes the received user information and saves it in a database. The server performs data calculations to verify whether the email address format is correct and whether the password meets the specified format, and if there are no problems, saves it in the database. Saving it in the database is the output.

[1481] Step 3:

[1482] The server sends a confirmation email to the registered email address. The server generates an authentication link and sends an email containing that link to the user. The confirmation email is the output.

[1483] Step 4:

[1484] The user clicks on the link in the confirmation email and authenticates their account. The server receives this action and updates the user status as "authenticated", allowing the user to log in. The output is a database update.

[1485] Step 5:

[1486] The user accesses the virtual person creation page and inputs characteristics such as height, hairstyle, and skin color. This input data is sent to the terminal, which processes the data in batches to generate a virtual person. A preview of the generated virtual person is output.

[1487] Step 6:

[1488] The user checks the virtual person image and modifies it if necessary. When the user finally clicks the button to save the virtual person image, the data is sent from the device to the server. The saved data is output.

[1489] Step 7:

[1490] The server sends the received virtual person data as input to the AI ​​model, which generates an appropriate outfit based on the user's characteristics and past data. The calculation results of this AI model are output as outfit suggestions.

[1491] Step 8:

[1492] The user searches for an item that meets a specific purpose. The search criteria entered by the user are sent by the terminal to the server. The server searches the database for relevant product information and sends the results to the terminal. The search results are output.

[1493] Step 9:

[1494] The user registers a photo of an item they own. This photo data is sent to the server by the device. The server analyzes the image and stores it in a database as different item information. The image analysis results are output.

[1495] Step 10:

[1496] The server proposes combinations of items in hand with new products. The server uses an AI model to calculate appropriate combinations. The results are sent to the device, which reflects the results on the virtual person and displays a preview. The proposed combinations are the output.

[1497] Step 11:

[1498] The user accesses a page to input their original design. The user inputs the color, material, and design specifications, and the data is sent from the terminal to the server. The server saves the design data in a database and sends it to partner companies as needed. The saved design data becomes the output.

[1499] Step 12:

[1500] The server obtains quotes and delivery date information from partner companies. The server notifies the user of this information, and the terminal displays it to the user. The quote information is output.

[1501] Step 13:

[1502] The user adds the items they like to the cart. The device manages the contents of the cart and sends the information to the server. The cart information is output.

[1503] Step 14:

[1504] The user completes the purchase procedure. The user enters payment information, and that data is sent from the terminal to the server. The server then works with the payment system to process the payment. The payment result is output.

[1505] Step 15:

[1506] The server saves the user's order information and starts the delivery process. The server then sends the information to the delivery company and notifies the user of the delivery status. The user can check the delivery status in real time. The delivery notification is the output.

[1507] (Application example 1)

[1508] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1509] While there are many systems available today that allow users to try on outfits using their own avatars in a virtual environment, there are still insufficient systems that can comprehensively manage a user's inventory, provide virtual try-ons, real-time outfit suggestions, and even create and commercialize original designs. There is also a need for comprehensive management of real-time try-ons, original item designs, purchase procedures, and delivery procedures within a virtual boutique. Therefore, it is essential to provide an integrated system that enhances user convenience.

[1510] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1511] In this invention, the server includes means for a user to create a new account and register interests, means for a user to create their own avatar and set basic characteristics, means for the server to save user information and manage authentication information, means for a terminal to operate an AI stylist and make initial outfit suggestions, means for the server to search for relevant products from a database and send them to the terminal, means for the terminal to reflect the suggested outfit on the avatar and display a preview, means for the user to input an original design, means for the server to save the user's design specifications and send the data to a manufacturing partner, and means for the terminal to preview the original design. This allows a user to try out combinations of existing items with new products in a virtual environment, receive outfit suggestions, easily commercialize their original design, and consistently manage purchase and delivery procedures.

[1512] A "user" is an individual who uses the virtual boutique system to create an avatar, try on outfits, purchase products, and create original designs.

[1513] A "new account" is individual user information created by a user when using the virtual boutique system for the first time.

[1514] "Interests" refers to information about a user's fashion style, preferences, and areas of interest that the user registers when using the system.

[1515] An "avatar" is a virtual character that a user creates within the virtual boutique system to represent themselves.

[1516] "AI Stylist" is a system equipped with artificial intelligence that suggests outfits based on the user's interests and the items they own.

[1517] The "server" is a computer system that manages and stores user information and design data, verifies authentication information, and searches and suggests product data.

[1518] A "database" is a large-scale data storage system connected to a server, and stores user information, product data, design data, and the like.

[1519] "Items in hand" are fashion-related items such as clothes and accessories that the user already owns.

[1520] An "original design" is a fashion item design that a user creates independently within the virtual boutique system.

[1521] A "manufacturing partner" is a company or factory that produces actual products based on a user's original design.

[1522] "Virtual try-on" is a function that allows a user to check how an item selected in the virtual boutique system looks by having an avatar try it on.

[1523] "Purchase procedure" refers to a series of procedures required for a user to purchase a product selected by the user through the virtual boutique system.

[1524] "Delivery procedure" refers to the process of arranging and managing logistics so that the products purchased by the user can be delivered to their home.

[1525] The present invention is an integrated system that allows users to try out outfits and purchase products using their own avatar in a virtual boutique. This system also provides functions for suggesting combinations with items the user already owns and for commercializing original designs. Specific embodiments for realizing this system are described below.

[1526] User registration and login functionality

[1527] A user creates a new account and registers their name, email address, password, and interests. The device sends this information to the server, which stores it in a database. The server then sends a confirmation email to the user's email address, and the user clicks on a link in the email to authenticate their account.

[1528] Avatar creation and stylist assistance features

[1529] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page, and the device generates an avatar based on the input and displays a preview. The user can then confirm and save the avatar. Based on the saved information, the device activates an AI stylist to suggest the best outfits.

[1530] Product search and combination suggestion function

[1531] The user searches for items that suit a specific time, place, and occasion, and the device sends the search criteria to the server, which then retrieves information about the relevant products from a database and sends it to the device. The user registers photos of their current clothes, shoes, and bags, and sends that information to the server. The device then suggests combinations of new products with the user's current items, and displays a preview of the suggested outfits reflected on an avatar.

[1532] Original design function

[1533] The user accesses a page to input their original design and enters the color, material, and design specifications. The device checks the design content and displays a preview. The server saves the user's design specifications and sends the design data to manufacturing partners as needed. The server obtains quotes and delivery date information from manufacturing partners and notifies the user.

[1534] Purchasing and shipping functions

[1535] The user adds the items they like to the cart, and the terminal displays the cart contents and total amount. The user completes the purchase procedure, and the server processes the payment in conjunction with the payment system. The server saves the user's order information and starts the delivery procedure. The server sends a shipping notification to the user via a dedicated app or email, and the terminal displays the delivery status in real time.

[1536] Hardware and software used

[1537] Hardware: Smartphone (e.g. iPhone, Android device)

[1538] Software: Python, REST API, PIL (Python Imaging Library), AI model

[1539] Specific examples

[1540] A specific example of operations in which a user creates a new account, creates an avatar, tries on a specific item, and purchases it is as follows.

[1541] 1. Create a new account

[1542] A user visits a new account creation page and enters their name, email address, password, and interests. The device sends this information to the server, which stores the user information in a database. The server then sends the user a confirmation email, and the user clicks on a link in the email to authenticate their account.

[1543] 2. Create an avatar

[1544] The user enters height, hairstyle, skin color, etc. on the avatar creation page. The device generates an avatar based on the input and displays a preview. The user can then confirm and save the avatar.

[1545] 3. Virtual try-on

[1546] Users search for items suited to a particular occasion and then have their avatar try on the items to see a preview.

[1547] 4. Purchase procedure

[1548] The user adds the items they like to their cart and completes the purchase. The server then connects with the payment system to process the payment and begin the delivery process. The server then sends a shipping notification to the user via a dedicated app or email, and the device displays the delivery status in real time.

[1549] Prompt Sentence Examples

[1550] A system that searches for items suited to a specific TPO (e.g., formal, casual) and suggests combinations of clothes, shoes, and bags that you already own.

[1551] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1552] Step 1:

[1553] Create a new account

[1554] Input: User enters name, email address, password, and interests.

[1555] Specific operation: The terminal receives the input information and sends it to the server.

[1556] Data processing: The server stores the received user information in a database.

[1557] Output: The server sends a confirmation email to the user's email address.

[1558] Step 2:

[1559] User Authentication

[1560] Input: User clicks on the link in the confirmation email.

[1561] Specific behavior: The server verifies that the link was clicked and changes the account to an authenticated state.

[1562] Data processing: Update authentication information to the database.

[1563] Output: The account is authenticated and the user can log in.

[1564] Step 3:

[1565] Avatar Creation

[1566] Input: The user enters characteristics such as body shape, hairstyle, and skin tone on the avatar creation page.

[1567] Specific operation: The device receives the input and sends the data to the avatar generation API.

[1568] Data processing: The server generates an avatar based on the avatar generation API.

[1569] Output: A preview of the generated avatar will be displayed on the device.

[1570] Step 4:

[1571] Stylist Assist

[1572] Input: User confirms and saves registered avatar.

[1573] Specific operation: The device sends avatar information to the AI ​​stylist.

[1574] Data processing: An AI stylist suggests outfits based on the user's interests and data.

[1575] Output: The suggested outfits are displayed on the device.

[1576] Step 5:

[1577] Product search and combination suggestions

[1578] Input: User searches for items that fit a specific TPO.

[1579] Specific operation: The device sends search criteria to the server.

[1580] Data processing: The server retrieves the relevant product information from the database.

[1581] Output: The relevant product information is sent to the terminal and displayed.

[1582] Step 6:

[1583] Register your items

[1584] Input: The user registers photos of their clothes, shoes, and bags.

[1585] Specific operation: The device sends the photo data to the server.

[1586] Data processing: The server analyzes the data sent and stores the item information in a database.

[1587] Output: The registered items are now available in the system.

[1588] Step 7:

[1589] Coordinate preview

[1590] Input: The user confirms the suggested outfit.

[1591] Specific operation: The device reflects the coordinate information on the avatar.

[1592] Data processing: Processing is performed to reflect the data on the avatar.

[1593] Output: A preview of the outfit reflected on the device is displayed.

[1594] Step 8:

[1595] Original design creation

[1596] Input: User enters color, material, and design specifications.

[1597] Specific operation: The device sends the entered design specifications to the server.

[1598] Data processing: The server stores the design data and sends it to the manufacturing partner.

[1599] Output: A preview of your design will be displayed on your device.

[1600] Step 9:

[1601] Get quotes and delivery information

[1602] Input: The server sends the design data to the manufacturing partner.

[1603] What it does: Receive quotes and delivery information from manufacturing partners.

[1604] Data processing: Formatting received information for presentation to the user.

[1605] Output: The user is notified of the estimate and delivery date.

[1606] Step 10:

[1607] Purchase and shipping procedures

[1608] Input: The user adds the items they like to their cart and checks out.

[1609] Specific operation: The terminal displays the cart contents and total amount. The terminal sends the payment information to the server.

[1610] Data processing: The server connects to the payment system and processes the payment.

[1611] Output: The user is notified of the purchase confirmation and shipping information.

[1612] Step 11:

[1613] Delivery notification and real-time tracking

[1614] Input: The server initiates the delivery procedure.

[1615] Specific operation: The server sends the order data to the delivery company.

[1616] Data processing: Receive real-time tracking information from the delivery company.

[1617] Output: Real-time updated delivery status is displayed on the terminal.

[1618] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1619] The present invention relates to a system that allows users to try out outfits and purchase products using their own avatars in a virtual boutique. This system incorporates an emotion engine that recognizes the user's emotions and also has the function of adjusting outfit suggestions based on the user's emotions.

[1620] Basic system configuration

[1621] 1. User registration and login function

[1622] When a user creates a new account, they enter their name, email address, password, and interests.

[1623] The terminal sends the input information to the server, and the server stores the user information in a database.

[1624] The server sends a confirmation email to the user's email address, and the user clicks on the link in the email to authenticate their account.

[1625] 2. Avatar Creation and Stylist Assistance

[1626] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page.

[1627] The device will generate an avatar based on your input and display a preview.

[1628] The user checks and edits the avatar and finally saves it.

[1629] Based on the information stored on the device, an AI stylist will be activated to suggest the best outfit.

[1630] 3. Product search and combination suggestions

[1631] A user searches for items that fit a specific occasion (e.g., formal, casual).

[1632] The terminal transmits the input conditions to the server, and the server retrieves information on the corresponding product from the database and transmits it to the terminal.

[1633] Users register photos of their clothes, shoes, and bags and send that information to the server.

[1634] The device suggests combinations of new products with items the user has on hand, and displays a preview of the suggested coordination reflected on the avatar.

[1635] 4. Original design function

[1636] The user accesses a page for inputting an original design and inputs the color, material, and design specifications.

[1637] The device will check the design and display a preview.

[1638] The server stores the user's design specifications and transmits the design data to manufacturing partner companies as needed.

[1639] The server obtains quotes and delivery date information from manufacturing partner companies and notifies the user.

[1640] 5. Purchase and Delivery Procedures

[1641] Users add their favorite items to their cart.

[1642] The terminal displays the cart contents and total amount, and the user completes the purchase.

[1643] The server works with the payment system to process the payment.

[1644] If the server confirms the payment, it saves the order information and starts the delivery process.

[1645] The server will send a shipping notification to the user via a dedicated app or email.

[1646] Additional configuration of the emotion engine

[1647] 1. Emotion recognition using an emotion engine

[1648] When a user uses the system, the emotion engine analyzes the user's input and behavior (for example, the time spent viewing an item and the frequency of clicks) and analyzes the emotion at that time.

[1649] The device sends the emotion engine analysis data to the server.

[1650] 2. Emotion-based outfit suggestions

[1651] The server receives the analysis results from the emotion engine and dynamically adjusts the conditions for searching for products from the database.

[1652] The server transmits data to the terminal that suggests the most suitable product for the user based on the adjusted conditions.

[1653] The device will reflect the updated coordination suggestions on the avatar and display a preview.

[1654] Specific examples

[1655] Example 1: Coordination suggestions based on the user's mood using an emotion engine

[1656] 1. A user logs into the system and indicates that their recent mood is "fatigued."

[1657] 2. The emotion engine analyzes the user's behavior and determines that a relaxed style is appropriate.

[1658] 3. The server retrieves the relevant product information from the database based on the relaxation style and sends it to the terminal.

[1659] 4. Your device will then preview your avatar in a relaxed outfit (e.g., a loose top and pants).

[1660] Example 2: Flow from purchase to delivery

[1661] 1. The user likes the suggested outfit and adds it to their cart.

[1662] 2. The terminal displays the cart contents and total amount, and the user completes the purchase.

[1663] 3. The server connects to the payment system and processes the payment.

[1664] 4. After the payment is confirmed, the server saves the order information and starts the shipping process.

[1665] 5. The server sends a shipping notification to the user via email or a dedicated app.

[1666] 6. The terminal displays the delivery status to the user in real time.

[1667] The above is a concrete example of the system. This configuration allows users to find outfits and products that suit their emotions and moods, and allows for a smooth purchase process. Furthermore, original designs are possible, and custom-made items tailored to individual users can be provided.

[1668] The processing flow will be explained below.

[1669] Specific processing steps of a system that combines emotion engines

[1670] User registration and login functionality

[1671] Step 1:

[1672] A user visits a new account creation page and enters their name, email address, password, and interests.

[1673] Step 2:

[1674] The device sends the input to the server.

[1675] Step 3:

[1676] The server stores the received user information in a database.

[1677] Step 4:

[1678] The server sends a confirmation email to the user's email address.

[1679] Step 5:

[1680] The user clicks the link in the confirmation email to verify their account.

[1681] Step 6:

[1682] The user enters their email address and password on the login page.

[1683] Step 7:

[1684] The device sends the input to the server.

[1685] Step 8:

[1686] The server queries the database to verify the authentication information.

[1687] Step 9:

[1688] If the server authenticates the user, it starts a session and redirects them to the dashboard.

[1689] Step 10:

[1690] The terminal displays the user's login status.

[1691] Avatar Creation and Stylist Assist

[1692] Step 1:

[1693] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page.

[1694] Step 2:

[1695] The device will generate an avatar based on your input and display a preview.

[1696] Step 3:

[1697] The user checks the avatar and makes corrections if necessary.

[1698] Step 4:

[1699] The user saves the final avatar settings.

[1700] Step 5:

[1701] The device will activate an AI stylist based on the information stored on it.

[1702] Step 6:

[1703] An AI stylist will create the initial outfit based on the user's preferences.

[1704] Step 7:

[1705] The server retrieves the relevant product data from the database and sends it to the terminal.

[1706] Step 8:

[1707] The device will reflect the suggested outfit on the avatar and display a preview.

[1708] Emotion recognition and coordination suggestions using an emotion engine

[1709] Step 1:

[1710] The emotion engine is activated when a user logs in and interacts with the system.

[1711] Step 2:

[1712] The emotion engine analyzes the user's input, browsing behavior, click frequency, etc. to estimate their current emotion.

[1713] Step 3:

[1714] The device sends the emotion engine analysis data to the server.

[1715] Step 4:

[1716] The server receives the emotion analysis results and stores them in a database.

[1717] Step 5:

[1718] The server dynamically changes the search criteria for related products based on the analysis results.

[1719] Step 6:

[1720] The server searches the database using the changed conditions and retrieves the relevant product information.

[1721] Step 7:

[1722] The server transmits product information to the terminal.

[1723] Step 8:

[1724] The device will reflect the suggested outfit on the avatar and display a preview.

[1725] Product search and combination suggestions

[1726] Step 1:

[1727] The user selects clothing appropriate for a particular occasion.

[1728] Step 2:

[1729] The device sends the selection to the server.

[1730] Step 3:

[1731] The server searches the database based on multiple brands, place of manufacture, fabric, etc., and retrieves the relevant products.

[1732] Step 4:

[1733] The server transmits product information to the terminal.

[1734] Step 5:

[1735] Users upload images of their clothes, shoes, and bags and register them in the system.

[1736] Step 6:

[1737] The server stores the information about the items in your possession in a database.

[1738] Step 7:

[1739] The device suggests combinations of new products with the user's existing items.

[1740] Step 8:

[1741] The device will reflect the suggested outfit on the avatar and display a preview.

[1742] Original design function

[1743] Step 1:

[1744] The user accesses a page for inputting an original design and inputs the color, material, and design specifications.

[1745] Step 2:

[1746] The device will check the design and display a preview.

[1747] Step 3:

[1748] The terminal transmits the design data to the server.

[1749] Step 4:

[1750] The server stores the user's design specifications and transmits the design data to partner companies that can manufacture the product.

[1751] Step 5:

[1752] The server obtains quotes and delivery date information from manufacturing partner companies.

[1753] Step 6:

[1754] The server notifies the user of the estimate and delivery date information.

[1755] Step 7:

[1756] The user gives final approval.

[1757] Step 8:

[1758] The server notifies partner companies that production has begun.

[1759] Purchase and shipping procedures

[1760] Step 1:

[1761] Users add their favorite items to their cart.

[1762] Step 2:

[1763] The terminal displays the cart contents and total amount.

[1764] Step 3:

[1765] The user begins the checkout process and enters shipping and payment information.

[1766] Step 4:

[1767] The device sends the input to the server.

[1768] Step 5:

[1769] The server connects to the payment system and processes the payment.

[1770] Step 6:

[1771] If the server confirms the payment, it saves the order information and starts the delivery process.

[1772] Step 7:

[1773] The server sends a shipping notification to the user.

[1774] Step 8:

[1775] The terminal displays the purchase status to the user in real time.

[1776] Example 2

[1777] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1778] Today's consumers demand customized fashion suggestions that reflect their individual style and mood, but existing systems struggle to reflect the user's emotions and moods. Furthermore, there are limited systems that allow users to virtually try on new items by combining existing items with new items. Furthermore, there is a lack of an easy way to incorporate original designs when a specific product cannot be found.

[1779] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1780] In this invention, the server includes: means for a user to create a new account and register interests; means for a user to create a virtual representation of themselves and set basic characteristics; means for the server to save user information and manage authentication information; means for the terminal to operate an artificial intelligence outfit suggestion engine and make an initial outfit suggestion; means for the server to search for relevant items from an information storage device and send them to the terminal; means for the terminal to reflect the suggested outfit in the virtual representation and display a preview; means for an emotion analysis engine to analyze the user's input and behavior and adjust the outfit suggestion based on the user's emotions; means for a user to select outfits appropriate for a specific time, place, and occasion; means for the server to search for and suggest relevant items from a plurality of options; means for the user to register items the user has in the system; means for the terminal to suggest combinations of items they have in stock and new items; means for the user to input their own design ideas if they cannot find a specific item; means for the server to save the user's design specifications and send the design data to partner companies that can manufacture the items; and means for the terminal to display the items as virtual items and for the user to wear them on the virtual representation to confirm them. This makes it possible to propose customized fashion items that match the user's emotions and moods, and also makes it possible to smoothly combine items with existing items and reflect original designs.

[1781] "User" refers to an individual who uses the System to create an account and attempt to create a virtual representation or coordination.

[1782] "New Account" refers to an account created when a User registers with the System for the first time.

[1783] "Interests" refers to information entered by a user during the registration process that indicates a particular fashion style or preference.

[1784] "Virtual Representation" refers to the digital representation (avatar) of oneself that a user creates within the system.

[1785] "Basic characteristics" refers to attributes such as body shape, hairstyle, skin color, etc. of the user's virtual representation.

[1786] "Authentication information" refers to information that allows a system to recognize and authorize a user, such as a username and password.

[1787] "Artificial intelligence coordination suggestion engine" refers to an artificial intelligence model that suggests optimal fashion coordination based on data entered by the user.

[1788] "Information storage device" refers to a database or storage for saving user information and product data.

[1789] An "emotion analysis engine" is an engine that analyzes user input and behavioral data to determine the emotions at that time.

[1790] "Time, place, occasion" refers to the criteria for selecting clothing appropriate for a particular situation.

[1791] "Choice" refers to a selection of multiple items that the server proposes to the user.

[1792] "Item" refers to fashion-related products such as clothing and accessories that users can select, register, and purchase within the system.

[1793] "Design Idea" refers to an original clothing design newly proposed by a user.

[1794] "Design specifications" refers to specific details of the design proposed by the user, such as color, material, and shape of the design.

[1795] "Manufacturing partner companies" refer to companies that work with the system to actually manufacture the user's design.

[1796] "Virtual item" refers to a digital item that virtually represents an item designed by a user within the system.

[1797] The present invention relates to a system that allows users to try out fashion coordination using their own virtual representation (avatar) in a virtual store and purchase products based on the coordination. This system incorporates an emotion analysis engine that recognizes the user's emotions and also has the function of adjusting coordination suggestions based on the user's emotions.

[1798] 1. User registration and login function

[1799] When a user creates a new account, they enter their name, email address, password, and interests. The device sends the information to the server, which stores the user's information in a database. The server then sends a confirmation email to the user's email address, and the user clicks on a link in the email to authenticate their account. HTTPS is used for communication between the server and the device.

[1800] As a specific example of usage, a user enters "Name: Yamada Taro, Email address: yamada@example.com, Interests: Casual fashion", and the server stores this information in a PostgreSQL database.

[1801] 2. Avatar Creation and Stylist Assistance

[1802] Users access the avatar creation page and input characteristics such as body shape, hairstyle, and skin color. The device generates an avatar in real time based on the input and displays a preview. After the user checks and edits the avatar and finally saves it, the device sends the avatar information to the server.

[1803] To operate the AI ​​stylist, the server runs a generative AI model (e.g., GPT-4) to generate optimal outfit suggestions based on the stored avatar information.

[1804] 3. Product search and combination suggestions

[1805] When a user searches for an item suitable for a specific time, place, or occasion, the device sends the search criteria to the server, which retrieves the relevant product information from the information storage device and sends it to the device. The server uses SQL search queries in this process.

[1806] Similarly, users register their personal items (clothes, shoes, bags, etc.) in the system, and their devices send this information to the server. The server uses the registered data to suggest combinations of the personal items with new products, and the device displays a preview of the suggested outfits on the user's avatar.

[1807] 4. Original design function

[1808] The user accesses the original design page and inputs color, material, and design specifications. The device checks these design details and displays a preview. The server saves the user's design specifications in a database and sends the design data via API to partner companies that can manufacture the product. The server also obtains quotes and delivery date information from partner companies and notifies the user.

[1809] For example, a user might enter specifications such as "red cashmere sweater, size medium, V-neck design," which the server then sends to a manufacturing partner.

[1810] 5. Purchase and Delivery Procedures

[1811] If the user likes the suggested outfit and adds it to the cart, the terminal displays the cart contents and total amount, and the user proceeds with the purchase.The server then connects to a payment system (e.g., Stripe) to process the payment.

[1812] Once payment is confirmed, the server saves the order information and starts the delivery process. The server also sends a shipping notification to the user via a dedicated app or email. The terminal displays this information to the user so that the user can check the delivery status in real time.

[1813] Additional configuration of the sentiment analysis engine

[1814] When a user uses the system, the emotion analysis engine analyzes the user's input and behavior (for example, the amount of time spent viewing an item or how often they click) to determine their emotions at the time. The device then sends the emotion analysis engine's analysis data to the server, which then uses this data to suggest the most suitable outfits for the user.

[1815] An example of a prompt sentence in this case may be "Suggest a relaxing outfit suitable for a user who has been feeling a bit tired recently."

[1816] The above is a specific embodiment of the present invention. With this configuration, users can receive fashion suggestions customized to their emotions and moods, and can easily combine existing items and incorporate original designs.

[1817] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1818] Step 1:

[1819] A user creates a new account. The user enters their name, email address, password, and interests (input data: name, email address, password, interests).

[1820] The terminal receives the input data and sends it to the server (action: form submission).

[1821] The server saves the received data in the database (data processing: saving user data).

[1822] The server sends a confirmation email to the user's email address (Output:Confirmation email).

[1823] Step 2:

[1824] The user clicks on a link in a confirmation email to authenticate their account (Input: Email Link Clicked).

[1825] The server receives the link click and authenticates the account (data calculation: code verification).

[1826] The server verifies the authentication and notifies the user (Output: Authentication complete message).

[1827] Step 3:

[1828] The user accesses the avatar creation page and inputs characteristics such as body shape, hairstyle, and skin color (input data: avatar characteristics).

[1829] The device generates an avatar based on the input data and displays a preview (operation: real-time generation and display of avatar).

[1830] The user checks and edits the avatar and finally saves it (input data: edited avatar features).

[1831] The device sends the final avatar information to the server (output: avatar information).

[1832] Step 4:

[1833] The server receives the saved avatar information and runs the AI ​​stylist (input: avatar information).

[1834] The server uses a generative AI model (e.g., GPT-4) to generate optimal outfit suggestions (data calculation: generating outfit suggestions).

[1835] The server sends the proposal results to the terminal (output: coordination proposal).

[1836] Step 5:

[1837] The user inputs search criteria to search for items suitable for a specific time, place, or occasion (input: search criteria).

[1838] The terminal sends the search conditions to the server (action: send search conditions).

[1839] The server retrieves the relevant product information from the information storage device and sends it to the terminal (data calculation: SQL search query execution, output: product information).

[1840] Step 6:

[1841] The user registers the items they have in their possession in the system (input: information about the items they have in their possession).

[1842] The device sends information about the items in hand to the server (action: sending item information).

[1843] The server uses the registered data to generate combinations of items in hand and new products (data calculation: item combination proposal).

[1844] The server sends the proposal results to the terminal (output: item combination proposals).

[1845] Step 7:

[1846] The user accesses the original design page and inputs the color, material, and design specifications (input: design specifications).

[1847] The device checks the input data and displays a preview (action: preview design).

[1848] The server stores the design specifications in a database and sends the design data to partner companies that can manufacture the product (data processing: sending design data, output: design specifications).

[1849] Step 8:

[1850] The server obtains quotes and delivery date information from manufacturing partner companies and notifies the user (operation: obtain and notify quote and delivery date information, output: quote and delivery date information).

[1851] Step 9:

[1852] The user adds the suggested outfit to their cart (input: add to cart).

[1853] The terminal displays the contents of the cart and the total amount, and the user completes the purchase process (operation: displaying cart contents and completing the purchase process).

[1854] The server works with the payment system (e.g., Stripe) to process the payment (data calculation: payment processing, output: payment completion information).

[1855] Step 10:

[1856] If the server confirms the payment, it saves the order information and starts the delivery procedure (data processing: saving the order information and starting the delivery procedure).

[1857] The server sends a shipping notification to the user via a dedicated app or email (Action: Send shipping notification, Output: Shipping notification).

[1858] Step 11:

[1859] The sentiment analysis engine analyzes the user's input and behavior (e.g., time spent viewing an item and frequency of clicks) and analyzes the emotions expressed at that time (input: user behavior data, data calculation: sentiment analysis).

[1860] The device sends the analysis data from the emotion analysis engine to the server (action: sending emotion data).

[1861] The server proposes optimal outfits to the user based on the emotion analysis results (data calculation: emotion-based suggestions, output: updated outfit suggestions).

[1862] The terminal reflects the updated outfit suggestions in a virtual representation of the user and displays a preview (action: outfit preview display).

[1863] (Application example 2)

[1864] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1865] Since the process of trying on outfits and purchasing products in a virtual store is linked to the user's emotions and the items they own, it is necessary to increase user satisfaction. Another challenge is to provide realistic, appropriate, and prompt outfit suggestions based on the user's emotions. Furthermore, it is necessary to improve the integration and flexibility of the entire system so that outfit selection and combination suggestions tailored to specific occasions best fit the user's actual situation.

[1866] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for the terminal to collect user behavior data and analyze emotions using an emotion engine, means for the server to dynamically adjust the conditions for coordination suggestions based on the analysis results, and means for generating design ideas suitable for the user based on the analysis by the emotion engine. This makes it possible to generate appropriate coordination suggestions and design ideas based on the user's emotions, thereby increasing user satisfaction.

[1867] A "user" is an individual who uses the system to try out their own outfits in the virtual boutique and purchase products.

[1868] "Create a new account" refers to the process required for a user to register for the first time on the system, by entering their name, email address, password, and interests.

[1869] "Interests" is information that indicates a user's preferences and interests, and is data that is used to suggest products in the system.

[1870] An "avatar" is a digital character that a user uses as their own representative within the system, and the user can set characteristics such as body shape, hairstyle, and skin color.

[1871] A "server" is a computer system that stores and manages user information and product data and controls the operation of the entire system.

[1872] "Authentication information" refers to the verification data required for a user to access a system, and primarily refers to an email address and password.

[1873] "AI Stylist" is a system function that uses artificial intelligence to suggest optimal outfits to users.

[1874] "Coordination suggestions" is the process by which the system presents the user with multiple combinations of clothes and accessories.

[1875] A "terminal" is a device used by a user to operate the system, and includes a smartphone, tablet, etc.

[1876] A "database" is an information system that systematically stores and manages various data used in a system.

[1877] "Behavioral data" is a record of a series of operations and interactions a user performs within the system, including, for example, the amount of time spent viewing items and the frequency of clicks.

[1878] An "emotion engine" is an algorithm that analyzes a user's behavioral data and estimates the user's current emotional state.

[1879] The "analysis results" are information about the user's emotional state derived by the emotion engine based on behavioral data.

[1880] A "design idea" is a product design concept that a user has devised himself or herself, and includes color, material, design specifications, etc.

[1881] "Manufacturing partner companies" are external companies that manufacture actual products based on the user's design ideas.

[1882] "Dynamic adjustment" is the process of changing system conditions and settings in real time in response to the user's current state or new data.

[1883] To implement this invention, it is necessary to develop a smartphone-based application and build a system that includes functions provided through interactions between a server, a terminal, and a user. The main components of the system and their specific processing are described below.

[1884] 1. User registration and login

[1885] When a user creates a new account, they enter their name, email address, password, and interests. The device sends these details to the server, which uses MongoDB to store the user information in a database. The server then sends a confirmation email to the user's email address, and the user authenticates the account by clicking a link.

[1886] 2. Avatar creation and AI stylist operation

[1887] When a user sets their body shape, hairstyle, skin color, etc. on the avatar creation page, the device uses TensorFlow.js to process the input data and generate an avatar. The generated avatar is previewed and the user can confirm and edit it. The saved information is then sent to the server, where the server-side AI stylist (OpenAI GPT-4 API) uses it to make initial outfit suggestions.

[1888] 3. Product search and combination suggestions

[1889] When a user selects an outfit for a particular occasion, the device sends that selection to the server. The server retrieves the corresponding product information from the database and returns the data to the device. The user also registers photos of items they own, which are also sent to the server. The server then suggests combinations of the items they own with new products, reflects them on the avatar, and displays a preview.

[1890] 4. Original design function

[1891] If a user cannot find a specific product, they can input their own design idea. A preview generated on the device is displayed and the design content is sent to the server. The server stores this information and sends the design data to partner companies that can manufacture the product. Estimates and delivery date information are also obtained from the server and notified to the user.

[1892] 5. Purchase and Delivery Procedures

[1893] When the user adds their favorite items to the cart, the terminal displays the cart contents and total amount. The user completes the purchase procedure, and the server processes the payment in cooperation with a payment system (e.g., Stripe or PayPal). After the payment is confirmed, the server saves the order information and starts the shipping process. A shipping notification is sent to the user via a dedicated app or email, and the terminal displays the delivery status in real time.

[1894] 6. Implementation of emotion engine and dynamic adjustment of coordination suggestions

[1895] When a user uses the system, the device collects the user's behavioral data (such as the amount of time spent viewing items and how often they click). This data is sent to an emotion engine (OpenAI GPT-4 API) that analyzes the user's emotional state. The analysis results are sent to the server, which dynamically adjusts the conditions for coordinating outfit suggestions based on the results. This enables more appropriate and personalized suggestions.

[1896] Examples of concrete examples and prompts

[1897] Example: Relaxed style suggestions using an emotion engine

[1898] Example prompt sentence:

[1899] If the user appears tired, suggest a relaxed style outfit, such as a loose top and relaxed pants.

[1900] When this prompt text is sent to the OpenAI GPT-4 API, the generated coordination suggestions are reflected on the device via the server and displayed to the user.

[1901] This system configuration makes it possible to dynamically suggest outfits and generate original designs based on the user's emotional state, thereby increasing user satisfaction.

[1902] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1903] Step 1:

[1904] A user creates a new account. Specifically, the user enters their name, email address, password, and interests into an input form. The entered data is sent from the device to the server, which receives it and stores it in a MongoDB database. The server then sends a confirmation email to the user's email address, which contains a link for account authentication. The user clicks the link in the email to complete the authentication.

[1905] Step 2:

[1906] The user creates an avatar. The user enters their characteristics, such as body shape, hairstyle, and skin color, on the avatar creation page on their device. This characteristic data is processed using TensorFlow.js to generate the user's avatar. The generated avatar is displayed as a preview, allowing the user to check and edit it. The final saved avatar data is sent to the server.

[1907] Step 3:

[1908] The AI ​​stylist makes an initial outfit suggestion. The server obtains the user's avatar data and interest data and sends a request to the OpenAI GPT-4 API. The generated outfit suggestion is received by the server and sent to the device. The device reflects the suggestion on the avatar and displays it as a preview to the user.

[1909] Step 4:

[1910] The user performs a product search. Using a terminal, the user inputs search criteria for clothing appropriate for a specific time, place, and occasion (e.g., formal, casual). The input criteria are sent to the server, which retrieves relevant product information from a database. The retrieved product information is sent to the terminal and suggested to the user.

[1911] Step 5:

[1912] The user registers the items they own. They then take photos of their clothes, shoes, and bags on their device and upload them to the system. The uploaded data is sent to the server and stored in a database. Based on the stored data, the server generates combination suggestions for new products and their own items and sends them to the device.

[1913] Step 6:

[1914] The emotion engine performs emotion analysis. When a user uses the system, the device collects user behavior data (e.g., time spent viewing items, frequency of clicks). This data is sent to the emotion engine, which uses the OpenAI GPT-4 API to analyze the user's emotional state. The analysis results are then sent to the server.

[1915] Step 7:

[1916] The server adjusts the outfit suggestions based on the user's emotional state. The server dynamically adjusts the product search criteria based on the analysis results from the emotion engine. New product information is searched for in the database based on the adjusted criteria and sent to the device. The device then reflects the updated outfit suggestions on the avatar and displays them as a preview to the user.

[1917] Step 8:

[1918] The user enters their original design. If the user cannot find a specific product, they access a page for entering design ideas and enter color, material, and design specifications. The input information is previewed on the device and finally sent to the server. The server stores the design specifications in a database and sends the design data to partner companies that can manufacture the product. Quotes and delivery date information are sent from the partner companies to the server, and are finally notified to the user.

[1919] Step 9:

[1920] The user completes the purchase and shipping process. The user adds the suggested items to the cart and completes the purchase process. The terminal displays the cart contents and total amount, and when the user presses the purchase button, the server works with the payment system to process the payment. Once the payment is confirmed, the server saves the order information and begins the shipping process. A shipping notification is sent to the user's terminal, allowing the user to check the delivery status in real time.

[1921] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1922] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1923] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1924] [Fourth embodiment]

[1925] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1926] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1927] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1928] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1929] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1930] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1931] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1932] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1933] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1934] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1935] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1936] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1937] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1938] The present invention is a system that allows users to try out outfits and purchase products using their own avatars in a virtual boutique. The system also provides functions for suggesting combinations with items the user already owns and for commercializing original designs.

[1939] Basic system configuration

[1940] 1. User registration and login function

[1941] When a user creates a new account, they enter their name, email address, password, and interests.

[1942] The terminal sends the input information to the server, and the server stores the user information in a database.

[1943] The server sends a confirmation email to the user's email address, and the user clicks on the link in the email to authenticate their account.

[1944] 2. Avatar Creation and Stylist Assistance

[1945] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page.

[1946] The device will generate an avatar based on your input and display a preview.

[1947] The user checks and edits the avatar and finally saves it.

[1948] Based on the information stored on the device, an AI stylist will be activated to suggest the best outfit.

[1949] 3. Product search and combination suggestions

[1950] A user searches for items that fit a specific occasion (e.g., formal, casual).

[1951] The terminal transmits the input conditions to the server, and the server retrieves information on the corresponding product from the database and transmits it to the terminal.

[1952] Users register photos of their clothes, shoes, and bags and send that information to the server.

[1953] The device suggests combinations of new products with items the user has on hand, and displays a preview of the suggested coordination reflected on the avatar.

[1954] 4. Original design function

[1955] The user accesses a page for inputting an original design and inputs the color, material, and design specifications.

[1956] The device will check the design and display a preview.

[1957] The server stores the user's design specifications and transmits the design data to manufacturing partner companies as needed.

[1958] The server obtains quotes and delivery date information from manufacturing partner companies and notifies the user.

[1959] 5. Purchase and Delivery Procedures

[1960] Users add their favorite items to their cart.

[1961] The terminal displays the cart contents and total amount, and the user completes the purchase.

[1962] The server works with the payment system to process the payment.

[1963] The server stores the user's order information and initiates the delivery process.

[1964] The server will send a shipping notification to the user via a dedicated app or email.

[1965] Specific examples

[1966] Example 1: Creating a new account

[1967] 1. A user visits the new account creation page and enters their name, email address, password, and interests such as casual style.

[1968] 2. The device sends this information to the server.

[1969] 3. The server stores the user information in a database and sends a confirmation email.

[1970] 4. The user clicks the link in the email to authenticate their account.

[1971] Example 2: Avatar creation and initial outfit suggestions

[1972] 1. The user enters height, hairstyle, skin color, etc. on the avatar creation page.

[1973] 2. The device generates an avatar and displays a preview to the user.

[1974] 3. The user is happy with the avatar and hits the save button.

[1975] 4. The device activates an AI stylist to suggest jeans and T-shirts based on the user's preferences.

[1976] 5. The server retrieves the relevant product information from the database and sends it to the terminal.

[1977] 6. The device reflects the coordinated outfit on the avatar and displays a preview to the user.

[1978] Example 3: Product search and purchase

[1979] 1. A user is looking for clothing suitable for a formal occasion and selects a specific brand.

[1980] 2. The device sends the selection to the server.

[1981] 3. The server searches the database for the brand's formal wear and sends it to the device.

[1982] 4. The user adds the items they like to their cart and checks out.

[1983] 5. The server connects to the payment system to process the payment and initiate the delivery procedure.

[1984] 6. The server sends a shipping notification to the user, and the terminal displays the delivery status to the user in real time.

[1985] The above is a concrete example of the system. This configuration allows users to easily find outfits and products that suit them, and they can also combine them with existing items. Furthermore, by supporting the realization of original designs, custom-made items can be easily obtained.

[1986] The processing flow will be explained below.

[1987] User registration and login functionality

[1988] Step 1:

[1989] A user visits a new account creation page and enters their name, email address, password, and interests.

[1990] Step 2:

[1991] The device sends the input to the server.

[1992] Step 3:

[1993] The server stores the received user information in a database.

[1994] Step 4:

[1995] The server sends a confirmation email to the user's email address.

[1996] Step 5:

[1997] The user clicks the link in the confirmation email to verify their account.

[1998] Step 6:

[1999] The user enters their email address and password on the login page.

[2000] Step 7:

[2001] The device sends the input to the server.

[2002] Step 8:

[2003] The server queries the database to verify the authentication information.

[2004] Step 9:

[2005] If the server authenticates the user, it starts a session and redirects them to the dashboard.

[2006] Step 10:

[2007] The terminal displays the user's login status.

[2008] Avatar Creation and Stylist Assist

[2009] Step 1:

[2010] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page.

[2011] Step 2:

[2012] The device will generate an avatar based on your input and display a preview.

[2013] Step 3:

[2014] The user checks the avatar and makes corrections if necessary.

[2015] Step 4:

[2016] The user saves the final avatar settings.

[2017] Step 5:

[2018] The device will activate an AI stylist based on the information stored on it.

[2019] Step 6:

[2020] An AI stylist will create the initial outfit based on the user's preferences.

[2021] Step 7:

[2022] The server retrieves the relevant product data from the database and sends it to the terminal.

[2023] Step 8:

[2024] The device will reflect the suggested outfit on the avatar and display a preview.

[2025] Product search and combination suggestions

[2026] Step 1:

[2027] The user selects clothing appropriate for a particular occasion.

[2028] Step 2:

[2029] The device sends the selection to the server.

[2030] Step 3:

[2031] The server searches the database based on multiple brands, place of manufacture, fabric, etc., and retrieves the relevant products.

[2032] Step 4:

[2033] The server transmits product information to the terminal.

[2034] Step 5:

[2035] Users upload images of their clothes, shoes, and bags and register them in the system.

[2036] Step 6:

[2037] The server stores the information about the items in your possession in a database.

[2038] Step 7:

[2039] The device suggests combinations of new products with the user's existing items.

[2040] Step 8:

[2041] The device will reflect the suggested outfit on the avatar and display a preview.

[2042] Original design function

[2043] Step 1:

[2044] The user accesses a page for inputting an original design and inputs the color, material, and design specifications.

[2045] Step 2:

[2046] The device will check the design and display a preview.

[2047] Step 3:

[2048] The terminal transmits the design data to the server.

[2049] Step 4:

[2050] The server stores the user's design specifications and transmits the design data to partner companies that can manufacture the product.

[2051] Step 5:

[2052] The server obtains quotes and delivery date information from manufacturing partner companies.

[2053] Step 6:

[2054] The server notifies the user of the estimate and delivery date information.

[2055] Step 7:

[2056] The user gives final approval.

[2057] Step 8:

[2058] The server notifies partner companies that production has begun.

[2059] Purchase and shipping procedures

[2060] Step 1:

[2061] Users add their favorite items to their cart.

[2062] Step 2:

[2063] The terminal displays the cart contents and total amount.

[2064] Step 3:

[2065] The user begins the checkout process and enters shipping and payment information.

[2066] Step 4:

[2067] The device sends the input to the server.

[2068] Step 5:

[2069] The server connects to the payment system and processes the payment.

[2070] Step 6:

[2071] If the server confirms the payment, it saves the order information and starts the delivery process.

[2072] Step 7:

[2073] The server sends a shipping notification to the user.

[2074] Step 8:

[2075] The terminal displays the purchase status to the user in real time.

[2076] Example 1

[2077] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2078] When users purchase fashion items online, they often face challenges in finding the right items. Coordinating existing and new items is also difficult, making it difficult to get suggestions that match their style. Furthermore, limited options for custom-made items and original designs make it difficult to meet individual needs.

[2079] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2080] In this invention, the server includes means for saving user information and managing authentication information, means for searching for relevant products from a database and sending them to the terminal, and means for saving the user's design specifications and sending the design data to partner companies that can manufacture them. This allows users to easily find outfits that suit them, combine existing items with new items, and even create custom-made items and original designs.

[2081] A "user" is a person who uses the system, creates an account, and purchases fashion items and receives coordination suggestions through a virtual character image.

[2082] A "virtual person" is a digital avatar that a user creates based on their own characteristics, such as height, hairstyle, and skin color, and is used to preview outfits.

[2083] "Server" refers to a computer device that manages information for the entire system, stores and authenticates user information, searches for products from a database, and stores and transmits design data.

[2084] "Terminal" refers to a device, such as a PC or smartphone, through which a user accesses the system and performs operations such as sending input information and displaying a preview of an outfit.

[2085] The "Artificial Intelligence Stylist" is an AI model that analyzes the user's preferences and characteristics and suggests the optimal coordination.

[2086] A "database" is an information management system that stores product information and user information and makes them searchable.

[2087] "Purpose of use" refers to the purpose of the fashion style or item that a user desires for a particular occasion or situation.

[2088] "Cooperating companies" refer to external manufacturing partners that manufacture products based on the user's original designs.

[2089] "Preview" is a function that allows the user to visually confirm the state in which the coordinates and design items selected by the user are applied to the virtual person image.

[2090] The present invention relates to a system that allows users to try out outfits and purchase products using their own virtual persona in a virtual boutique. The system also provides functions for suggesting combinations with items the user already owns and for commercializing original designs.

[2091] Basic system configuration

[2092] User registration and login functionality

[2093] A user creates a new account and enters information such as their name, email address, password, and interests. The device sends this information to the server, which stores it in a database. The server also manages authentication information and sends a confirmation email to the user. The user clicks on a link in the email to authenticate their account.

[2094] Virtual persona creation and stylist assistance

[2095] The user enters characteristics such as height, hairstyle, and skin color on the virtual person creation page. The device receives this information, generates a virtual person, and displays a preview. The user checks, edits, and saves the virtual person, and the device sends this information to the server. The server then runs an AI stylist to suggest the best outfits for the user.

[2096] Product search and combination suggestions

[2097] When a user searches for an item that meets a specific purpose, the device sends the search criteria to the server. The server retrieves the relevant products from the database and sends them to the device. The user registers photos of items they own (clothes, shoes, bags, etc.), and the device sends this information to the server. Based on this, the server suggests new product combinations, and the device reflects these combinations on a virtual person image and displays a preview.

[2098] Original design function

[2099] The user accesses the original design page and inputs color, material, and design specifications. The device confirms this and displays a design preview. The server saves the design specifications and sends the design data to cooperating companies as needed. The server obtains quotes and delivery date information from cooperating companies and notifies the user.

[2100] Purchase and shipping procedures

[2101] The user adds the items they like to their cart and completes the purchase. The terminal displays the cart contents and total amount, and the server connects with the payment system to process the payment. The server saves the order information and starts the delivery process. The user receives a shipping notification by email or via a dedicated app, and can check the delivery status in real time.

[2102] Specific examples

[2103] Example 1: Creating a new account

[2104] A user accesses the new account creation page and enters their name, email address, password, and interests such as casual style. The device sends this information to the server, which stores the user information in a database and sends a confirmation email. The user clicks on the link in the email to authenticate their account.

[2105] Example 2: Creating a virtual persona and initial outfit suggestions

[2106] The user enters height, hairstyle, skin color, etc. on the virtual person creation page. The device generates a virtual person and displays a preview to the user. When the user is satisfied with the virtual person, they press the save button. The device activates an AI stylist, which suggests jeans and a T-shirt based on the user's preferences. The server retrieves the relevant product information from the database and sends it to the device. The device reflects the coordination on the virtual person and displays a preview to the user.

[2107] Example 3: Product search and purchase

[2108] The user searches for clothing suitable for a formal occasion and selects a particular brand. The device sends the selection to the server, which retrieves the relevant product information from a database and sends it to the device. The user adds the items they like to their cart and completes the purchase. The server connects with the payment system to process the payment and initiate the delivery process. The server sends a shipping notification to the user, and the device displays the delivery status to the user in real time.

[2109] This invention allows users to easily find outfits and products that suit them, and also allows them to combine existing items. It also makes it possible to create items with original designs.

[2110] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2111] Step 1:

[2112] A user visits a new account creation page. The user enters their name, email address, password, and interests. This data is sent as input to the device. The device packages this input data in JSON format and sends it to the server.

[2113] Step 2:

[2114] The server analyzes the received user information and saves it in a database. The server performs data calculations to verify whether the email address format is correct and whether the password meets the specified format, and if there are no problems, saves it in the database. Saving it in the database is the output.

[2115] Step 3:

[2116] The server sends a confirmation email to the registered email address. The server generates an authentication link and sends an email containing that link to the user. The confirmation email is the output.

[2117] Step 4:

[2118] The user clicks on the link in the confirmation email and authenticates their account. The server receives this action and updates the user status as "authenticated", allowing the user to log in. The output is a database update.

[2119] Step 5:

[2120] The user accesses the virtual person creation page and inputs characteristics such as height, hairstyle, and skin color. This input data is sent to the terminal, which processes the data in batches to generate a virtual person. A preview of the generated virtual person is output.

[2121] Step 6:

[2122] The user checks the virtual person image and modifies it if necessary. When the user finally clicks the button to save the virtual person image, the data is sent from the device to the server. The saved data is output.

[2123] Step 7:

[2124] The server sends the received virtual person data as input to the AI ​​model, which generates an appropriate outfit based on the user's characteristics and past data. The calculation results of this AI model are output as outfit suggestions.

[2125] Step 8:

[2126] The user searches for an item that meets a specific purpose. The search criteria entered by the user are sent by the terminal to the server. The server searches the database for relevant product information and sends the results to the terminal. The search results are output.

[2127] Step 9:

[2128] The user registers a photo of an item they own. This photo data is sent to the server by the device. The server analyzes the image and stores it in a database as different item information. The image analysis results are output.

[2129] Step 10:

[2130] The server proposes combinations of items in hand with new products. The server uses an AI model to calculate appropriate combinations. The results are sent to the device, which reflects the results on the virtual person and displays a preview. The proposed combinations are the output.

[2131] Step 11:

[2132] The user accesses a page to input their original design. The user inputs the color, material, and design specifications, and the data is sent from the terminal to the server. The server saves the design data in a database and sends it to partner companies as needed. The saved design data becomes the output.

[2133] Step 12:

[2134] The server obtains quotes and delivery date information from partner companies. The server notifies the user of this information, and the terminal displays it to the user. The quote information is output.

[2135] Step 13:

[2136] The user adds the items they like to the cart. The device manages the contents of the cart and sends the information to the server. The cart information is output.

[2137] Step 14:

[2138] The user completes the purchase procedure. The user enters payment information, and that data is sent from the terminal to the server. The server then works with the payment system to process the payment. The payment result is output.

[2139] Step 15:

[2140] The server saves the user's order information and starts the delivery process. The server then sends the information to the delivery company and notifies the user of the delivery status. The user can check the delivery status in real time. The delivery notification is the output.

[2141] (Application example 1)

[2142] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2143] While there are many systems available today that allow users to try on outfits using their own avatars in a virtual environment, there are still insufficient systems that can comprehensively manage a user's inventory, provide virtual try-ons, real-time outfit suggestions, and even create and commercialize original designs. There is also a need for comprehensive management of real-time try-ons, original item designs, purchase procedures, and delivery procedures within a virtual boutique. Therefore, it is essential to provide an integrated system that enhances user convenience.

[2144] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2145] In this invention, the server includes means for a user to create a new account and register interests, means for a user to create their own avatar and set basic characteristics, means for the server to save user information and manage authentication information, means for a terminal to operate an AI stylist and make initial outfit suggestions, means for the server to search for relevant products from a database and send them to the terminal, means for the terminal to reflect the suggested outfit on the avatar and display a preview, means for the user to input an original design, means for the server to save the user's design specifications and send the data to a manufacturing partner, and means for the terminal to preview the original design. This allows a user to try out combinations of existing items with new products in a virtual environment, receive outfit suggestions, easily commercialize their original design, and consistently manage purchase and delivery procedures.

[2146] A "user" is an individual who uses the virtual boutique system to create an avatar, try on outfits, purchase products, and create original designs.

[2147] A "new account" is individual user information created by a user when using the virtual boutique system for the first time.

[2148] "Interests" refers to information about a user's fashion style, preferences, and areas of interest that the user registers when using the system.

[2149] An "avatar" is a virtual character that a user creates within the virtual boutique system to represent themselves.

[2150] "AI Stylist" is a system equipped with artificial intelligence that suggests outfits based on the user's interests and the items they own.

[2151] The "server" is a computer system that manages and stores user information and design data, verifies authentication information, and searches and suggests product data.

[2152] A "database" is a large-scale data storage system connected to a server, and stores user information, product data, design data, and the like.

[2153] "Items in hand" are fashion-related items such as clothes and accessories that the user already owns.

[2154] An "original design" is a fashion item design that a user creates independently within the virtual boutique system.

[2155] A "manufacturing partner" is a company or factory that produces actual products based on a user's original design.

[2156] "Virtual try-on" is a function that allows a user to check how an item selected in the virtual boutique system looks by having an avatar try it on.

[2157] "Purchase procedure" refers to a series of procedures required for a user to purchase a product selected by the user through the virtual boutique system.

[2158] "Delivery procedure" refers to the process of arranging and managing logistics so that the products purchased by the user can be delivered to their home.

[2159] The present invention is an integrated system that allows users to try out outfits and purchase products using their own avatar in a virtual boutique. This system also provides functions for suggesting combinations with items the user already owns and for commercializing original designs. Specific embodiments for realizing this system are described below.

[2160] User registration and login functionality

[2161] A user creates a new account and registers their name, email address, password, and interests. The device sends this information to the server, which stores it in a database. The server then sends a confirmation email to the user's email address, and the user clicks on a link in the email to authenticate their account.

[2162] Avatar creation and stylist assistance features

[2163] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page, and the device generates an avatar based on the input and displays a preview. The user can then confirm and save the avatar. Based on the saved information, the device activates an AI stylist to suggest the best outfits.

[2164] Product search and combination suggestion function

[2165] The user searches for items that suit a specific time, place, and occasion, and the device sends the search criteria to the server, which then retrieves information about the relevant products from a database and sends it to the device. The user registers photos of their current clothes, shoes, and bags, and sends that information to the server. The device then suggests combinations of new products with the user's current items, and displays a preview of the suggested outfits reflected on an avatar.

[2166] Original design function

[2167] The user accesses a page to input their original design and enters the color, material, and design specifications. The device checks the design content and displays a preview. The server saves the user's design specifications and sends the design data to manufacturing partners as needed. The server obtains quotes and delivery date information from manufacturing partners and notifies the user.

[2168] Purchasing and shipping functions

[2169] The user adds the items they like to the cart, and the terminal displays the cart contents and total amount. The user completes the purchase procedure, and the server processes the payment in conjunction with the payment system. The server saves the user's order information and starts the delivery procedure. The server sends a shipping notification to the user via a dedicated app or email, and the terminal displays the delivery status in real time.

[2170] Hardware and software used

[2171] Hardware: Smartphone (e.g. iPhone, Android device)

[2172] Software: Python, REST API, PIL (Python Imaging Library), AI model

[2173] Specific examples

[2174] A specific example of operations in which a user creates a new account, creates an avatar, tries on a specific item, and purchases it is as follows.

[2175] 1. Create a new account

[2176] A user visits a new account creation page and enters their name, email address, password, and interests. The device sends this information to the server, which stores the user information in a database. The server then sends the user a confirmation email, and the user clicks on a link in the email to authenticate their account.

[2177] 2. Create an avatar

[2178] The user enters height, hairstyle, skin color, etc. on the avatar creation page. The device generates an avatar based on the input and displays a preview. The user can then confirm and save the avatar.

[2179] 3. Virtual try-on

[2180] Users search for items suited to a particular occasion and then have their avatar try on the items to see a preview.

[2181] 4. Purchase procedure

[2182] The user adds the items they like to their cart and completes the purchase. The server then connects with the payment system to process the payment and begin the delivery process. The server then sends a shipping notification to the user via a dedicated app or email, and the device displays the delivery status in real time.

[2183] Prompt Sentence Examples

[2184] A system that searches for items suited to a specific TPO (e.g., formal, casual) and suggests combinations of clothes, shoes, and bags that you already own.

[2185] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2186] Step 1:

[2187] Create a new account

[2188] Input: User enters name, email address, password, and interests.

[2189] Specific operation: The terminal receives the input information and sends it to the server.

[2190] Data processing: The server stores the received user information in a database.

[2191] Output: The server sends a confirmation email to the user's email address.

[2192] Step 2:

[2193] User Authentication

[2194] Input: User clicks on the link in the confirmation email.

[2195] Specific behavior: The server verifies that the link was clicked and changes the account to an authenticated state.

[2196] Data processing: Update authentication information to the database.

[2197] Output: The account is authenticated and the user can log in.

[2198] Step 3:

[2199] Avatar Creation

[2200] Input: The user enters characteristics such as body shape, hairstyle, and skin tone on the avatar creation page.

[2201] Specific operation: The device receives the input and sends the data to the avatar generation API.

[2202] Data processing: The server generates an avatar based on the avatar generation API.

[2203] Output: A preview of the generated avatar will be displayed on the device.

[2204] Step 4:

[2205] Stylist Assist

[2206] Input: User confirms and saves registered avatar.

[2207] Specific operation: The device sends avatar information to the AI ​​stylist.

[2208] Data processing: An AI stylist suggests outfits based on the user's interests and data.

[2209] Output: The suggested outfits are displayed on the device.

[2210] Step 5:

[2211] Product search and combination suggestions

[2212] Input: User searches for items that fit a specific TPO.

[2213] Specific operation: The device sends search criteria to the server.

[2214] Data processing: The server retrieves the relevant product information from the database.

[2215] Output: The relevant product information is sent to the terminal and displayed.

[2216] Step 6:

[2217] Register your items

[2218] Input: The user registers photos of their clothes, shoes, and bags.

[2219] Specific operation: The device sends the photo data to the server.

[2220] Data processing: The server analyzes the data sent and stores the item information in a database.

[2221] Output: The registered items are now available in the system.

[2222] Step 7:

[2223] Coordinate preview

[2224] Input: The user confirms the suggested outfit.

[2225] Specific operation: The device reflects the coordinate information on the avatar.

[2226] Data processing: Processing is performed to reflect the data on the avatar.

[2227] Output: A preview of the outfit reflected on the device is displayed.

[2228] Step 8:

[2229] Original design creation

[2230] Input: User enters color, material, and design specifications.

[2231] Specific operation: The device sends the entered design specifications to the server.

[2232] Data processing: The server stores the design data and sends it to the manufacturing partner.

[2233] Output: A preview of your design will be displayed on your device.

[2234] Step 9:

[2235] Get quotes and delivery information

[2236] Input: The server sends the design data to the manufacturing partner.

[2237] What it does: Receive quotes and delivery information from manufacturing partners.

[2238] Data processing: Formatting received information for presentation to the user.

[2239] Output: The user is notified of the estimate and delivery date.

[2240] Step 10:

[2241] Purchase and shipping procedures

[2242] Input: The user adds the items they like to their cart and checks out.

[2243] Specific operation: The terminal displays the cart contents and total amount. The terminal sends the payment information to the server.

[2244] Data processing: The server connects to the payment system and processes the payment.

[2245] Output: The user is notified of the purchase confirmation and shipping information.

[2246] Step 11:

[2247] Delivery notification and real-time tracking

[2248] Input: The server initiates the delivery procedure.

[2249] Specific operation: The server sends the order data to the delivery company.

[2250] Data processing: Receive real-time tracking information from the delivery company.

[2251] Output: Real-time updated delivery status is displayed on the terminal.

[2252] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2253] The present invention relates to a system that allows users to try out outfits and purchase products using their own avatars in a virtual boutique. This system incorporates an emotion engine that recognizes the user's emotions and also has the function of adjusting outfit suggestions based on the user's emotions.

[2254] Basic system configuration

[2255] 1. User registration and login function

[2256] When a user creates a new account, they enter their name, email address, password, and interests.

[2257] The terminal sends the input information to the server, and the server stores the user information in a database.

[2258] The server sends a confirmation email to the user's email address, and the user clicks on the link in the email to authenticate their account.

[2259] 2. Avatar Creation and Stylist Assistance

[2260] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page.

[2261] The device will generate an avatar based on your input and display a preview.

[2262] The user checks and edits the avatar and finally saves it.

[2263] Based on the information stored on the device, an AI stylist will be activated to suggest the best outfit.

[2264] 3. Product search and combination suggestions

[2265] A user searches for items that fit a specific occasion (e.g., formal, casual).

[2266] The terminal transmits the input conditions to the server, and the server retrieves information on the corresponding product from the database and transmits it to the terminal.

[2267] Users register photos of their clothes, shoes, and bags and send that information to the server.

[2268] The device suggests combinations of new products with items the user has on hand, and displays a preview of the suggested coordination reflected on the avatar.

[2269] 4. Original design function

[2270] The user accesses a page for inputting an original design and inputs the color, material, and design specifications.

[2271] The device will check the design and display a preview.

[2272] The server stores the user's design specifications and transmits the design data to manufacturing partner companies as needed.

[2273] The server obtains quotes and delivery date information from manufacturing partner companies and notifies the user.

[2274] 5. Purchase and Delivery Procedures

[2275] Users add their favorite items to their cart.

[2276] The terminal displays the cart contents and total amount, and the user completes the purchase.

[2277] The server works with the payment system to process the payment.

[2278] If the server confirms the payment, it saves the order information and starts the delivery process.

[2279] The server will send a shipping notification to the user via a dedicated app or email.

[2280] Additional configuration of the emotion engine

[2281] 1. Emotion recognition using an emotion engine

[2282] When a user uses the system, the emotion engine analyzes the user's input and behavior (for example, the time spent viewing an item and the frequency of clicks) and analyzes the emotion at that time.

[2283] The device sends the emotion engine analysis data to the server.

[2284] 2. Emotion-based outfit suggestions

[2285] The server receives the analysis results from the emotion engine and dynamically adjusts the conditions for searching for products from the database.

[2286] The server transmits data to the terminal that suggests the most suitable product for the user based on the adjusted conditions.

[2287] The device will reflect the updated coordination suggestions on the avatar and display a preview.

[2288] Specific examples

[2289] Example 1: Coordination suggestions based on the user's mood using an emotion engine

[2290] 1. A user logs into the system and indicates that their recent mood is "fatigued."

[2291] 2. The emotion engine analyzes the user's behavior and determines that a relaxed style is appropriate.

[2292] 3. The server retrieves the relevant product information from the database based on the relaxation style and sends it to the terminal.

[2293] 4. Your device will then preview your avatar in a relaxed outfit (e.g., a loose top and pants).

[2294] Example 2: Flow from purchase to delivery

[2295] 1. The user likes the suggested outfit and adds it to their cart.

[2296] 2. The terminal displays the cart contents and total amount, and the user completes the purchase.

[2297] 3. The server connects to the payment system and processes the payment.

[2298] 4. After the payment is confirmed, the server saves the order information and starts the shipping process.

[2299] 5. The server sends a shipping notification to the user via email or a dedicated app.

[2300] 6. The terminal displays the delivery status to the user in real time.

[2301] The above is a concrete example of the system. This configuration allows users to find outfits and products that suit their emotions and moods, and allows for a smooth purchase process. Furthermore, original designs are possible, and custom-made items tailored to individual users can be provided.

[2302] The processing flow will be explained below.

[2303] Specific processing steps of a system that combines emotion engines

[2304] User registration and login functionality

[2305] Step 1:

[2306] A user visits a new account creation page and enters their name, email address, password, and interests.

[2307] Step 2:

[2308] The device sends the input to the server.

[2309] Step 3:

[2310] The server stores the received user information in a database.

[2311] Step 4:

[2312] The server sends a confirmation email to the user's email address.

[2313] Step 5:

[2314] The user clicks the link in the confirmation email to verify their account.

[2315] Step 6:

[2316] The user enters their email address and password on the login page.

[2317] Step 7:

[2318] The device sends the input to the server.

[2319] Step 8:

[2320] The server queries the database to verify the authentication information.

[2321] Step 9:

[2322] If the server authenticates the user, it starts a session and redirects them to the dashboard.

[2323] Step 10:

[2324] The terminal displays the user's login status.

[2325] Avatar Creation and Stylist Assist

[2326] Step 1:

[2327] The user enters characteristics such as body shape, hairstyle, and skin color on the avatar creation page.

[2328] Step 2:

[2329] The device will generate an avatar based on your input and display a preview.

[2330] Step 3:

[2331] The user checks the avatar and makes corrections if necessary.

[2332] Step 4:

[2333] The user saves the final avatar settings.

[2334] Step 5:

[2335] The device will activate an AI stylist based on the information stored on it.

[2336] Step 6:

[2337] An AI stylist will create the initial outfit based on the user's preferences.

[2338] Step 7:

[2339] The server retrieves the relevant product data from the database and sends it to the terminal.

[2340] Step 8:

[2341] The device will reflect the suggested outfit on the avatar and display a preview.

[2342] Emotion recognition and coordination suggestions using an emotion engine

[2343] Step 1:

[2344] The emotion engine is activated when a user logs in and interacts with the system.

[2345] Step 2:

[2346] The emotion engine analyzes the user's input, browsing behavior, click frequency, etc. to estimate their current emotion.

[2347] Step 3:

[2348] The device sends the emotion engine analysis data to the server.

[2349] Step 4:

[2350] The server receives the emotion analysis results and stores them in a database.

[2351] Step 5:

[2352] The server dynamically changes the search criteria for related products based on the analysis results.

[2353] Step 6:

[2354] The server searches the database using the changed conditions and retrieves the relevant product information.

[2355] Step 7:

[2356] The server transmits product information to the terminal.

[2357] Step 8:

[2358] The device will reflect the suggested outfit on the avatar and display a preview.

[2359] Product search and combination suggestions

[2360] Step 1:

[2361] The user selects clothing appropriate for a particular occasion.

[2362] Step 2:

[2363] The device sends the selection to the server.

[2364] Step 3:

[2365] The server searches the database based on multiple brands, place of manufacture, fabric, etc., and retrieves the relevant products.

[2366] Step 4:

[2367] The server transmits product information to the terminal.

[2368] Step 5:

[2369] Users upload images of their clothes, shoes, and bags and register them in the system.

[2370] Step 6:

[2371] The server stores the information about the items in your possession in a database.

[2372] Step 7:

[2373] The device suggests combinations of new products with the user's existing items.

[2374] Step 8:

[2375] The device will reflect the suggested outfit on the avatar and display a preview.

[2376] Original design function

[2377] Step 1:

[2378] The user accesses a page for inputting an original design and inputs the color, material, and design specifications.

[2379] Step 2:

[2380] The device will check the design and display a preview.

[2381] Step 3:

[2382] The terminal transmits the design data to the server.

[2383] Step 4:

[2384] The server stores the user's design specifications and transmits the design data to partner companies that can manufacture the product.

[2385] Step 5:

[2386] The server obtains quotes and delivery date information from manufacturing partner companies.

[2387] Step 6:

[2388] The server notifies the user of the estimate and delivery date information.

[2389] Step 7:

[2390] The user gives final approval.

[2391] Step 8:

[2392] The server notifies partner companies that production has begun.

[2393] Purchase and shipping procedures

[2394] Step 1:

[2395] Users add their favorite items to their cart.

[2396] Step 2:

[2397] The terminal displays the cart contents and total amount.

[2398] Step 3:

[2399] The user begins the checkout process and enters shipping and payment information.

[2400] Step 4:

[2401] The device sends the input to the server.

[2402] Step 5:

[2403] The server connects to the payment system and processes the payment.

[2404] Step 6:

[2405] If the server confirms the payment, it saves the order information and starts the delivery process.

[2406] Step 7:

[2407] The server sends a shipping notification to the user.

[2408] Step 8:

[2409] The terminal displays the purchase status to the user in real time.

[2410] Example 2

[2411] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2412] Today's consumers demand customized fashion suggestions that reflect their individual style and mood, but existing systems struggle to reflect the user's emotions and moods. Furthermore, there are limited systems that allow users to virtually try on new items by combining existing items with new items. Furthermore, there is a lack of an easy way to incorporate original designs when a specific product cannot be found.

[2413] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2414] In this invention, the server includes: means for a user to create a new account and register interests; means for a user to create a virtual representation of themselves and set basic characteristics; means for the server to save user information and manage authentication information; means for the terminal to operate an artificial intelligence outfit suggestion engine and make an initial outfit suggestion; means for the server to search for relevant items from an informati...

Claims

1. A means for users to create new accounts and register their interests; a means for users to create their own avatar and configure its basic characteristics; a means for the server to store user information and manage authentication information; The device will run an AI stylist and provide initial coordination suggestions. A means for the server to search for the corresponding product from the database and transmit it to the terminal; The system includes a means for the terminal to reflect the suggested coordination on an avatar and display a preview.

2. A means for a user to select an outfit appropriate for a particular time, place, and occasion; A means for the server to search for and suggest a corresponding product from multiple options; A means for registering items held by a user in the system; 2. The system according to claim 1, wherein the terminal includes means for suggesting combinations of on-hand items with new products.

3. A way for users to input their own design ideas if they cannot find a specific product; A server stores the user's design specifications and transmits the design data to partner companies capable of manufacturing the products; 2. The system according to claim 1, further comprising means for displaying the virtual item on the terminal and allowing the user to wear it on an avatar and confirm it.

Citation Information

Patent Citations

  • Persona chatbot control method and system

    JP2022180282A