System

Abstract

A system is provided.SOLUTION: A system comprising: means for a user to input his / her own hairstyle, skin condition, clothing style, and budget information; means for transmitting the information input by the user to a server; means for the server to pass the received information to a generating AI for analysis; means for the generating AI to compare the user's current and ideal information and generate a plan for approaching an optimal appearance; and means for transmitting and displaying the generated plan to a user device.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In order to get closer to their ideal appearance, users need to create a plan based on multiple data, such as their current appearance, ideal image, and budget. However, doing this manually is extremely time-consuming and makes it difficult to create an effective plan. Furthermore, hiring a dedicated advisor is expensive, making it unrealistic for many users. Furthermore, it is difficult to find items and services that suit them, making it difficult to make optimal purchases within their budget. [Means for solving the problem]

[0005] The present invention provides a system in which a user inputs information about their hairstyle, skin condition, clothing style, and budget, and a generation AI analyzes that information to automatically generate a specific plan to bring the user closer to their ideal appearance. Specifically, the information input by the user is sent to a server, and the data received by the server is passed to the generation AI. The generation AI compares the user's current data with their ideal data, generates an optimal plan, and displays it on the user's device. The generation AI also has the function of listing available items and services, taking the user's budget information into consideration. In this way, users can easily obtain a specific plan to bring their ideal appearance closer to their ideal appearance efficiently and economically, without having to consult a professional advisor.

[0006] A "user" is an individual who uses the system and inputs information about their appearance and their ideal appearance.

[0007] "Hairstyle" refers to the style and shape of the user's hair.

[0008] "Skin condition" refers to the condition or characteristics of the user's skin, and falls into categories such as dry, oily, and sensitive skin.

[0009] "Clothing style" refers to a user's clothing preferences and fashion trends.

[0010] "Budget information" indicates the financial range that a user can spend on beauty and fashion.

[0011] "Terminal" refers to the device a user uses to enter information and communicate with the system, including smartphones and tablets.

[0012] A "server" is a computer system that receives information sent from the user's device and passes it on to the generation AI for analysis.

[0013] "Generative AI" is an artificial intelligence system that analyzes information input by the user and generates plans and recommendations to help users achieve their ideal appearance.

[0014] A "plan" is a specific action plan or schedule that the generation AI generates by analyzing the information input by the user.

[0015] "Recommendation" refers to the selection of specific items or services that the generative AI suggests to the user. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] This invention relates to a system in which a user inputs their own appearance data and ideal image into the system, and a generation AI analyzes the data and generates a plan to bring the user closer to their ideal appearance. This system inputs the user's hairstyle, skin condition, clothing style, and budget information and automatically makes optimal beauty and fashion suggestions based on this information.

[0038] System configuration

[0039] User terminal

[0040] Terminal: The user uses a terminal such as their smartphone or tablet to input information about their hairstyle, skin condition, clothing style, and budget. The input information is sent to the server via the terminal.

[0041] server

[0042] Server: Receives user information sent from the device and stores it in a database. The server passes this data to the generation AI for analysis.

[0043] Generation AI

[0044] Generative AI: Analyzes the data passed from the server and compares the user's current data with their ideal data. This generates a specific plan and recommendations to achieve optimal appearance, which are then sent to the user's device via the server.

[0045] Program processing

[0046] 1. Enter and submit information

[0047] Device: The user launches the application and enters their hairstyle, skin condition, clothing style, and budget information through a dedicated form. For example, if a user prefers short hair, dry skin, and casual clothing, they enter this information and also set their ideal appearance and monthly beauty budget.

[0048] Terminal: Once the input is complete, the user presses the send button to send the input information to the server.

[0049] 2. Data Reception and Analysis

[0050] Server: Receives user input information and stores it in an internal database. Then, passes the received data to the generation AI.

[0051] Generative AI: Analyzes the received data and compares the user's current condition with their ideal appearance, for example, suggesting moisturizing cream to combat dry skin or planning a haircut to achieve their ideal hairstyle.

[0052] 3. Plan generation and display

[0053] Generative AI: Based on user data, it generates the optimal plan for hairstyle, skin condition, and clothing style. It also takes into account budget information and lists available items and services.

[0054] Server: Sends the plans and recommendations created by the generation AI to the user device.

[0055] Device: The user can view the generated plan on their device and refer to their daily execution plan. Examples include the skin care products the user uses daily and a haircut schedule.

[0056] Specific examples

[0057] User: Create a new account and enter your hairstyle (short hair), skin condition (dry skin), and preferred clothing style (casual). Your ideal look is "simple and clean," and you set your monthly budget at 10,000 yen.

[0058] Server: Receives the input information and sends it to the generating AI.

[0059] Generative AI: Suggests moisturizing creams for dry skin, recommends simple and casual fashion items, and generates a two-weekly haircut plan for maintaining short hair.

[0060] Server: Sends the generated plan to the user terminal.

[0061] Device: Displays suggested skin care products and clothing ideas, allowing users to carry out daily care and shopping accordingly.

[0062] In this way, users can easily take concrete actions to get closer to their ideal appearance with the help of generative AI.

[0063] The processing flow will be explained below.

[0064] Step 1:

[0065] Terminal: The user launches the application and logs in or creates a new account. In the case of a new account, the user enters the required personal information (email address, password, etc.) to create the account.

[0066] Step 2:

[0067] Terminal: The user inputs their hairstyle, skin condition, clothing style, and budget information on the application screen. For example, the user selects "short hair," "dry skin," and "casual clothing style," and inputs "10,000 yen" as budget information.

[0068] Step 3:

[0069] Device: The user takes a photo of their hairstyle and skin condition and uploads it through the app.

[0070] Step 4:

[0071] Device: The user answers a questionnaire about their ideal appearance. For example, they may write that they are aiming for a "simple and clean look."

[0072] Step 5:

[0073] Terminal: Once the input is complete, the user presses the send button to send the input information and photo to the server.

[0074] Step 6:

[0075] Server: Receives user input information and photos and stores them in a built-in database.

[0076] Step 7:

[0077] Server: Passes the received data to the generation AI for analysis, verifying that the data is in the correct format.

[0078] Step 8:

[0079] Generative AI: Analyzes the received user data and compares the user's current data (hairstyle, skin condition, clothing style) with the ideal data.

[0080] Step 9:

[0081] Generative AI: Based on the analysis results, it generates a plan to help the user achieve their ideal appearance, such as "recommending moisturizing creams for dry skin" and "a plan for cutting hair every two weeks to maintain short hair."

[0082] Step 10:

[0083] Generative AI: Considers the user's budget information, checks whether the suggested items and services can be purchased within the budget, and generates a list of available goods and services.

[0084] Step 11:

[0085] Server: Sends the generated plans and recommendations to the user device.

[0086] Step 12:

[0087] On Device: The user can view the generated plan on their device, which includes daily skin care routines, weekly hair care plans, and monthly fashion updates.

[0088] Step 13:

[0089] Terminal: The user accesses the link to purchase the suggested items and does their online shopping.

[0090] Step 14:

[0091] Server: Periodically collects user progress data and passes it to the generation AI. The collected data includes the results of actions taken by the user and feedback.

[0092] Step 15:

[0093] Generative AI: Analyzes collected data and evaluates the effectiveness of the plan, then optimizes it as needed.

[0094] Step 16:

[0095] Server: Sends the new optimized plan to the user's device, which then takes the next step.

[0096] In this way, users can easily take concrete actions to get closer to their ideal appearance using generative AI.

[0097] Example 1

[0098] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0099] The present invention relates to a system that automatically generates a specific plan for a user to efficiently fulfill their appearance-related desires. Conventional methods require users to collect information on beauty and fashion and create their own plans, which is a very time-consuming process. Furthermore, individual beauty and fashion information is not centralized, making it difficult for users to find appropriate products and services. This presents a challenge for users, making it difficult to efficiently and effectively achieve their ideal appearance.

[0100] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0101] In this invention, the server includes means for a user to input information about their hairstyle, skin condition, clothing style, and budget, means for transmitting the information input by the user to the server, means for the server to pass the received information to a generation AI for analysis, means for the generation AI to compare the user's current data with ideal data and generate a plan to achieve an optimal appearance, means for transmitting the generated plan to a user terminal and displaying it, means for the server to store the user's input information in a database, means for the generation AI to retrieve data from the database to create a plan, and means for the user terminal to display a daily implementation plan. This allows users to easily obtain a specific plan to achieve their ideal appearance and carry out their daily beauty and fashion routines.

[0102] "User" refers to a person who uses the system to input information about their own appearance and ideal appearance.

[0103] "Hairstyle" refers to information indicating the state of the user's hair, such as style and length.

[0104] "Skin condition" refers to information that indicates the condition or characteristics of the user's skin, such as dry skin or oily skin.

[0105] "Clothing style" refers to information about the type, design, and fashion of clothing that the user prefers.

[0106] "Budget information" refers to information indicating the amount of money a user can spend on beauty and fashion within a certain period of time.

[0107] "Device" refers to the device used by a user to input and transmit their appearance information to a server. Examples include smartphones and tablets.

[0108] "Server" refers to a component that receives information sent from the user terminal and passes it on to the generation AI.

[0109] "Database" means the data storage system used by the Server to organize and store User information.

[0110] "Generative AI" refers to artificial intelligence that analyzes user information passed from the server, compares the user's current data with their ideal data, and generates a plan to achieve their optimal appearance.

[0111] A "plan" refers to a plan created by the generative AI based on the user's information, showing specific actions and recommendations to move closer to their ideal appearance.

[0112] "User terminal" refers to a device for receiving the generated plan and displaying it to the user.

[0113] The present invention relates to a system in which a user inputs their own appearance data and ideal image, and a generation AI analyzes the data and generates a specific plan to help the user approach their ideal appearance. Detailed embodiments of the present invention are described below.

[0114] System configuration

[0115] User terminal

[0116] The terminal is a device that allows users to input information about their hairstyle, skin condition, clothing style, and budget using their own smartphone, tablet, etc. The input information is sent to the server via the terminal.

[0117] server

[0118] The server receives the user information sent from the device and stores it in a database. The server also passes this data to the generation AI for analysis.

[0119] Generation AI

[0120] The generation AI analyzes the data passed from the server and compares the user's current data with their ideal data. This generates a specific plan and recommendations to help them achieve their ideal appearance, which are then sent to the user's device via the server.

[0121] Hardware and software used

[0122] Hardware:

[0123] User devices such as smartphones and tablets

[0124] Server for data storage and analysis

[0125] software:

[0126] An application that provides a user interface

[0127] Generative AI models that analyze data

[0128] Specific examples

[0129] Enter and submit information

[0130] The user launches the application and enters information about their hairstyle, skin condition, clothing style, and budget through a dedicated form. For example, if the user prefers short hair, dry skin, and a casual clothing style, they enter this information, as well as their ideal appearance and monthly beauty budget. Once the input is complete, the user presses the submit button, which sends the entered information to the server.

[0131] Data reception and analysis

[0132] The server receives the user's input, stores it in an internal database, and then passes the data to the AI ​​generator, which analyzes the data and compares the user's current appearance with their ideal appearance. For example, this could include suggesting a moisturizing cream to combat dry skin or a haircut plan to achieve their ideal hairstyle.

[0133] Plan Generation and Display

[0134] The generation AI generates an optimal plan based on the user's data, taking into account hairstyle, skin condition, and clothing style, and also lists items and services that can be purchased, taking into account budget information. The server sends the plan and recommendations created by the generation AI to the user's device, and the user can check the generated plan on their device and refer to their daily execution plan. Specific examples include the user's daily skin care products and haircut schedule.

[0135] Example prompts for generative AI models

[0136] "Please suggest a specific plan for a user with short hair and dry skin to achieve a clean look with a casual clothing style."

[0137] "Make a list of the products and services you need to combat dry skin and maintain short hair within a monthly budget of ¥10,000."

[0138] In this way, users can easily take concrete actions to get closer to their ideal appearance with the help of generative AI.

[0139] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0140] Step 1:

[0141] The user launches an application.

[0142] Specific operation: The user taps and launches the dedicated application on their smartphone or tablet.

[0143] Input: The user operates the device to launch the app.

[0144] Output: A dedicated form is displayed.

[0145] Step 2:

[0146] Users enter hairstyle, skin condition, clothing style, and budget information into a dedicated form.

[0147] Specific operation: The user enters hairstyle (e.g., short hair), skin condition (e.g., dry skin), clothing style (e.g., casual), and budget information (e.g., 10,000 yen) into the form.

[0148] Input: The user enters information into the form.

[0149] Output: The input information is kept within the application.

[0150] Step 3:

[0151] The user presses the send button to send the input information to the server.

[0152] Specific behavior: When the user has completed filling out the form, they tap the submit button.

[0153] Input: The action of the user pressing the submit button.

[0154] Output: The input information is sent to the server.

[0155] Step 4:

[0156] The server receives the information sent by the user.

[0157] Specific operation: The server processes data received from the user terminal in real time.

[0158] Input: Information sent from the user's device.

[0159] Output: The received information is saved on the server.

[0160] Step 5:

[0161] The server stores the received data in a database.

[0162] Specific operation: The server stores the received information in an internal database.

[0163] Input: Received information.

[0164] Output: Information stored in a database.

[0165] Step 6:

[0166] The server retrieves the necessary data from the database and passes it to the generation AI.

[0167] Specific operation: The server reads user information from the database and sends it to the generation AI.

[0168] Input: User information retrieved from the database.

[0169] Output: User information passed to the generation AI.

[0170] Step 7:

[0171] The generative AI analyzes the user's information and compares the current data with the ideal data.

[0172] Specific operation: The generating AI compares the user's current data (entered hairstyle, skin condition, etc.) with the ideal data and identifies any gaps.

[0173] Input: User's current and ideal data.

[0174] Output: Analysis results based on gaps.

[0175] Step 8:

[0176] Generative AI creates the optimal plan.

[0177] Specific operation: Based on the analysis results, the generation AI generates a plan to help the user achieve their ideal appearance.

[0178] Input: Analysis results.

[0179] Output: Optimal plan and recommendations.

[0180] Step 9:

[0181] The plan created by the generation AI is sent to the server.

[0182] Specific operation: The generation AI sends the generated plan to the server.

[0183] Input: The generated plan.

[0184] Output: The plan sent to the server.

[0185] Step 10:

[0186] The server transmits the plan to the user terminal.

[0187] Specific operation: The server sends the plan received from the generation AI to the user terminal.

[0188] Input: The plan received from the generation AI.

[0189] Output: The plan sent to the user device.

[0190] Step 11:

[0191] The user checks the plan on the device and refers to the daily execution plan.

[0192] Specific behavior: The user views the plan on their device and performs the recommended actions.

[0193] Input: The plan received from the server.

[0194] Output: Daily execution plan based on the plan.

[0195] (Application example 1)

[0196] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0197] In conventional beauty and fashion planning, it was difficult for users to obtain specific advice to get closer to their ideal appearance. Furthermore, there was no system that analyzed the user's appearance data and ideal data and provided a plan tailored to individual needs, so users had to spend a lot of time and effort. Furthermore, proposals rarely took budget information into account, making it difficult to obtain a feasible plan.

[0198] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0199] In this invention, the server includes means for a user to input information about their hairstyle, skin condition, clothing style, and budget, means for transmitting the information input by the user to the server, means for the server to pass the received information to a generation AI for analysis, means for the generation AI to compare the user's current data with ideal data and generate a plan to achieve an optimal appearance, means for transmitting the generated plan to a user terminal and displaying it, means for visualizing the generated plan and presenting it to the user, and means for the user to set their ideal appearance and use that data for analysis. This allows the user to easily take specific actions to achieve their ideal appearance and obtain a workable plan that fits their budget.

[0200] "User" refers to an individual who utilizes the system to input their own appearance data and receive a plan to achieve their ideal appearance.

[0201] "Hairstyle" is information that indicates the current state of the user's hairstyle.

[0202] "Skin condition" is information that indicates the user's skin condition (e.g., dry skin, oily skin).

[0203] "Clothing style" is information that indicates the fashion style (e.g., casual, formal) that the user prefers.

[0204] "Budget information" is information that indicates the amount of budget that a user will spend on beauty and fashion for each month and year.

[0205] The "server" is a relay device that passes information received from the user to the generation AI and transmits the generated plan to the user's terminal.

[0206] "Generative AI" is an artificial intelligence that analyzes the user's appearance data and ideal data received and generates a plan to approach the optimal appearance.

[0207] A "plan" is a proposal made by the generative AI after analyzing the user's data, including a specific action plan and a list of items to help them achieve their ideal appearance.

[0208] A "user terminal" is an electronic device (e.g., a smartphone or tablet) through which a user inputs data and receives the generated plan.

[0209] "Visualization" is the process of visually displaying the generated plan and presenting it to the user.

[0210] "Ideal appearance" refers to the image of one's appearance that a user sets as a goal to aim for.

[0211] The system for implementing this invention begins when a user uses a device such as a smartphone or tablet to input information about their hairstyle, skin condition, clothing style, and budget, and sends it to a server. The server then passes the received user data to a generation AI, which analyzes the data, compares the user's current data with their ideal data, and generates a plan to achieve their optimal appearance. The generated plan is then sent to the user's device via the server, where it is visualized and presented to the user.

[0212] Hardware and software used

[0213] Hardware

[0214] Smartphones / Tablets: Used as devices for users to input data.

[0215] Server: A relay device that passes data received from the user to the generation AI and sends the generated plan to the user's terminal.

[0216] Cloud Server: Hosts the generative AI and provides the necessary computing resources.

[0217] software

[0218] Flask (server side): A lightweight Python web framework that provides API endpoints.

[0219] Generative AI model (e.g., GPT-3): An artificial intelligence that analyzes user data and generates an appearance improvement plan.

[0220] Requests (client side): A Python HTTP library used to send data.

[0221] Specific system behavior

[0222] Enter and submit information

[0223] The user starts the smartphone application and enters information about their hairstyle, skin condition, clothing style, and budget into a dedicated form. For example, the user may have short hair, dry skin, a preference for casual clothing, and a monthly budget of 10,000 yen. Once the information is complete, it is sent to the server.

[0224] Data reception and analysis

[0225] The server receives the user's input and stores it in an internal database. The received data is then passed to the generation AI, which compares the user's current condition with their ideal appearance and generates an optimal plan. Specific examples include recommendations for moisturizing creams for dry skin and haircut plans to achieve the ideal hairstyle.

[0226] Plan Generation and Display

[0227] The plan created by the AI ​​is sent to the user's device via the server, where it is visualized and displayed, allowing the user to refer to their daily plan, including, for example, the skin care products they use every day and their haircut schedule.

[0228] Prompt Sentence Examples

[0229] User's current data:

[0230] Hairstyle: Short hair

[0231] Skin condition: Dry skin

[0232] Clothing style: Casual

[0233] Budget: 10,000 yen

[0234] Ideal appearance:

[0235] Simple and clean appearance

[0236] Suggest beauty and fashion plans to help users achieve their ideal appearance.

[0237] This system allows users to easily take specific actions to get closer to their ideal appearance and provides a workable plan that fits their budget.

[0238] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0239] Step 1:

[0240] The user launches a dedicated application on their smartphone or tablet and enters their hairstyle, skin condition, clothing style, and budget information. Specifically, the user specifies that they prefer short hair, dry skin, and casual clothing, and sets their monthly budget to 10,000 yen. Once the information is complete, they press the send button in the application to send the information to the server.

[0241] Input: Hairstyle, skin condition, clothing style, budget information

[0242] Output: User appearance data and budget information sent to the server

[0243] Step 2:

[0244] The server temporarily stores the received user appearance data and budget information in an internal database, then packets the stored data for transmission to the generation AI and sends it to the generation AI's analysis process.

[0245] Input: User appearance data and budget information

[0246] Output: Data packet sent to the generating AI

[0247] Step 3:

[0248] The generative AI analyzes the received data and compares the user's current condition with the ideal appearance data. The analysis may, for example, suggest a moisturizing cream for dry skin or a haircut plan to maintain short hair. This analysis generates a beauty and fashion plan to bring the user closer to their optimal appearance.

[0249] Input: User's appearance data and ideal appearance data

[0250] Output: Generated appearance improvement plan

[0251] Step 4:

[0252] The server analyzes the appearance improvement plan received from the generation AI and formats it for transmission to the user's device. The plan contents include specific beauty product and service recommendations, usage instructions, and implementation schedules.

[0253] Input: Generated appearance improvement plan

[0254] Output: Formatted plan data sent to the user device

[0255] Step 5:

[0256] The user device visualizes the received plan and displays it to the user. The user can then review the plan generated on the application and take specific actions, such as incorporating suggested skin care products or haircut schedules into their daily lives.

[0257] Input: Formatted plan data

[0258] Output: Visualized appearance improvement plan

[0259] This allows users to easily take specific actions to get closer to their ideal appearance and obtain a workable plan that fits their budget.

[0260] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0261] This invention relates to a system in which a user inputs their own appearance data and ideal image into the system, and a generation AI analyzes the data to generate a plan to bring the user closer to their ideal appearance. Furthermore, by combining it with an emotion engine, the system has the function of recognizing the user's emotions and adjusting the plan based on those emotions. By inputting the user's hairstyle, skin condition, clothing style, and budget information, and incorporating emotional data, the system makes more personalized and effective beauty and fashion recommendations.

[0262] System configuration

[0263] User terminal

[0264] Device: The user uses a device such as a smartphone or tablet to input information about their hairstyle, skin condition, clothing style, and budget. Emotional data is acquired using text input, voice input, and even facial recognition technology. The input information is sent to the server via the device.

[0265] server

[0266] Server: Receives user information and emotion data sent from the device and stores it in a built-in database. The server passes this data to the generation AI and emotion engine for analysis.

[0267] Generation AI

[0268] Generative AI: Analyzes the data passed from the server and compares the user's current data with the ideal data. The Generative AI also takes into account the emotional data obtained from the user's emotion engine to generate a plan that will best satisfy the user.

[0269] Emotion Engine

[0270] Emotion engine: Analyzes the user's emotional data passed from the server and recognizes the user's current emotional state. This information is provided to the generative AI, contributing to the optimization of the plan.

[0271] Program processing

[0272] 1. Enter and submit information

[0273] Device: The user launches the application and logs in or creates a new account. They enter their hairstyle, skin condition, clothing style, and budget information, and then run questions and facial recognition to assess the user's emotions.

[0274] Terminal: After all information is entered, the user presses the send button to send the information and emotion data to the server.

[0275] 2. Data Reception and Analysis

[0276] Server: Receives user input information and emotion data, stores it in a database, and passes the received data to the generation AI and emotion engine.

[0277] Generative AI: Analyzes the received data and combines the user's current data (hairstyle, skin condition, clothing style), ideal data, and emotional data to generate the optimal plan.

[0278] 3. Plan generation and display

[0279] Generative AI: Based on user data, it generates optimal plans for hairstyle, skin condition, and clothing style, and adjusts them to maximize user satisfaction by taking into account data from the emotion engine. It also takes into account the user's budget information and lists items and services that can be purchased.

[0280] Server: Sends the generated plans and recommendations to the user device.

[0281] Device: The user can view the generated plan on their device and refer to their daily action plan, including the skin care products they use every day and their haircut schedule.

[0282] Specific examples

[0283] 1. User: Create a new account and enter your hairstyle (short hair), skin condition (dry skin), and preferred clothing style (casual). Fill out a questionnaire and select "simple and clean appearance" as your ideal appearance, and set your monthly budget at 10,000 yen. Also, enter emotional information such as "I've been feeling tired lately" or "I'm feeling stressed" as an emotional assessment.

[0284] 2. Server: Receives input information and emotion data and sends it to the generative AI and emotion engine.

[0285] 3. Generative AI: It can suggest moisturizing creams for dry skin, recommend simple and casual fashion items, and create a two-weekly haircut plan to maintain short hair. It also uses the analysis results of the emotion engine to suggest relaxing spa services and refreshing activities for users.

[0286] 4. Server: Sends the generated plan to the user terminal.

[0287] 5. Device: Displays suggested skin care products, outfit ideas, and even relaxing services, allowing users to carry out their daily care and shopping accordingly.

[0288] In this way, users can easily take concrete actions to get closer to their ideal appearance, with the assistance of generative AI and an emotion engine.

[0289] The processing flow will be explained below.

[0290] System processing flow and specific steps

[0291] Step 1:

[0292] Terminal: The user launches the application and logs in or creates a new account. In the case of a new account, the user enters the required personal information (email address, password, etc.) to create the account.

[0293] Step 2:

[0294] Terminal: The user inputs their hairstyle, skin condition, clothing style, and budget information on the application screen. For example, the user selects "short hair," "dry skin," and "casual clothing style," and inputs "10,000 yen" as budget information.

[0295] Step 3:

[0296] Device: The user takes a photo of their hairstyle and skin condition and uploads it through the app.

[0297] Step 4:

[0298] Device: The user answers a questionnaire about their ideal appearance. For example, they may write that they are aiming for a "simple and clean look."

[0299] Step 5:

[0300] Terminal: The user fills out a form to input their emotional state. For example, they can input emotional information such as "I've been feeling tired recently" or "I'm stressed." Alternatively, they can use facial recognition to collect emotional data and obtain real-time emotional states.

[0301] Step 6:

[0302] Terminal: Once the input is complete, the user presses the send button to send the input information, photo, and emotion data to the server.

[0303] Step 7:

[0304] Server: Receives user input information and emotion data and stores them in a built-in database.

[0305] Step 8:

[0306] Server: Passes the received data to the generation AI and emotion engine for analysis, and verifies that the data is in the correct format.

[0307] Step 9:

[0308] Generative AI: Analyzes the received user data and compares the user's current data (hairstyle, skin condition, clothing style) with the ideal data.

[0309] Step 10:

[0310] Emotion Engine: Analyzes received emotion data and recognizes the user's emotional state. This information is provided to the generative AI, which then contributes to optimizing the plan.

[0311] Step 11:

[0312] Generative AI: Based on the analysis results, it generates a plan to help the user achieve their ideal appearance. For example, it creates a "moisturizing cream recommendation for dry skin" or a "haircut plan every two weeks to maintain short hair." It adjusts the plan to maximize user satisfaction, taking into account data from the emotion engine.

[0313] Step 12:

[0314] Generative AI: Considers the user's budget information, checks whether the suggested items and services can be purchased within the budget, and generates a list of available goods and services.

[0315] Step 13:

[0316] Server: Sends the generated plans and recommendations to the user device.

[0317] Step 14:

[0318] On Device: The user can view the generated plan on their device, which includes daily skin care routines, weekly hair care plans, and monthly fashion updates.

[0319] Step 15:

[0320] Terminal: The user accesses the link to purchase the suggested items and does their online shopping.

[0321] Step 16:

[0322] Server: Periodically collects user progress data and passes it to the generative AI and emotion engine. The collected data includes the results of actions taken by the user and feedback.

[0323] Step 17:

[0324] Generative AI: Analyzes collected data and evaluates the effectiveness of the plan, then optimizes it as needed.

[0325] Step 18:

[0326] Server: Sends the new optimized plan to the user's device, which then takes the next step.

[0327] In this way, users can easily take concrete actions to get closer to their ideal appearance, with the assistance of generative AI and an emotion engine.

[0328] Example 2

[0329] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0330] Conventional appearance improvement systems generate plans based solely on user input, making it difficult to provide an optimal plan that takes into account the user's emotional state and daily changes. Furthermore, they may not adequately propose specific actions that satisfy the user or fit their budget. Therefore, there is a need for a system that provides an individually optimized appearance improvement plan that takes into account the user's emotional state.

[0331] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for storing user information and emotional data in a database, means for transferring the stored information to the analysis module, and means for the generation AI to generate a plan by integrating the user's current data, ideal data, and emotional data. This enables comprehensive data analysis, including the user's emotional state, and makes it possible to provide an individually optimized, high-quality appearance improvement plan.

[0332] "User" refers to an individual who uses the System to create and implement their own appearance improvement plan.

[0333] "Server" refers to the computer system that receives and stores information entered by users and passes that data to the analysis module.

[0334] "Generative AI" refers to artificial intelligence that generates an optimal appearance improvement plan based on the user's current data, ideal data, and emotional data.

[0335] "Emotion data" refers to information that reflects the user's current emotional state, and refers to data obtained by text input, voice input, facial recognition, etc.

[0336] A "plan" refers to the suggestions that the generative AI makes after analyzing the user's data, including specific actions and recommended items to help the user achieve their ideal appearance.

[0337] "Database" refers to an electronic storage device where the server stores user information and emotion data.

[0338] An "analysis module" refers to a combination of software and hardware that allows the generation AI and emotion engine to analyze data based on data passed from the server.

[0339] "Current status data" refers to information entered by the user that indicates current physical characteristics such as hairstyle, skin condition, clothing style, etc.

[0340] "Ideal data" refers to specific information about the user's desired appearance, and refers to data entered in a questionnaire or as a preference.

[0341] "Budget Information" refers to the amount of money a user can spend on improving their appearance in a month or a specific period of time.

[0342] This invention is a system in which a user inputs their own appearance data and ideal image into the system, and a generation AI analyzes the data to generate a plan to bring the user closer to their ideal appearance. Furthermore, by combining it with an emotion engine, it has the function of recognizing the user's emotions and adjusting the plan based on those emotions. A specific embodiment of this system will be described below.

[0343] System configuration

[0344] User terminal

[0345] Device: The user uses a device such as a smartphone or tablet to input information about their hairstyle, skin condition, clothing style, and budget. Emotional data is acquired using text input, voice input, and even facial recognition technology. The input information is sent to the server via the device.

[0346] server

[0347] Server: The server receives user information and emotion data sent from the device and stores it in a built-in database. The stored data is then passed to the generative AI and emotion engine for analysis.

[0348] Generation AI

[0349] Generative AI: Analyzes the data passed from the server and compares the user's current data with their ideal data. The Generative AI also takes into account the emotional data obtained from the emotion engine to generate a plan that will best satisfy the user.

[0350] Emotion Engine

[0351] Emotion engine: Analyzes the user's emotional data passed from the server and recognizes the user's current emotional state. This information is provided to the generative AI, contributing to the optimization of the plan.

[0352] System Operation

[0353] 1. Enter and submit information

[0354] Users launch the application, log in or create a new account, enter their hairstyle, skin condition, clothing style, and budget information, and then run questions and facial recognition to assess the user's emotions.

[0355] After all the information has been entered, the terminal presses the send button to send the information and emotion data to the server.

[0356] 2. Data Reception and Analysis

[0357] The server receives the user's input information and emotion data, stores it in a database, and passes the received data to the analysis module.

[0358] The generation AI analyzes the received data and combines the user's current data (hairstyle, skin condition, clothing style), ideal data, and emotional data to generate the optimal plan.

[0359] 3. Plan generation and display

[0360] The generative AI uses user data to generate optimal plans for hairstyle, skin condition, and clothing style, and adjusts them to maximize user satisfaction by taking into account data from the emotion engine. It also takes into account the user's budget information to list items and services that can be purchased.

[0361] The server transmits the generated plan and recommendations to the user terminal.

[0362] On the terminal, the user can check the generated plan and refer to the daily execution plan.

[0363] Specific examples

[0364] 1. User: Create a new account and enter your hairstyle (short hair), skin condition (dry skin), and preferred clothing style (casual). Fill out a questionnaire and select "simple and clean appearance" as your ideal appearance, and set your monthly budget at 10,000 yen. Also, enter emotional information such as "I've been feeling tired lately" or "I'm feeling stressed" as an emotional assessment.

[0365] Example prompt: "Please tell us about your hairstyle, skin condition, clothing style, and monthly budget. Also, tell us about your recent emotional state. For example, have you been feeling tired or stressed lately?"

[0366] 2. Server: Receives input information and emotion data and sends it to the generative AI and emotion engine.

[0367] 3. Generative AI: It can suggest moisturizing creams for dry skin, recommend simple and casual fashion items, and create a two-weekly haircut plan to maintain short hair. It also uses the analysis results of the emotion engine to suggest relaxing spa services and refreshing activities for users.

[0368] 4. Server: Sends the generated plan to the user terminal.

[0369] 5. Terminal: Displays suggested skin care products, clothing ideas, and even relaxing services, allowing users to follow their daily care and shopping accordingly.

[0370] In this way, users can easily take concrete actions to get closer to their ideal appearance, with the assistance of generative AI and an emotion engine.

[0371] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0372] Specific processing steps of the program

[0373] Step 1:

[0374] A user launches the application and creates a new account or logs in. Data entered includes hairstyle, skin condition, clothing style, and budget information.

[0375] Input: Hairstyle, skin condition, clothing style, and budget information from the user.

[0376] Output: Temporarily saves input data.

[0377] Specific operation: The user enters the necessary information into the form. For example, the user enters data such as "hairstyle: short hair," "skin condition: dry skin," "clothing style: casual," and "budget: 10,000 yen."

[0378] Step 2:

[0379] The device requests the input of emotional data, and the user inputs the emotional data by answering questions or using facial recognition technology.

[0380] Input: User emotion data (text responses, voice input, facial recognition).

[0381] Output: Temporary storage of emotion data.

[0382] Specific operation: The user inputs their emotional state, such as "I've been feeling tired lately" or "I'm feeling stressed." Using facial recognition technology, the system can determine whether they are smiling or tired.

[0383] Step 3:

[0384] The device sends all user information and emotion data to the server.

[0385] Input: User information and emotion data collected in the previous step.

[0386] Output: Data packets sent to the server.

[0387] Specific operation: Press the send button to generate a data packet and upload it to the server.

[0388] Step 4:

[0389] The server stores the received data in a database.

[0390] Input: Data packets sent from the terminal.

[0391] Output: User information and emotion data stored in a database.

[0392] Specific operation: The server executes an SQL query to store the received data in a database.

[0393] Step 5:

[0394] The server passes the stored data to the generative AI and emotion engine.

[0395] Input: Information stored in a database.

[0396] Output: The data passed to the analysis module.

[0397] Specific operation: The server reads data from the database and sends it to the generative AI and emotion engine using an API.

[0398] Step 6:

[0399] The generative AI analyzes the user's current situation, ideal data, and emotional data.

[0400] Input: All user information passed from the server.

[0401] Output: The optimal appearance plan as a result of the analysis.

[0402] Specific operation: The generative AI analyzes the data and creates a plan, such as "This moisturizing cream is for dry skin" or "A haircut plan to maintain short hair."

[0403] Step 7:

[0404] The emotion engine adjusts the plan based on the user's emotional data.

[0405] Input: Emotion data and initial plan for generative AI.

[0406] Output: The adjusted optimization plan.

[0407] What it does: The emotion engine takes into account emotional data such as "I'm tired" and adds a relaxing spa service to the plan.

[0408] Step 8:

[0409] Based on the adjusted plan, the generative AI will list items and services that fit the user's budget.

[0410] Inputs: Adjusted optimization plan, budget information.

[0411] Output: A list of items and services available for purchase.

[0412] Specific operation: The AI ​​extracts items that can be purchased within the budget from a product database and creates a list.

[0413] Step 9:

[0414] The server transmits the generated plan and list to the user terminal.

[0415] Input: Plans and service list created by the generative AI.

[0416] Output: Plans and lists sent to user terminal.

[0417] Specific operation: The server packages the plan and list in JSON format or similar and sends it to the user's terminal.

[0418] Step 10:

[0419] The terminal displays the proposed plan to the user.

[0420] Input: Plan and list sent from the server.

[0421] Output: Plan and specific actions displayed on the device screen.

[0422] Specific operation: The terminal app displays the plan and list on the GUI, allowing the user to check it and carry out daily care and purchases.

[0423] (Application example 2)

[0424] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0425] Conventional fashion and beauty recommendation systems have struggled to analyze a user's appearance data and emotional state in detail and provide recommendations tailored to individual needs. Furthermore, it has been difficult to provide personalized and effective recommendations in real time during the shopping experience in a physical store. This can cause users great stress when choosing the products and services that best suit them.

[0426] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for the user to input information about their hairstyle, skin condition, clothing style, and budget; means for transmitting the information input by the user to the server; means for the server to pass the received information to a generation AI for analysis; means for the generation AI to compare the user's current data with ideal data and generate a plan to achieve an optimal appearance; means for transmitting the generated plan to the user's terminal and displaying it; means including an emotion engine for analyzing emotion data; means for the generation AI to adjust the plan taking the emotion data into consideration; and means for providing personalized suggestions to the user in a physical store. This allows users to receive optimized fashion and beauty suggestions based on their individual appearance and emotion data, significantly improving the shopping experience in a physical store.

[0427] A "user terminal" is an information processing device that allows a user to input information and check proposed plans.

[0428] The "server" is a central processing unit that receives information sent by users and analyzes it using generative AI and an emotion engine.

[0429] "Generative AI" is an artificial intelligence technology that analyzes a user's appearance and emotional data to generate the optimal plan.

[0430] An "emotion engine" is a system that analyzes a user's emotional data and recognizes their emotional state.

[0431] "Emotion data" is information that indicates the user's emotional state, and is data that is acquired using text input, facial recognition technology, or the like.

[0432] A "brick and mortar store" is a physical location where users actually visit and purchase products.

[0433] "Personalized suggestions" are suggestions that are customized based on the user's individual appearance and emotional data.

[0434] "Appearance data" refers to information related to the user's appearance, such as hairstyle, skin condition, and clothing style.

[0435] "Budget information" is information about the amount of money a user can spend on beauty and fashion.

[0436] A "plan" is a specific plan created by the generative AI based on the user's current data and ideal data to help the user get closer to their ideal appearance.

[0437] This invention relates to a system in which a user inputs their own appearance data and ideal image, and a generation AI analyzes it to generate a plan to bring the user closer to their ideal appearance. Furthermore, by combining it with an emotion engine, it is possible to recognize the user's emotions and adjust the plan based on those emotions.

[0438] System Overview

[0439] User terminal

[0440] The user terminal is an information processing device such as a smartphone or tablet that allows the user to input information about their hairstyle, skin condition, clothing style, budget, and emotional data. The emotional data is acquired using text input, voice input, or facial recognition technology. For example, after a user launches an application and logs in or creates a new account, they input specific appearance information and evaluate their emotional state. This information is then transmitted to a server via the terminal.

[0441] server

[0442] The server is a central processing unit that receives information sent from the user's device and analyzes it using the generation AI and emotion engine. The received data is stored in a database and analyzed. The generation AI on the server compares the user's appearance data with their ideal data and generates an optimal plan. The emotion engine also analyzes the user's emotion data and provides that information to the generation AI to help adjust the plan.

[0443] Generation AI

[0444] The AI ​​analyzes the user's hairstyle, skin condition, clothing style, budget information, and emotional data, and combines the user's current and ideal data to generate an optimal plan. For example, it might suggest a moisturizing cream for dry skin entered by the user, or list fashion items based on the user's preferred clothing style. It also takes emotional data into account to suggest relaxing spa services and refreshing activities for the user.

[0445] Emotion Engine

[0446] The emotion engine is a system that analyzes the user's emotional data passed from the server and recognizes their emotional state. For example, based on information entered by the user such as "I've been feeling stressed recently," it provides the AI ​​with suggestions to help the user relax.

[0447] Specific examples

[0448] Here is an example where a user enters the following information using a smartphone app.

[0449] Hairstyle: Short cut

[0450] Skin condition: Dry skin

[0451] Favorite clothing style: Casual

[0452] Budget information: 10,000 yen

[0453] Emotional information: "I've been feeling stressed lately"

[0454] An example of a prompt is

[0455] "I'm a 24-year-old woman with short hair, dry skin, a preference for casual styles, a budget of ¥10,000, and I've been feeling stressed lately. Could you recommend some clothes and cosmetics?"

[0456] The server receives the information entered by the user and analyzes it using a generative AI and emotion engine. Based on this analysis, it can suggest moisturizing creams for dry skin and list casual fashion items. It can also suggest relaxing spa services, taking into account the user's emotional data, such as "I've been feeling stressed lately."

[0457] In this way, users can easily take concrete actions to get closer to their ideal appearance, with the assistance of generative AI and an emotion engine.

[0458] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0459] Step 1:

[0460] A user launches a smartphone application and logs in or creates a new account. The user inputs their hairstyle, skin condition, clothing style, budget information, and emotional information. This data is temporarily saved within the application. The input information includes hairstyle as "short cut," skin condition as "dry skin," clothing style as "casual," budget information as "10,000 yen," and emotional information as "feeling stressed recently."

[0461] Step 2:

[0462] The terminal sends all input information to the server, where the input data is transferred to the server via a network. This transferred data includes information about the user's appearance and emotion data.

[0463] Step 3:

[0464] The server stores the received user data in its built-in database. The specific action of saving the data is to write to the database. The received data is managed in association with the user ID.

[0465] Step 4:

[0466] The server passes the saved user data to the generation AI, which begins analysis. The user's hairstyle, skin condition, clothing style, budget information, and emotional information are used as input for analysis. The generation AI uses this data to compare the user's current data with their ideal data and generate the optimal plan. Specific operations include the AI ​​model's calculation processing.

[0467] Step 5:

[0468] The generative AI uses an emotion engine to analyze the user's emotional data. The emotion engine analyzes the emotional data, such as "I've been feeling stressed recently," and provides the results to the generative AI. The emotion engine classifies the emotional data and analyzes emotional fluctuations.

[0469] Step 6:

[0470] The generative AI takes into account the emotional data from the emotion engine to tailor the user's plan, including specific actions such as adding suggestions to help the user relax. The final plan may include moisturizing creams for dry skin, casual clothing styles, and recommendations for relaxing spa services.

[0471] Step 7:

[0472] The server sends the generated plan to the user terminal, where it is returned to the user terminal via the network. The transmitted data includes a specific action plan and an item list.

[0473] Step 8:

[0474] The device displays the sent plan on a user interface. The user can check the suggested skin care products, fashion ideas, and relaxation services on the device and create a daily plan to put them into practice. Specifically, the plan is displayed in list format on the screen.

[0475] Through these steps, users receive a personalized plan based on their appearance and emotional data, and can take specific actions to move closer to their ideal appearance.

[0476] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0477] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0478] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0479] [Second embodiment]

[0480] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0481] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0482] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0483] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0484] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0485] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0486] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0487] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0488] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0489] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0490] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0491] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0492] This invention relates to a system in which a user inputs their own appearance data and ideal image into the system, and a generation AI analyzes the data and generates a plan to bring the user closer to their ideal appearance. This system inputs the user's hairstyle, skin condition, clothing style, and budget information and automatically makes optimal beauty and fashion suggestions based on this information.

[0493] System configuration

[0494] User terminal

[0495] Terminal: The user uses a terminal such as their smartphone or tablet to input information about their hairstyle, skin condition, clothing style, and budget. The input information is sent to the server via the terminal.

[0496] server

[0497] Server: Receives user information sent from the device and stores it in a database. The server passes this data to the generation AI for analysis.

[0498] Generation AI

[0499] Generative AI: Analyzes the data passed from the server and compares the user's current data with their ideal data. This generates a specific plan and recommendations to achieve optimal appearance, which are then sent to the user's device via the server.

[0500] Program processing

[0501] 1. Enter and submit information

[0502] Device: The user launches the application and enters their hairstyle, skin condition, clothing style, and budget information through a dedicated form. For example, if a user prefers short hair, dry skin, and casual clothing, they enter this information and also set their ideal appearance and monthly beauty budget.

[0503] Terminal: Once the input is complete, the user presses the send button to send the input information to the server.

[0504] 2. Data Reception and Analysis

[0505] Server: Receives user input information and stores it in an internal database. Then, passes the received data to the generation AI.

[0506] Generative AI: Analyzes the received data and compares the user's current condition with their ideal appearance, for example, suggesting moisturizing cream to combat dry skin or planning a haircut to achieve their ideal hairstyle.

[0507] 3. Plan generation and display

[0508] Generative AI: Based on user data, it generates the optimal plan for hairstyle, skin condition, and clothing style. It also takes into account budget information and lists available items and services.

[0509] Server: Sends the plans and recommendations created by the generation AI to the user device.

[0510] Device: The user can view the generated plan on their device and refer to their daily execution plan. Examples include the skin care products the user uses daily and a haircut schedule.

[0511] Specific examples

[0512] User: Create a new account and enter your hairstyle (short hair), skin condition (dry skin), and preferred clothing style (casual). Your ideal look is "simple and clean," and you set your monthly budget at 10,000 yen.

[0513] Server: Receives the input information and sends it to the generating AI.

[0514] Generative AI: Suggests moisturizing creams for dry skin, recommends simple and casual fashion items, and generates a two-weekly haircut plan for maintaining short hair.

[0515] Server: Sends the generated plan to the user terminal.

[0516] Device: Displays suggested skin care products and clothing ideas, allowing users to carry out daily care and shopping accordingly.

[0517] In this way, users can easily take concrete actions to get closer to their ideal appearance with the help of generative AI.

[0518] The processing flow will be explained below.

[0519] Step 1:

[0520] Terminal: The user launches the application and logs in or creates a new account. In the case of a new account, the user enters the required personal information (email address, password, etc.) to create the account.

[0521] Step 2:

[0522] Terminal: The user inputs their hairstyle, skin condition, clothing style, and budget information on the application screen. For example, the user selects "short hair," "dry skin," and "casual clothing style," and inputs "10,000 yen" as budget information.

[0523] Step 3:

[0524] Device: The user takes a photo of their hairstyle and skin condition and uploads it through the app.

[0525] Step 4:

[0526] Device: The user answers a questionnaire about their ideal appearance. For example, they may write that they are aiming for a "simple and clean look."

[0527] Step 5:

[0528] Terminal: Once the input is complete, the user presses the send button to send the input information and photo to the server.

[0529] Step 6:

[0530] Server: Receives user input information and photos and stores them in a built-in database.

[0531] Step 7:

[0532] Server: Passes the received data to the generation AI for analysis, verifying that the data is in the correct format.

[0533] Step 8:

[0534] Generative AI: Analyzes the received user data and compares the user's current data (hairstyle, skin condition, clothing style) with the ideal data.

[0535] Step 9:

[0536] Generative AI: Based on the analysis results, it generates a plan to help the user achieve their ideal appearance, such as "recommending moisturizing creams for dry skin" and "a plan for cutting hair every two weeks to maintain short hair."

[0537] Step 10:

[0538] Generative AI: Considers the user's budget information, checks whether the suggested items and services can be purchased within the budget, and generates a list of available goods and services.

[0539] Step 11:

[0540] Server: Sends the generated plans and recommendations to the user device.

[0541] Step 12:

[0542] On Device: The user can view the generated plan on their device, which includes daily skin care routines, weekly hair care plans, and monthly fashion updates.

[0543] Step 13:

[0544] Terminal: The user accesses the link to purchase the suggested items and does their online shopping.

[0545] Step 14:

[0546] Server: Periodically collects user progress data and passes it to the generation AI. The collected data includes the results of actions taken by the user and feedback.

[0547] Step 15:

[0548] Generative AI: Analyzes collected data and evaluates the effectiveness of the plan, then optimizes it as needed.

[0549] Step 16:

[0550] Server: Sends the new optimized plan to the user's device, which then takes the next step.

[0551] In this way, users can easily take concrete actions to get closer to their ideal appearance using generative AI.

[0552] Example 1

[0553] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0554] The present invention relates to a system that automatically generates a specific plan for a user to efficiently fulfill their appearance-related desires. Conventional methods require users to collect information on beauty and fashion and create their own plans, which is a very time-consuming process. Furthermore, individual beauty and fashion information is not centralized, making it difficult for users to find appropriate products and services. This presents a challenge for users, making it difficult to efficiently and effectively achieve their ideal appearance.

[0555] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0556] In this invention, the server includes means for a user to input information about their hairstyle, skin condition, clothing style, and budget, means for transmitting the information input by the user to the server, means for the server to pass the received information to a generation AI for analysis, means for the generation AI to compare the user's current data with ideal data and generate a plan to achieve an optimal appearance, means for transmitting the generated plan to a user terminal and displaying it, means for the server to store the user's input information in a database, means for the generation AI to retrieve data from the database to create a plan, and means for the user terminal to display a daily implementation plan. This allows users to easily obtain a specific plan to achieve their ideal appearance and carry out their daily beauty and fashion routines.

[0557] "User" refers to a person who uses the system to input information about their own appearance and ideal appearance.

[0558] "Hairstyle" refers to information indicating the state of the user's hair, such as style and length.

[0559] "Skin condition" refers to information that indicates the condition or characteristics of the user's skin, such as dry skin or oily skin.

[0560] "Clothing style" refers to information about the type, design, and fashion of clothing that the user prefers.

[0561] "Budget information" refers to information indicating the amount of money a user can spend on beauty and fashion within a certain period of time.

[0562] "Device" refers to the device used by a user to input and transmit their appearance information to a server. Examples include smartphones and tablets.

[0563] "Server" refers to a component that receives information sent from the user terminal and passes it on to the generation AI.

[0564] "Database" means the data storage system used by the Server to organize and store User information.

[0565] "Generative AI" refers to artificial intelligence that analyzes user information passed from the server, compares the user's current data with their ideal data, and generates a plan to achieve their optimal appearance.

[0566] A "plan" refers to a plan created by the generative AI based on the user's information, showing specific actions and recommendations to move closer to their ideal appearance.

[0567] "User terminal" refers to a device for receiving the generated plan and displaying it to the user.

[0568] The present invention relates to a system in which a user inputs their own appearance data and ideal image, and a generation AI analyzes the data and generates a specific plan to help the user approach their ideal appearance. Detailed embodiments of the present invention are described below.

[0569] System configuration

[0570] User terminal

[0571] The terminal is a device that allows users to input information about their hairstyle, skin condition, clothing style, and budget using their own smartphone, tablet, etc. The input information is sent to the server via the terminal.

[0572] server

[0573] The server receives the user information sent from the device and stores it in a database. The server also passes this data to the generation AI for analysis.

[0574] Generation AI

[0575] The generation AI analyzes the data passed from the server and compares the user's current data with their ideal data. This generates a specific plan and recommendations to help them achieve their ideal appearance, which are then sent to the user's device via the server.

[0576] Hardware and software used

[0577] Hardware:

[0578] User devices such as smartphones and tablets

[0579] Server for data storage and analysis

[0580] software:

[0581] An application that provides a user interface

[0582] Generative AI models that analyze data

[0583] Specific examples

[0584] Enter and submit information

[0585] The user launches the application and enters information about their hairstyle, skin condition, clothing style, and budget through a dedicated form. For example, if the user prefers short hair, dry skin, and a casual clothing style, they enter this information, as well as their ideal appearance and monthly beauty budget. Once the input is complete, the user presses the submit button, which sends the entered information to the server.

[0586] Data reception and analysis

[0587] The server receives the user's input, stores it in an internal database, and then passes the data to the AI ​​generator, which analyzes the data and compares the user's current appearance with their ideal appearance. For example, this could include suggesting a moisturizing cream to combat dry skin or a haircut plan to achieve their ideal hairstyle.

[0588] Plan Generation and Display

[0589] The generation AI generates an optimal plan based on the user's data, taking into account hairstyle, skin condition, and clothing style, and also lists items and services that can be purchased, taking into account budget information. The server sends the plan and recommendations created by the generation AI to the user's device, and the user can check the generated plan on their device and refer to their daily execution plan. Specific examples include the user's daily skin care products and haircut schedule.

[0590] Example prompts for generative AI models

[0591] "Please suggest a specific plan for a user with short hair and dry skin to achieve a clean look with a casual clothing style."

[0592] "Make a list of the products and services you need to combat dry skin and maintain short hair within a monthly budget of ¥10,000."

[0593] In this way, users can easily take concrete actions to get closer to their ideal appearance with the help of generative AI.

[0594] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0595] Step 1:

[0596] The user launches an application.

[0597] Specific operation: The user taps and launches the dedicated application on their smartphone or tablet.

[0598] Input: The user operates the device to launch the app.

[0599] Output: A dedicated form is displayed.

[0600] Step 2:

[0601] Users enter hairstyle, skin condition, clothing style, and budget information into a dedicated form.

[0602] Specific operation: The user enters hairstyle (e.g., short hair), skin condition (e.g., dry skin), clothing style (e.g., casual), and budget information (e.g., 10,000 yen) into the form.

[0603] Input: The user enters information into the form.

[0604] Output: The input information is kept within the application.

[0605] Step 3:

[0606] The user presses the send button to send the input information to the server.

[0607] Specific behavior: When the user has completed filling out the form, they tap the submit button.

[0608] Input: The action of the user pressing the submit button.

[0609] Output: The input information is sent to the server.

[0610] Step 4:

[0611] The server receives the information sent by the user.

[0612] Specific operation: The server processes data received from the user terminal in real time.

[0613] Input: Information sent from the user's device.

[0614] Output: The received information is saved on the server.

[0615] Step 5:

[0616] The server stores the received data in a database.

[0617] Specific operation: The server stores the received information in an internal database.

[0618] Input: Received information.

[0619] Output: Information stored in a database.

[0620] Step 6:

[0621] The server retrieves the necessary data from the database and passes it to the generation AI.

[0622] Specific operation: The server reads user information from the database and sends it to the generation AI.

[0623] Input: User information retrieved from the database.

[0624] Output: User information passed to the generation AI.

[0625] Step 7:

[0626] The generative AI analyzes the user's information and compares the current data with the ideal data.

[0627] Specific operation: The generating AI compares the user's current data (entered hairstyle, skin condition, etc.) with the ideal data and identifies any gaps.

[0628] Input: User's current and ideal data.

[0629] Output: Analysis results based on gaps.

[0630] Step 8:

[0631] Generative AI creates the optimal plan.

[0632] Specific operation: Based on the analysis results, the generation AI generates a plan to help the user achieve their ideal appearance.

[0633] Input: Analysis results.

[0634] Output: Optimal plan and recommendations.

[0635] Step 9:

[0636] The plan created by the generation AI is sent to the server.

[0637] Specific operation: The generation AI sends the generated plan to the server.

[0638] Input: The generated plan.

[0639] Output: The plan sent to the server.

[0640] Step 10:

[0641] The server transmits the plan to the user terminal.

[0642] Specific operation: The server sends the plan received from the generation AI to the user terminal.

[0643] Input: The plan received from the generation AI.

[0644] Output: The plan sent to the user device.

[0645] Step 11:

[0646] The user checks the plan on the device and refers to the daily execution plan.

[0647] Specific behavior: The user views the plan on their device and performs the recommended actions.

[0648] Input: The plan received from the server.

[0649] Output: Daily execution plan based on the plan.

[0650] (Application example 1)

[0651] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0652] In conventional beauty and fashion planning, it was difficult for users to obtain specific advice to get closer to their ideal appearance. Furthermore, there was no system that analyzed the user's appearance data and ideal data and provided a plan tailored to individual needs, so users had to spend a lot of time and effort. Furthermore, proposals rarely took budget information into account, making it difficult to obtain a feasible plan.

[0653] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0654] In this invention, the server includes means for a user to input information about their hairstyle, skin condition, clothing style, and budget, means for transmitting the information input by the user to the server, means for the server to pass the received information to a generation AI for analysis, means for the generation AI to compare the user's current data with ideal data and generate a plan to achieve an optimal appearance, means for transmitting the generated plan to a user terminal and displaying it, means for visualizing the generated plan and presenting it to the user, and means for the user to set their ideal appearance and use that data for analysis. This allows the user to easily take specific actions to achieve their ideal appearance and obtain a workable plan that fits their budget.

[0655] "User" refers to an individual who utilizes the system to input their own appearance data and receive a plan to achieve their ideal appearance.

[0656] "Hairstyle" is information that indicates the current state of the user's hairstyle.

[0657] "Skin condition" is information that indicates the user's skin condition (e.g., dry skin, oily skin).

[0658] "Clothing style" is information that indicates the fashion style (e.g., casual, formal) that the user prefers.

[0659] "Budget information" is information that indicates the amount of budget that a user will spend on beauty and fashion for each month and year.

[0660] The "server" is a relay device that passes information received from the user to the generation AI and transmits the generated plan to the user's terminal.

[0661] "Generative AI" is an artificial intelligence that analyzes the user's appearance data and ideal data received and generates a plan to approach the optimal appearance.

[0662] A "plan" is a proposal made by the generative AI after analyzing the user's data, including a specific action plan and a list of items to help them achieve their ideal appearance.

[0663] A "user terminal" is an electronic device (e.g., a smartphone or tablet) through which a user inputs data and receives the generated plan.

[0664] "Visualization" is the process of visually displaying the generated plan and presenting it to the user.

[0665] "Ideal appearance" refers to the image of one's appearance that a user sets as a goal to aim for.

[0666] The system for implementing this invention begins when a user uses a device such as a smartphone or tablet to input information about their hairstyle, skin condition, clothing style, and budget, and sends it to a server. The server then passes the received user data to a generation AI, which analyzes the data, compares the user's current data with their ideal data, and generates a plan to achieve their optimal appearance. The generated plan is then sent to the user's device via the server, where it is visualized and presented to the user.

[0667] Hardware and software used

[0668] Hardware

[0669] Smartphones / Tablets: Used as devices for users to input data.

[0670] Server: A relay device that passes data received from the user to the generation AI and sends the generated plan to the user's terminal.

[0671] Cloud Server: Hosts the generative AI and provides the necessary computing resources.

[0672] software

[0673] Flask (server side): A lightweight Python web framework that provides API endpoints.

[0674] Generative AI model (e.g., GPT-3): An artificial intelligence that analyzes user data and generates an appearance improvement plan.

[0675] Requests (client side): A Python HTTP library used to send data.

[0676] Specific system behavior

[0677] Enter and submit information

[0678] The user starts the smartphone application and enters information about their hairstyle, skin condition, clothing style, and budget into a dedicated form. For example, the user may have short hair, dry skin, a preference for casual clothing, and a monthly budget of 10,000 yen. Once the information is complete, it is sent to the server.

[0679] Data reception and analysis

[0680] The server receives the user's input and stores it in an internal database. The received data is then passed to the generation AI, which compares the user's current condition with their ideal appearance and generates an optimal plan. Specific examples include recommendations for moisturizing creams for dry skin and haircut plans to achieve the ideal hairstyle.

[0681] Plan Generation and Display

[0682] The plan created by the AI ​​is sent to the user's device via the server, where it is visualized and displayed, allowing the user to refer to their daily plan, including, for example, the skin care products they use every day and their haircut schedule.

[0683] Prompt Sentence Examples

[0684] User's current data:

[0685] Hairstyle: Short hair

[0686] Skin condition: Dry skin

[0687] Clothing style: Casual

[0688] Budget: 10,000 yen

[0689] Ideal appearance:

[0690] Simple and clean appearance

[0691] Suggest beauty and fashion plans to help users achieve their ideal appearance.

[0692] This system allows users to easily take specific actions to get closer to their ideal appearance and provides a workable plan that fits their budget.

[0693] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0694] Step 1:

[0695] The user launches a dedicated application on their smartphone or tablet and enters their hairstyle, skin condition, clothing style, and budget information. Specifically, the user specifies that they prefer short hair, dry skin, and casual clothing, and sets their monthly budget to 10,000 yen. Once the information is complete, they press the send button in the application to send the information to the server.

[0696] Input: Hairstyle, skin condition, clothing style, budget information

[0697] Output: User appearance data and budget information sent to the server

[0698] Step 2:

[0699] The server temporarily stores the received user appearance data and budget information in an internal database, then packets the stored data for transmission to the generation AI and sends it to the generation AI's analysis process.

[0700] Input: User appearance data and budget information

[0701] Output: Data packet sent to the generating AI

[0702] Step 3:

[0703] The generative AI analyzes the received data and compares the user's current condition with the ideal appearance data. The analysis may, for example, suggest a moisturizing cream for dry skin or a haircut plan to maintain short hair. This analysis generates a beauty and fashion plan to bring the user closer to their optimal appearance.

[0704] Input: User's appearance data and ideal appearance data

[0705] Output: Generated appearance improvement plan

[0706] Step 4:

[0707] The server analyzes the appearance improvement plan received from the generation AI and formats it for transmission to the user's device. The plan contents include specific beauty product and service recommendations, usage instructions, and implementation schedules.

[0708] Input: Generated appearance improvement plan

[0709] Output: Formatted plan data sent to the user device

[0710] Step 5:

[0711] The user device visualizes the received plan and displays it to the user. The user can then review the plan generated on the application and take specific actions, such as incorporating suggested skin care products or haircut schedules into their daily lives.

[0712] Input: Formatted plan data

[0713] Output: Visualized appearance improvement plan

[0714] This allows users to easily take specific actions to get closer to their ideal appearance and obtain a workable plan that fits their budget.

[0715] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0716] This invention relates to a system in which a user inputs their own appearance data and ideal image into the system, and a generation AI analyzes the data to generate a plan to bring the user closer to their ideal appearance. Furthermore, by combining it with an emotion engine, the system has the function of recognizing the user's emotions and adjusting the plan based on those emotions. By inputting the user's hairstyle, skin condition, clothing style, and budget information, and incorporating emotional data, the system makes more personalized and effective beauty and fashion recommendations.

[0717] System configuration

[0718] User terminal

[0719] Device: The user uses a device such as a smartphone or tablet to input information about their hairstyle, skin condition, clothing style, and budget. Emotional data is acquired using text input, voice input, and even facial recognition technology. The input information is sent to the server via the device.

[0720] server

[0721] Server: Receives user information and emotion data sent from the device and stores it in a built-in database. The server passes this data to the generation AI and emotion engine for analysis.

[0722] Generation AI

[0723] Generative AI: Analyzes the data passed from the server and compares the user's current data with the ideal data. The Generative AI also takes into account the emotional data obtained from the user's emotion engine to generate a plan that will best satisfy the user.

[0724] Emotion Engine

[0725] Emotion engine: Analyzes the user's emotional data passed from the server and recognizes the user's current emotional state. This information is provided to the generative AI, contributing to the optimization of the plan.

[0726] Program processing

[0727] 1. Enter and submit information

[0728] Device: The user launches the application and logs in or creates a new account. They enter their hairstyle, skin condition, clothing style, and budget information, and then run questions and facial recognition to assess the user's emotions.

[0729] Terminal: After all information is entered, the user presses the send button to send the information and emotion data to the server.

[0730] 2. Data Reception and Analysis

[0731] Server: Receives user input information and emotion data, stores it in a database, and passes the received data to the generation AI and emotion engine.

[0732] Generative AI: Analyzes the received data and combines the user's current data (hairstyle, skin condition, clothing style), ideal data, and emotional data to generate the optimal plan.

[0733] 3. Plan generation and display

[0734] Generative AI: Based on user data, it generates optimal plans for hairstyle, skin condition, and clothing style, and adjusts them to maximize user satisfaction by taking into account data from the emotion engine. It also takes into account the user's budget information and lists items and services that can be purchased.

[0735] Server: Sends the generated plans and recommendations to the user device.

[0736] Device: The user can view the generated plan on their device and refer to their daily action plan, including the skin care products they use every day and their haircut schedule.

[0737] Specific examples

[0738] 1. User: Create a new account and enter your hairstyle (short hair), skin condition (dry skin), and preferred clothing style (casual). Fill out a questionnaire and select "simple and clean appearance" as your ideal appearance, and set your monthly budget at 10,000 yen. Also, enter emotional information such as "I've been feeling tired lately" or "I'm feeling stressed" as an emotional assessment.

[0739] 2. Server: Receives input information and emotion data and sends it to the generative AI and emotion engine.

[0740] 3. Generative AI: It can suggest moisturizing creams for dry skin, recommend simple and casual fashion items, and create a two-weekly haircut plan to maintain short hair. It also uses the analysis results of the emotion engine to suggest relaxing spa services and refreshing activities for users.

[0741] 4. Server: Sends the generated plan to the user terminal.

[0742] 5. Device: Displays suggested skin care products, outfit ideas, and even relaxing services, allowing users to carry out their daily care and shopping accordingly.

[0743] In this way, users can easily take concrete actions to get closer to their ideal appearance, with the assistance of generative AI and an emotion engine.

[0744] The processing flow will be explained below.

[0745] System processing flow and specific steps

[0746] Step 1:

[0747] Terminal: The user launches the application and logs in or creates a new account. In the case of a new account, the user enters the required personal information (email address, password, etc.) to create the account.

[0748] Step 2:

[0749] Terminal: The user inputs their hairstyle, skin condition, clothing style, and budget information on the application screen. For example, the user selects "short hair," "dry skin," and "casual clothing style," and inputs "10,000 yen" as budget information.

[0750] Step 3:

[0751] Device: The user takes a photo of their hairstyle and skin condition and uploads it through the app.

[0752] Step 4:

[0753] Device: The user answers a questionnaire about their ideal appearance. For example, they may write that they are aiming for a "simple and clean look."

[0754] Step 5:

[0755] Terminal: The user fills out a form to input their emotional state. For example, they can input emotional information such as "I've been feeling tired recently" or "I'm stressed." Alternatively, they can use facial recognition to collect emotional data and obtain real-time emotional states.

[0756] Step 6:

[0757] Terminal: Once the input is complete, the user presses the send button to send the input information, photo, and emotion data to the server.

[0758] Step 7:

[0759] Server: Receives user input information and emotion data and stores them in a built-in database.

[0760] Step 8:

[0761] Server: Passes the received data to the generation AI and emotion engine for analysis, and verifies that the data is in the correct format.

[0762] Step 9:

[0763] Generative AI: Analyzes the received user data and compares the user's current data (hairstyle, skin condition, clothing style) with the ideal data.

[0764] Step 10:

[0765] Emotion Engine: Analyzes received emotion data and recognizes the user's emotional state. This information is provided to the generative AI, which then contributes to optimizing the plan.

[0766] Step 11:

[0767] Generative AI: Based on the analysis results, it generates a plan to help the user achieve their ideal appearance. For example, it creates a "moisturizing cream recommendation for dry skin" or a "haircut plan every two weeks to maintain short hair." It adjusts the plan to maximize user satisfaction, taking into account data from the emotion engine.

[0768] Step 12:

[0769] Generative AI: Considers the user's budget information, checks whether the suggested items and services can be purchased within the budget, and generates a list of available goods and services.

[0770] Step 13:

[0771] Server: Sends the generated plans and recommendations to the user device.

[0772] Step 14:

[0773] On Device: The user can view the generated plan on their device, which includes daily skin care routines, weekly hair care plans, and monthly fashion updates.

[0774] Step 15:

[0775] Terminal: The user accesses the link to purchase the suggested items and does their online shopping.

[0776] Step 16:

[0777] Server: Periodically collects user progress data and passes it to the generative AI and emotion engine. The collected data includes the results of actions taken by the user and feedback.

[0778] Step 17:

[0779] Generative AI: Analyzes collected data and evaluates the effectiveness of the plan, then optimizes it as needed.

[0780] Step 18:

[0781] Server: Sends the new optimized plan to the user's device, which then takes the next step.

[0782] In this way, users can easily take concrete actions to get closer to their ideal appearance, with the assistance of generative AI and an emotion engine.

[0783] Example 2

[0784] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0785] Conventional appearance improvement systems generate plans based solely on user input, making it difficult to provide an optimal plan that takes into account the user's emotional state and daily changes. Furthermore, they may not adequately propose specific actions that satisfy the user or fit their budget. Therefore, there is a need for a system that provides an individually optimized appearance improvement plan that takes into account the user's emotional state.

[0786] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for storing user information and emotional data in a database, means for transferring the stored information to the analysis module, and means for the generation AI to generate a plan by integrating the user's current data, ideal data, and emotional data. This enables comprehensive data analysis, including the user's emotional state, and makes it possible to provide an individually optimized, high-quality appearance improvement plan.

[0787] "User" refers to an individual who uses the System to create and implement their own appearance improvement plan.

[0788] "Server" refers to the computer system that receives and stores information entered by users and passes that data to the analysis module.

[0789] "Generative AI" refers to artificial intelligence that generates an optimal appearance improvement plan based on the user's current data, ideal data, and emotional data.

[0790] "Emotion data" refers to information that reflects the user's current emotional state, and refers to data obtained by text input, voice input, facial recognition, etc.

[0791] A "plan" refers to the suggestions that the generative AI makes after analyzing the user's data, including specific actions and recommended items to help the user achieve their ideal appearance.

[0792] "Database" refers to an electronic storage device where the server stores user information and emotion data.

[0793] An "analysis module" refers to a combination of software and hardware that allows the generation AI and emotion engine to analyze data based on data passed from the server.

[0794] "Current status data" refers to information entered by the user that indicates current physical characteristics such as hairstyle, skin condition, clothing style, etc.

[0795] "Ideal data" refers to specific information about the user's desired appearance, and refers to data entered in a questionnaire or as a preference.

[0796] "Budget Information" refers to the amount of money a user can spend on improving their appearance in a month or a specific period of time.

[0797] This invention is a system in which a user inputs their own appearance data and ideal image into the system, and a generation AI analyzes the data to generate a plan to bring the user closer to their ideal appearance. Furthermore, by combining it with an emotion engine, it has the function of recognizing the user's emotions and adjusting the plan based on those emotions. A specific embodiment of this system will be described below.

[0798] System configuration

[0799] User terminal

[0800] Device: The user uses a device such as a smartphone or tablet to input information about their hairstyle, skin condition, clothing style, and budget. Emotional data is acquired using text input, voice input, and even facial recognition technology. The input information is sent to the server via the device.

[0801] server

[0802] Server: The server receives user information and emotion data sent from the device and stores it in a built-in database. The stored data is then passed to the generative AI and emotion engine for analysis.

[0803] Generation AI

[0804] Generative AI: Analyzes the data passed from the server and compares the user's current data with their ideal data. The Generative AI also takes into account the emotional data obtained from the emotion engine to generate a plan that will best satisfy the user.

[0805] Emotion Engine

[0806] Emotion engine: Analyzes the user's emotional data passed from the server and recognizes the user's current emotional state. This information is provided to the generative AI, contributing to the optimization of the plan.

[0807] System Operation

[0808] 1. Enter and submit information

[0809] Users launch the application, log in or create a new account, enter their hairstyle, skin condition, clothing style, and budget information, and then run questions and facial recognition to assess the user's emotions.

[0810] After all the information has been entered, the terminal presses the send button to send the information and emotion data to the server.

[0811] 2. Data Reception and Analysis

[0812] The server receives the user's input information and emotion data, stores it in a database, and passes the received data to the analysis module.

[0813] The generation AI analyzes the received data and combines the user's current data (hairstyle, skin condition, clothing style), ideal data, and emotional data to generate the optimal plan.

[0814] 3. Plan generation and display

[0815] The generative AI uses user data to generate optimal plans for hairstyle, skin condition, and clothing style, and adjusts them to maximize user satisfaction by taking into account data from the emotion engine. It also takes into account the user's budget information to list items and services that can be purchased.

[0816] The server transmits the generated plan and recommendations to the user terminal.

[0817] On the terminal, the user can check the generated plan and refer to the daily execution plan.

[0818] Specific examples

[0819] 1. User: Create a new account and enter your hairstyle (short hair), skin condition (dry skin), and preferred clothing style (casual). Fill out a questionnaire and select "simple and clean appearance" as your ideal appearance, and set your monthly budget at 10,000 yen. Also, enter emotional information such as "I've been feeling tired lately" or "I'm feeling stressed" as an emotional assessment.

[0820] Example prompt: "Please tell us about your hairstyle, skin condition, clothing style, and monthly budget. Also, tell us about your recent emotional state. For example, have you been feeling tired or stressed lately?"

[0821] 2. Server: Receives input information and emotion data and sends it to the generative AI and emotion engine.

[0822] 3. Generative AI: It can suggest moisturizing creams for dry skin, recommend simple and casual fashion items, and create a two-weekly haircut plan to maintain short hair. It also uses the analysis results of the emotion engine to suggest relaxing spa services and refreshing activities for users.

[0823] 4. Server: Sends the generated plan to the user terminal.

[0824] 5. Terminal: Displays suggested skin care products, clothing ideas, and even relaxing services, allowing users to follow their daily care and shopping accordingly.

[0825] In this way, users can easily take concrete actions to get closer to their ideal appearance, with the assistance of generative AI and an emotion engine.

[0826] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0827] Specific processing steps of the program

[0828] Step 1:

[0829] A user launches the application and creates a new account or logs in. Data entered includes hairstyle, skin condition, clothing style, and budget information.

[0830] Input: Hairstyle, skin condition, clothing style, and budget information from the user.

[0831] Output: Temporarily saves input data.

[0832] Specific operation: The user enters the necessary information into the form. For example, the user enters data such as "hairstyle: short hair," "skin condition: dry skin," "clothing style: casual," and "budget: 10,000 yen."

[0833] Step 2:

[0834] The device requests the input of emotional data, and the user inputs the emotional data by answering questions or using facial recognition technology.

[0835] Input: User emotion data (text responses, voice input, facial recognition).

[0836] Output: Temporary storage of emotion data.

[0837] Specific operation: The user inputs their emotional state, such as "I've been feeling tired lately" or "I'm feeling stressed." Using facial recognition technology, the system can determine whether they are smiling or tired.

[0838] Step 3:

[0839] The device sends all user information and emotion data to the server.

[0840] Input: User information and emotion data collected in the previous step.

[0841] Output: Data packets sent to the server.

[0842] Specific operation: Press the send button to generate a data packet and upload it to the server.

[0843] Step 4:

[0844] The server stores the received data in a database.

[0845] Input: Data packets sent from the terminal.

[0846] Output: User information and emotion data stored in a database.

[0847] Specific operation: The server executes an SQL query to store the received data in a database.

[0848] Step 5:

[0849] The server passes the stored data to the generative AI and emotion engine.

[0850] Input: Information stored in a database.

[0851] Output: The data passed to the analysis module.

[0852] Specific operation: The server reads data from the database and sends it to the generative AI and emotion engine using an API.

[0853] Step 6:

[0854] The generative AI analyzes the user's current situation, ideal data, and emotional data.

[0855] Input: All user information passed from the server.

[0856] Output: The optimal appearance plan as a result of the analysis.

[0857] Specific operation: The generative AI analyzes the data and creates a plan, such as "This moisturizing cream is for dry skin" or "A haircut plan to maintain short hair."

[0858] Step 7:

[0859] The emotion engine adjusts the plan based on the user's emotional data.

[0860] Input: Emotion data and initial plan for generative AI.

[0861] Output: The adjusted optimization plan.

[0862] What it does: The emotion engine takes into account emotional data such as "I'm tired" and adds a relaxing spa service to the plan.

[0863] Step 8:

[0864] Based on the adjusted plan, the generative AI will list items and services that fit the user's budget.

[0865] Inputs: Adjusted optimization plan, budget information.

[0866] Output: A list of items and services available for purchase.

[0867] Specific operation: The AI ​​extracts items that can be purchased within the budget from a product database and creates a list.

[0868] Step 9:

[0869] The server transmits the generated plan and list to the user terminal.

[0870] Input: Plans and service list created by the generative AI.

[0871] Output: Plans and lists sent to user terminal.

[0872] Specific operation: The server packages the plan and list in JSON format or similar and sends it to the user's terminal.

[0873] Step 10:

[0874] The terminal displays the proposed plan to the user.

[0875] Input: Plan and list sent from the server.

[0876] Output: Plan and specific actions displayed on the device screen.

[0877] Specific operation: The terminal app displays the plan and list on the GUI, allowing the user to check it and carry out daily care and purchases.

[0878] (Application example 2)

[0879] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0880] Conventional fashion and beauty recommendation systems have struggled to analyze a user's appearance data and emotional state in detail and provide recommendations tailored to individual needs. Furthermore, it has been difficult to provide personalized and effective recommendations in real time during the shopping experience in a physical store. This can cause users great stress when choosing the products and services that best suit them.

[0881] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for the user to input information about their hairstyle, skin condition, clothing style, and budget; means for transmitting the information input by the user to the server; means for the server to pass the received information to a generation AI for analysis; means for the generation AI to compare the user's current data with ideal data and generate a plan to achieve an optimal appearance; means for transmitting the generated plan to the user's terminal and displaying it; means including an emotion engine for analyzing emotion data; means for the generation AI to adjust the plan taking the emotion data into consideration; and means for providing personalized suggestions to the user in a physical store. This allows users to receive optimized fashion and beauty suggestions based on their individual appearance and emotion data, significantly improving the shopping experience in a physical store.

[0882] A "user terminal" is an information processing device that allows a user to input information and check proposed plans.

[0883] The "server" is a central processing unit that receives information sent by users and analyzes it using generative AI and an emotion engine.

[0884] "Generative AI" is an artificial intelligence technology that analyzes a user's appearance and emotional data to generate the optimal plan.

[0885] An "emotion engine" is a system that analyzes a user's emotional data and recognizes their emotional state.

[0886] "Emotion data" is information that indicates the user's emotional state, and is data that is acquired using text input, facial recognition technology, or the like.

[0887] A "brick and mortar store" is a physical location where users actually visit and purchase products.

[0888] "Personalized suggestions" are suggestions that are customized based on the user's individual appearance and emotional data.

[0889] "Appearance data" refers to information related to the user's appearance, such as hairstyle, skin condition, and clothing style.

[0890] "Budget information" is information about the amount of money a user can spend on beauty and fashion.

[0891] A "plan" is a specific plan created by the generative AI based on the user's current data and ideal data to help the user get closer to their ideal appearance.

[0892] This invention relates to a system in which a user inputs their own appearance data and ideal image, and a generation AI analyzes it to generate a plan to bring the user closer to their ideal appearance. Furthermore, by combining it with an emotion engine, it is possible to recognize the user's emotions and adjust the plan based on those emotions.

[0893] System Overview

[0894] User terminal

[0895] The user terminal is an information processing device such as a smartphone or tablet that allows the user to input information about their hairstyle, skin condition, clothing style, budget, and emotional data. The emotional data is acquired using text input, voice input, or facial recognition technology. For example, after a user launches an application and logs in or creates a new account, they input specific appearance information and evaluate their emotional state. This information is then transmitted to a server via the terminal.

[0896] server

[0897] The server is a central processing unit that receives information sent from the user's device and analyzes it using the generation AI and emotion engine. The received data is stored in a database and analyzed. The generation AI on the server compares the user's appearance data with their ideal data and generates an optimal plan. The emotion engine also analyzes the user's emotion data and provides that information to the generation AI to help adjust the plan.

[0898] Generation AI

[0899] The AI ​​analyzes the user's hairstyle, skin condition, clothing style, budget information, and emotional data, and combines the user's current and ideal data to generate an optimal plan. For example, it might suggest a moisturizing cream for dry skin entered by the user, or list fashion items based on the user's preferred clothing style. It also takes emotional data into account to suggest relaxing spa services and refreshing activities for the user.

[0900] Emotion Engine

[0901] The emotion engine is a system that analyzes the user's emotional data passed from the server and recognizes their emotional state. For example, based on information entered by the user such as "I've been feeling stressed recently," it provides the AI ​​with suggestions to help the user relax.

[0902] Specific examples

[0903] Here is an example where a user enters the following information using a smartphone app.

[0904] Hairstyle: Short cut

[0905] Skin condition: Dry skin

[0906] Favorite clothing style: Casual

[0907] Budget information: 10,000 yen

[0908] Emotional information: "I've been feeling stressed lately"

[0909] An example of a prompt is

[0910] "I'm a 24-year-old woman with short hair, dry skin, a preference for casual styles, a budget of ¥10,000, and I've been feeling stressed lately. Could you recommend some clothes and cosmetics?"

[0911] The server receives the information entered by the user and analyzes it using a generative AI and emotion engine. Based on this analysis, it can suggest moisturizing creams for dry skin and list casual fashion items. It can also suggest relaxing spa services, taking into account the user's emotional data, such as "I've been feeling stressed lately."

[0912] In this way, users can easily take concrete actions to get closer to their ideal appearance, with the assistance of generative AI and an emotion engine.

[0913] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0914] Step 1:

[0915] A user launches a smartphone application and logs in or creates a new account. The user inputs their hairstyle, skin condition, clothing style, budget information, and emotional information. This data is temporarily saved within the application. The input information includes hairstyle as "short cut," skin condition as "dry skin," clothing style as "casual," budget information as "10,000 yen," and emotional information as "feeling stressed recently."

[0916] Step 2:

[0917] The terminal sends all input information to the server, where the input data is transferred to the server via a network. This transferred data includes information about the user's appearance and emotion data.

[0918] Step 3:

[0919] The server stores the received user data in its built-in database. The specific action of saving the data is to write to the database. The received data is managed in association with the user ID.

[0920] Step 4:

[0921] The server passes the saved user data to the generation AI, which begins analysis. The user's hairstyle, skin condition, clothing style, budget information, and emotional information are used as input for analysis. The generation AI uses this data to compare the user's current data with their ideal data and generate the optimal plan. Specific operations include the AI ​​model's calculation processing.

[0922] Step 5:

[0923] The generative AI uses an emotion engine to analyze the user's emotional data. The emotion engine analyzes the emotional data, such as "I've been feeling stressed recently," and provides the results to the generative AI. The emotion engine classifies the emotional data and analyzes emotional fluctuations.

[0924] Step 6:

[0925] The generative AI takes into account the emotional data from the emotion engine to tailor the user's plan, including specific actions such as adding suggestions to help the user relax. The final plan may include moisturizing creams for dry skin, casual clothing styles, and recommendations for relaxing spa services.

[0926] Step 7:

[0927] The server sends the generated plan to the user terminal, where it is returned to the user terminal via the network. The transmitted data includes a specific action plan and an item list.

[0928] Step 8:

[0929] The device displays the sent plan on a user interface. The user can check the suggested skin care products, fashion ideas, and relaxation services on the device and create a daily plan to put them into practice. Specifically, the plan is displayed in list format on the screen.

[0930] Through these steps, users receive a personalized plan based on their appearance and emotional data, and can take specific actions to move closer to their ideal appearance.

[0931] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0932] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0933] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0934] [Third embodiment]

[0935] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0936] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0937] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0938] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0939] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0940] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0941] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0942] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0943] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0944] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0945] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0946] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0947] This invention relates to a system in which a user inputs their own appearance data and ideal image into the system, and a generation AI analyzes the data and generates a plan to bring the user closer to their ideal appearance. This system inputs the user's hairstyle, skin condition, clothing style, and budget information and automatically makes optimal beauty and fashion suggestions based on this information.

[0948] System configuration

[0949] User terminal

[0950] Terminal: The user uses a terminal such as their smartphone or tablet to input information about their hairstyle, skin condition, clothing style, and budget. The input information is sent to the server via the terminal.

[0951] server

[0952] Server: Receives user information sent from the device and stores it in a database. The server passes this data to the generation AI for analysis.

[0953] Generation AI

[0954] Generative AI: Analyzes the data passed from the server and compares the user's current data with their ideal data. This generates a specific plan and recommendations to achieve optimal appearance, which are then sent to the user's device via the server.

[0955] Program processing

[0956] 1. Enter and submit information

[0957] Device: The user launches the application and enters their hairstyle, skin condition, clothing style, and budget information through a dedicated form. For example, if a user prefers short hair, dry skin, and casual clothing, they enter this information and also set their ideal appearance and monthly beauty budget.

[0958] Terminal: Once the input is complete, the user presses the send button to send the input information to the server.

[0959] 2. Data Reception and Analysis

[0960] Server: Receives user input information and stores it in an internal database. Then, passes the received data to the generation AI.

[0961] Generative AI: Analyzes the received data and compares the user's current condition with their ideal appearance, for example, suggesting moisturizing cream to combat dry skin or planning a haircut to achieve their ideal hairstyle.

[0962] 3. Plan generation and display

[0963] Generative AI: Based on user data, it generates the optimal plan for hairstyle, skin condition, and clothing style. It also takes into account budget information and lists available items and services.

[0964] Server: Sends the plans and recommendations created by the generation AI to the user device.

[0965] Device: The user can view the generated plan on their device and refer to their daily execution plan. Examples include the skin care products the user uses daily and a haircut schedule.

[0966] Specific examples

[0967] User: Create a new account and enter your hairstyle (short hair), skin condition (dry skin), and preferred clothing style (casual). Your ideal look is "simple and clean," and you set your monthly budget at 10,000 yen.

[0968] Server: Receives the input information and sends it to the generating AI.

[0969] Generative AI: Suggests moisturizing creams for dry skin, recommends simple and casual fashion items, and generates a two-weekly haircut plan for maintaining short hair.

[0970] Server: Sends the generated plan to the user terminal.

[0971] Device: Displays suggested skin care products and clothing ideas, allowing users to carry out daily care and shopping accordingly.

[0972] In this way, users can easily take concrete actions to get closer to their ideal appearance with the help of generative AI.

[0973] The processing flow will be explained below.

[0974] Step 1:

[0975] Terminal: The user launches the application and logs in or creates a new account. In the case of a new account, the user enters the required personal information (email address, password, etc.) to create the account.

[0976] Step 2:

[0977] Terminal: The user inputs their hairstyle, skin condition, clothing style, and budget information on the application screen. For example, the user selects "short hair," "dry skin," and "casual clothing style," and inputs "10,000 yen" as budget information.

[0978] Step 3:

[0979] Device: The user takes a photo of their hairstyle and skin condition and uploads it through the app.

[0980] Step 4:

[0981] Device: The user answers a questionnaire about their ideal appearance. For example, they may write that they are aiming for a "simple and clean look."

[0982] Step 5:

[0983] Terminal: Once the input is complete, the user presses the send button to send the input information and photo to the server.

[0984] Step 6:

[0985] Server: Receives user input information and photos and stores them in a built-in database.

[0986] Step 7:

[0987] Server: Passes the received data to the generation AI for analysis, verifying that the data is in the correct format.

[0988] Step 8:

[0989] Generative AI: Analyzes the received user data and compares the user's current data (hairstyle, skin condition, clothing style) with the ideal data.

[0990] Step 9:

[0991] Generative AI: Based on the analysis results, it generates a plan to help the user achieve their ideal appearance, such as "recommending moisturizing creams for dry skin" and "a plan for cutting hair every two weeks to maintain short hair."

[0992] Step 10:

[0993] Generative AI: Considers the user's budget information, checks whether the suggested items and services can be purchased within the budget, and generates a list of available goods and services.

[0994] Step 11:

[0995] Server: Sends the generated plans and recommendations to the user device.

[0996] Step 12:

[0997] On Device: The user can view the generated plan on their device, which includes daily skin care routines, weekly hair care plans, and monthly fashion updates.

[0998] Step 13:

[0999] Terminal: The user accesses the link to purchase the suggested items and does their online shopping.

[1000] Step 14:

[1001] Server: Periodically collects user progress data and passes it to the generation AI. The collected data includes the results of actions taken by the user and feedback.

[1002] Step 15:

[1003] Generative AI: Analyzes collected data and evaluates the effectiveness of the plan, then optimizes it as needed.

[1004] Step 16:

[1005] Server: Sends the new optimized plan to the user's device, which then takes the next step.

[1006] In this way, users can easily take concrete actions to get closer to their ideal appearance using generative AI.

[1007] Example 1

[1008] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1009] The present invention relates to a system that automatically generates a specific plan for a user to efficiently fulfill their appearance-related desires. Conventional methods require users to collect information on beauty and fashion and create their own plans, which is a very time-consuming process. Furthermore, individual beauty and fashion information is not centralized, making it difficult for users to find appropriate products and services. This presents a challenge for users, making it difficult to efficiently and effectively achieve their ideal appearance.

[1010] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1011] In this invention, the server includes means for a user to input information about their hairstyle, skin condition, clothing style, and budget, means for transmitting the information input by the user to the server, means for the server to pass the received information to a generation AI for analysis, means for the generation AI to compare the user's current data with ideal data and generate a plan to achieve an optimal appearance, means for transmitting the generated plan to a user terminal and displaying it, means for the server to store the user's input information in a database, means for the generation AI to retrieve data from the database to create a plan, and means for the user terminal to display a daily implementation plan. This allows users to easily obtain a specific plan to achieve their ideal appearance and carry out their daily beauty and fashion routines.

[1012] "User" refers to a person who uses the system to input information about their own appearance and ideal appearance.

[1013] "Hairstyle" refers to information indicating the state of the user's hair, such as style and length.

[1014] "Skin condition" refers to information that indicates the condition or characteristics of the user's skin, such as dry skin or oily skin.

[1015] "Clothing style" refers to information about the type, design, and fashion of clothing that the user prefers.

[1016] "Budget information" refers to information indicating the amount of money a user can spend on beauty and fashion within a certain period of time.

[1017] "Device" refers to the device used by a user to input and transmit their appearance information to a server. Examples include smartphones and tablets.

[1018] "Server" refers to a component that receives information sent from the user terminal and passes it on to the generation AI.

[1019] "Database" means the data storage system used by the Server to organize and store User information.

[1020] "Generative AI" refers to artificial intelligence that analyzes user information passed from the server, compares the user's current data with their ideal data, and generates a plan to achieve their optimal appearance.

[1021] A "plan" refers to a plan created by the generative AI based on the user's information, showing specific actions and recommendations to move closer to their ideal appearance.

[1022] "User terminal" refers to a device for receiving the generated plan and displaying it to the user.

[1023] The present invention relates to a system in which a user inputs their own appearance data and ideal image, and a generation AI analyzes the data and generates a specific plan to help the user approach their ideal appearance. Detailed embodiments of the present invention are described below.

[1024] System configuration

[1025] User terminal

[1026] The terminal is a device that allows users to input information about their hairstyle, skin condition, clothing style, and budget using their own smartphone, tablet, etc. The input information is sent to the server via the terminal.

[1027] server

[1028] The server receives the user information sent from the device and stores it in a database. The server also passes this data to the generation AI for analysis.

[1029] Generation AI

[1030] The generation AI analyzes the data passed from the server and compares the user's current data with their ideal data. This generates a specific plan and recommendations to help them achieve their ideal appearance, which are then sent to the user's device via the server.

[1031] Hardware and software used

[1032] Hardware:

[1033] User devices such as smartphones and tablets

[1034] Server for data storage and analysis

[1035] software:

[1036] An application that provides a user interface

[1037] Generative AI models that analyze data

[1038] Specific examples

[1039] Enter and submit information

[1040] The user launches the application and enters information about their hairstyle, skin condition, clothing style, and budget through a dedicated form. For example, if the user prefers short hair, dry skin, and a casual clothing style, they enter this information, as well as their ideal appearance and monthly beauty budget. Once the input is complete, the user presses the submit button, which sends the entered information to the server.

[1041] Data reception and analysis

[1042] The server receives the user's input, stores it in an internal database, and then passes the data to the AI ​​generator, which analyzes the data and compares the user's current appearance with their ideal appearance. For example, this could include suggesting a moisturizing cream to combat dry skin or a haircut plan to achieve their ideal hairstyle.

[1043] Plan Generation and Display

[1044] The generation AI generates an optimal plan based on the user's data, taking into account hairstyle, skin condition, and clothing style, and also lists items and services that can be purchased, taking into account budget information. The server sends the plan and recommendations created by the generation AI to the user's device, and the user can check the generated plan on their device and refer to their daily execution plan. Specific examples include the user's daily skin care products and haircut schedule.

[1045] Example prompts for generative AI models

[1046] "Please suggest a specific plan for a user with short hair and dry skin to achieve a clean look with a casual clothing style."

[1047] "Make a list of the products and services you need to combat dry skin and maintain short hair within a monthly budget of ¥10,000."

[1048] In this way, users can easily take concrete actions to get closer to their ideal appearance with the help of generative AI.

[1049] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1050] Step 1:

[1051] The user launches an application.

[1052] Specific operation: The user taps and launches the dedicated application on their smartphone or tablet.

[1053] Input: The user operates the device to launch the app.

[1054] Output: A dedicated form is displayed.

[1055] Step 2:

[1056] Users enter hairstyle, skin condition, clothing style, and budget information into a dedicated form.

[1057] Specific operation: The user enters hairstyle (e.g., short hair), skin condition (e.g., dry skin), clothing style (e.g., casual), and budget information (e.g., 10,000 yen) into the form.

[1058] Input: The user enters information into the form.

[1059] Output: The input information is kept within the application.

[1060] Step 3:

[1061] The user presses the send button to send the input information to the server.

[1062] Specific behavior: When the user has completed filling out the form, they tap the submit button.

[1063] Input: The action of the user pressing the submit button.

[1064] Output: The input information is sent to the server.

[1065] Step 4:

[1066] The server receives the information sent by the user.

[1067] Specific operation: The server processes data received from the user terminal in real time.

[1068] Input: Information sent from the user's device.

[1069] Output: The received information is saved on the server.

[1070] Step 5:

[1071] The server stores the received data in a database.

[1072] Specific operation: The server stores the received information in an internal database.

[1073] Input: Received information.

[1074] Output: Information stored in a database.

[1075] Step 6:

[1076] The server retrieves the necessary data from the database and passes it to the generation AI.

[1077] Specific operation: The server reads user information from the database and sends it to the generation AI.

[1078] Input: User information retrieved from the database.

[1079] Output: User information passed to the generation AI.

[1080] Step 7:

[1081] The generative AI analyzes the user's information and compares the current data with the ideal data.

[1082] Specific operation: The generating AI compares the user's current data (entered hairstyle, skin condition, etc.) with the ideal data and identifies any gaps.

[1083] Input: User's current and ideal data.

[1084] Output: Analysis results based on gaps.

[1085] Step 8:

[1086] Generative AI creates the optimal plan.

[1087] Specific operation: Based on the analysis results, the generation AI generates a plan to help the user achieve their ideal appearance.

[1088] Input: Analysis results.

[1089] Output: Optimal plan and recommendations.

[1090] Step 9:

[1091] The plan created by the generation AI is sent to the server.

[1092] Specific operation: The generation AI sends the generated plan to the server.

[1093] Input: The generated plan.

[1094] Output: The plan sent to the server.

[1095] Step 10:

[1096] The server transmits the plan to the user terminal.

[1097] Specific operation: The server sends the plan received from the generation AI to the user terminal.

[1098] Input: The plan received from the generation AI.

[1099] Output: The plan sent to the user device.

[1100] Step 11:

[1101] The user checks the plan on the device and refers to the daily execution plan.

[1102] Specific behavior: The user views the plan on their device and performs the recommended actions.

[1103] Input: The plan received from the server.

[1104] Output: Daily execution plan based on the plan.

[1105] (Application example 1)

[1106] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1107] In conventional beauty and fashion planning, it was difficult for users to obtain specific advice to get closer to their ideal appearance. Furthermore, there was no system that analyzed the user's appearance data and ideal data and provided a plan tailored to individual needs, so users had to spend a lot of time and effort. Furthermore, proposals rarely took budget information into account, making it difficult to obtain a feasible plan.

[1108] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1109] In this invention, the server includes means for a user to input information about their hairstyle, skin condition, clothing style, and budget, means for transmitting the information input by the user to the server, means for the server to pass the received information to a generation AI for analysis, means for the generation AI to compare the user's current data with ideal data and generate a plan to achieve an optimal appearance, means for transmitting the generated plan to a user terminal and displaying it, means for visualizing the generated plan and presenting it to the user, and means for the user to set their ideal appearance and use that data for analysis. This allows the user to easily take specific actions to achieve their ideal appearance and obtain a workable plan that fits their budget.

[1110] "User" refers to an individual who utilizes the system to input their own appearance data and receive a plan to achieve their ideal appearance.

[1111] "Hairstyle" is information that indicates the current state of the user's hairstyle.

[1112] "Skin condition" is information that indicates the user's skin condition (e.g., dry skin, oily skin).

[1113] "Clothing style" is information that indicates the fashion style (e.g., casual, formal) that the user prefers.

[1114] "Budget information" is information that indicates the amount of budget that a user will spend on beauty and fashion for each month and year.

[1115] The "server" is a relay device that passes information received from the user to the generation AI and transmits the generated plan to the user's terminal.

[1116] "Generative AI" is an artificial intelligence that analyzes the user's appearance data and ideal data received and generates a plan to approach the optimal appearance.

[1117] A "plan" is a proposal made by the generative AI after analyzing the user's data, including a specific action plan and a list of items to help them achieve their ideal appearance.

[1118] A "user terminal" is an electronic device (e.g., a smartphone or tablet) through which a user inputs data and receives the generated plan.

[1119] "Visualization" is the process of visually displaying the generated plan and presenting it to the user.

[1120] "Ideal appearance" refers to the image of one's appearance that a user sets as a goal to aim for.

[1121] The system for implementing this invention begins when a user uses a device such as a smartphone or tablet to input information about their hairstyle, skin condition, clothing style, and budget, and sends it to a server. The server then passes the received user data to a generation AI, which analyzes the data, compares the user's current data with their ideal data, and generates a plan to achieve their optimal appearance. The generated plan is then sent to the user's device via the server, where it is visualized and presented to the user.

[1122] Hardware and software used

[1123] Hardware

[1124] Smartphones / Tablets: Used as devices for users to input data.

[1125] Server: A relay device that passes data received from the user to the generation AI and sends the generated plan to the user's terminal.

[1126] Cloud Server: Hosts the generative AI and provides the necessary computing resources.

[1127] software

[1128] Flask (server side): A lightweight Python web framework that provides API endpoints.

[1129] Generative AI model (e.g., GPT-3): An artificial intelligence that analyzes user data and generates an appearance improvement plan.

[1130] Requests (client side): A Python HTTP library used to send data.

[1131] Specific system behavior

[1132] Enter and submit information

[1133] The user starts the smartphone application and enters information about their hairstyle, skin condition, clothing style, and budget into a dedicated form. For example, the user may have short hair, dry skin, a preference for casual clothing, and a monthly budget of 10,000 yen. Once the information is complete, it is sent to the server.

[1134] Data reception and analysis

[1135] The server receives the user's input and stores it in an internal database. The received data is then passed to the generation AI, which compares the user's current condition with their ideal appearance and generates an optimal plan. Specific examples include recommendations for moisturizing creams for dry skin and haircut plans to achieve the ideal hairstyle.

[1136] Plan Generation and Display

[1137] The plan created by the AI ​​is sent to the user's device via the server, where it is visualized and displayed, allowing the user to refer to their daily plan, including, for example, the skin care products they use every day and their haircut schedule.

[1138] Prompt Sentence Examples

[1139] User's current data:

[1140] Hairstyle: Short hair

[1141] Skin condition: Dry skin

[1142] Clothing style: Casual

[1143] Budget: 10,000 yen

[1144] Ideal appearance:

[1145] Simple and clean appearance

[1146] Suggest beauty and fashion plans to help users achieve their ideal appearance.

[1147] This system allows users to easily take specific actions to get closer to their ideal appearance and provides a workable plan that fits their budget.

[1148] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1149] Step 1:

[1150] The user launches a dedicated application on their smartphone or tablet and enters their hairstyle, skin condition, clothing style, and budget information. Specifically, the user specifies that they prefer short hair, dry skin, and casual clothing, and sets their monthly budget to 10,000 yen. Once the information is complete, they press the send button in the application to send the information to the server.

[1151] Input: Hairstyle, skin condition, clothing style, budget information

[1152] Output: User appearance data and budget information sent to the server

[1153] Step 2:

[1154] The server temporarily stores the received user appearance data and budget information in an internal database, then packets the stored data for transmission to the generation AI and sends it to the generation AI's analysis process.

[1155] Input: User appearance data and budget information

[1156] Output: Data packet sent to the generating AI

[1157] Step 3:

[1158] The generative AI analyzes the received data and compares the user's current condition with the ideal appearance data. The analysis may, for example, suggest a moisturizing cream for dry skin or a haircut plan to maintain short hair. This analysis generates a beauty and fashion plan to bring the user closer to their optimal appearance.

[1159] Input: User's appearance data and ideal appearance data

[1160] Output: Generated appearance improvement plan

[1161] Step 4:

[1162] The server analyzes the appearance improvement plan received from the generation AI and formats it for transmission to the user's device. The plan contents include specific beauty product and service recommendations, usage instructions, and implementation schedules.

[1163] Input: Generated appearance improvement plan

[1164] Output: Formatted plan data sent to the user device

[1165] Step 5:

[1166] The user device visualizes the received plan and displays it to the user. The user can then review the plan generated on the application and take specific actions, such as incorporating suggested skin care products or haircut schedules into their daily lives.

[1167] Input: Formatted plan data

[1168] Output: Visualized appearance improvement plan

[1169] This allows users to easily take specific actions to get closer to their ideal appearance and obtain a workable plan that fits their budget.

[1170] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1171] This invention relates to a system in which a user inputs their own appearance data and ideal image into the system, and a generation AI analyzes the data to generate a plan to bring the user closer to their ideal appearance. Furthermore, by combining it with an emotion engine, the system has the function of recognizing the user's emotions and adjusting the plan based on those emotions. By inputting the user's hairstyle, skin condition, clothing style, and budget information, and incorporating emotional data, the system makes more personalized and effective beauty and fashion recommendations.

[1172] System configuration

[1173] User terminal

[1174] Device: The user uses a device such as a smartphone or tablet to input information about their hairstyle, skin condition, clothing style, and budget. Emotional data is acquired using text input, voice input, and even facial recognition technology. The input information is sent to the server via the device.

[1175] server

[1176] Server: Receives user information and emotion data sent from the device and stores it in a built-in database. The server passes this data to the generation AI and emotion engine for analysis.

[1177] Generation AI

[1178] Generative AI: Analyzes the data passed from the server and compares the user's current data with the ideal data. The Generative AI also takes into account the emotional data obtained from the user's emotion engine to generate a plan that will best satisfy the user.

[1179] Emotion Engine

[1180] Emotion engine: Analyzes the user's emotional data passed from the server and recognizes the user's current emotional state. This information is provided to the generative AI, contributing to the optimization of the plan.

[1181] Program processing

[1182] 1. Enter and submit information

[1183] Device: The user launches the application and logs in or creates a new account. They enter their hairstyle, skin condition, clothing style, and budget information, and then run questions and facial recognition to assess the user's emotions.

[1184] Terminal: After all information is entered, the user presses the send button to send the information and emotion data to the server.

[1185] 2. Data Reception and Analysis

[1186] Server: Receives user input information and emotion data, stores it in a database, and passes the received data to the generation AI and emotion engine.

[1187] Generative AI: Analyzes the received data and combines the user's current data (hairstyle, skin condition, clothing style), ideal data, and emotional data to generate the optimal plan.

[1188] 3. Plan generation and display

[1189] Generative AI: Based on user data, it generates optimal plans for hairstyle, skin condition, and clothing style, and adjusts them to maximize user satisfaction by taking into account data from the emotion engine. It also takes into account the user's budget information and lists items and services that can be purchased.

[1190] Server: Sends the generated plans and recommendations to the user device.

[1191] Device: The user can view the generated plan on their device and refer to their daily action plan, including the skin care products they use every day and their haircut schedule.

[1192] Specific examples

[1193] 1. User: Create a new account and enter your hairstyle (short hair), skin condition (dry skin), and preferred clothing style (casual). Fill out a questionnaire and select "simple and clean appearance" as your ideal appearance, and set your monthly budget at 10,000 yen. Also, enter emotional information such as "I've been feeling tired lately" or "I'm feeling stressed" as an emotional assessment.

[1194] 2. Server: Receives input information and emotion data and sends it to the generative AI and emotion engine.

[1195] 3. Generative AI: It can suggest moisturizing creams for dry skin, recommend simple and casual fashion items, and create a two-weekly haircut plan to maintain short hair. It also uses the analysis results of the emotion engine to suggest relaxing spa services and refreshing activities for users.

[1196] 4. Server: Sends the generated plan to the user terminal.

[1197] 5. Device: Displays suggested skin care products, outfit ideas, and even relaxing services, allowing users to carry out their daily care and shopping accordingly.

[1198] In this way, users can easily take concrete actions to get closer to their ideal appearance, with the assistance of generative AI and an emotion engine.

[1199] The processing flow will be explained below.

[1200] System processing flow and specific steps

[1201] Step 1:

[1202] Terminal: The user launches the application and logs in or creates a new account. In the case of a new account, the user enters the required personal information (email address, password, etc.) to create the account.

[1203] Step 2:

[1204] Terminal: The user inputs their hairstyle, skin condition, clothing style, and budget information on the application screen. For example, the user selects "short hair," "dry skin," and "casual clothing style," and inputs "10,000 yen" as budget information.

[1205] Step 3:

[1206] Device: The user takes a photo of their hairstyle and skin condition and uploads it through the app.

[1207] Step 4:

[1208] Device: The user answers a questionnaire about their ideal appearance. For example, they may write that they are aiming for a "simple and clean look."

[1209] Step 5:

[1210] Terminal: The user fills out a form to input their emotional state. For example, they can input emotional information such as "I've been feeling tired recently" or "I'm stressed." Alternatively, they can use facial recognition to collect emotional data and obtain real-time emotional states.

[1211] Step 6:

[1212] Terminal: Once the input is complete, the user presses the send button to send the input information, photo, and emotion data to the server.

[1213] Step 7:

[1214] Server: Receives user input information and emotion data and stores them in a built-in database.

[1215] Step 8:

[1216] Server: Passes the received data to the generation AI and emotion engine for analysis, and verifies that the data is in the correct format.

[1217] Step 9:

[1218] Generative AI: Analyzes the received user data and compares the user's current data (hairstyle, skin condition, clothing style) with the ideal data.

[1219] Step 10:

[1220] Emotion Engine: Analyzes received emotion data and recognizes the user's emotional state. This information is provided to the generative AI, which then contributes to optimizing the plan.

[1221] Step 11:

[1222] Generative AI: Based on the analysis results, it generates a plan to help the user achieve their ideal appearance. For example, it creates a "moisturizing cream recommendation for dry skin" or a "haircut plan every two weeks to maintain short hair." It adjusts the plan to maximize user satisfaction, taking into account data from the emotion engine.

[1223] Step 12:

[1224] Generative AI: Considers the user's budget information, checks whether the suggested items and services can be purchased within the budget, and generates a list of available goods and services.

[1225] Step 13:

[1226] Server: Sends the generated plans and recommendations to the user device.

[1227] Step 14:

[1228] On Device: The user can view the generated plan on their device, which includes daily skin care routines, weekly hair care plans, and monthly fashion updates.

[1229] Step 15:

[1230] Terminal: The user accesses the link to purchase the suggested items and does their online shopping.

[1231] Step 16:

[1232] Server: Periodically collects user progress data and passes it to the generative AI and emotion engine. The collected data includes the results of actions taken by the user and feedback.

[1233] Step 17:

[1234] Generative AI: Analyzes collected data and evaluates the effectiveness of the plan, then optimizes it as needed.

[1235] Step 18:

[1236] Server: Sends the new optimized plan to the user's device, which then takes the next step.

[1237] In this way, users can easily take concrete actions to get closer to their ideal appearance, with the assistance of generative AI and an emotion engine.

[1238] Example 2

[1239] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1240] Conventional appearance improvement systems generate plans based solely on user input, making it difficult to provide an optimal plan that takes into account the user's emotional state and daily changes. Furthermore, they may not adequately propose specific actions that satisfy the user or fit their budget. Therefore, there is a need for a system that provides an individually optimized appearance improvement plan that takes into account the user's emotional state.

[1241] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for storing user information and emotional data in a database, means for transferring the stored information to the analysis module, and means for the generation AI to generate a plan by integrating the user's current data, ideal data, and emotional data. This enables comprehensive data analysis, including the user's emotional state, and makes it possible to provide an individually optimized, high-quality appearance improvement plan.

[1242] "User" refers to an individual who uses the System to create and implement their own appearance improvement plan.

[1243] "Server" refers to the computer system that receives and stores information entered by users and passes that data to the analysis module.

[1244] "Generative AI" refers to artificial intelligence that generates an optimal appearance improvement plan based on the user's current data, ideal data, and emotional data.

[1245] "Emotion data" refers to information that reflects the user's current emotional state, and refers to data obtained by text input, voice input, facial recognition, etc.

[1246] A "plan" refers to the suggestions that the generative AI makes after analyzing the user's data, including specific actions and recommended items to help the user achieve their ideal appearance.

[1247] "Database" refers to an electronic storage device where the server stores user information and emotion data.

[1248] An "analysis module" refers to a combination of software and hardware that allows the generation AI and emotion engine to analyze data based on data passed from the server.

[1249] "Current status data" refers to information entered by the user that indicates current physical characteristics such as hairstyle, skin condition, clothing style, etc.

[1250] "Ideal data" refers to specific information about the user's desired appearance, and refers to data entered in a questionnaire or as a preference.

[1251] "Budget Information" refers to the amount of money a user can spend on improving their appearance in a month or a specific period of time.

[1252] This invention is a system in which a user inputs their own appearance data and ideal image into the system, and a generation AI analyzes the data to generate a plan to bring the user closer to their ideal appearance. Furthermore, by combining it with an emotion engine, it has the function of recognizing the user's emotions and adjusting the plan based on those emotions. A specific embodiment of this system will be described below.

[1253] System configuration

[1254] User terminal

[1255] Device: The user uses a device such as a smartphone or tablet to input information about their hairstyle, skin condition, clothing style, and budget. Emotional data is acquired using text input, voice input, and even facial recognition technology. The input information is sent to the server via the device.

[1256] server

[1257] Server: The server receives user information and emotion data sent from the device and stores it in a built-in database. The stored data is then passed to the generative AI and emotion engine for analysis.

[1258] Generation AI

[1259] Generative AI: Analyzes the data passed from the server and compares the user's current data with their ideal data. The Generative AI also takes into account the emotional data obtained from the emotion engine to generate a plan that will best satisfy the user.

[1260] Emotion Engine

[1261] Emotion engine: Analyzes the user's emotional data passed from the server and recognizes the user's current emotional state. This information is provided to the generative AI, contributing to the optimization of the plan.

[1262] System Operation

[1263] 1. Enter and submit information

[1264] Users launch the application, log in or create a new account, enter their hairstyle, skin condition, clothing style, and budget information, and then run questions and facial recognition to assess the user's emotions.

[1265] After all the information has been entered, the terminal presses the send button to send the information and emotion data to the server.

[1266] 2. Data Reception and Analysis

[1267] The server receives the user's input information and emotion data, stores it in a database, and passes the received data to the analysis module.

[1268] The generation AI analyzes the received data and combines the user's current data (hairstyle, skin condition, clothing style), ideal data, and emotional data to generate the optimal plan.

[1269] 3. Plan generation and display

[1270] The generative AI uses user data to generate optimal plans for hairstyle, skin condition, and clothing style, and adjusts them to maximize user satisfaction by taking into account data from the emotion engine. It also takes into account the user's budget information to list items and services that can be purchased.

[1271] The server transmits the generated plan and recommendations to the user terminal.

[1272] On the terminal, the user can check the generated plan and refer to the daily execution plan.

[1273] Specific examples

[1274] 1. User: Create a new account and enter your hairstyle (short hair), skin condition (dry skin), and preferred clothing style (casual). Fill out a questionnaire and select "simple and clean appearance" as your ideal appearance, and set your monthly budget at 10,000 yen. Also, enter emotional information such as "I've been feeling tired lately" or "I'm feeling stressed" as an emotional assessment.

[1275] Example prompt: "Please tell us about your hairstyle, skin condition, clothing style, and monthly budget. Also, tell us about your recent emotional state. For example, have you been feeling tired or stressed lately?"

[1276] 2. Server: Receives input information and emotion data and sends it to the generative AI and emotion engine.

[1277] 3. Generative AI: It can suggest moisturizing creams for dry skin, recommend simple and casual fashion items, and create a two-weekly haircut plan to maintain short hair. It also uses the analysis results of the emotion engine to suggest relaxing spa services and refreshing activities for users.

[1278] 4. Server: Sends the generated plan to the user terminal.

[1279] 5. Terminal: Displays suggested skin care products, clothing ideas, and even relaxing services, allowing users to follow their daily care and shopping accordingly.

[1280] In this way, users can easily take concrete actions to get closer to their ideal appearance, with the assistance of generative AI and an emotion engine.

[1281] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1282] Specific processing steps of the program

[1283] Step 1:

[1284] A user launches the application and creates a new account or logs in. Data entered includes hairstyle, skin condition, clothing style, and budget information.

[1285] Input: Hairstyle, skin condition, clothing style, and budget information from the user.

[1286] Output: Temporarily saves input data.

[1287] Specific operation: The user enters the necessary information into the form. For example, the user enters data such as "hairstyle: short hair," "skin condition: dry skin," "clothing style: casual," and "budget: 10,000 yen."

[1288] Step 2:

[1289] The device requests the input of emotional data, and the user inputs the emotional data by answering questions or using facial recognition technology.

[1290] Input: User emotion data (text responses, voice input, facial recognition).

[1291] Output: Temporary storage of emotion data.

[1292] Specific operation: The user inputs their emotional state, such as "I've been feeling tired lately" or "I'm feeling stressed." Using facial recognition technology, the system can determine whether they are smiling or tired.

[1293] Step 3:

[1294] The device sends all user information and emotion data to the server.

[1295] Input: User information and emotion data collected in the previous step.

[1296] Output: Data packets sent to the server.

[1297] Specific operation: Press the send button to generate a data packet and upload it to the server.

[1298] Step 4:

[1299] The server stores the received data in a database.

[1300] Input: Data packets sent from the terminal.

[1301] Output: User information and emotion data stored in a database.

[1302] Specific operation: The server executes an SQL query to store the received data in a database.

[1303] Step 5:

[1304] The server passes the stored data to the generative AI and emotion engine.

[1305] Input: Information stored in a database.

[1306] Output: The data passed to the analysis module.

[1307] Specific operation: The server reads data from the database and sends it to the generative AI and emotion engine using an API.

[1308] Step 6:

[1309] The generative AI analyzes the user's current situation, ideal data, and emotional data.

[1310] Input: All user information passed from the server.

[1311] Output: The optimal appearance plan as a result of the analysis.

[1312] Specific operation: The generative AI analyzes the data and creates a plan, such as "This moisturizing cream is for dry skin" or "A haircut plan to maintain short hair."

[1313] Step 7:

[1314] The emotion engine adjusts the plan based on the user's emotional data.

[1315] Input: Emotion data and initial plan for generative AI.

[1316] Output: The adjusted optimization plan.

[1317] What it does: The emotion engine takes into account emotional data such as "I'm tired" and adds a relaxing spa service to the plan.

[1318] Step 8:

[1319] Based on the adjusted plan, the generative AI will list items and services that fit the user's budget.

[1320] Inputs: Adjusted optimization plan, budget information.

[1321] Output: A list of items and services available for purchase.

[1322] Specific operation: The AI ​​extracts items that can be purchased within the budget from a product database and creates a list.

[1323] Step 9:

[1324] The server transmits the generated plan and list to the user terminal.

[1325] Input: Plans and service list created by the generative AI.

[1326] Output: Plans and lists sent to user terminal.

[1327] Specific operation: The server packages the plan and list in JSON format or similar and sends it to the user's terminal.

[1328] Step 10:

[1329] The terminal displays the proposed plan to the user.

[1330] Input: Plan and list sent from the server.

[1331] Output: Plan and specific actions displayed on the device screen.

[1332] Specific operation: The terminal app displays the plan and list on the GUI, allowing the user to check it and carry out daily care and purchases.

[1333] (Application example 2)

[1334] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1335] Conventional fashion and beauty recommendation systems have struggled to analyze a user's appearance data and emotional state in detail and provide recommendations tailored to individual needs. Furthermore, it has been difficult to provide personalized and effective recommendations in real time during the shopping experience in a physical store. This can cause users great stress when choosing the products and services that best suit them.

[1336] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for the user to input information about their hairstyle, skin condition, clothing style, and budget; means for transmitting the information input by the user to the server; means for the server to pass the received information to a generation AI for analysis; means for the generation AI to compare the user's current data with ideal data and generate a plan to achieve an optimal appearance; means for transmitting the generated plan to the user's terminal and displaying it; means including an emotion engine for analyzing emotion data; means for the generation AI to adjust the plan taking the emotion data into consideration; and means for providing personalized suggestions to the user in a physical store. This allows users to receive optimized fashion and beauty suggestions based on their individual appearance and emotion data, significantly improving the shopping experience in a physical store.

[1337] A "user terminal" is an information processing device that allows a user to input information and check proposed plans.

[1338] The "server" is a central processing unit that receives information sent by users and analyzes it using generative AI and an emotion engine.

[1339] "Generative AI" is an artificial intelligence technology that analyzes a user's appearance and emotional data to generate the optimal plan.

[1340] An "emotion engine" is a system that analyzes a user's emotional data and recognizes their emotional state.

[1341] "Emotion data" is information that indicates the user's emotional state, and is data that is acquired using text input, facial recognition technology, or the like.

[1342] A "brick and mortar store" is a physical location where users actually visit and purchase products.

[1343] "Personalized suggestions" are suggestions that are customized based on the user's individual appearance and emotional data.

[1344] "Appearance data" refers to information related to the user's appearance, such as hairstyle, skin condition, and clothing style.

[1345] "Budget information" is information about the amount of money a user can spend on beauty and fashion.

[1346] A "plan" is a specific plan created by the generative AI based on the user's current data and ideal data to help the user get closer to their ideal appearance.

[1347] This invention relates to a system in which a user inputs their own appearance data and ideal image, and a generation AI analyzes it to generate a plan to bring the user closer to their ideal appearance. Furthermore, by combining it with an emotion engine, it is possible to recognize the user's emotions and adjust the plan based on those emotions.

[1348] System Overview

[1349] User terminal

[1350] The user terminal is an information processing device such as a smartphone or tablet that allows the user to input information about their hairstyle, skin condition, clothing style, budget, and emotional data. The emotional data is acquired using text input, voice input, or facial recognition technology. For example, after a user launches an application and logs in or creates a new account, they input specific appearance information and evaluate their emotional state. This information is then transmitted to a server via the terminal.

[1351] server

[1352] The server is a central processing unit that receives information sent from the user's device and analyzes it using the generation AI and emotion engine. The received data is stored in a database and analyzed. The generation AI on the server compares the user's appearance data with their ideal data and generates an optimal plan. The emotion engine also analyzes the user's emotion data and provides that information to the generation AI to help adjust the plan.

[1353] Generation AI

[1354] The AI ​​analyzes the user's hairstyle, skin condition, clothing style, budget information, and emotional data, and combines the user's current and ideal data to generate an optimal plan. For example, it might suggest a moisturizing cream for dry skin entered by the user, or list fashion items based on the user's preferred clothing style. It also takes emotional data into account to suggest relaxing spa services and refreshing activities for the user.

[1355] Emotion Engine

[1356] The emotion engine is a system that analyzes the user's emotional data passed from the server and recognizes their emotional state. For example, based on information entered by the user such as "I've been feeling stressed recently," it provides the AI ​​with suggestions to help the user relax.

[1357] Specific examples

[1358] Here is an example where a user enters the following information using a smartphone app.

[1359] Hairstyle: Short cut

[1360] Skin condition: Dry skin

[1361] Favorite clothing style: Casual

[1362] Budget information: 10,000 yen

[1363] Emotional information: "I've been feeling stressed lately"

[1364] An example of a prompt is

[1365] "I'm a 24-year-old woman with short hair, dry skin, a preference for casual styles, a budget of ¥10,000, and I've been feeling stressed lately. Could you recommend some clothes and cosmetics?"

[1366] The server receives the information entered by the user and analyzes it using a generative AI and emotion engine. Based on this analysis, it can suggest moisturizing creams for dry skin and list casual fashion items. It can also suggest relaxing spa services, taking into account the user's emotional data, such as "I've been feeling stressed lately."

[1367] In this way, users can easily take concrete actions to get closer to their ideal appearance, with the assistance of generative AI and an emotion engine.

[1368] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1369] Step 1:

[1370] A user launches a smartphone application and logs in or creates a new account. The user inputs their hairstyle, skin condition, clothing style, budget information, and emotional information. This data is temporarily saved within the application. The input information includes hairstyle as "short cut," skin condition as "dry skin," clothing style as "casual," budget information as "10,000 yen," and emotional information as "feeling stressed recently."

[1371] Step 2:

[1372] The terminal sends all input information to the server, where the input data is transferred to the server via a network. This transferred data includes information about the user's appearance and emotion data.

[1373] Step 3:

[1374] The server stores the received user data in its built-in database. The specific action of saving the data is to write to the database. The received data is managed in association with the user ID.

[1375] Step 4:

[1376] The server passes the saved user data to the generation AI, which begins analysis. The user's hairstyle, skin condition, clothing style, budget information, and emotional information are used as input for analysis. The generation AI uses this data to compare the user's current data with their ideal data and generate the optimal plan. Specific operations include the AI ​​model's calculation processing.

[1377] Step 5:

[1378] The generative AI uses an emotion engine to analyze the user's emotional data. The emotion engine analyzes the emotional data, such as "I've been feeling stressed recently," and provides the results to the generative AI. The emotion engine classifies the emotional data and analyzes emotional fluctuations.

[1379] Step 6:

[1380] The generative AI takes into account the emotional data from the emotion engine to tailor the user's plan, including specific actions such as adding suggestions to help the user relax. The final plan may include moisturizing creams for dry skin, casual clothing styles, and recommendations for relaxing spa services.

[1381] Step 7:

[1382] The server sends the generated plan to the user terminal, where it is returned to the user terminal via the network. The transmitted data includes a specific action plan and an item list.

[1383] Step 8:

[1384] The device displays the sent plan on a user interface. The user can check the suggested skin care products, fashion ideas, and relaxation services on the device and create a daily plan to put them into practice. Specifically, the plan is displayed in list format on the screen.

[1385] Through these steps, users receive a personalized plan based on their appearance and emotional data, and can take specific actions to move closer to their ideal appearance.

[1386] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1387] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1388] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1389] [Fourth embodiment]

[1390] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1391] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1392] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1393] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1394] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1395] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1396] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1397] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1398] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1399] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1400] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1401] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1402] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1403] This invention relates to a system in which a user inputs their own appearance data and ideal image into the system, and a generation AI analyzes the data and generates a plan to bring the user closer to their ideal appearance. This system inputs the user's hairstyle, skin condition, clothing style, and budget information and automatically makes optimal beauty and fashion suggestions based on this information.

[1404] System configuration

[1405] User terminal

[1406] Terminal: The user uses a terminal such as their smartphone or tablet to input information about their hairstyle, skin condition, clothing style, and budget. The input information is sent to the server via the terminal.

[1407] server

[1408] Server: Receives user information sent from the device and stores it in a database. The server passes this data to the generation AI for analysis.

[1409] Generation AI

[1410] Generative AI: Analyzes the data passed from the server and compares the user's current data with their ideal data. This generates a specific plan and recommendations to achieve optimal appearance, which are then sent to the user's device via the server.

[1411] Program processing

[1412] 1. Enter and submit information

[1413] Device: The user launches the application and enters their hairstyle, skin condition, clothing style, and budget information through a dedicated form. For example, if a user prefers short hair, dry skin, and casual clothing, they enter this information and also set their ideal appearance and monthly beauty budget.

[1414] Terminal: Once the input is complete, the user presses the send button to send the input information to the server.

[1415] 2. Data Reception and Analysis

[1416] Server: Receives user input information and stores it in an internal database. Then, passes the received data to the generation AI.

[1417] Generative AI: Analyzes the received data and compares the user's current condition with their ideal appearance, for example, suggesting moisturizing cream to combat dry skin or planning a haircut to achieve their ideal hairstyle.

[1418] 3. Plan generation and display

[1419] Generative AI: Based on user data, it generates the optimal plan for hairstyle, skin condition, and clothing style. It also takes into account budget information and lists available items and services.

[1420] Server: Sends the plans and recommendations created by the generation AI to the user device.

[1421] Device: The user can view the generated plan on their device and refer to their daily execution plan. Examples include the skin care products the user uses daily and a haircut schedule.

[1422] Specific examples

[1423] User: Create a new account and enter your hairstyle (short hair), skin condition (dry skin), and preferred clothing style (casual). Your ideal look is "simple and clean," and you set your monthly budget at 10,000 yen.

[1424] Server: Receives the input information and sends it to the generating AI.

[1425] Generative AI: Suggests moisturizing creams for dry skin, recommends simple and casual fashion items, and generates a two-weekly haircut plan for maintaining short hair.

[1426] Server: Sends the generated plan to the user terminal.

[1427] Device: Displays suggested skin care products and clothing ideas, allowing users to carry out daily care and shopping accordingly.

[1428] In this way, users can easily take concrete actions to get closer to their ideal appearance with the help of generative AI.

[1429] The processing flow will be explained below.

[1430] Step 1:

[1431] Terminal: The user launches the application and logs in or creates a new account. In the case of a new account, the user enters the required personal information (email address, password, etc.) to create the account.

[1432] Step 2:

[1433] Terminal: The user inputs their hairstyle, skin condition, clothing style, and budget information on the application screen. For example, the user selects "short hair," "dry skin," and "casual clothing style," and inputs "10,000 yen" as budget information.

[1434] Step 3:

[1435] Device: The user takes a photo of their hairstyle and skin condition and uploads it through the app.

[1436] Step 4:

[1437] Device: The user answers a questionnaire about their ideal appearance. For example, they may write that they are aiming for a "simple and clean look."

[1438] Step 5:

[1439] Terminal: Once the input is complete, the user presses the send button to send the input information and photo to the server.

[1440] Step 6:

[1441] Server: Receives user input information and photos and stores them in a built-in database.

[1442] Step 7:

[1443] Server: Passes the received data to the generation AI for analysis, verifying that the data is in the correct format.

[1444] Step 8:

[1445] Generative AI: Analyzes the received user data and compares the user's current data (hairstyle, skin condition, clothing style) with the ideal data.

[1446] Step 9:

[1447] Generative AI: Based on the analysis results, it generates a plan to help the user achieve their ideal appearance, such as "recommending moisturizing creams for dry skin" and "a plan for cutting hair every two weeks to maintain short hair."

[1448] Step 10:

[1449] Generative AI: Considers the user's budget information, checks whether the suggested items and services can be purchased within the budget, and generates a list of available goods and services.

[1450] Step 11:

[1451] Server: Sends the generated plans and recommendations to the user device.

[1452] Step 12:

[1453] On Device: The user can view the generated plan on their device, which includes daily skin care routines, weekly hair care plans, and monthly fashion updates.

[1454] Step 13:

[1455] Terminal: The user accesses the link to purchase the suggested items and does their online shopping.

[1456] Step 14:

[1457] Server: Periodically collects user progress data and passes it to the generation AI. The collected data includes the results of actions taken by the user and feedback.

[1458] Step 15:

[1459] Generative AI: Analyzes collected data and evaluates the effectiveness of the plan, then optimizes it as needed.

[1460] Step 16:

[1461] Server: Sends the new optimized plan to the user's device, which then takes the next step.

[1462] In this way, users can easily take concrete actions to get closer to their ideal appearance using generative AI.

[1463] Example 1

[1464] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1465] The present invention relates to a system that automatically generates a specific plan for a user to efficiently fulfill their appearance-related desires. Conventional methods require users to collect information on beauty and fashion and create their own plans, which is a very time-consuming process. Furthermore, individual beauty and fashion information is not centralized, making it difficult for users to find appropriate products and services. This presents a challenge for users, making it difficult to efficiently and effectively achieve their ideal appearance.

[1466] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1467] In this invention, the server includes means for a user to input information about their hairstyle, skin condition, clothing style, and budget, means for transmitting the information input by the user to the server, means for the server to pass the received information to a generation AI for analysis, means for the generation AI to compare the user's current data with ideal data and generate a plan to achieve an optimal appearance, means for transmitting the generated plan to a user terminal and displaying it, means for the server to store the user's input information in a database, means for the generation AI to retrieve data from the database to create a plan, and means for the user terminal to display a daily implementation plan. This allows users to easily obtain a specific plan to achieve their ideal appearance and carry out their daily beauty and fashion routines.

[1468] "User" refers to a person who uses the system to input information about their own appearance and ideal appearance.

[1469] "Hairstyle" refers to information indicating the state of the user's hair, such as style and length.

[1470] "Skin condition" refers to information that indicates the condition or characteristics of the user's skin, such as dry skin or oily skin.

[1471] "Clothing style" refers to information about the type, design, and fashion of clothing that the user prefers.

[1472] "Budget information" refers to information indicating the amount of money a user can spend on beauty and fashion within a certain period of time.

[1473] "Device" refers to the device used by a user to input and transmit their appearance information to a server. Examples include smartphones and tablets.

[1474] "Server" refers to a component that receives information sent from the user terminal and passes it on to the generation AI.

[1475] "Database" means the data storage system used by the Server to organize and store User information.

[1476] "Generative AI" refers to artificial intelligence that analyzes user information passed from the server, compares the user's current data with their ideal data, and generates a plan to achieve their optimal appearance.

[1477] A "plan" refers to a plan created by the generative AI based on the user's information, showing specific actions and recommendations to move closer to their ideal appearance.

[1478] "User terminal" refers to a device for receiving the generated plan and displaying it to the user.

[1479] The present invention relates to a system in which a user inputs their own appearance data and ideal image, and a generation AI analyzes the data and generates a specific plan to help the user approach their ideal appearance. Detailed embodiments of the present invention are described below.

[1480] System configuration

[1481] User terminal

[1482] The terminal is a device that allows users to input information about their hairstyle, skin condition, clothing style, and budget using their own smartphone, tablet, etc. The input information is sent to the server via the terminal.

[1483] server

[1484] The server receives the user information sent from the device and stores it in a database. The server also passes this data to the generation AI for analysis.

[1485] Generation AI

[1486] The generation AI analyzes the data passed from the server and compares the user's current data with their ideal data. This generates a specific plan and recommendations to help them achieve their ideal appearance, which are then sent to the user's device via the server.

[1487] Hardware and software used

[1488] Hardware:

[1489] User devices such as smartphones and tablets

[1490] Server for data storage and analysis

[1491] software:

[1492] An application that provides a user interface

[1493] Generative AI models that analyze data

[1494] Specific examples

[1495] Enter and submit information

[1496] The user launches the application and enters information about their hairstyle, skin condition, clothing style, and budget through a dedicated form. For example, if the user prefers short hair, dry skin, and a casual clothing style, they enter this information, as well as their ideal appearance and monthly beauty budget. Once the input is complete, the user presses the submit button, which sends the entered information to the server.

[1497] Data reception and analysis

[1498] The server receives the user's input, stores it in an internal database, and then passes the data to the AI ​​generator, which analyzes the data and compares the user's current appearance with their ideal appearance. For example, this could include suggesting a moisturizing cream to combat dry skin or a haircut plan to achieve their ideal hairstyle.

[1499] Plan Generation and Display

[1500] The generation AI generates an optimal plan based on the user's data, taking into account hairstyle, skin condition, and clothing style, and also lists items and services that can be purchased, taking into account budget information. The server sends the plan and recommendations created by the generation AI to the user's device, and the user can check the generated plan on their device and refer to their daily execution plan. Specific examples include the user's daily skin care products and haircut schedule.

[1501] Example prompts for generative AI models

[1502] "Please suggest a specific plan for a user with short hair and dry skin to achieve a clean look with a casual clothing style."

[1503] "Make a list of the products and services you need to combat dry skin and maintain short hair within a monthly budget of ¥10,000."

[1504] In this way, users can easily take concrete actions to get closer to their ideal appearance with the help of generative AI.

[1505] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1506] Step 1:

[1507] The user launches an application.

[1508] Specific operation: The user taps and launches the dedicated application on their smartphone or tablet.

[1509] Input: The user operates the device to launch the app.

[1510] Output: A dedicated form is displayed.

[1511] Step 2:

[1512] Users enter hairstyle, skin condition, clothing style, and budget information into a dedicated form.

[1513] Specific operation: The user enters hairstyle (e.g., short hair), skin condition (e.g., dry skin), clothing style (e.g., casual), and budget information (e.g., 10,000 yen) into the form.

[1514] Input: The user enters information into the form.

[1515] Output: The input information is kept within the application.

[1516] Step 3:

[1517] The user presses the send button to send the input information to the server.

[1518] Specific behavior: When the user has completed filling out the form, they tap the submit button.

[1519] Input: The action of the user pressing the submit button.

[1520] Output: The input information is sent to the server.

[1521] Step 4:

[1522] The server receives the information sent by the user.

[1523] Specific operation: The server processes data received from the user terminal in real time.

[1524] Input: Information sent from the user's device.

[1525] Output: The received information is saved on the server.

[1526] Step 5:

[1527] The server stores the received data in a database.

[1528] Specific operation: The server stores the received information in an internal database.

[1529] Input: Received information.

[1530] Output: Information stored in a database.

[1531] Step 6:

[1532] The server retrieves the necessary data from the database and passes it to the generation AI.

[1533] Specific operation: The server reads user information from the database and sends it to the generation AI.

[1534] Input: User information retrieved from the database.

[1535] Output: User information passed to the generation AI.

[1536] Step 7:

[1537] The generative AI analyzes the user's information and compares the current data with the ideal data.

[1538] Specific operation: The generating AI compares the user's current data (entered hairstyle, skin condition, etc.) with the ideal data and identifies any gaps.

[1539] Input: User's current and ideal data.

[1540] Output: Analysis results based on gaps.

[1541] Step 8:

[1542] Generative AI creates the optimal plan.

[1543] Specific operation: Based on the analysis results, the generation AI generates a plan to help the user achieve their ideal appearance.

[1544] Input: Analysis results.

[1545] Output: Optimal plan and recommendations.

[1546] Step 9:

[1547] The plan created by the generation AI is sent to the server.

[1548] Specific operation: The generation AI sends the generated plan to the server.

[1549] Input: The generated plan.

[1550] Output: The plan sent to the server.

[1551] Step 10:

[1552] The server transmits the plan to the user terminal.

[1553] Specific operation: The server sends the plan received from the generation AI to the user terminal.

[1554] Input: The plan received from the generation AI.

[1555] Output: The plan sent to the user device.

[1556] Step 11:

[1557] The user checks the plan on the device and refers to the daily execution plan.

[1558] Specific behavior: The user views the plan on their device and performs the recommended actions.

[1559] Input: The plan received from the server.

[1560] Output: Daily execution plan based on the plan.

[1561] (Application example 1)

[1562] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1563] In conventional beauty and fashion planning, it was difficult for users to obtain specific advice to get closer to their ideal appearance. Furthermore, there was no system that analyzed the user's appearance data and ideal data and provided a plan tailored to individual needs, so users had to spend a lot of time and effort. Furthermore, proposals rarely took budget information into account, making it difficult to obtain a feasible plan.

[1564] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1565] In this invention, the server includes means for a user to input information about their hairstyle, skin condition, clothing style, and budget, means for transmitting the information input by the user to the server, means for the server to pass the received information to a generation AI for analysis, means for the generation AI to compare the user's current data with ideal data and generate a plan to achieve an optimal appearance, means for transmitting the generated plan to a user terminal and displaying it, means for visualizing the generated plan and presenting it to the user, and means for the user to set their ideal appearance and use that data for analysis. This allows the user to easily take specific actions to achieve their ideal appearance and obtain a workable plan that fits their budget.

[1566] "User" refers to an individual who utilizes the system to input their own appearance data and receive a plan to achieve their ideal appearance.

[1567] "Hairstyle" is information that indicates the current state of the user's hairstyle.

[1568] "Skin condition" is information that indicates the user's skin condition (e.g., dry skin, oily skin).

[1569] "Clothing style" is information that indicates the fashion style (e.g., casual, formal) that the user prefers.

[1570] "Budget information" is information that indicates the amount of budget that a user will spend on beauty and fashion for each month and year.

[1571] The "server" is a relay device that passes information received from the user to the generation AI and transmits the generated plan to the user's terminal.

[1572] "Generative AI" is an artificial intelligence that analyzes the user's appearance data and ideal data received and generates a plan to approach the optimal appearance.

[1573] A "plan" is a proposal made by the generative AI after analyzing the user's data, including a specific action plan and a list of items to help them achieve their ideal appearance.

[1574] A "user terminal" is an electronic device (e.g., a smartphone or tablet) through which a user inputs data and receives the generated plan.

[1575] "Visualization" is the process of visually displaying the generated plan and presenting it to the user.

[1576] "Ideal appearance" refers to the image of one's appearance that a user sets as a goal to aim for.

[1577] The system for implementing this invention begins when a user uses a device such as a smartphone or tablet to input information about their hairstyle, skin condition, clothing style, and budget, and sends it to a server. The server then passes the received user data to a generation AI, which analyzes the data, compares the user's current data with their ideal data, and generates a plan to achieve their optimal appearance. The generated plan is then sent to the user's device via the server, where it is visualized and presented to the user.

[1578] Hardware and software used

[1579] Hardware

[1580] Smartphones / Tablets: Used as devices for users to input data.

[1581] Server: A relay device that passes data received from the user to the generation AI and sends the generated plan to the user's terminal.

[1582] Cloud Server: Hosts the generative AI and provides the necessary computing resources.

[1583] software

[1584] Flask (server side): A lightweight Python web framework that provides API endpoints.

[1585] Generative AI model (e.g., GPT-3): An artificial intelligence that analyzes user data and generates an appearance improvement plan.

[1586] Requests (client side): A Python HTTP library used to send data.

[1587] Specific system behavior

[1588] Enter and submit information

[1589] The user starts the smartphone application and enters information about their hairstyle, skin condition, clothing style, and budget into a dedicated form. For example, the user may have short hair, dry skin, a preference for casual clothing, and a monthly budget of 10,000 yen. Once the information is complete, it is sent to the server.

[1590] Data reception and analysis

[1591] The server receives the user's input and stores it in an internal database. The received data is then passed to the generation AI, which compares the user's current condition with their ideal appearance and generates an optimal plan. Specific examples include recommendations for moisturizing creams for dry skin and haircut plans to achieve the ideal hairstyle.

[1592] Plan Generation and Display

[1593] The plan created by the AI ​​is sent to the user's device via the server, where it is visualized and displayed, allowing the user to refer to their daily plan, including, for example, the skin care products they use every day and their haircut schedule.

[1594] Prompt Sentence Examples

[1595] User's current data:

[1596] Hairstyle: Short hair

[1597] Skin condition: Dry skin

[1598] Clothing style: Casual

[1599] Budget: 10,000 yen

[1600] Ideal appearance:

[1601] Simple and clean appearance

[1602] Suggest beauty and fashion plans to help users achieve their ideal appearance.

[1603] This system allows users to easily take specific actions to get closer to their ideal appearance and provides a workable plan that fits their budget.

[1604] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1605] Step 1:

[1606] The user launches a dedicated application on their smartphone or tablet and enters their hairstyle, skin condition, clothing style, and budget information. Specifically, the user specifies that they prefer short hair, dry skin, and casual clothing, and sets their monthly budget to 10,000 yen. Once the information is complete, they press the send button in the application to send the information to the server.

[1607] Input: Hairstyle, skin condition, clothing style, budget information

[1608] Output: User appearance data and budget information sent to the server

[1609] Step 2:

[1610] The server temporarily stores the received user appearance data and budget information in an internal database, then packets the stored data for transmission to the generation AI and sends it to the generation AI's analysis process.

[1611] Input: User appearance data and budget information

[1612] Output: Data packet sent to the generating AI

[1613] Step 3:

[1614] The generative AI analyzes the received data and compares the user's current condition with the ideal appearance data. The analysis may, for example, suggest a moisturizing cream for dry skin or a haircut plan to maintain short hair. This analysis generates a beauty and fashion plan to bring the user closer to their optimal appearance.

[1615] Input: User's appearance data and ideal appearance data

[1616] Output: Generated appearance improvement plan

[1617] Step 4:

[1618] The server analyzes the appearance improvement plan received from the generation AI and formats it for transmission to the user's device. The plan contents include specific beauty product and service recommendations, usage instructions, and implementation schedules.

[1619] Input: Generated appearance improvement plan

[1620] Output: Formatted plan data sent to the user device

[1621] Step 5:

[1622] The user device visualizes the received plan and displays it to the user. The user can then review the plan generated on the application and take specific actions, such as incorporating suggested skin care products or haircut schedules into their daily lives.

[1623] Input: Formatted plan data

[1624] Output: Visualized appearance improvement plan

[1625] This allows users to easily take specific actions to get closer to their ideal appearance and obtain a workable plan that fits their budget.

[1626] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1627] This invention relates to a system in which a user inputs their own appearance data and ideal image into the system, and a generation AI analyzes the data to generate a plan to bring the user closer to their ideal appearance. Furthermore, by combining it with an emotion engine, the system has the function of recognizing the user's emotions and adjusting the plan based on those emotions. By inputting the user's hairstyle, skin condition, clothing style, and budget information, and incorporating emotional data, the system makes more personalized and effective beauty and fashion recommendations.

[1628] System configuration

[1629] User terminal

[1630] Device: The user uses a device such as a smartphone or tablet to input information about their hairstyle, skin condition, clothing style, and budget. Emotional data is acquired using text input, voice input, and even facial recognition technology. The input information is sent to the server via the device.

[1631] server

[1632] Server: Receives user information and emotion data sent from the device and stores it in a built-in database. The server passes this data to the generation AI and emotion engine for analysis.

[1633] Generation AI

[1634] Generative AI: Analyzes the data passed from the server and compares the user's current data with the ideal data. The Generative AI also takes into account the emotional data obtained from the user's emotion engine to generate a plan that will best satisfy the user.

[1635] Emotion Engine

[1636] Emotion engine: Analyzes the user's emotional data passed from the server and recognizes the user's current emotional state. This information is provided to the generative AI, contributing to the optimization of the plan.

[1637] Program processing

[1638] 1. Enter and submit information

[1639] Device: The user launches the application and logs in or creates a new account. They enter their hairstyle, skin condition, clothing style, and budget information, and then run questions and facial recognition to assess the user's emotions.

[1640] Terminal: After all information is entered, the user presses the send button to send the information and emotion data to the server.

[1641] 2. Data Reception and Analysis

[1642] Server: Receives user input information and emotion data, stores it in a database, and passes the received data to the generation AI and emotion engine.

[1643] Generative AI: Analyzes the received data and combines the user's current data (hairstyle, skin condition, clothing style), ideal data, and emotional data to generate the optimal plan.

[1644] 3. Plan generation and display

[1645] Generative AI: Based on user data, it generates optimal plans for hairstyle, skin condition, and clothing style, and adjusts them to maximize user satisfaction by taking into account data from the emotion engine. It also takes into account the user's budget information and lists items and services that can be purchased.

[1646] Server: Sends the generated plans and recommendations to the user device.

[1647] Device: The user can view the generated plan on their device and refer to their daily action plan, including the skin care products they use every day and their haircut schedule.

[1648] Specific examples

[1649] 1. User: Create a new account and enter your hairstyle (short hair), skin condition (dry skin), and preferred clothing style (casual). Fill out a questionnaire and select "simple and clean appearance" as your ideal appearance, and set your monthly budget at 10,000 yen. Also, enter emotional information such as "I've been feeling tired lately" or "I'm feeling stressed" as an emotional assessment.

[1650] 2. Server: Receives input information and emotion data and sends it to the generative AI and emotion engine.

[1651] 3. Generative AI: It can suggest moisturizing creams for dry skin, recommend simple and casual fashion items, and create a two-weekly haircut plan to maintain short hair. It also uses the analysis results of the emotion engine to suggest relaxing spa services and refreshing activities for users.

[1652] 4. Server: Sends the generated plan to the user terminal.

[1653] 5. Device: Displays suggested skin care products, outfit ideas, and even relaxing services, allowing users to carry out their daily care and shopping accordingly.

[1654] In this way, users can easily take concrete actions to get closer to their ideal appearance, with the assistance of generative AI and an emotion engine.

[1655] The processing flow will be explained below.

[1656] System processing flow and specific steps

[1657] Step 1:

[1658] Terminal: The user launches the application and logs in or creates a new account. In the case of a new account, the user enters the required personal information (email address, password, etc.) to create the account.

[1659] Step 2:

[1660] Terminal: The user inputs their hairstyle, skin condition, clothing style, and budget information on the application screen. For example, the user selects "short hair," "dry skin," and "casual clothing style," and inputs "10,000 yen" as budget information.

[1661] Step 3:

[1662] Device: The user takes a photo of their hairstyle and skin condition and uploads it through the app.

[1663] Step 4:

[1664] Device: The user answers a questionnaire about their ideal appearance. For example, they may write that they are aiming for a "simple and clean look."

[1665] Step 5:

[1666] Terminal: The user fills out a form to input their emotional state. For example, they can input emotional information such as "I've been feeling tired recently" or "I'm stressed." Alternatively, they can use facial recognition to collect emotional data and obtain real-time emotional states.

[1667] Step 6:

[1668] Terminal: Once the input is complete, the user presses the send button to send the input information, photo, and emotion data to the server.

[1669] Step 7:

[1670] Server: Receives user input information and emotion data and stores them in a built-in database.

[1671] Step 8:

[1672] Server: Passes the received data to the generation AI and emotion engine for analysis, and verifies that the data is in the correct format.

[1673] Step 9:

[1674] Generative AI: Analyzes the received user data and compares the user's current data (hairstyle, skin condition, clothing style) with the ideal data.

[1675] Step 10:

[1676] Emotion Engine: Analyzes received emotion data and recognizes the user's emotional state. This information is provided to the generative AI, which then contributes to optimizing the plan.

[1677] Step 11:

[1678] Generative AI: Based on the analysis results, it generates a plan to help the user achieve their ideal appearance. For example, it creates a "moisturizing cream recommendation for dry skin" or a "haircut plan every two weeks to maintain short hair." It adjusts the plan to maximize user satisfaction, taking into account data from the emotion engine.

[1679] Step 12:

[1680] Generative AI: Considers the user's budget information, checks whether the suggested items and services can be purchased within the budget, and generates a list of available goods and services.

[1681] Step 13:

[1682] Server: Sends the generated plans and recommendations to the user device.

[1683] Step 14:

[1684] On Device: The user can view the generated plan on their device, which includes daily skin care routines, weekly hair care plans, and monthly fashion updates.

[1685] Step 15:

[1686] Terminal: The user accesses the link to purchase the suggested items and does their online shopping.

[1687] Step 16:

[1688] Server: Periodically collects user progress data and passes it to the generative AI and emotion engine. The collected data includes the results of actions taken by the user and feedback.

[1689] Step 17:

[1690] Generative AI: Analyzes collected data and evaluates the effectiveness of the plan, then optimizes it as needed.

[1691] Step 18:

[1692] Server: Sends the new optimized plan to the user's device, which then takes the next step.

[1693] In this way, users can easily take concrete actions to get closer to their ideal appearance, with the assistance of generative AI and an emotion engine.

[1694] Example 2

[1695] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1696] Conventional appearance improvement systems generate plans based solely on user input, making it difficult to provide an optimal plan that takes into account the user's emotional state and daily changes. Furthermore, they may not adequately propose specific actions that satisfy the user or fit their budget. Therefore, there is a need for a system that provides an individually optimized appearance improvement plan that takes into account the user's emotional state.

[1697] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for storing user information and emotional data in a database, means for transferring the stored information to the analysis module, and means for the generation AI to generate a plan by integrating the user's current data, ideal data, and emotional data. This enables comprehensive data analysis, including the user's emotional state, and makes it possible to provide an individually optimized, high-quality appearance improvement plan.

[1698] "User" refers to an individual who uses the System to create and implement their own appearance improvement plan.

[1699] "Server" refers to the computer system that receives and stores information entered by users and passes that data to the analysis module.

[1700] "Generative AI" refers to artificial intelligence that generates an optimal appearance improvement plan based on the user's current data, ideal data, and emotional data.

[1701] "Emotion data" refers to information that reflects the user's current emotional state, and refers to data obtained by text input, voice input, facial recognition, etc.

[1702] A "plan" refers to the suggestions that the generative AI makes after analyzing the user's data, including specific actions and recommended items to help the user achieve their ideal appearance.

[1703] "Database" refers to an electronic storage device where the server stores user information and emotion data.

[1704] An "analysis module" refers to a combination of software and hardware that allows the generation AI and emotion engine to analyze data based on data passed from the server.

[1705] "Current status data" refers to information entered by the user that indicates current physical characteristics such as hairstyle, skin condition, clothing style, etc.

[1706] "Ideal data" refers to specific information about the user's desired appearance, and refers to data entered in a questionnaire or as a preference.

[1707] "Budget Information" refers to the amount of money a user can spend on improving their appearance in a month or a specific period of time.

[1708] This invention is a system in which a user inputs their own appearance data and ideal image into the system, and a generation AI analyzes the data to generate a plan to bring the user closer to their ideal appearance. Furthermore, by combining it with an emotion engine, it has the function of recognizing the user's emotions and adjusting the plan based on those emotions. A specific embodiment of this system will be described below.

[1709] System configuration

[1710] User terminal

[1711] Device: The user uses a device such as a smartphone or tablet to input information about their hairstyle, skin condition, clothing style, and budget. Emotional data is acquired using text input, voice input, and even facial recognition technology. The input information is sent to the server via the device.

[1712] server

[1713] Server: The server receives user information and emotion data sent from the device and stores it in a built-in database. The stored data is then passed to the generative AI and emotion engine for analysis.

[1714] Generation AI

[1715] Generative AI: Analyzes the data passed from the server and compares the user's current data with their ideal data. The Generative AI also takes into account the emotional data obtained from the emotion engine to generate a plan that will best satisfy the user.

[1716] Emotion Engine

[1717] Emotion engine: Analyzes the user's emotional data passed from the server and recognizes the user's current emotional state. This information is provided to the generative AI, contributing to the optimization of the plan.

[1718] System Operation

[1719] 1. Enter and submit information

[1720] Users launch the application, log in or create a new account, enter their hairstyle, skin condition, clothing style, and budget information, and then run questions and facial recognition to assess the user's emotions.

[1721] After all the information has been entered, the terminal presses the send button to send the information and emotion data to the server.

[1722] 2. Data Reception and Analysis

[1723] The server receives the user's input information and emotion data, stores it in a database, and passes the received data to the analysis module.

[1724] The generation AI analyzes the received data and combines the user's current data (hairstyle, skin condition, clothing style), ideal data, and emotional data to generate the optimal plan.

[1725] 3. Plan generation and display

[1726] The generative AI uses user data to generate optimal plans for hairstyle, skin condition, and clothing style, and adjusts them to maximize user satisfaction by taking into account data from the emotion engine. It also takes into account the user's budget information to list items and services that can be purchased.

[1727] The server transmits the generated plan and recommendations to the user terminal.

[1728] On the terminal, the user can check the generated plan and refer to the daily execution plan.

[1729] Specific examples

[1730] 1. User: Create a new account and enter your hairstyle (short hair), skin condition (dry skin), and preferred clothing style (casual). Fill out a questionnaire and select "simple and clean appearance" as your ideal appearance, and set your monthly budget at 10,000 yen. Also, enter emotional information such as "I've been feeling tired lately" or "I'm feeling stressed" as an emotional assessment.

[1731] Example prompt: "Please tell us about your hairstyle, skin condition, clothing style, and monthly budget. Also, tell us about your recent emotional state. For example, have you been feeling tired or stressed lately?"

[1732] 2. Server: Receives input information and emotion data and sends it to the generative AI and emotion engine.

[1733] 3. Generative AI: It can suggest moisturizing creams for dry skin, recommend simple and casual fashion items, and create a two-weekly haircut plan to maintain short hair. It also uses the analysis results of the emotion engine to suggest relaxing spa services and refreshing activities for users.

[1734] 4. Server: Sends the generated plan to the user terminal.

[1735] 5. Terminal: Displays suggested skin care products, clothing ideas, and even relaxing services, allowing users to follow their daily care and shopping accordingly.

[1736] In this way, users can easily take concrete actions to get closer to their ideal appearance, with the assistance of generative AI and an emotion engine.

[1737] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1738] Specific processing steps of the program

[1739] Step 1:

[1740] A user launches the application and creates a new account or logs in. Data entered includes hairstyle, skin condition, clothing style, and budget information.

[1741] Input: Hairstyle, skin condition, clothing style, and budget information from the user.

[1742] Output: Temporarily saves input data.

[1743] Specific operation: The user enters the necessary information into the form. For example, the user enters data such as "hairstyle: short hair," "skin condition: dry skin," "clothing style: casual," and "budget: 10,000 yen."

[1744] Step 2:

[1745] The device requests the input of emotional data, and the user inputs the emotional data by answering questions or using facial recognition technology.

[1746] Input: User emotion data (text responses, voice input, facial recognition).

[1747] Output: Temporary storage of emotion data.

[1748] Specific operation: The user inputs their emotional state, such as "I've been feeling tired lately" or "I'm feeling stressed." Using facial recognition technology, the system can determine whether they are smiling or tired.

[1749] Step 3:

[1750] The device sends all user information and emotion data to the server.

[1751] Input: User information and emotion data collected in the previous step.

[1752] Output: Data packets sent to the server.

[1753] Specific operation: Press the send button to generate a data packet and upload it to the server.

[1754] Step 4:

[1755] The server stores the received data in a database.

[1756] Input: Data packets sent from the terminal.

[1757] Output: User information and emotion data stored in a database.

[1758] Specific operation: The server executes an SQL query to store the received data in a database.

[1759] Step 5:

[1760] The server passes the stored data to the generative AI and emotion engine.

[1761] Input: Information stored in a database.

[1762] Output: The data passed to the analysis module.

[1763] Specific operation: The server reads data from the database and sends it to the generative AI and emotion engine using an API.

[1764] Step 6:

[1765] The generative AI analyzes the user's current situation, ideal data, and emotional data.

[1766] Input: All user information passed from the server.

[1767] Output: The optimal appearance plan as a result of the analysis.

[1768] Specific operation: The generative AI analyzes the data and creates a plan, such as "This moisturizing cream is for dry skin" or "A haircut plan to maintain short hair."

[1769] Step 7:

[1770] The emotion engine adjusts the plan based on the user's emotional data.

[1771] Input: Emotion data and initial plan for generative AI.

[1772] Output: The adjusted optimization plan.

[1773] What it does: The emotion engine takes into account emotional data such as "I'm tired" and adds a relaxing spa service to the plan.

[1774] Step 8:

[1775] Based on the adjusted plan, the generative AI will list items and services that fit the user's budget.

[1776] Inputs: Adjusted optimization plan, budget information.

[1777] Output: A list of items and services available for purchase.

[1778] Specific operation: The AI ​​extracts items that can be purchased within the budget from a product database and creates a list.

[1779] Step 9:

[1780] The server transmits the generated plan and list to the user terminal.

[1781] Input: Plans and service list created by the generative AI.

[1782] Output: Plans and lists sent to user terminal.

[1783] Specific operation: The server packages the plan and list in JSON format or similar and sends it to the user's terminal.

[1784] Step 10:

[1785] The terminal displays the proposed plan to the user.

[1786] Input: Plan and list sent from the server.

[1787] Output: Plan and specific actions displayed on the device screen.

[1788] Specific operation: The terminal app displays the plan and list on the GUI, allowing the user to check it and carry out daily care and purchases.

[1789] (Application example 2)

[1790] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1791] Conventional fashion and beauty recommendation systems have struggled to analyze a user's appearance data and emotional state in detail and provide recommendations tailored to individual needs. Furthermore, it has been difficult to provide personalized and effective recommendations in real time during the shopping experience in a physical store. This can cause users great stress when choosing the products and services that best suit them.

[1792] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for the user to input information about their hairstyle, skin condition, clothing style, and budget; means for transmitting the information input by the user to the server; means for the server to pass the received information to a generation AI for analysis; means for the generation AI to compare the user's current data with ideal data and generate a plan to achieve an optimal appearance; means for transmitting the generated plan to the user's terminal and displaying it; means including an emotion engine for analyzing emotion data; means for the generation AI to adjust the plan taking the emotion data into consideration; and means for providing personalized suggestions to the user in a physical store. This allows users to receive optimized fashion and beauty suggestions based on their individual appearance and emotion data, significantly improving the shopping experience in a physical store.

[1793] A "user terminal" is an information processing device that allows a user to input information and check proposed plans.

[1794] The "server" is a central processing unit that receives information sent by users and analyzes it using generative AI and an emotion engine.

[1795] "Generative AI" is an artificial intelligence technology that analyzes a user's appearance and emotional data to generate the optimal plan.

[1796] An "emotion engine" is a system that analyzes a user's emotional data and recognizes their emotional state.

[1797] "Emotion data" is information that indicates the user's emotional state, and is data that is acquired using text input, facial recognition technology, or the like.

[1798] A "brick and mortar store" is a physical location where users actually visit and purchase products.

[1799] "Personalized suggestions" are suggestions that are customized based on the user's individual appearance and emotional data.

[1800] "Appearance data" refers to information related to the user's appearance, such as hairstyle, skin condition, and clothing style.

[1801] "Budget information" is information about the amount of money a user can spend on beauty and fashion.

[1802] A "plan" is a specific plan created by the generative AI based on the user's current data and ideal data to help the user get closer to their ideal appearance.

[1803] This invention relates to a system in which a user inputs their own appearance data and ideal image, and a generation AI analyzes it to generate a plan to bring the user closer to their ideal appearance. Furthermore, by combining it with an emotion engine, it is possible to recognize the user's emotions and adjust the plan based on those emotions.

[1804] System Overview

[1805] User terminal

[1806] The user terminal is an information processing device such as a smartphone or tablet that allows the user to input information about their hairstyle, skin condition, clothing style, budget, and emotional data. The emotional data is acquired using text input, voice input, or facial recognition technology. For example, after a user launches an application and logs in or creates a new account, they input specific appearance information and evaluate their emotional state. This information is then transmitted to a server via the terminal.

[1807] server

[1808] The server is a central processing unit that receives information sent from the user's device and analyzes it using the generation AI and emotion engine. The received data is stored in a database and analyzed. The generation AI on the server compares the user's appearance data with their ideal data and generates an optimal plan. The emotion engine also analyzes the user's emotion data and provides that information to the generation AI to help adjust the plan.

[1809] Generation AI

[1810] The AI ​​analyzes the user's hairstyle, skin condition, clothing style, budget information, and emotional data, and combines the user's current and ideal data to generate an optimal plan. For example, it might suggest a moisturizing cream for dry skin entered by the user, or list fashion items based on the user's preferred clothing style. It also takes emotional data into account to suggest relaxing spa services and refreshing activities for the user.

[1811] Emotion Engine

[1812] The emotion engine is a system that analyzes the user's emotional data passed from the server and recognizes their emotional state. For example, based on information entered by the user such as "I've been feeling stressed recently," it provides the AI ​​with suggestions to help the user relax.

[1813] Specific examples

[1814] Here is an example where a user enters the following information using a smartphone app.

[1815] Hairstyle: Short cut

[1816] Skin condition: Dry skin

[1817] Favorite clothing style: Casual

[1818] Budget information: 10,000 yen

[1819] Emotional information: "I've been feeling stressed lately"

[1820] An example of a prompt is

[1821] "I'm a 24-year-old woman with short hair, dry skin, a preference for casual styles, a budget of ¥10,000, and I've been feeling stressed lately. Could you recommend some clothes and cosmetics?"

[1822] The server receives the information entered by the user and analyzes it using a generative AI and emotion engine. Based on this analysis, it can suggest moisturizing creams for dry skin and list casual fashion items. It can also suggest relaxing spa services, taking into account the user's emotional data, such as "I've been feeling stressed lately."

[1823] In this way, users can easily take concrete actions to get closer to their ideal appearance, with the assistance of generative AI and an emotion engine.

[1824] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1825] Step 1:

[1826] A user launches a smartphone application and logs in or creates a new account. The user inputs their hairstyle, skin condition, clothing style, budget information, and emotional information. This data is temporarily saved within the application. The input information includes hairstyle as "short cut," skin condition as "dry skin," clothing style as "casual," budget information as "10,000 yen," and emotional information as "feeling stressed recently."

[1827] Step 2:

[1828] The terminal sends all input information to the server, where the input data is transferred to the server via a network. This transferred data includes information about the user's appearance and emotion data.

[1829] Step 3:

[1830] The server stores the received user data in its built-in database. The specific action of saving the data is to write to the database. The received data is managed in association with the user ID.

[1831] Step 4:

[1832] The server passes the saved user data to the generation AI, which begins analysis. The user's hairstyle, skin condition, clothing style, budget information, and emotional information are used as input for analysis. The generation AI uses this data to compare the user's current data with their ideal data and generate the optimal plan. Specific operations include the AI ​​model's calculation processing.

[1833] Step 5:

[1834] The generative AI uses an emotion engine to analyze the user's emotional data. The emotion engine analyzes the emotional data, such as "I've been feeling stressed recently," and provides the results to the generative AI. The emotion engine classifies the emotional data and analyzes emotional fluctuations.

[1835] Step 6:

[1836] The generative AI takes into account the emotional data from the emotion engine to tailor the user's plan, including specific actions such as adding suggestions to help the user relax. The final plan may include moisturizing creams for dry skin, casual clothing styles, and recommendations for relaxing spa services.

[1837] Step 7:

[1838] The server sends the generated plan to the user terminal, where it is returned to the user terminal via the network. The transmitted data includes a specific action plan and an item list.

[1839] Step 8:

[1840] The device displays the sent plan on a user interface. The user can check the suggested skin care products, fashion ideas, and relaxation services on the device and create a daily plan to put them into practice. Specifically, the plan is displayed in list format on the screen.

[1841] Through these steps, users receive a personalized plan based on their appearance and emotional data, and can take specific actions to move closer to their ideal appearance.

[1842] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1843] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1844] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1845] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1846] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1847] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1848] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1849] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1850] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1851] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1852] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1853] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1854] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1855] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1856] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1857] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1858] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1859] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1860] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1861] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1862] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1863] The following is further disclosed regarding the above embodiment.

[1864] (Claim 1)

[1865] means for a user to input their hairstyle, skin condition, clothing style, and budget information;

[1866] means for transmitting the information input by the user to a server;

[1867] A means for the server to pass the received information to the generation AI for analysis;

[1868] The AI ​​compares the user's current data with their ideal data and generates a plan to achieve their optimal appearance.

[1869] The system includes means for transmitting and displaying the generated plan at a user terminal.

[1870] (Claim 2)

[1871] The system of claim 1, further comprising means for presenting specific actions to be taken by the user based on the plan proposed by the generation AI.

[1872] (Claim 3)

[1873] The system of claim 1 , further comprising means for the generating AI to list items or services available for purchase taking into account a user's budget information.

[1874] "Example 1"

[1875] (Claim 1)

[1876] a means for the user to input their hairstyle, skin condition, clothing style, and budget information;

[1877] means for transmitting the information input by the user to a server;

[1878] A means for the server to pass the received information to the generation AI for analysis;

[1879] The AI ​​compares the user's current data with their ideal data and generates a plan to achieve their optimal appearance.

[1880] means for transmitting the generated plan to a user terminal and displaying it;

[1881] a means for the server to store the user's input information in a database;

[1882] A means for the generation AI to acquire data from a database to create a plan;

[1883] The system wherein the user terminal includes means for displaying a daily execution plan.

[1884] (Claim 2)

[1885] The system of claim 1, further comprising means for presenting specific actions to be taken by the user based on the plan proposed by the generation AI.

[1886] (Claim 3)

[1887] The system of claim 1 , further comprising means for the generating AI to list items or services available for purchase taking into account a user's budget information.

[1888] "Application Example 1"

[1889] (Claim 1)

[1890] means for a user to input their hairstyle, skin condition, clothing style, and budget information;

[1891] means for transmitting the information input by the user to a server;

[1892] A means for the server to pass the received information to the generation AI for analysis;

[1893] The AI ​​compares the user's current data with their ideal data and generates a plan to achieve their optimal appearance.

[1894] means for transmitting the generated plan to a user terminal and displaying it;

[1895] means for visualizing the generated plan and presenting it to a user;

[1896] A system that includes a means for users to set their ideal appearance and use that data for analysis.

[1897] (Claim 2)

[1898] The system of claim 1, further comprising means for presenting specific actions to be taken by the user based on the plan proposed by the generation AI.

[1899] (Claim 3)

[1900] The system of claim 1 , further comprising means for the generating AI to list items or services available for purchase taking into account a user's budget information.

[1901] "Example 2: Combining Emotion Engines"

[1902] (Claim 1)

[1903] means for a user to input their hairstyle, skin condition, clothing style, and budget information;

[1904] means for transmitting the information input by the user to a server;

[1905] means for storing the information received by the server in a database;

[1906] means for the server to pass the stored information to an analysis module;

[1907] A means for the generation AI to generate a plan by integrating the user's current situation data, ideal data, and emotional data;

[1908] The system includes means for transmitting and displaying the generated plan at a user terminal.

[1909] (Claim 2)

[1910] The system of claim 1, further comprising means for presenting specific actions to be taken by the user based on the plan proposed by the generation AI.

[1911] (Claim 3)

[1912] The system of claim 1 , further comprising means for the generating AI to take into account a user's budget information to list goods and services available for purchase.

[1913] "Application example 2 when combining emotion engines"

[1914] (Claim 1)

[1915] means for a user to input their hairstyle, skin condition, clothing style, and budget information;

[1916] means for transmitting the information input by the user to a server;

[1917] A means for the server to pass the received information to the generation AI for analysis;

[1918] The AI ​​compares the user's current data with their ideal data and generates a plan to achieve their optimal appearance.

[1919] means for transmitting the generated plan to a user terminal and displaying it;

[1920] means including an emotion engine for analyzing emotion data;

[1921] A way for generative AI to adjust its plans by taking emotional data into account;

[1922] A system including a means for providing personalized offers to a user in a physical store.

[1923] (Claim 2)

[1924] The system of claim 1, further comprising means for presenting specific actions to be taken by the user based on the plan proposed by the generation AI.

[1925] (Claim 3)

[1926] The system of claim 1 , further comprising means for the generating AI to list items or services available for purchase taking into account a user's budget information. [Explanation of symbols]

[1927] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. means for a user to input their hairstyle, skin condition, clothing style, and budget information; means for transmitting the information input by the user to a server; A means for the server to pass the received information to the generation AI for analysis; The AI ​​compares the user's current data with their ideal data and generates a plan to achieve their optimal appearance. The system includes means for transmitting and displaying the generated plan at a user terminal.

2. The system according to claim 1 , further comprising means for presenting specific actions to be taken by the user based on the plan proposed by the generation AI.

3. The system of claim 1 , further comprising means for the generating AI to list items and services available for purchase taking into account a user's budget information.

Images