System

Abstract

A system is provided.SOLUTION: The system includes a means for a user to register his / her own face photograph, a means for inputting a hair style desired by the user in a text or an image, a means having a generation AI for generating a hair style image based on the registered face photograph and the inputted desired hair style information, and a means for transmitting the generated hair style image to a user terminal and displaying it.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Many people who visit beauty salons and barber shops have difficulty communicating the hairstyle they want, which can lead to frustration due to miscommunication. It is also difficult for hairdressers to accurately understand what customers want. For this reason, there is a need for a system that allows customers to visually share the specific hairstyle they want. [Means for solving the problem]

[0005] The present invention is a system that includes a means for a user to register their own facial photo, a means for the user to input their desired hairstyle via text or image, a generation AI that generates a hairstyle image based on the registered facial photo and the input desired hairstyle information, and a means for transmitting and displaying the generated hairstyle image on the user's terminal. The system also includes a means for issuing an NFT token for the generated hairstyle image and registering it on a blockchain network, and a means for publishing the issued NFT token on a marketplace. The present invention makes it easier for users to share specific hairstyle ideas with their hairdressers, reducing communication errors and enabling monetization by making the generated hairstyle images tradable as digital tokens.

[0006] "User" refers to an individual who uses the application to input their own face photo and desired hairstyle to generate and confirm a hairstyle image.

[0007] "Face Photo" refers to an image of a user's face that the user uploads to the Application.

[0008] "Hairstyle" refers to the hair style desired by the user, and is expressed in text or an image.

[0009] "Text" refers to data in which the user inputs the hairstyle they desire in sentence form.

[0010] "Image" refers to visual data such as photographs or drawings that a user uploads to the application as a reference for the hairstyle they desire.

[0011] "Generative AI" refers to an artificial intelligence model that generates hairstyle images based on a user's facial photo and desired hairstyle information.

[0012] "Hairstyle image" refers to a visual representation of a specific hairstyle generated by the AI ​​based on the user's face photo and desired hairstyle information.

[0013] An "NFT token" is a digital certificate issued for the generated hairstyle image, and is registered and traded through a blockchain network.

[0014] A "blockchain network" refers to a distributed ledger system for distributing and sharing digital data and recording and managing transaction history.

[0015] "Marketplace" refers to the online platform where NFT tokens are traded. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] This invention relates to a system that uses generative AI to generate a specific hairstyle image by allowing users to register a photo of their face and input their desired hairstyle via text or image. This system makes it easier for users to share their specific image with their hairdresser, reducing communication errors. It is also possible to issue an NFT token for the generated hairstyle image, register it on a blockchain network, and trade it on a marketplace.

[0038] Program processing explanation

[0039] User registration phase

[0040] 1. A user installs the app and creates an account.

[0041] The user enters their name, email address, password, etc.

[0042] The terminal sends the input data to the server.

[0043] 2. The server receives the user information and stores it in a database.

[0044] The server performs a duplicate check on the user information.

[0045] After checking, if there are no problems, the user information is saved in the database.

[0046] 3. The device displays a UI to prompt the user to take a photo of their face.

[0047] It offers a photo button and the option to select from the gallery.

[0048] 4. The user takes a photo of their face or selects one from the gallery and uploads it.

[0049] The user clicks the capture button to start the camera.

[0050] After taking the photo, click the "OK" button to select the face photo.

[0051] 5. The device sends the facial photo data to the server.

[0052] The image data of the face photo is encoded and an HTTPS request is sent to the server.

[0053] 6. The server receives the facial photo and stores it in an image database.

[0054] The server stores the image in storage and associates it with the user account.

[0055] Hairstyle preference input phase

[0056] 1. The user enters the desired hairstyle in text in the app's text input field.

[0057] The user inputs a desired hairstyle, such as "short bob," into a text box.

[0058] 2. Users also have the option to upload an image of their hairstyle as a reference.

[0059] The user selects a reference image from the gallery and presses the upload button.

[0060] 3. The device receives user input or uploads and sends the data to the server.

[0061] The text data and image data are encoded together and an HTTPS request is sent to the server.

[0062] Hairstyle image generation phase

[0063] 1. The server prepares to provide the received face photo and desired hairstyle data to the generative AI model.

[0064] The server converts the face photo and desired hairstyle data into a format that the AI ​​model can understand.

[0065] 2. The generative AI model generates an image of the desired hairstyle that matches the user's face photo.

[0066] The AI ​​model generates a hairstyle image based on a face photo and text (or a reference image).

[0067] The generated image is temporarily stored in the server's storage.

[0068] 3. The server receives the generated hairstyle image and sends it to the user's device.

[0069] The generated image is encoded and sent to the user's device in an HTTPS response.

[0070] Checking the image and sharing it with the hairdresser

[0071] 1. The device displays the generated hairstyle image to the user.

[0072] Open an image viewer and view the generated hairstyle image.

[0073] 2. The user reviews the image and can request corrections if necessary.

[0074] When the user presses the "Request revision" button, a form will appear where the user can enter their desired hairstyle again.

[0075] 3. Save the image once the user has confirmed it.

[0076] Click the "Save" button to save the image to your local storage.

[0077] 4. The user shows the saved image to the hairdresser and shares the specific hairstyle image.

[0078] You can show the image directly to your hairdresser or share it on social media or messaging apps.

[0079] NFT token issuance and market registration phase

[0080] 1. The user selects the option to issue an NFT token for the generated hairstyle image.

[0081] Click the "Tokenize NFT" button in the app.

[0082] 2. The device sends a request to the server to issue an NFT token.

[0083] The necessary metadata and image data are collected and sent as a request to the server.

[0084] 3. The server generates an NFT token corresponding to the image and registers it on the blockchain.

[0085] The server communicates with the blockchain network to generate and register tokens.

[0086] 4. The server publishes information related to the issued NFT tokens to the market.

[0087] Upload token information to the NFT marketplace and notify users.

[0088] 5. Users will be able to trade tokens on the market.

[0089] Users can buy, sell, or rent tokens on the marketplace.

[0090] In this way, the present invention not only allows users to easily create and share specific hairstyle requests with their hairdressers, but also allows users to issue and trade the generated images as NFTs. This system reduces miscommunication and improves customer satisfaction.

[0091] The processing flow will be explained below.

[0092] Step 1:

[0093] A user installs and launches the app. The user proceeds to the new account creation screen and enters their name, email address, and password. The device collects this input data and, when the user presses the button to proceed to the next step, sends this data to the server.

[0094] Step 2:

[0095] The server checks for duplicates in the received user data and, if there are no problems, saves it in the database. Once the saving is complete, the server returns a message to the device indicating that account creation is complete.

[0096] Step 3:

[0097] The device displays a UI that prompts the user to take a photo of their face. The user then presses the capture button to launch the camera and take a photo of their face, or selects a photo from the gallery.

[0098] Step 4:

[0099] The user takes or selects a photo of their face and presses the confirmation button. The device encodes the image data of the photo and sends it to the server.

[0100] Step 5:

[0101] The server receives the face photo and stores it in an image database, then associates the image with the user's account.

[0102] Step 6:

[0103] Users can enter their desired hairstyle in text on the app screen, and also have the option to upload an image of the hairstyle they want as a reference.

[0104] Step 7:

[0105] The terminal collects the text data entered by the user and the hairstyle image uploaded and sends them to the server.

[0106] Step 8:

[0107] The server prepares the received face photo and desired hairstyle data to provide to the generative AI model. Specifically, the server converts the face photo and desired hairstyle text or image data into a format that the AI ​​model can understand.

[0108] Step 9:

[0109] The generative AI model uses the user's face photo and desired hairstyle data to generate a specific hairstyle image, which is temporarily stored in the server's storage.

[0110] Step 10:

[0111] The server retrieves the generated hairstyle image and encodes it for transmission to the user's device. The server then sends the hairstyle image data to the device via an HTTPS response.

[0112] Step 11:

[0113] The terminal displays the generated hairstyle image on the user's screen. If the user checks the hairstyle image and requests corrections as necessary, the data is sent to the server again.

[0114] Step 12:

[0115] The user presses the save button to save the image to local storage, and then shows the image directly to the hairdresser or shares it via social media or a messaging app to show the hairdresser the hairstyle.

[0116] Step 13:

[0117] The user selects the option to issue an NFT token for the generated hairstyle image. The device receives the user's selection and sends an NFT token issuance request.

[0118] Step 14:

[0119] The device sends a request to issue an NFT token to the server, along with metadata and image data.

[0120] Step 15:

[0121] The server generates an NFT token for the image and registers it on the blockchain network. Once complete, the issued token information is published on the marketplace.

[0122] Step 16:

[0123] Users will receive notifications and can browse and trade tokens on the marketplace, where they can buy and sell these tokens and earn revenue through trading.

[0124] Example 1

[0125] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0126] In the past, it was difficult for hairdressers and customers to share their hairstyle images, which often led to miscommunication. This could result in lower customer satisfaction. Furthermore, there was a lack of means to protect the generated hairstyle images and use them commercially.

[0127] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0128] In this invention, the server includes a means for a user to register their own facial photo, a means for the user to input their desired hairstyle using text or an image, a generation AI that generates a hairstyle image based on the registered facial photo and the input desired hairstyle information, a means for transmitting and displaying the generated hairstyle image to the user's terminal, and a means for the user to check the hairstyle image and request modifications. This allows for the generation of a specific hairstyle image that meets the user's preferences, enabling smooth communication with the hairdresser. The server also includes a means for issuing an NFT token for the generated hairstyle image and registering it on a blockchain network, and a means for publishing the issued NFT token on a marketplace, enabling the hairstyle image to be converted into a digital asset and used commercially.

[0129] A "user" is someone who uses this system to register a photo of their face and input their desired hairstyle.

[0130] "Generative AI" refers to an artificial intelligence model that generates hairstyle images based on a user's facial photo and desired hairstyle information entered.

[0131] "User terminal" refers to a device used by a user to access this system, such as a smartphone or PC.

[0132] An "NFT token" is a digital proof of ownership issued to the generated hairstyle image and registered on a blockchain network.

[0133] "Blockchain network" refers to a network that uses distributed ledger technology to record and manage data.

[0134] "Marketplace" refers to the digital marketplace where NFT tokens are bought, sold, or rented.

[0135] The "means for requesting modifications" refers to a function for re-inputting information into the system when a user desires to make changes to the generated hairstyle image.

[0136] "Means of registration" refers to the function that allows users to input and save their own face photo and desired hairstyle information into the system.

[0137] The "means for inputting a desired hairstyle" refers to a function that allows a user to provide information about a desired hairstyle using text or an image.

[0138] The "means for transmitting and displaying the generated hairstyle image" refers to a function for transferring the hairstyle image generated by the server to the user's terminal and displaying the image to the user.

[0139] This invention is a system that uses a generative AI model to generate a specific hairstyle image by allowing users to register a photo of their face and input their desired hairstyle via text or image. This system makes it easier for users to share their specific image with their hairdresser, reducing communication errors. It is also possible to issue an NFT token for the generated hairstyle image, register it on the blockchain network, and trade it on the marketplace.

[0140] Hardware and software used

[0141] Hardware: Servers (cloud servers and database servers), user devices (smartphones, PCs)

[0142] Software: AI image generation models (e.g., DALL-E), blockchain technology (e.g., Ethereum), database management systems (e.g., MySQL (registered trademark))

[0143] System Overview

[0144] 1. User Registration:

[0145] A user installs the app and creates an account by entering their name, email address, and password. The device sends this information to the server via HTTPS, and the server stores it in a database.

[0146] After creating an account, the device displays a UI that prompts the user to take a photo of their face or select one from the gallery. The user provides a photo of their face, and the data is sent from the device to the server.

[0147] The server stores the facial photo in a database and associates it with the user account.

[0148] 2. Enter your desired hairstyle:

[0149] The user enters the desired hairstyle into a text input field within the app (e.g., "short bob").

[0150] Users can also upload images of hairstyles for reference.

[0151] The terminal encodes this data and sends it to the server.

[0152] 3. Hairstyle image generation:

[0153] The server receives the face photo and desired hairstyle data and provides it to the AI ​​image generation model, which converts this data into a format that the generative AI model can understand.

[0154] The generative AI model generates an image of the desired hairstyle that matches the user's face photo. As an example of the prompt sentence, we use "A short bob hairstyle that matches this face photo."

[0155] The generated hairstyle image is temporarily stored in the server's storage and then sent to the user's device via an HTTPS response.

[0156] 4. View and share images:

[0157] The terminal displays the generated hairstyle image to the user, who can review the image and request corrections if necessary.

[0158] Save the final image and show it directly to your hairdresser or share it on social media or messaging apps.

[0159] 5. Issuance and trading of NFT tokens:

[0160] The user selects the option to issue an NFT token for the generated hairstyle image, and sends the necessary metadata and image data from the device to the server.

[0161] The server generates an NFT token corresponding to the image and registers it on the blockchain network, then publishes the token information on the marketplace and notifies users.

[0162] Users can buy, sell, or rent tokens on the marketplace.

[0163] In this way, the present invention not only allows users to easily create and share specific hairstyle requests with their hairdressers, but also allows users to issue and trade the generated images as NFTs. This system reduces miscommunication and improves customer satisfaction.

[0164] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0165] Step 1:

[0166] A user installs the app and creates an account.

[0167] Input: Name, email address, password

[0168] How it works: A user downloads and installs the app from the App Store or GOOGLE PLAY®, launches the app, clicks the "Sign Up" button, and is presented with a form to enter their name, email address, and password.

[0169] Output: The entered user information is saved on the device.

[0170] Step 2:

[0171] The terminal sends the input data to the server.

[0172] Input: User information (name, email address, password)

[0173] How it works: When a user fills out the form and presses the "Register" button, the device sends the input data to the server using HTTPS.

[0174] Output: The server receives the user information.

[0175] Step 3:

[0176] The server stores the user information in a database.

[0177] Input: User information (name, email address, password)

[0178] What it does: After the server receives the data, it checks for duplicates and saves the new user information to the database.

[0179] Output: The registered user information is saved in the database.

[0180] Step 4:

[0181] The device will display a UI for taking or selecting a face photo.

[0182] Input: None (interface provided)

[0183] Operation: After user registration is complete, the device displays a UI for "registering a face photo." It displays a button to take a photo and a button to select from the gallery.

[0184] Output: The face photo registration screen is displayed to the user.

[0185] Step 5:

[0186] The user takes or selects and uploads a photo of their face.

[0187] Input: Face photo data (take a photo or select)

[0188] How it works: The user clicks the camera button to take a photo of their face, then clicks the "OK" button or selects an existing photo from the gallery.

[0189] Output: The selected or taken face photo is temporarily saved on the device.

[0190] Step 6:

[0191] The terminal transmits the facial photo data to the server.

[0192] Input: Facial photo data

[0193] What it does: Encodes the face photo data and sends it to the server using an HTTPS request.

[0194] Output: The server receives the face photo data.

[0195] Step 7:

[0196] The server stores the facial photos in an image database.

[0197] Input: Facial photo data

[0198] How it works: The server receives the image data and stores it in storage, associating the image with the user's account.

[0199] Output: The face photo stored in the image database is registered.

[0200] Step 8:

[0201] The user inputs the desired hairstyle by text.

[0202] Input: Text of desired hairstyle (e.g. "Short bob")

[0203] How it works: A user enters their desired hairstyle into a text input field within the app.

[0204] Output: The text data of the desired hairstyle is temporarily saved on the device.

[0205] Step 9:

[0206] User uploads reference image.

[0207] Input: Reference hairstyle image

[0208] How it works: The user selects a hairstyle reference image from the gallery and presses the "Upload" button.

[0209] Output: The selected reference image is temporarily saved on the device.

[0210] Step 10:

[0211] The terminal sends the input data to the server.

[0212] Input: Hairstyle text data, reference image

[0213] What it does: Encodes text and image data and sends it to the server in an HTTPS request.

[0214] Output: The server receives the desired hairstyle data and reference images.

[0215] Step 11:

[0216] The server prepares the input data to serve as a generative AI model.

[0217] Input: Face photo data, desired hairstyle data, reference image

[0218] How it works: The server converts the received face photo and desired hairstyle data into a format that the generative AI model can understand.

[0219] Output: A dataset is prepared in a format that can be input into an AI model.

[0220] Step 12:

[0221] A generative AI model generates hairstyle images.

[0222] Input: Face photo data, desired hairstyle data (text or reference image)

[0223] How it works: The generative AI model generates a hairstyle image based on input data (a face photo and desired hairstyle). An example of a prompt sentence is "A short bob hairstyle that suits this face photo."

[0224] Output: The generated hairstyle image is temporarily saved.

[0225] Step 13:

[0226] The server transmits the generated hairstyle image to the terminal.

[0227] Input: Generated hairstyle image

[0228] What it does: The generated hairstyle image is encoded and sent to the user's device in an HTTPS response.

[0229] Output: The generated hairstyle image is received on the user's terminal.

[0230] Step 14:

[0231] The terminal displays the generated hairstyle image.

[0232] Input: Generated hairstyle image

[0233] Action: The device opens an image viewer and displays the generated hairstyle image.

[0234] Output: The user can check the generated hairstyle image.

[0235] Step 15:

[0236] The user checks the image and saves it or requests corrections.

[0237] Input: Generated hairstyle image

[0238] How it works: The user checks the image and clicks the "Save" button to save it to local storage. If any corrections are needed, the user clicks the "Request corrections" button and a form is displayed where the user can re-enter their hairstyle preference.

[0239] Output: Saved image data, input data for correction requests (if necessary).

[0240] Step 16:

[0241] The user shares the image with the hairdresser.

[0242] Input: Generated hairstyle image

[0243] How it works: The user shows the image to the hairdresser directly or shares it via social media or messaging apps.

[0244] Output: Hairstyle image shared with hairdresser.

[0245] Step 17:

[0246] The user chooses to issue an NFT token.

[0247] Input: Generated hairstyle image

[0248] How it works: Click the "Tokenize NFT" button in the app.

[0249] Output: The tokenization request data is temporarily saved on the device.

[0250] Step 18:

[0251] The device sends an NFT token issuance request to the server.

[0252] Input: Generated hairstyle image, metadata

[0253] How it works: The necessary metadata and image data are bundled together and sent as a request to the server.

[0254] Output: NFT token issuance request sent to the server.

[0255] Step 19:

[0256] The server generates NFT tokens and registers them on the blockchain.

[0257] Input: Generated hairstyle image, metadata

[0258] How it works: The server communicates with the blockchain network to generate and register tokens.

[0259] Output: NFT token information registered on the blockchain.

[0260] Step 20:

[0261] The server publishes the NFT token information to the market.

[0262] Input: NFT token information

[0263] What it does: Uploads token information to the NFT marketplace and notifies users.

[0264] Output: NFT token information published on the marketplace.

[0265] Step 21:

[0266] Users trade tokens on the market.

[0267] Input: NFT token information

[0268] How it works: Users buy, sell, or rent tokens on the marketplace.

[0269] Output: The traded NFT tokens.

[0270] (Application example 1)

[0271] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0272] Traditional methods for proposing and confirming hairstyles at beauty salons depended on communication between the user and the hairdresser, making it difficult to share specific ideas. As a result, the user's desired hairstyle was not accurately conveyed, leading to a high likelihood of dissatisfaction with the finished product. Furthermore, methods for issuing and trading NFT tokens as a new means of providing value by utilizing the generated hairstyle images had not yet been fully established.

[0273] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0274] In this invention, the server includes: a means for a user to register their own facial photo; a means for the user to input their desired hairstyle in text or image; a means for having a generation AI that generates a hairstyle image based on the registered facial photo and the input desired hairstyle information; a means for transmitting and displaying the generated hairstyle image to a user terminal; and a means for the user to input their desired hairstyle using a smart device and confirm and modify the generated hairstyle image. This allows the user to visually confirm their specific desired hairstyle using the generation AI, facilitating communication with their hairdresser. Furthermore, the generated hairstyle image can be used to issue NFT tokens, which can be registered on a blockchain network and traded on a marketplace.

[0275] The term "user" refers to a person who uses this system to input a desired hairstyle and view the generated hairstyle image.

[0276] "Facial photo" refers to image data of a user's face.

[0277] "Text or image" refers to text information that the user inputs to express the hairstyle they desire, or a hairstyle image for reference.

[0278] "Generative AI" refers to artificial intelligence technology that generates hairstyle images that suit a user based on a photo of the user's face and desired hairstyle information.

[0279] "User terminal" refers to an electronic device such as a smartphone, tablet, or smart glasses that is used to display a hairstyle image.

[0280] A "smart device" refers to a multifunctional electronic device that is connected to the Internet and can run applications.

[0281] "Confirmation and correction" refers to the act of the user checking the generated hairstyle image and requesting changes if necessary.

[0282] "NFT token" refers to a unique token on the blockchain issued for the generated hairstyle image.

[0283] A "blockchain network" refers to a network that uses distributed ledger technology to issue and manage NFT tokens.

[0284] "Marketplace" refers to an online platform for publishing and trading issued NFT tokens.

[0285] "Smart glasses" refers to a wearable device that can display visual information when worn on the head.

[0286] This invention provides a system in which a user registers a photo of their face and inputs their desired hairstyle using text or an image. The system utilizes AI technology to generate a hairstyle image based on the user's input face photo and desired hairstyle information, and transmits it to the user's terminal for display. Furthermore, the generated hairstyle image can be issued as an NFT token as needed, registered on the blockchain network, and published on the marketplace.

[0287] The system is configured as follows:

[0288] 1. Registering a user's face photo

[0289] Users start the application on their smartphone, PC, or other device and register a photo of their face. They can either take a photo using the camera or upload an existing image.

[0290] The server receives the registered facial photograph and stores it in a database.

[0291] 2. Enter your desired hairstyle

[0292] Users can upload their desired hairstyle via text input or a reference image on the application.

[0293] The server receives information about the desired hairstyle and inputs it into a generative AI model.

[0294] 3. Hairstyle Image Generation

[0295] The generative AI model generates hairstyle images based on the user's facial photo and desired hairstyle information.

[0296] The server transmits the generated hairstyle image to the user terminal and displays it.

[0297] 4. Check and correct the generated image

[0298] The user can check the generated hairstyle image on a smart device (such as smart glasses) and request corrections if necessary.

[0299] 5. NFT Tokenization and Trading of Generated Images

[0300] Depending on the user's wishes, the generated hairstyle image will be issued as an NFT token.

[0301] The server registers the NFT tokens on the blockchain network and publishes them on the marketplace.

[0302] The main hardware and software used are as follows:

[0303] Smart glasses: AR-enabled devices such as Oculus Quest 2

[0304] Server: AWS (registered trademark) EC2 instance

[0305] AI model: OpenAI's GPT-4 (registered trademark), DeepArt's style transfer model

[0306] Database: AWS RDS

[0307] Blockchain technology: Ethereum

[0308] For example, a customer at a beauty salon can put on smart glasses at the reception desk and voice-input the hairstyle they want, such as "shoulder-length bob." Images of hairstyles that fit the description will then appear on the glasses' display. The customer can then review the hairstyle images and consult with the hairdresser to determine the appropriate design. This allows customers to receive more satisfying service and reduces miscommunication.

[0309] The following are examples of possible prompt sentences:

[0310] "A customer visits a beauty salon and wants to use smart glasses to see how their hairstyle will look":

[0311] A customer visits a beauty salon and puts on a pair of smart glasses at the reception desk. They input their desired hairstyle into the smart glasses by voice, saying "a bob that falls over the shoulders," and a generated image of the hairstyle is instantly displayed on the glasses. The customer can then review the image with the hairdresser, who will help them decide on the hairstyle.

[0312] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0313] Step 1:

[0314] Users launch the application on their device, such as a smartphone or PC, and take a photo of their face or upload an existing image.

[0315] Input: User's face photo

[0316] Output: Facial photo data sent to the server

[0317] Data processing / calculation: Encode the face photo and send it to the server as an HTTPS request.

[0318] Step 2:

[0319] The server stores the received facial photos in a database and also performs validation such as checking for duplicates.

[0320] Input: User's face photo data

[0321] Output: Facial photo data stored in the database

[0322] Data processing / calculation: Facial photo data is stored in storage and associated with the user's account.

[0323] Step 3:

[0324] Users can enter their desired hairstyle in text on the application or upload an image of the hairstyle as a reference.

[0325] Input: Text or image of desired hairstyle

[0326] Output: Hair style preference data sent to the server

[0327] Data processing / calculation: Encode text data or image data and send it to the server as an HTTPS request.

[0328] Step 4:

[0329] The server prepares the received facial photo and desired hairstyle information for the generative AI model, which includes pre-processing the data and converting it into an appropriate format.

[0330] Input: Face photo data, desired hairstyle data

[0331] Output: Data format to feed to a generative AI model

[0332] Data processing / calculation: Convert the face photo and desired hairstyle data into a format that the AI ​​model can understand.

[0333] Step 5:

[0334] The generative AI model generates a suitable hairstyle image based on the user's facial photo and desired hairstyle information.

[0335] Input: Preprocessed face photo data, desired hairstyle data

[0336] Output: Generated hairstyle image

[0337] Data processing / calculation: Machine learning algorithms are used to match facial photos and generate hairstyles.

[0338] Step 6:

[0339] The server receives the generated hairstyle image and transmits it to the user's terminal.

[0340] Input: Generated hairstyle image data

[0341] Output: Hairstyle image sent to the user's device

[0342] Data processing / calculation: The generated hairstyle image is encoded and sent to the user's device via an HTTPS response.

[0343] Step 7:

[0344] The user can check the generated hairstyle image on a smart device such as smart glasses and request corrections if necessary.

[0345] Input: Generated hairstyle image

[0346] Output: User's correction request (if necessary)

[0347] Data processing / calculation: Check the generated image and send correction requests to the server as new data.

[0348] Step 8:

[0349] If the user wishes, they can send a request to issue an NFT token for the generated hairstyle image.

[0350] Input: Generated hairstyle image, NFT issuance request

[0351] Output: NFT issuance request sent to the server

[0352] Data processing / calculation: Image data and metadata are sent together to the server.

[0353] Step 9:

[0354] The server generates an NFT token corresponding to the image and registers it on the blockchain network.

[0355] Input: NFT issuance request and image data

[0356] Output: NFT token registered on the blockchain

[0357] Data processing / calculation: Tokens are generated using blockchain technology and registered on the network.

[0358] Step 10:

[0359] The server publishes information related to the issued NFT tokens on the marketplace and notifies users.

[0360] Input: NFT token information registered on the blockchain

[0361] Output: NFT token information published on the marketplace, notification to users

[0362] Data processing / calculation: Convert the data into the format required for the marketplace and publish it.

[0363] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0364] This invention relates to a system that uses generative AI to generate specific hairstyle images by having users register their own facial photos and input their desired hairstyle via text or image. This system makes it easier for users to share specific images with their hairdressers, reducing communication errors. It is also possible to issue NFT tokens for the generated hairstyle images, register them on a blockchain network, and trade them on the marketplace. Furthermore, by combining this with an emotion engine that recognizes the user's emotions, it is possible to suggest hairstyles based on the user's emotional state.

[0365] Program processing explanation

[0366] User registration phase

[0367] 1. The user installs and launches the app. The user proceeds to the new account creation screen and enters their name, email address, and password. The device collects this input data and, when the user presses the button to proceed to the next step, sends this data to the server.

[0368] 2. The server checks for duplicates in the received user data and, if there are no problems, saves it in the database. Once saved, the server returns a message to the device indicating account creation is complete.

[0369] 3. The device displays a UI that prompts the user to take a photo of their face. At this point, the user presses the capture button to launch the camera and take a photo of their face, or selects a photo from the gallery.

[0370] 4. The user takes or selects a photo of their face and presses the confirmation button. The device encodes the image data of the photo and sends it to the server.

[0371] 5. The server receives the face photo and stores it in an image database. Once stored, the image information is associated with the user's account.

[0372] Hairstyle preference input phase

[0373] 1. The user enters the desired hairstyle in text on the app screen. The user also has the option to upload an image of the hairstyle as a reference.

[0374] 2. The device collects the text data entered by the user and the hairstyle image uploaded and sends them to the server.

[0375] 3. The emotion engine recognizes the emotion from the user's facial photo and sends the emotion information to the server. For example, the emotion of the user, such as whether they are happy or sad, is analyzed here.

[0376] Hairstyle image generation phase

[0377] 1. The server prepares the received face photo, desired hairstyle data, and emotion information for the generative AI model. Specifically, the server converts this data into a format that the AI ​​model can understand.

[0378] 2. The generative AI model uses the user's facial photo, desired hairstyle data, and emotional information to generate a specific hairstyle image. This generated hairstyle image is temporarily stored in the server's storage.

[0379] 3. The server retrieves the generated hairstyle image and encodes it for transmission to the user's device. The server sends the hairstyle image data to the device via an HTTPS response.

[0380] Checking the image and sharing it with the hairdresser

[0381] 1. The terminal displays the generated hairstyle image on the user's screen. The user checks the hairstyle image and requests corrections if necessary. The data is then sent to the server again.

[0382] 2. The user presses the save button to save the image to local storage. Then, to show the hairdresser the hairstyle, the user can show the image directly to the hairdresser or share it via social media or a messaging app.

[0383] NFT token issuance and market registration phase

[0384] 1. The user selects the option to issue an NFT token for the generated hairstyle image. The device receives the user's selection and sends an NFT token issuance request.

[0385] 2. The device sends a request to the server to issue an NFT token, along with metadata and image data.

[0386] 3. The server generates an NFT token for the image and registers it on the blockchain network. Once complete, the issued token information is published on the marketplace.

[0387] 4. Users receive notifications and can browse and trade tokens on the marketplace. Users can buy and sell these tokens and earn revenue through trading.

[0388] As a concrete example, after a user uses the app and goes through the registration process, the emotion engine recognizes a "happy emotion" from the user's facial photo. Based on this emotional information, the generative AI model generates a hairstyle image that matches a lively atmosphere, which is ultimately displayed on the user's device. The user can show this image to their hairdresser, making it easier to share the specific hairstyle image. Furthermore, by issuing an NFT token for this hairstyle image, it can be sold and traded on the marketplace.

[0389] The processing flow will be explained below.

[0390] Step 1:

[0391] A user installs and launches the app. They proceed to the new account creation screen and enter their name, email address, and password. The device collects this input data and, when they press the button to proceed to the next step, sends it to the server.

[0392] Step 2:

[0393] The server checks and verifies the received user data for duplicates. After confirming that there are no duplicates, it saves the user information in the database. Once the saving is complete, the server returns a message to the device indicating that the account has been created.

[0394] Step 3:

[0395] The device displays a UI that prompts the user to take a photo of their face. The user presses the capture button to launch the camera and take a photo of their face, or selects a photo from the gallery.

[0396] Step 4:

[0397] The user takes or selects a photo of their face and presses the confirmation button. The device encodes the image data of the photo and sends it to the server.

[0398] Step 5:

[0399] The server receives the face photo and stores it in an image database. After storage is complete, the face photo information is associated with the user's account.

[0400] Step 6:

[0401] Users can enter their desired hairstyle in text on the app screen, and if they have an image of the hairstyle they want to use as a reference, they can also select the option to upload that image.

[0402] Step 7:

[0403] The terminal collects the text data entered by the user and the hairstyle image uploaded, and transmits them to the server.

[0404] Step 8:

[0405] The emotion engine analyzes the user's facial photo and recognizes their emotions, such as whether they look happy or sad, and sends the results to the server.

[0406] Step 9:

[0407] The server prepares the received facial photo, desired hairstyle data, and emotion information for delivery to the generative AI model, which involves converting the data into a format that the AI ​​model can understand.

[0408] Step 10:

[0409] The generative AI model uses the user's facial photo, desired hairstyle data, and emotional information to generate a specific hairstyle image, which is then temporarily stored in the server's storage.

[0410] Step 11:

[0411] The server retrieves the generated hairstyle image and encodes it for transmission to the user's device. The server then sends the hairstyle image data to the device via an HTTPS response.

[0412] Step 12:

[0413] The terminal displays the generated hairstyle image on the user's screen. The user checks the hairstyle image and requests corrections as necessary, and the request is sent to the server.

[0414] Step 13:

[0415] The user confirms the image and presses the save button to save the image to local storage. They can then show the image directly to their hairdresser or share it via social media or messaging apps.

[0416] Step 14:

[0417] The user selects the option to issue an NFT token for the generated hairstyle image, which causes the device to send an NFT token issuance request to the server.

[0418] Step 15:

[0419] The device sends a request to the server to issue an NFT token, along with metadata and image data.

[0420] Step 16:

[0421] Based on the data received, the server generates an NFT token corresponding to the image and registers it on the blockchain network. Once registration is complete, the issued token information is published on the marketplace.

[0422] Step 17:

[0423] Users receive notifications and can browse and trade NFT tokens on the marketplace. By buying and selling these tokens, users can earn revenue. This system not only embodies the user's desired hairstyle and reduces communication errors, but also suggests more suitable hairstyles through emotion recognition using an emotion engine, and further enables digital economic activity using NFT tokens.

[0424] Example 2

[0425] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0426] The present invention aims to provide a means for users to easily generate their desired hairstyle and other images based on their own facial images and to communicate specifically through the generated images. Furthermore, by clarifying ownership of the generated images and tokenizing them to make them tradable, it is possible to give them value as a new form of digital asset. Conventional systems often fail to accurately reflect the user's desired hairstyle or image, resulting in miscommunication. Furthermore, the lack of a means to establish ownership of generated digital images makes it difficult to trade them in the market. There is a need to solve these problems.

[0427] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0428] In this invention, the server includes: a means for a user to register their own image; a means for the user to input their desired image as text or an image; a means for generating an image based on the registered facial image and the input desired image information; a means for transmitting and displaying the generated image to the user's terminal; a means for issuing a token for the generated image and registering it in a distributed network; a means for publishing the issued token in an information disclosure system; a means for providing the user's facial image and desired image information to an algorithmic model to generate an image; a means for transmitting and displaying the generated image to the user's terminal; and a means for the user to request modifications as needed. This allows users to accurately generate their desired image and share specific images with hairdressers and others. Furthermore, by issuing an NFT token for the generated image and establishing ownership, it becomes possible to trade it as a digital asset.

[0429] A "user" is a person who uses this system to register their own facial image or desired image, and to generate hairstyles and other images.

[0430] "Image" refers to the facial image registered by the user and visual data corresponding to the hairstyle or other design desired by the user.

[0431] "Text" refers to information in the form of text that the user inputs about the hairstyle or image they desire.

[0432] "Generative AI" is an artificial intelligence system that automatically generates new hairstyle images and other designs based on the user's facial image, text, and desired image information.

[0433] "Terminal" refers to the device (smartphone, tablet, PC, etc.) that a user uses to operate this system.

[0434] The "server" is a computer system that receives user data, processes it, provides it to the generating AI, stores the generated images, and transmits them to the user.

[0435] "Token" refers to a digital representation of ownership of a generated hairstyle image or other product.

[0436] A "decentralized network" is a system in which tokens are recorded on a common ledger by multiple nodes without a centralized management entity.

[0437] "Information Disclosure System" means an online platform for public disclosure and display of issued Tokens and other information.

[0438] An "algorithmic model" refers to the computational logic and methods used to process a user's facial image or desired image information as input and generate the desired image.

[0439] A "modification request" refers to a user's request for changes or adjustments to a generated image.

[0440] This invention relates to a system that uses generative AI to generate specific images by allowing users to register their own facial images and input their desired hairstyle and other images via text or images. This system makes it easier for users to share specific images with their hairdressers, reducing communication errors. It is also possible to issue NFT tokens for the generated images, register them on a blockchain network, and trade them on a marketplace.

[0441] User registration phase

[0442] 1. The user installs and launches the app. They proceed to the new account creation screen and enter their name, email address, and password. The device collects this input data and sends it to the server when the user presses the button to proceed to the next step. This process is carried out using devices such as smartphones and tablets.

[0443] 2. The server checks for duplicates in the received user data and, if there are no problems, saves it in the database. Once saved, the server returns a message to the device indicating account creation is complete.

[0444] 3. The device displays a UI that prompts the user to take a photo of their face. At this point, the user presses the capture button to activate the camera and take a photo of their face, or select a photo from the gallery. After the user takes or selects a photo of their face and presses the confirmation button, the device encodes the image data of the photo and sends it to the server.

[0445] 4. The server receives the face photo, stores the data in an image database, and associates the image information with the user's account. Specifically, the image file is stored in a file storage or database.

[0446] Hairstyle preference input phase

[0447] 1. The user enters the desired hairstyle in text on the app screen. The user can also select the option to upload an image of the hairstyle as a reference.

[0448] 2. The device collects the text data entered by the user and the hairstyle image uploaded and sends them to the server.

[0449] 3. The emotion engine recognizes the emotion from the user's facial photo and sends the emotion information to the server. For example, the emotion is analyzed to determine whether the user looks happy or sad.

[0450] Hairstyle image generation phase

[0451] 1. The server receives the face photo, desired hairstyle data, and emotion information and prepares them for provision to the generative AI model. The server converts this data into a format that the AI ​​model can understand.

[0452] 2. The generative AI model generates a specific hairstyle image based on the user's facial photo, desired hairstyle data, and emotional information. This generated hairstyle image is temporarily stored in the server's storage.

[0453] 3. The server retrieves the generated hairstyle image and encodes it for transmission to the user's device. The server sends the hairstyle image data to the device via an HTTPS response.

[0454] Checking the image and sharing it with the hairdresser

[0455] 1. The terminal displays the generated hairstyle image on the user's screen. The user checks the hairstyle image and requests corrections if necessary. The data is then sent to the server again.

[0456] 2. The user presses the save button to save the image to local storage. Then, to show the hairdresser the hairstyle, the user can show the image directly to the hairdresser or share it via social media or a messaging app.

[0457] NFT token issuance and market registration phase

[0458] 1. The user selects the option to issue an NFT token for the generated hairstyle image. The device receives the user's selection and sends an NFT token issuance request.

[0459] 2. The device sends a request to the server to issue an NFT token, along with metadata and image data.

[0460] 3. The server generates an NFT token for the image and registers it on the blockchain network. Once complete, the issued token information is published on the marketplace.

[0461] 4. Users receive notifications and can browse and trade tokens on the marketplace. Users can buy and sell these tokens and earn revenue through trading.

[0462] Specific examples

[0463] For example, after a user uses the app and goes through the registration process, the emotion engine recognizes a "happy emotion" from the user's facial photo. Based on this emotional information, the generative AI model generates a hairstyle image that matches a lively atmosphere, which is ultimately displayed on the user's device. The user can show this image to their hairdresser, making it easier to share the specific hairstyle image they want. In addition, by issuing an NFT token for this hairstyle image, it can be sold and traded on the marketplace.

[0464] Prompt Sentence Examples

[0465] "Generate hairstyle images that match a lively atmosphere based on a photo of the user's face that shows a happy expression."

[0466] The above is a description of the embodiment of the present invention. This system allows users to accurately generate desired hairstyles and other images and use them as digital assets.

[0467] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0468] Processing Steps

[0469] User registration phase

[0470] Step 1:

[0471] A user installs and launches the app. The user proceeds to the new account creation screen and enters their name, email address, and password.

[0472] Input: Name, Email Address, Password

[0473] Output: Input data is sent to the server in JSON format

[0474] What it does: Your smartphone or tablet collects input data and sends it to the server via an HTTP POST request.

[0475] Step 2:

[0476] The server checks for duplicates in the received user data, and if there are no duplicates, stores them in the database.

[0477] Input: User data

[0478] Output: Results of duplicate check, saved to database

[0479] What happens: The server runs an SQL query to check for duplicate email addresses, and if there are no problems, it saves them to the database with an INSERT statement.

[0480] Step 3:

[0481] The server sends a message to the device indicating that the account has been created.

[0482] Input: Account creation completion status

[0483] Output: Account creation successful message

[0484] Specific operation: A message is sent to the terminal as an HTTP response with status code 200.

[0485] Step 4:

[0486] The device displays a UI that prompts the user to take a photo of their face. The user takes a photo of their face or selects a photo from the gallery.

[0487] Input: User-initiated camera or selection from gallery

[0488] Output: Captured photo data or selected photo data

[0489] Specific behavior: The camera app launches and a photo is taken, or an image selected from the gallery is retrieved from the device.

[0490] Step 5:

[0491] The user presses the "Confirm Face Photo" button. The device encodes the image data of the face photo and sends it to the server.

[0492] Input: Facial photo data

[0493] Output: Encoded image data

[0494] What happens: The image is encoded in a format such as Base64 and sent to the server as an HTTP request.

[0495] Step 6:

[0496] The server receives the face photo and stores it in an image database, which associates the image information with the user's account.

[0497] Input: Facial photo data

[0498] Output: Save to image database, associate with user account

[0499] Specific behavior: The image file is saved to file storage or a database, and the path to the image file is added to the user's database record.

[0500] Hairstyle preference input phase

[0501] Step 1:

[0502] Users enter their desired hairstyle in text on the app screen, and also have the option to upload an image of the hairstyle as a reference.

[0503] Input: Text data and image data of desired hairstyle

[0504] Output: Uploaded data

[0505] What it does: Collects text and images.

[0506] Step 2:

[0507] The terminal collects the text data entered by the user and the hairstyle image uploaded and sends them to the server.

[0508] Input: Text data, image data

[0509] Output: Data sent to the server

[0510] Specific behavior: Sends data to the server as an HTTP request.

[0511] Step 3:

[0512] The emotion engine recognizes emotions from the user's facial photograph and transmits the emotion information to the server.

[0513] Input: Facial photo data

[0514] Output: Emotion recognition result data

[0515] Specific operation: Image processing is performed and emotion recognition results are generated.

[0516] Hairstyle image generation phase

[0517] Step 1:

[0518] The server prepares the received facial photo, desired hairstyle data, and emotional information to provide to the generative AI model.

[0519] Input: Face photo data, desired hairstyle data, emotional information

[0520] Output: Data format for generative AI models

[0521] What happens: Data is formatted for the AI ​​model.

[0522] Step 2:

[0523] The generative AI model generates a specific hairstyle image based on the user's face photo, desired hairstyle data, and emotional information.

[0524] Input: Reformatted user data

[0525] Output: Generated hairstyle image

[0526] Specific operation: The AI ​​model performs inference processing and generates a hairstyle image.

[0527] Step 3:

[0528] The server acquires the generated hairstyle image and encodes it for transmission to the user's terminal.

[0529] Input: Generated hairstyle image

[0530] Output: Encoded image data

[0531] Specific behavior: Image data is encoded and sent to the device as an HTTPS response.

[0532] Checking the image and sharing it with the hairdresser

[0533] Step 1:

[0534] The terminal displays the generated hairstyle image on the user's screen, and the user checks the hairstyle image and requests corrections as necessary.

[0535] Input: Generated hairstyle image

[0536] Output: User confirmation result and correction request

[0537] What happens: The image is displayed on the device screen and user interactions are processed.

[0538] Step 2:

[0539] The user presses the save button to save the image to local storage, and then shows the image to the hairdresser directly or shares it via social media or messaging apps.

[0540] Input: Saved image data

[0541] Output: Images saved in local storage, shared images

[0542] What it does: The image is saved to your device's storage and can be transferred to other apps or services using the share feature.

[0543] NFT token issuance and market registration phase

[0544] Step 1:

[0545] The user selects the option to issue an NFT token for the generated hairstyle image.

[0546] Input: Token issuance request by user operation

[0547] Output: Token issuance request data

[0548] Specific operation: A token issuance request is generated.

[0549] Step 2:

[0550] The device sends a request to issue an NFT token to the server, along with metadata and image data.

[0551] Input: Metadata, image data

[0552] Output: Token issuance request sent to the server

[0553] What happens: Data is sent to the server as an HTTP request.

[0554] Step 3:

[0555] The server generates an NFT token for the image and registers it on the decentralized network.

[0556] Input: Metadata, image data

[0557] Output: Token registered on the blockchain

[0558] Specific behavior: Token generation is completed and the transaction is added to the blockchain.

[0559] Step 4:

[0560] After the server is complete, it will publish the issued token information to the marketplace.

[0561] Input: Token information

[0562] Output: Published token information

[0563] Specific operation: Token information is registered using the marketplace API.

[0564] Step 5:

[0565] Users receive notifications and can browse and trade tokens on the marketplace.

[0566] Input: Push notification or email

[0567] Output: Tokens traded on the marketplace

[0568] What happens: A notification is sent to the user, who then trades the token on the marketplace.

[0569] (Application example 2)

[0570] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0571] Conventional hairstyle suggestion systems have had problems with insufficient sharing of specific images between users and hairdressers, leading to frequent miscommunication. Furthermore, it is difficult to suggest hairstyles based on the user's emotions or current mood, making it difficult to provide personalized services. Furthermore, there are limited ways to commercially use the generated hairstyle images.

[0572] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0573] In this invention, the server includes a means for recognizing emotions from a user's facial photograph, a means for providing emotion information to a generative AI model, and a means for issuing the generated hairstyle image as an NFT token and registering it on a blockchain network. This enables personalized hairstyle suggestions based on the user's emotions, expanding the commercial use of the generated hairstyle image.

[0574] A "user" is a person who uses this system and provides a photograph of their face and information about their desired hairstyle.

[0575] A "face photo" is image data of a user's face, and is primarily used for analysis by generative AI models and emotion engines.

[0576] "Text" is an information format in which the user inputs the desired hairstyle or style in text.

[0577] "Image" is visual data such as a photograph or illustration that specifically shows the hairstyle desired by the user.

[0578] "Generative AI" is an artificial intelligence that generates specific hairstyle images based on a user's facial photo, desired hairstyle information, and emotional information.

[0579] The "emotion engine" is a system that analyzes the emotions of a user from a facial photograph and acquires the user's emotional information.

[0580] An "NFT token" is a non-fungible token issued for a generated hairstyle image, and is a digital asset that is unique on the blockchain.

[0581] A "blockchain network" is a distributed database technology and infrastructure for securely issuing and trading NFT tokens.

[0582] The "Marketplace" is a market where NFT tokens are bought and sold, and a platform that enables the commercial use of generated hairstyle images.

[0583] A "modification request" is a request from a user for changes or improvements to the generated hairstyle image.

[0584] This invention relates to a system that uses AI to generate a specific hairstyle image by allowing a user to register a photo of their face and input desired hairstyle information. This system uses the following hardware and software:

[0585] Hardware and software used

[0586] 1. Smartphone: A device on which users install and operate apps.

[0587] 2. Cloud server: A server that stores user data and runs generative AI models.

[0588] 3. Emotion Engine: A system for recognizing emotions from a user's facial photograph, using Azure® Cognitive Services as an example.

[0589] 4. Generative AI model: A model for generating hairstyle images based on a user's facial photo, desired hairstyle information, and emotional information. Examples include Stable Diffusion and MidJourney.

[0590] 5. Blockchain network: This is the infrastructure for issuing and registering NFT tokens, and examples include Ethereum and Polygon.

[0591] Processing flow

[0592] This system basically operates in the following steps. First, the user installs and launches the smartphone app to create a new account. After completing the account creation, they register a photo of their face and input their desired hairstyle using text or an image. At this point, the emotion engine analyzes the emotional information from the user's face photo and provides it to the generative AI model. The generative AI model generates a hairstyle image based on this information and saves it on a cloud server. The hairstyle image is then sent to the user's smartphone and displayed.

[0593] Specific data processing

[0594] First, a photo of the user's face is taken with a smartphone and sent to a cloud server. The cloud server stores this face photo data in an image database and simultaneously passes it to an emotion engine for emotional analysis. The analyzed emotional information, along with desired hairstyle information, is provided to a generative AI model. The generative AI model generates a specific hairstyle image based on the user's face photo, emotional information, and hairstyle information. This generated hairstyle image is temporarily stored on the cloud server and then sent to the user's smartphone.

[0595] Prompt Sentence Examples

[0596] The generative AI model generates hairstyle images using prompt sentences such as the following:

[0597] Example prompt: "Generate a cheerful, short hairstyle with bangs for a happy-looking person."

[0598] Usage example

[0599] For example, suppose a user takes a photo of their face with a happy expression. Based on this photo, the emotion engine recognizes the "happy emotion" and inputs this emotion information into the generative AI model. Based on this emotion information and the user's desired hairstyle information, the generative AI model generates an image of a hairstyle that matches a lively atmosphere and displays it on the user's smartphone. The user can check this hairstyle image and show it to their hairdresser, making it easier to share a specific image.

[0600] This system allows users to easily get hairstyles that suit their emotions, reducing miscommunication between them and their hairdressers. Furthermore, by issuing NFT tokens for the generated hairstyle images, it can be used commercially.

[0601] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0602] Step 1: User registration phase

[0603] The user installs and launches the smartphone app. The user proceeds to the new account creation screen and enters their name, email address, and password. This input data is collected by the device, and when the user presses the button to proceed to the next step, the data is sent to the cloud server. The cloud server checks the received user data for duplicates and, if there are no problems, stores it in a database. Once the data is saved, the server returns a message to the device indicating that account creation has been completed. In this phase, the input is user information (name, email address, password), and the output is a message indicating that account creation has been completed.

[0604] Step 2: Register your face photo

[0605] The user takes a photo of their face using a smartphone app. When the app presses the capture button, the camera starts up and the user takes a photo of their face or selects a photo from the gallery. The device encodes the image data of the face photo and sends it to the server. The server receives this image data and stores it in an image database. In this step, the face photo is the input and the image data is registered to the server as the output.

[0606] Step 3: Enter your desired hairstyle

[0607] The user enters the desired hairstyle in text on the app screen. The user can also select the option to upload an image of the hairstyle as a reference. The device collects the entered text data and the uploaded hairstyle image and sends them to the server. In this step, the input is hairstyle information (text and image), and the output is the registration of hairstyle data to the server.

[0608] Step 4: Recognizing emotional information

[0609] The emotion engine recognizes emotions from the user's facial photo. The cloud server calls the emotion engine and analyzes the facial photo. The recognized emotion information is sent back to the server as the analysis result. In this step, the facial photo is the input and the emotion information is the output.

[0610] Step 5: Generate hairstyle images

[0611] The server prepares the received face photo, desired hairstyle information, and emotional information to provide to the generative AI model. Specifically, the server converts this data into a format that the AI ​​model can understand. The generative AI model (e.g., Stable Diffusion) uses the user's face photo, desired hairstyle data, and emotional information to generate a specific hairstyle image. This generated hairstyle image is temporarily stored in the server's storage. In this step, the input is the face photo, hairstyle information, and emotional information, and the output is the generated hairstyle image.

[0612] Step 6: Send and view hairstyle images

[0613] The server obtains the generated hairstyle image and encodes it for sending to the user's device. The server sends the hairstyle image data to the device in an HTTPS response. The device displays the received hairstyle image on the user's screen. If the user checks the hairstyle image and requests corrections as necessary, the data is sent to the server again. In this step, the input is the generated hairstyle image, and the output is a display on the user's device and a request to correct it.

[0614] Step 7: Save and share your image

[0615] The user presses the save button to save the image to local storage. Then, to show this hairstyle image to the hairdresser, the user can show the image directly to the hairdresser or share it via social media or a messaging app. In this step, the hairstyle image is the input, and saving to local storage and sharing are the outputs.

[0616] Step 8: Issue NFT tokens and register them on the market

[0617] The user selects the option to issue an NFT token for the generated hairstyle image. The device receives the user's selection and sends an NFT token issuance request. The server receives the request to issue an NFT token, generates an NFT token for the image, and registers it on the blockchain network. Once completed, the issued token information is published to the marketplace. In this step, the input is the hairstyle image and the NFT issuance request, and the output is the NFT token and registration on the marketplace.

[0618] By sequentially executing the above processing steps, the user is suggested a hairstyle that suits them, making it easier to share specific images with a hairdresser, and furthermore, the generated hairstyle image can be used commercially.

[0619] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0620] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0621] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0622] [Second embodiment]

[0623] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0624] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0625] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0626] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0627] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0628] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0629] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0630] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0631] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0632] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0633] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0634] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0635] This invention relates to a system that uses generative AI to generate a specific hairstyle image by allowing users to register a photo of their face and input their desired hairstyle via text or image. This system makes it easier for users to share their specific image with their hairdresser, reducing communication errors. It is also possible to issue an NFT token for the generated hairstyle image, register it on a blockchain network, and trade it on a marketplace.

[0636] Program processing explanation

[0637] User registration phase

[0638] 1. A user installs the app and creates an account.

[0639] The user enters their name, email address, password, etc.

[0640] The terminal sends the input data to the server.

[0641] 2. The server receives the user information and stores it in a database.

[0642] The server performs a duplicate check on the user information.

[0643] After checking, if there are no problems, the user information is saved in the database.

[0644] 3. The device displays a UI to prompt the user to take a photo of their face.

[0645] It offers a photo button and the option to select from the gallery.

[0646] 4. The user takes a photo of their face or selects one from the gallery and uploads it.

[0647] The user clicks the capture button to start the camera.

[0648] After taking the photo, click the "OK" button to select the face photo.

[0649] 5. The device sends the facial photo data to the server.

[0650] The image data of the face photo is encoded and an HTTPS request is sent to the server.

[0651] 6. The server receives the facial photo and stores it in an image database.

[0652] The server stores the image in storage and associates it with the user account.

[0653] Hairstyle preference input phase

[0654] 1. The user enters the desired hairstyle in text in the app's text input field.

[0655] The user inputs a desired hairstyle, such as "short bob," into a text box.

[0656] 2. Users also have the option to upload an image of their hairstyle as a reference.

[0657] The user selects a reference image from the gallery and presses the upload button.

[0658] 3. The device receives user input or uploads and sends the data to the server.

[0659] The text data and image data are encoded together and an HTTPS request is sent to the server.

[0660] Hairstyle image generation phase

[0661] 1. The server prepares to provide the received face photo and desired hairstyle data to the generative AI model.

[0662] The server converts the face photo and desired hairstyle data into a format that the AI ​​model can understand.

[0663] 2. The generative AI model generates an image of the desired hairstyle that matches the user's face photo.

[0664] The AI ​​model generates a hairstyle image based on a face photo and text (or a reference image).

[0665] The generated image is temporarily stored in the server's storage.

[0666] 3. The server receives the generated hairstyle image and sends it to the user's device.

[0667] The generated image is encoded and sent to the user's device in an HTTPS response.

[0668] Checking the image and sharing it with the hairdresser

[0669] 1. The device displays the generated hairstyle image to the user.

[0670] Open an image viewer and view the generated hairstyle image.

[0671] 2. The user reviews the image and can request corrections if necessary.

[0672] When the user presses the "Request revision" button, a form will appear where the user can enter their desired hairstyle again.

[0673] 3. Save the image once the user has confirmed it.

[0674] Click the "Save" button to save the image to your local storage.

[0675] 4. The user shows the saved image to the hairdresser and shares the specific hairstyle image.

[0676] You can show the image directly to your hairdresser or share it on social media or messaging apps.

[0677] NFT token issuance and market registration phase

[0678] 1. The user selects the option to issue an NFT token for the generated hairstyle image.

[0679] Click the "Tokenize NFT" button in the app.

[0680] 2. The device sends a request to the server to issue an NFT token.

[0681] The necessary metadata and image data are collected and sent as a request to the server.

[0682] 3. The server generates an NFT token corresponding to the image and registers it on the blockchain.

[0683] The server communicates with the blockchain network to generate and register tokens.

[0684] 4. The server publishes information related to the issued NFT tokens to the market.

[0685] Upload token information to the NFT marketplace and notify users.

[0686] 5. Users will be able to trade tokens on the market.

[0687] Users can buy, sell, or rent tokens on the marketplace.

[0688] In this way, the present invention not only allows users to easily create and share specific hairstyle requests with their hairdressers, but also allows users to issue and trade the generated images as NFTs. This system reduces miscommunication and improves customer satisfaction.

[0689] The processing flow will be explained below.

[0690] Step 1:

[0691] A user installs and launches the app. The user proceeds to the new account creation screen and enters their name, email address, and password. The device collects this input data and, when the user presses the button to proceed to the next step, sends this data to the server.

[0692] Step 2:

[0693] The server checks for duplicates in the received user data and, if there are no problems, saves it in the database. Once the saving is complete, the server returns a message to the device indicating that account creation is complete.

[0694] Step 3:

[0695] The device displays a UI that prompts the user to take a photo of their face. The user then presses the capture button to launch the camera and take a photo of their face, or selects a photo from the gallery.

[0696] Step 4:

[0697] The user takes or selects a photo of their face and presses the confirmation button. The device encodes the image data of the photo and sends it to the server.

[0698] Step 5:

[0699] The server receives the face photo and stores it in an image database, then associates the image with the user's account.

[0700] Step 6:

[0701] Users can enter their desired hairstyle in text on the app screen, and also have the option to upload an image of the hairstyle they want as a reference.

[0702] Step 7:

[0703] The terminal collects the text data entered by the user and the hairstyle image uploaded and sends them to the server.

[0704] Step 8:

[0705] The server prepares the received face photo and desired hairstyle data to provide to the generative AI model. Specifically, the server converts the face photo and desired hairstyle text or image data into a format that the AI ​​model can understand.

[0706] Step 9:

[0707] The generative AI model uses the user's face photo and desired hairstyle data to generate a specific hairstyle image, which is temporarily stored in the server's storage.

[0708] Step 10:

[0709] The server retrieves the generated hairstyle image and encodes it for transmission to the user's device. The server then sends the hairstyle image data to the device via an HTTPS response.

[0710] Step 11:

[0711] The terminal displays the generated hairstyle image on the user's screen. If the user checks the hairstyle image and requests corrections as necessary, the data is sent to the server again.

[0712] Step 12:

[0713] The user presses the save button to save the image to local storage, and then shows the image directly to the hairdresser or shares it via social media or a messaging app to show the hairdresser the hairstyle.

[0714] Step 13:

[0715] The user selects the option to issue an NFT token for the generated hairstyle image. The device receives the user's selection and sends an NFT token issuance request.

[0716] Step 14:

[0717] The device sends a request to issue an NFT token to the server, along with metadata and image data.

[0718] Step 15:

[0719] The server generates an NFT token for the image and registers it on the blockchain network. Once complete, the issued token information is published on the marketplace.

[0720] Step 16:

[0721] Users will receive notifications and can browse and trade tokens on the marketplace, where they can buy and sell these tokens and earn revenue through trading.

[0722] Example 1

[0723] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0724] In the past, it was difficult for hairdressers and customers to share their hairstyle images, which often led to miscommunication. This could result in lower customer satisfaction. Furthermore, there was a lack of means to protect the generated hairstyle images and use them commercially.

[0725] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0726] In this invention, the server includes a means for a user to register their own facial photo, a means for the user to input their desired hairstyle using text or an image, a generation AI that generates a hairstyle image based on the registered facial photo and the input desired hairstyle information, a means for transmitting and displaying the generated hairstyle image to the user's terminal, and a means for the user to check the hairstyle image and request modifications. This allows for the generation of a specific hairstyle image that meets the user's preferences, enabling smooth communication with the hairdresser. The server also includes a means for issuing an NFT token for the generated hairstyle image and registering it on a blockchain network, and a means for publishing the issued NFT token on a marketplace, enabling the hairstyle image to be converted into a digital asset and used commercially.

[0727] A "user" is someone who uses this system to register a photo of their face and input their desired hairstyle.

[0728] "Generative AI" refers to an artificial intelligence model that generates hairstyle images based on a user's facial photo and desired hairstyle information entered.

[0729] "User terminal" refers to a device used by a user to access this system, such as a smartphone or PC.

[0730] An "NFT token" is a digital proof of ownership issued to the generated hairstyle image and registered on a blockchain network.

[0731] "Blockchain network" refers to a network that uses distributed ledger technology to record and manage data.

[0732] "Marketplace" refers to the digital marketplace where NFT tokens are bought, sold, or rented.

[0733] The "means for requesting modifications" refers to a function for re-inputting information into the system when a user desires to make changes to the generated hairstyle image.

[0734] "Means of registration" refers to the function that allows users to input and save their own face photo and desired hairstyle information into the system.

[0735] The "means for inputting a desired hairstyle" refers to a function that allows a user to provide information about a desired hairstyle using text or an image.

[0736] The "means for transmitting and displaying the generated hairstyle image" refers to a function for transferring the hairstyle image generated by the server to the user's terminal and displaying the image to the user.

[0737] This invention is a system that uses a generative AI model to generate a specific hairstyle image by allowing users to register a photo of their face and input their desired hairstyle via text or image. This system makes it easier for users to share their specific image with their hairdresser, reducing communication errors. It is also possible to issue an NFT token for the generated hairstyle image, register it on the blockchain network, and trade it on the marketplace.

[0738] Hardware and software used

[0739] Hardware: Servers (cloud servers and database servers), user devices (smartphones, PCs)

[0740] Software: AI image generation models (e.g., DALL-E), blockchain technology (e.g., Ethereum), database management systems (e.g., MySQL)

[0741] System Overview

[0742] 1. User Registration:

[0743] A user installs the app and creates an account by entering their name, email address, and password. The device sends this information to the server via HTTPS, and the server stores it in a database.

[0744] After creating an account, the device displays a UI that prompts the user to take a photo of their face or select one from the gallery. The user provides a photo of their face, and the data is sent from the device to the server.

[0745] The server stores the facial photo in a database and associates it with the user account.

[0746] 2. Enter your desired hairstyle:

[0747] The user enters the desired hairstyle into a text input field within the app (e.g., "short bob").

[0748] Users can also upload images of hairstyles for reference.

[0749] The terminal encodes this data and sends it to the server.

[0750] 3. Hairstyle image generation:

[0751] The server receives the face photo and desired hairstyle data and provides it to the AI ​​image generation model, which converts this data into a format that the generative AI model can understand.

[0752] The generative AI model generates an image of the desired hairstyle that matches the user's face photo. As an example of the prompt sentence, we use "A short bob hairstyle that matches this face photo."

[0753] The generated hairstyle image is temporarily stored in the server's storage and then sent to the user's device via an HTTPS response.

[0754] 4. View and share images:

[0755] The terminal displays the generated hairstyle image to the user, who can review the image and request corrections if necessary.

[0756] Save the final image and show it directly to your hairdresser or share it on social media or messaging apps.

[0757] 5. Issuance and trading of NFT tokens:

[0758] The user selects the option to issue an NFT token for the generated hairstyle image, and sends the necessary metadata and image data from the device to the server.

[0759] The server generates an NFT token corresponding to the image and registers it on the blockchain network, then publishes the token information on the marketplace and notifies users.

[0760] Users can buy, sell, or rent tokens on the marketplace.

[0761] In this way, the present invention not only allows users to easily create and share specific hairstyle requests with their hairdressers, but also allows users to issue and trade the generated images as NFTs. This system reduces miscommunication and improves customer satisfaction.

[0762] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0763] Step 1:

[0764] A user installs the app and creates an account.

[0765] Input: Name, email address, password

[0766] How it works: A user downloads and installs the app from the App Store or Google Play. They launch the app and click the "Sign Up" button, which displays a form where they can enter their name, email address, and password.

[0767] Output: The entered user information is saved on the device.

[0768] Step 2:

[0769] The terminal sends the input data to the server.

[0770] Input: User information (name, email address, password)

[0771] How it works: When a user fills out the form and presses the "Register" button, the device sends the input data to the server using HTTPS.

[0772] Output: The server receives the user information.

[0773] Step 3:

[0774] The server stores the user information in a database.

[0775] Input: User information (name, email address, password)

[0776] What it does: After the server receives the data, it checks for duplicates and saves the new user information to the database.

[0777] Output: The registered user information is saved in the database.

[0778] Step 4:

[0779] The device will display a UI for taking or selecting a face photo.

[0780] Input: None (interface provided)

[0781] Operation: After user registration is complete, the device displays a UI for "registering a face photo." It displays a button to take a photo and a button to select from the gallery.

[0782] Output: The face photo registration screen is displayed to the user.

[0783] Step 5:

[0784] The user takes or selects and uploads a photo of their face.

[0785] Input: Face photo data (take a photo or select)

[0786] How it works: The user clicks the camera button to take a photo of their face, then clicks the "OK" button or selects an existing photo from the gallery.

[0787] Output: The selected or taken face photo is temporarily saved on the device.

[0788] Step 6:

[0789] The terminal transmits the facial photo data to the server.

[0790] Input: Facial photo data

[0791] What it does: Encodes the face photo data and sends it to the server using an HTTPS request.

[0792] Output: The server receives the face photo data.

[0793] Step 7:

[0794] The server stores the facial photos in an image database.

[0795] Input: Facial photo data

[0796] How it works: The server receives the image data and stores it in storage, associating the image with the user's account.

[0797] Output: The face photo stored in the image database is registered.

[0798] Step 8:

[0799] The user inputs the desired hairstyle by text.

[0800] Input: Text of desired hairstyle (e.g. "Short bob")

[0801] How it works: A user enters their desired hairstyle into a text input field within the app.

[0802] Output: The text data of the desired hairstyle is temporarily saved on the device.

[0803] Step 9:

[0804] User uploads reference image.

[0805] Input: Reference hairstyle image

[0806] How it works: The user selects a hairstyle reference image from the gallery and presses the "Upload" button.

[0807] Output: The selected reference image is temporarily saved on the device.

[0808] Step 10:

[0809] The terminal sends the input data to the server.

[0810] Input: Hairstyle text data, reference image

[0811] What it does: Encodes text and image data and sends it to the server in an HTTPS request.

[0812] Output: The server receives the desired hairstyle data and reference images.

[0813] Step 11:

[0814] The server prepares the input data to serve as a generative AI model.

[0815] Input: Face photo data, desired hairstyle data, reference image

[0816] How it works: The server converts the received face photo and desired hairstyle data into a format that the generative AI model can understand.

[0817] Output: A dataset is prepared in a format that can be input into an AI model.

[0818] Step 12:

[0819] A generative AI model generates hairstyle images.

[0820] Input: Face photo data, desired hairstyle data (text or reference image)

[0821] How it works: The generative AI model generates a hairstyle image based on input data (a face photo and desired hairstyle). An example of a prompt sentence is "A short bob hairstyle that suits this face photo."

[0822] Output: The generated hairstyle image is temporarily saved.

[0823] Step 13:

[0824] The server transmits the generated hairstyle image to the terminal.

[0825] Input: Generated hairstyle image

[0826] What it does: The generated hairstyle image is encoded and sent to the user's device in an HTTPS response.

[0827] Output: The generated hairstyle image is received on the user's terminal.

[0828] Step 14:

[0829] The terminal displays the generated hairstyle image.

[0830] Input: Generated hairstyle image

[0831] Action: The device opens an image viewer and displays the generated hairstyle image.

[0832] Output: The user can check the generated hairstyle image.

[0833] Step 15:

[0834] The user checks the image and saves it or requests corrections.

[0835] Input: Generated hairstyle image

[0836] How it works: The user checks the image and clicks the "Save" button to save it to local storage. If any corrections are needed, the user clicks the "Request corrections" button and a form is displayed where the user can re-enter their hairstyle preference.

[0837] Output: Saved image data, input data for correction requests (if necessary).

[0838] Step 16:

[0839] The user shares the image with the hairdresser.

[0840] Input: Generated hairstyle image

[0841] How it works: The user shows the image to the hairdresser directly or shares it via social media or messaging apps.

[0842] Output: Hairstyle image shared with hairdresser.

[0843] Step 17:

[0844] The user chooses to issue an NFT token.

[0845] Input: Generated hairstyle image

[0846] How it works: Click the "Tokenize NFT" button in the app.

[0847] Output: The tokenization request data is temporarily saved on the device.

[0848] Step 18:

[0849] The device sends an NFT token issuance request to the server.

[0850] Input: Generated hairstyle image, metadata

[0851] How it works: The necessary metadata and image data are bundled together and sent as a request to the server.

[0852] Output: NFT token issuance request sent to the server.

[0853] Step 19:

[0854] The server generates NFT tokens and registers them on the blockchain.

[0855] Input: Generated hairstyle image, metadata

[0856] How it works: The server communicates with the blockchain network to generate and register tokens.

[0857] Output: NFT token information registered on the blockchain.

[0858] Step 20:

[0859] The server publishes the NFT token information to the market.

[0860] Input: NFT token information

[0861] What it does: Uploads token information to the NFT marketplace and notifies users.

[0862] Output: NFT token information published on the marketplace.

[0863] Step 21:

[0864] Users trade tokens on the market.

[0865] Input: NFT token information

[0866] How it works: Users buy, sell, or rent tokens on the marketplace.

[0867] Output: The traded NFT tokens.

[0868] (Application example 1)

[0869] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0870] Traditional methods for proposing and confirming hairstyles at beauty salons depended on communication between the user and the hairdresser, making it difficult to share specific ideas. As a result, the user's desired hairstyle was not accurately conveyed, leading to a high likelihood of dissatisfaction with the finished product. Furthermore, methods for issuing and trading NFT tokens as a new means of providing value by utilizing the generated hairstyle images had not yet been fully established.

[0871] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0872] In this invention, the server includes: a means for a user to register their own facial photo; a means for the user to input their desired hairstyle in text or image; a means for having a generation AI that generates a hairstyle image based on the registered facial photo and the input desired hairstyle information; a means for transmitting and displaying the generated hairstyle image to a user terminal; and a means for the user to input their desired hairstyle using a smart device and confirm and modify the generated hairstyle image. This allows the user to visually confirm their specific desired hairstyle using the generation AI, facilitating communication with their hairdresser. Furthermore, the generated hairstyle image can be used to issue NFT tokens, which can be registered on a blockchain network and traded on a marketplace.

[0873] The term "user" refers to a person who uses this system to input a desired hairstyle and view the generated hairstyle image.

[0874] "Facial photo" refers to image data of a user's face.

[0875] "Text or image" refers to text information that the user inputs to express the hairstyle they desire, or a hairstyle image for reference.

[0876] "Generative AI" refers to artificial intelligence technology that generates hairstyle images that suit a user based on a photo of the user's face and desired hairstyle information.

[0877] "User terminal" refers to an electronic device such as a smartphone, tablet, or smart glasses that is used to display a hairstyle image.

[0878] A "smart device" refers to a multifunctional electronic device that is connected to the Internet and can run applications.

[0879] "Confirmation and correction" refers to the act of the user checking the generated hairstyle image and requesting changes if necessary.

[0880] "NFT token" refers to a unique token on the blockchain issued for the generated hairstyle image.

[0881] A "blockchain network" refers to a network that uses distributed ledger technology to issue and manage NFT tokens.

[0882] "Marketplace" refers to an online platform for publishing and trading issued NFT tokens.

[0883] "Smart glasses" refers to a wearable device that can display visual information when worn on the head.

[0884] This invention provides a system in which a user registers a photo of their face and inputs their desired hairstyle using text or an image. The system utilizes AI technology to generate a hairstyle image based on the user's input face photo and desired hairstyle information, and transmits it to the user's terminal for display. Furthermore, the generated hairstyle image can be issued as an NFT token as needed, registered on the blockchain network, and published on the marketplace.

[0885] The system is configured as follows:

[0886] 1. Registering a user's face photo

[0887] Users start the application on their smartphone, PC, or other device and register a photo of their face. They can either take a photo using the camera or upload an existing image.

[0888] The server receives the registered facial photograph and stores it in a database.

[0889] 2. Enter your desired hairstyle

[0890] Users can upload their desired hairstyle via text input or a reference image on the application.

[0891] The server receives information about the desired hairstyle and inputs it into a generative AI model.

[0892] 3. Hairstyle Image Generation

[0893] The generative AI model generates hairstyle images based on the user's facial photo and desired hairstyle information.

[0894] The server transmits the generated hairstyle image to the user terminal and displays it.

[0895] 4. Check and correct the generated image

[0896] The user can check the generated hairstyle image on a smart device (such as smart glasses) and request corrections if necessary.

[0897] 5. NFT Tokenization and Trading of Generated Images

[0898] Depending on the user's wishes, the generated hairstyle image will be issued as an NFT token.

[0899] The server registers the NFT tokens on the blockchain network and publishes them on the marketplace.

[0900] The main hardware and software used are as follows:

[0901] Smart glasses: AR-enabled devices such as Oculus Quest 2

[0902] Server: AWS EC2 instance

[0903] AI models: OpenAI's GPT-4, DeepArt's style transfer model

[0904] Database: AWS RDS

[0905] Blockchain technology: Ethereum

[0906] For example, a customer at a beauty salon can put on smart glasses at the reception desk and voice-input the hairstyle they want, such as "shoulder-length bob." Images of hairstyles that fit the description will then appear on the glasses' display. The customer can then review the hairstyle images and consult with the hairdresser to determine the appropriate design. This allows customers to receive more satisfying service and reduces miscommunication.

[0907] The following are examples of possible prompt sentences:

[0908] "A customer visits a beauty salon and wants to use smart glasses to see how their hairstyle will look":

[0909] A customer visits a beauty salon and puts on a pair of smart glasses at the reception desk. They input their desired hairstyle into the smart glasses by voice, saying "a bob that falls over the shoulders," and a generated image of the hairstyle is instantly displayed on the glasses. The customer can then review the image with the hairdresser, who will help them decide on the hairstyle.

[0910] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0911] Step 1:

[0912] Users launch the application on their device, such as a smartphone or PC, and take a photo of their face or upload an existing image.

[0913] Input: User's face photo

[0914] Output: Facial photo data sent to the server

[0915] Data processing / calculation: Encode the face photo and send it to the server as an HTTPS request.

[0916] Step 2:

[0917] The server stores the received facial photos in a database and also performs validation such as checking for duplicates.

[0918] Input: User's face photo data

[0919] Output: Facial photo data stored in the database

[0920] Data processing / calculation: Facial photo data is stored in storage and associated with the user's account.

[0921] Step 3:

[0922] Users can enter their desired hairstyle in text on the application or upload an image of the hairstyle as a reference.

[0923] Input: Text or image of desired hairstyle

[0924] Output: Hair style preference data sent to the server

[0925] Data processing / calculation: Encode text data or image data and send it to the server as an HTTPS request.

[0926] Step 4:

[0927] The server prepares the received facial photo and desired hairstyle information for the generative AI model, which includes pre-processing the data and converting it into an appropriate format.

[0928] Input: Face photo data, desired hairstyle data

[0929] Output: Data format to feed to a generative AI model

[0930] Data processing / calculation: Convert the face photo and desired hairstyle data into a format that the AI ​​model can understand.

[0931] Step 5:

[0932] The generative AI model generates a suitable hairstyle image based on the user's facial photo and desired hairstyle information.

[0933] Input: Preprocessed face photo data, desired hairstyle data

[0934] Output: Generated hairstyle image

[0935] Data processing / calculation: Machine learning algorithms are used to match facial photos and generate hairstyles.

[0936] Step 6:

[0937] The server receives the generated hairstyle image and transmits it to the user's terminal.

[0938] Input: Generated hairstyle image data

[0939] Output: Hairstyle image sent to the user's device

[0940] Data processing / calculation: The generated hairstyle image is encoded and sent to the user's device via an HTTPS response.

[0941] Step 7:

[0942] The user can check the generated hairstyle image on a smart device such as smart glasses and request corrections if necessary.

[0943] Input: Generated hairstyle image

[0944] Output: User's correction request (if necessary)

[0945] Data processing / calculation: Check the generated image and send correction requests to the server as new data.

[0946] Step 8:

[0947] If the user wishes, they can send a request to issue an NFT token for the generated hairstyle image.

[0948] Input: Generated hairstyle image, NFT issuance request

[0949] Output: NFT issuance request sent to the server

[0950] Data processing / calculation: Image data and metadata are sent together to the server.

[0951] Step 9:

[0952] The server generates an NFT token corresponding to the image and registers it on the blockchain network.

[0953] Input: NFT issuance request and image data

[0954] Output: NFT token registered on the blockchain

[0955] Data processing / calculation: Tokens are generated using blockchain technology and registered on the network.

[0956] Step 10:

[0957] The server publishes information related to the issued NFT tokens on the marketplace and notifies users.

[0958] Input: NFT token information registered on the blockchain

[0959] Output: NFT token information published on the marketplace, notification to users

[0960] Data processing / calculation: Convert the data into the format required for the marketplace and publish it.

[0961] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0962] This invention relates to a system that uses generative AI to generate specific hairstyle images by having users register their own facial photos and input their desired hairstyle via text or image. This system makes it easier for users to share specific images with their hairdressers, reducing communication errors. It is also possible to issue NFT tokens for the generated hairstyle images, register them on a blockchain network, and trade them on the marketplace. Furthermore, by combining this with an emotion engine that recognizes the user's emotions, it is possible to suggest hairstyles based on the user's emotional state.

[0963] Program processing explanation

[0964] User registration phase

[0965] 1. The user installs and launches the app. The user proceeds to the new account creation screen and enters their name, email address, and password. The device collects this input data and, when the user presses the button to proceed to the next step, sends this data to the server.

[0966] 2. The server checks for duplicates in the received user data and, if there are no problems, saves it in the database. Once saved, the server returns a message to the device indicating account creation is complete.

[0967] 3. The device displays a UI that prompts the user to take a photo of their face. At this point, the user presses the capture button to launch the camera and take a photo of their face, or selects a photo from the gallery.

[0968] 4. The user takes or selects a photo of their face and presses the confirmation button. The device encodes the image data of the photo and sends it to the server.

[0969] 5. The server receives the face photo and stores it in an image database. Once stored, the image information is associated with the user's account.

[0970] Hairstyle preference input phase

[0971] 1. The user enters the desired hairstyle in text on the app screen. The user also has the option to upload an image of the hairstyle as a reference.

[0972] 2. The device collects the text data entered by the user and the hairstyle image uploaded and sends them to the server.

[0973] 3. The emotion engine recognizes the emotion from the user's facial photo and sends the emotion information to the server. For example, the emotion of the user, such as whether they are happy or sad, is analyzed here.

[0974] Hairstyle image generation phase

[0975] 1. The server prepares the received face photo, desired hairstyle data, and emotion information for the generative AI model. Specifically, the server converts this data into a format that the AI ​​model can understand.

[0976] 2. The generative AI model uses the user's facial photo, desired hairstyle data, and emotional information to generate a specific hairstyle image. This generated hairstyle image is temporarily stored in the server's storage.

[0977] 3. The server retrieves the generated hairstyle image and encodes it for transmission to the user's device. The server sends the hairstyle image data to the device via an HTTPS response.

[0978] Checking the image and sharing it with the hairdresser

[0979] 1. The terminal displays the generated hairstyle image on the user's screen. The user checks the hairstyle image and requests corrections if necessary. The data is then sent to the server again.

[0980] 2. The user presses the save button to save the image to local storage. Then, to show the hairdresser the hairstyle, the user can show the image directly to the hairdresser or share it via social media or a messaging app.

[0981] NFT token issuance and market registration phase

[0982] 1. The user selects the option to issue an NFT token for the generated hairstyle image. The device receives the user's selection and sends an NFT token issuance request.

[0983] 2. The device sends a request to the server to issue an NFT token, along with metadata and image data.

[0984] 3. The server generates an NFT token for the image and registers it on the blockchain network. Once complete, the issued token information is published on the marketplace.

[0985] 4. Users receive notifications and can browse and trade tokens on the marketplace. Users can buy and sell these tokens and earn revenue through trading.

[0986] As a concrete example, after a user uses the app and goes through the registration process, the emotion engine recognizes a "happy emotion" from the user's facial photo. Based on this emotional information, the generative AI model generates a hairstyle image that matches a lively atmosphere, which is ultimately displayed on the user's device. The user can show this image to their hairdresser, making it easier to share the specific hairstyle image. Furthermore, by issuing an NFT token for this hairstyle image, it can be sold and traded on the marketplace.

[0987] The processing flow will be explained below.

[0988] Step 1:

[0989] A user installs and launches the app. They proceed to the new account creation screen and enter their name, email address, and password. The device collects this input data and, when they press the button to proceed to the next step, sends it to the server.

[0990] Step 2:

[0991] The server checks and verifies the received user data for duplicates. After confirming that there are no duplicates, it saves the user information in the database. Once the saving is complete, the server returns a message to the device indicating that the account has been created.

[0992] Step 3:

[0993] The device displays a UI that prompts the user to take a photo of their face. The user presses the capture button to launch the camera and take a photo of their face, or selects a photo from the gallery.

[0994] Step 4:

[0995] The user takes or selects a photo of their face and presses the confirmation button. The device encodes the image data of the photo and sends it to the server.

[0996] Step 5:

[0997] The server receives the face photo and stores it in an image database. After storage is complete, the face photo information is associated with the user's account.

[0998] Step 6:

[0999] Users can enter their desired hairstyle in text on the app screen, and if they have an image of the hairstyle they want to use as a reference, they can also select the option to upload that image.

[1000] Step 7:

[1001] The terminal collects the text data entered by the user and the hairstyle image uploaded, and transmits them to the server.

[1002] Step 8:

[1003] The emotion engine analyzes the user's facial photo and recognizes their emotions, such as whether they look happy or sad, and sends the results to the server.

[1004] Step 9:

[1005] The server prepares the received facial photo, desired hairstyle data, and emotion information for delivery to the generative AI model, which involves converting the data into a format that the AI ​​model can understand.

[1006] Step 10:

[1007] The generative AI model uses the user's facial photo, desired hairstyle data, and emotional information to generate a specific hairstyle image, which is then temporarily stored in the server's storage.

[1008] Step 11:

[1009] The server retrieves the generated hairstyle image and encodes it for transmission to the user's device. The server then sends the hairstyle image data to the device via an HTTPS response.

[1010] Step 12:

[1011] The terminal displays the generated hairstyle image on the user's screen. The user checks the hairstyle image and requests corrections as necessary, and the request is sent to the server.

[1012] Step 13:

[1013] The user confirms the image and presses the save button to save the image to local storage. They can then show the image directly to their hairdresser or share it via social media or messaging apps.

[1014] Step 14:

[1015] The user selects the option to issue an NFT token for the generated hairstyle image, which causes the device to send an NFT token issuance request to the server.

[1016] Step 15:

[1017] The device sends a request to the server to issue an NFT token, along with metadata and image data.

[1018] Step 16:

[1019] Based on the data received, the server generates an NFT token corresponding to the image and registers it on the blockchain network. Once registration is complete, the issued token information is published on the marketplace.

[1020] Step 17:

[1021] Users receive notifications and can browse and trade NFT tokens on the marketplace. By buying and selling these tokens, users can earn revenue. This system not only embodies the user's desired hairstyle and reduces communication errors, but also suggests more suitable hairstyles through emotion recognition using an emotion engine, and further enables digital economic activity using NFT tokens.

[1022] Example 2

[1023] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1024] The present invention aims to provide a means for users to easily generate their desired hairstyle and other images based on their own facial images and to communicate specifically through the generated images. Furthermore, by clarifying ownership of the generated images and tokenizing them to make them tradable, it is possible to give them value as a new form of digital asset. Conventional systems often fail to accurately reflect the user's desired hairstyle or image, resulting in miscommunication. Furthermore, the lack of a means to establish ownership of generated digital images makes it difficult to trade them in the market. There is a need to solve these problems.

[1025] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1026] In this invention, the server includes: a means for a user to register their own image; a means for the user to input their desired image as text or an image; a means for generating an image based on the registered facial image and the input desired image information; a means for transmitting and displaying the generated image to the user's terminal; a means for issuing a token for the generated image and registering it in a distributed network; a means for publishing the issued token in an information disclosure system; a means for providing the user's facial image and desired image information to an algorithmic model to generate an image; a means for transmitting and displaying the generated image to the user's terminal; and a means for the user to request modifications as needed. This allows users to accurately generate their desired image and share specific images with hairdressers and others. Furthermore, by issuing an NFT token for the generated image and establishing ownership, it becomes possible to trade it as a digital asset.

[1027] A "user" is a person who uses this system to register their own facial image or desired image, and to generate hairstyles and other images.

[1028] "Image" refers to the facial image registered by the user and visual data corresponding to the hairstyle or other design desired by the user.

[1029] "Text" refers to information in the form of text that the user inputs about the hairstyle or image they desire.

[1030] "Generative AI" is an artificial intelligence system that automatically generates new hairstyle images and other designs based on the user's facial image, text, and desired image information.

[1031] "Terminal" refers to the device (smartphone, tablet, PC, etc.) that a user uses to operate this system.

[1032] The "server" is a computer system that receives user data, processes it, provides it to the generating AI, stores the generated images, and transmits them to the user.

[1033] "Token" refers to a digital representation of ownership of a generated hairstyle image or other product.

[1034] A "decentralized network" is a system in which tokens are recorded on a common ledger by multiple nodes without a centralized management entity.

[1035] "Information Disclosure System" means an online platform for public disclosure and display of issued Tokens and other information.

[1036] An "algorithmic model" refers to the computational logic and methods used to process a user's facial image or desired image information as input and generate the desired image.

[1037] A "modification request" refers to a user's request for changes or adjustments to a generated image.

[1038] This invention relates to a system that uses generative AI to generate specific images by allowing users to register their own facial images and input their desired hairstyle and other images via text or images. This system makes it easier for users to share specific images with their hairdressers, reducing communication errors. It is also possible to issue NFT tokens for the generated images, register them on a blockchain network, and trade them on a marketplace.

[1039] User registration phase

[1040] 1. The user installs and launches the app. They proceed to the new account creation screen and enter their name, email address, and password. The device collects this input data and sends it to the server when the user presses the button to proceed to the next step. This process is carried out using devices such as smartphones and tablets.

[1041] 2. The server checks for duplicates in the received user data and, if there are no problems, saves it in the database. Once saved, the server returns a message to the device indicating account creation is complete.

[1042] 3. The device displays a UI that prompts the user to take a photo of their face. At this point, the user presses the capture button to activate the camera and take a photo of their face, or select a photo from the gallery. After the user takes or selects a photo of their face and presses the confirmation button, the device encodes the image data of the photo and sends it to the server.

[1043] 4. The server receives the face photo, stores the data in an image database, and associates the image information with the user's account. Specifically, the image file is stored in a file storage or database.

[1044] Hairstyle preference input phase

[1045] 1. The user enters the desired hairstyle in text on the app screen. The user can also select the option to upload an image of the hairstyle as a reference.

[1046] 2. The device collects the text data entered by the user and the hairstyle image uploaded and sends them to the server.

[1047] 3. The emotion engine recognizes the emotion from the user's facial photo and sends the emotion information to the server. For example, the emotion is analyzed to determine whether the user looks happy or sad.

[1048] Hairstyle image generation phase

[1049] 1. The server receives the face photo, desired hairstyle data, and emotion information and prepares them for provision to the generative AI model. The server converts this data into a format that the AI ​​model can understand.

[1050] 2. The generative AI model generates a specific hairstyle image based on the user's facial photo, desired hairstyle data, and emotional information. This generated hairstyle image is temporarily stored in the server's storage.

[1051] 3. The server retrieves the generated hairstyle image and encodes it for transmission to the user's device. The server sends the hairstyle image data to the device via an HTTPS response.

[1052] Checking the image and sharing it with the hairdresser

[1053] 1. The terminal displays the generated hairstyle image on the user's screen. The user checks the hairstyle image and requests corrections if necessary. The data is then sent to the server again.

[1054] 2. The user presses the save button to save the image to local storage. Then, to show the hairdresser the hairstyle, the user can show the image directly to the hairdresser or share it via social media or a messaging app.

[1055] NFT token issuance and market registration phase

[1056] 1. The user selects the option to issue an NFT token for the generated hairstyle image. The device receives the user's selection and sends an NFT token issuance request.

[1057] 2. The device sends a request to the server to issue an NFT token, along with metadata and image data.

[1058] 3. The server generates an NFT token for the image and registers it on the blockchain network. Once complete, the issued token information is published on the marketplace.

[1059] 4. Users receive notifications and can browse and trade tokens on the marketplace. Users can buy and sell these tokens and earn revenue through trading.

[1060] Specific examples

[1061] For example, after a user uses the app and goes through the registration process, the emotion engine recognizes a "happy emotion" from the user's facial photo. Based on this emotional information, the generative AI model generates a hairstyle image that matches a lively atmosphere, which is ultimately displayed on the user's device. The user can show this image to their hairdresser, making it easier to share the specific hairstyle image they want. In addition, by issuing an NFT token for this hairstyle image, it can be sold and traded on the marketplace.

[1062] Prompt Sentence Examples

[1063] "Generate hairstyle images that match a lively atmosphere based on a photo of the user's face that shows a happy expression."

[1064] The above is a description of the embodiment of the present invention. This system allows users to accurately generate desired hairstyles and other images and use them as digital assets.

[1065] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1066] Processing Steps

[1067] User registration phase

[1068] Step 1:

[1069] A user installs and launches the app. The user proceeds to the new account creation screen and enters their name, email address, and password.

[1070] Input: Name, Email Address, Password

[1071] Output: Input data is sent to the server in JSON format

[1072] What it does: Your smartphone or tablet collects input data and sends it to the server via an HTTP POST request.

[1073] Step 2:

[1074] The server checks for duplicates in the received user data, and if there are no duplicates, stores them in the database.

[1075] Input: User data

[1076] Output: Results of duplicate check, saved to database

[1077] What happens: The server runs an SQL query to check for duplicate email addresses, and if there are no problems, it saves them to the database with an INSERT statement.

[1078] Step 3:

[1079] The server sends a message to the device indicating that the account has been created.

[1080] Input: Account creation completion status

[1081] Output: Account creation successful message

[1082] Specific operation: A message is sent to the terminal as an HTTP response with status code 200.

[1083] Step 4:

[1084] The device displays a UI that prompts the user to take a photo of their face. The user takes a photo of their face or selects a photo from the gallery.

[1085] Input: User-initiated camera or selection from gallery

[1086] Output: Captured photo data or selected photo data

[1087] Specific behavior: The camera app launches and a photo is taken, or an image selected from the gallery is retrieved from the device.

[1088] Step 5:

[1089] The user presses the "Confirm Face Photo" button. The device encodes the image data of the face photo and sends it to the server.

[1090] Input: Facial photo data

[1091] Output: Encoded image data

[1092] What happens: The image is encoded in a format such as Base64 and sent to the server as an HTTP request.

[1093] Step 6:

[1094] The server receives the face photo and stores it in an image database, which associates the image information with the user's account.

[1095] Input: Facial photo data

[1096] Output: Save to image database, associate with user account

[1097] Specific behavior: The image file is saved to file storage or a database, and the path to the image file is added to the user's database record.

[1098] Hairstyle preference input phase

[1099] Step 1:

[1100] Users enter their desired hairstyle in text on the app screen, and also have the option to upload an image of the hairstyle as a reference.

[1101] Input: Text data and image data of desired hairstyle

[1102] Output: Uploaded data

[1103] What it does: Collects text and images.

[1104] Step 2:

[1105] The terminal collects the text data entered by the user and the hairstyle image uploaded and sends them to the server.

[1106] Input: Text data, image data

[1107] Output: Data sent to the server

[1108] Specific behavior: Sends data to the server as an HTTP request.

[1109] Step 3:

[1110] The emotion engine recognizes emotions from the user's facial photograph and transmits the emotion information to the server.

[1111] Input: Facial photo data

[1112] Output: Emotion recognition result data

[1113] Specific operation: Image processing is performed and emotion recognition results are generated.

[1114] Hairstyle image generation phase

[1115] Step 1:

[1116] The server prepares the received facial photo, desired hairstyle data, and emotional information to provide to the generative AI model.

[1117] Input: Face photo data, desired hairstyle data, emotional information

[1118] Output: Data format for generative AI models

[1119] What happens: Data is formatted for the AI ​​model.

[1120] Step 2:

[1121] The generative AI model generates a specific hairstyle image based on the user's face photo, desired hairstyle data, and emotional information.

[1122] Input: Reformatted user data

[1123] Output: Generated hairstyle image

[1124] Specific operation: The AI ​​model performs inference processing and generates a hairstyle image.

[1125] Step 3:

[1126] The server acquires the generated hairstyle image and encodes it for transmission to the user's terminal.

[1127] Input: Generated hairstyle image

[1128] Output: Encoded image data

[1129] Specific behavior: Image data is encoded and sent to the device as an HTTPS response.

[1130] Checking the image and sharing it with the hairdresser

[1131] Step 1:

[1132] The terminal displays the generated hairstyle image on the user's screen, and the user checks the hairstyle image and requests corrections as necessary.

[1133] Input: Generated hairstyle image

[1134] Output: User confirmation result and correction request

[1135] What happens: The image is displayed on the device screen and user interactions are processed.

[1136] Step 2:

[1137] The user presses the save button to save the image to local storage, and then shows the image to the hairdresser directly or shares it via social media or messaging apps.

[1138] Input: Saved image data

[1139] Output: Images saved in local storage, shared images

[1140] What it does: The image is saved to your device's storage and can be transferred to other apps or services using the share feature.

[1141] NFT token issuance and market registration phase

[1142] Step 1:

[1143] The user selects the option to issue an NFT token for the generated hairstyle image.

[1144] Input: Token issuance request by user operation

[1145] Output: Token issuance request data

[1146] Specific operation: A token issuance request is generated.

[1147] Step 2:

[1148] The device sends a request to issue an NFT token to the server, along with metadata and image data.

[1149] Input: Metadata, image data

[1150] Output: Token issuance request sent to the server

[1151] What happens: Data is sent to the server as an HTTP request.

[1152] Step 3:

[1153] The server generates an NFT token for the image and registers it on the decentralized network.

[1154] Input: Metadata, image data

[1155] Output: Token registered on the blockchain

[1156] Specific behavior: Token generation is completed and the transaction is added to the blockchain.

[1157] Step 4:

[1158] After the server is complete, it will publish the issued token information to the marketplace.

[1159] Input: Token information

[1160] Output: Published token information

[1161] Specific operation: Token information is registered using the marketplace API.

[1162] Step 5:

[1163] Users receive notifications and can browse and trade tokens on the marketplace.

[1164] Input: Push notification or email

[1165] Output: Tokens traded on the marketplace

[1166] What happens: A notification is sent to the user, who then trades the token on the marketplace.

[1167] (Application example 2)

[1168] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1169] Conventional hairstyle suggestion systems have had problems with insufficient sharing of specific images between users and hairdressers, leading to frequent miscommunication. Furthermore, it is difficult to suggest hairstyles based on the user's emotions or current mood, making it difficult to provide personalized services. Furthermore, there are limited ways to commercially use the generated hairstyle images.

[1170] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1171] In this invention, the server includes a means for recognizing emotions from a user's facial photograph, a means for providing emotion information to a generative AI model, and a means for issuing the generated hairstyle image as an NFT token and registering it on a blockchain network. This enables personalized hairstyle suggestions based on the user's emotions, expanding the commercial use of the generated hairstyle image.

[1172] A "user" is a person who uses this system and provides a photograph of their face and information about their desired hairstyle.

[1173] A "face photo" is image data of a user's face, and is primarily used for analysis by generative AI models and emotion engines.

[1174] "Text" is an information format in which the user inputs the desired hairstyle or style in text.

[1175] "Image" is visual data such as a photograph or illustration that specifically shows the hairstyle desired by the user.

[1176] "Generative AI" is an artificial intelligence that generates specific hairstyle images based on a user's facial photo, desired hairstyle information, and emotional information.

[1177] The "emotion engine" is a system that analyzes the emotions of a user from a facial photograph and acquires the user's emotional information.

[1178] An "NFT token" is a non-fungible token issued for a generated hairstyle image, and is a digital asset that is unique on the blockchain.

[1179] A "blockchain network" is a distributed database technology and infrastructure for securely issuing and trading NFT tokens.

[1180] The "Marketplace" is a market where NFT tokens are bought and sold, and a platform that enables the commercial use of generated hairstyle images.

[1181] A "modification request" is a request from a user for changes or improvements to the generated hairstyle image.

[1182] This invention relates to a system that uses AI to generate a specific hairstyle image by allowing a user to register a photo of their face and input desired hairstyle information. This system uses the following hardware and software:

[1183] Hardware and software used

[1184] 1. Smartphone: A device on which users install and operate apps.

[1185] 2. Cloud server: A server that stores user data and runs generative AI models.

[1186] 3. Emotion Engine: This is a system for recognizing emotions from a user's facial photograph, and Azure Cognitive Services is used as an example.

[1187] 4. Generative AI model: A model for generating hairstyle images based on a user's facial photo, desired hairstyle information, and emotional information. Examples include Stable Diffusion and MidJourney.

[1188] 5. Blockchain network: This is the infrastructure for issuing and registering NFT tokens, and examples include Ethereum and Polygon.

[1189] Processing flow

[1190] This system basically operates in the following steps. First, the user installs and launches the smartphone app to create a new account. After completing the account creation, they register a photo of their face and input their desired hairstyle using text or an image. At this point, the emotion engine analyzes the emotional information from the user's face photo and provides it to the generative AI model. The generative AI model generates a hairstyle image based on this information and saves it on a cloud server. The hairstyle image is then sent to the user's smartphone and displayed.

[1191] Specific data processing

[1192] First, a photo of the user's face is taken with a smartphone and sent to a cloud server. The cloud server stores this face photo data in an image database and simultaneously passes it to an emotion engine for emotional analysis. The analyzed emotional information, along with desired hairstyle information, is provided to a generative AI model. The generative AI model generates a specific hairstyle image based on the user's face photo, emotional information, and hairstyle information. This generated hairstyle image is temporarily stored on the cloud server and then sent to the user's smartphone.

[1193] Prompt Sentence Examples

[1194] The generative AI model generates hairstyle images using prompt sentences such as the following:

[1195] Example prompt: "Generate a cheerful, short hairstyle with bangs for a happy-looking person."

[1196] Usage example

[1197] For example, suppose a user takes a photo of their face with a happy expression. Based on this photo, the emotion engine recognizes the "happy emotion" and inputs this emotion information into the generative AI model. Based on this emotion information and the user's desired hairstyle information, the generative AI model generates an image of a hairstyle that matches a lively atmosphere and displays it on the user's smartphone. The user can check this hairstyle image and show it to their hairdresser, making it easier to share a specific image.

[1198] This system allows users to easily get hairstyles that suit their emotions, reducing miscommunication between them and their hairdressers. Furthermore, by issuing NFT tokens for the generated hairstyle images, it can be used commercially.

[1199] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1200] Step 1: User registration phase

[1201] The user installs and launches the smartphone app. The user proceeds to the new account creation screen and enters their name, email address, and password. This input data is collected by the device, and when the user presses the button to proceed to the next step, the data is sent to the cloud server. The cloud server checks the received user data for duplicates and, if there are no problems, stores it in a database. Once the data is saved, the server returns a message to the device indicating that account creation has been completed. In this phase, the input is user information (name, email address, password), and the output is a message indicating that account creation has been completed.

[1202] Step 2: Register your face photo

[1203] The user takes a photo of their face using a smartphone app. When the app presses the capture button, the camera starts up and the user takes a photo of their face or selects a photo from the gallery. The device encodes the image data of the face photo and sends it to the server. The server receives this image data and stores it in an image database. In this step, the face photo is the input and the image data is registered to the server as the output.

[1204] Step 3: Enter your desired hairstyle

[1205] The user enters the desired hairstyle in text on the app screen. The user can also select the option to upload an image of the hairstyle as a reference. The device collects the entered text data and the uploaded hairstyle image and sends them to the server. In this step, the input is hairstyle information (text and image), and the output is the registration of hairstyle data to the server.

[1206] Step 4: Recognizing emotional information

[1207] The emotion engine recognizes emotions from the user's facial photo. The cloud server calls the emotion engine and analyzes the facial photo. The recognized emotion information is sent back to the server as the analysis result. In this step, the facial photo is the input and the emotion information is the output.

[1208] Step 5: Generate hairstyle images

[1209] The server prepares the received face photo, desired hairstyle information, and emotional information to provide to the generative AI model. Specifically, the server converts this data into a format that the AI ​​model can understand. The generative AI model (e.g., Stable Diffusion) uses the user's face photo, desired hairstyle data, and emotional information to generate a specific hairstyle image. This generated hairstyle image is temporarily stored in the server's storage. In this step, the input is the face photo, hairstyle information, and emotional information, and the output is the generated hairstyle image.

[1210] Step 6: Send and view hairstyle images

[1211] The server obtains the generated hairstyle image and encodes it for sending to the user's device. The server sends the hairstyle image data to the device in an HTTPS response. The device displays the received hairstyle image on the user's screen. If the user checks the hairstyle image and requests corrections as necessary, the data is sent to the server again. In this step, the input is the generated hairstyle image, and the output is a display on the user's device and a request to correct it.

[1212] Step 7: Save and share your image

[1213] The user presses the save button to save the image to local storage. Then, to show this hairstyle image to the hairdresser, the user can show the image directly to the hairdresser or share it via social media or a messaging app. In this step, the hairstyle image is the input, and saving to local storage and sharing are the outputs.

[1214] Step 8: Issue NFT tokens and register them on the market

[1215] The user selects the option to issue an NFT token for the generated hairstyle image. The device receives the user's selection and sends an NFT token issuance request. The server receives the request to issue an NFT token, generates an NFT token for the image, and registers it on the blockchain network. Once completed, the issued token information is published to the marketplace. In this step, the input is the hairstyle image and the NFT issuance request, and the output is the NFT token and registration on the marketplace.

[1216] By sequentially executing the above processing steps, the user is suggested a hairstyle that suits them, making it easier to share specific images with a hairdresser, and furthermore, the generated hairstyle image can be used commercially.

[1217] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1218] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1219] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1220] [Third embodiment]

[1221] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1222] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1223] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1224] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1225] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1226] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1227] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1228] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1229] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1230] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1231] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1232] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1233] This invention relates to a system that uses generative AI to generate a specific hairstyle image by allowing users to register a photo of their face and input their desired hairstyle via text or image. This system makes it easier for users to share their specific image with their hairdresser, reducing communication errors. It is also possible to issue an NFT token for the generated hairstyle image, register it on a blockchain network, and trade it on a marketplace.

[1234] Program processing explanation

[1235] User registration phase

[1236] 1. A user installs the app and creates an account.

[1237] The user enters their name, email address, password, etc.

[1238] The terminal sends the input data to the server.

[1239] 2. The server receives the user information and stores it in a database.

[1240] The server performs a duplicate check on the user information.

[1241] After checking, if there are no problems, the user information is saved in the database.

[1242] 3. The device displays a UI to prompt the user to take a photo of their face.

[1243] It offers a photo button and the option to select from the gallery.

[1244] 4. The user takes a photo of their face or selects one from the gallery and uploads it.

[1245] The user clicks the capture button to start the camera.

[1246] After taking the photo, click the "OK" button to select the face photo.

[1247] 5. The device sends the facial photo data to the server.

[1248] The image data of the face photo is encoded and an HTTPS request is sent to the server.

[1249] 6. The server receives the facial photo and stores it in an image database.

[1250] The server stores the image in storage and associates it with the user account.

[1251] Hairstyle preference input phase

[1252] 1. The user enters the desired hairstyle in text in the app's text input field.

[1253] The user inputs a desired hairstyle, such as "short bob," into a text box.

[1254] 2. Users also have the option to upload an image of their hairstyle as a reference.

[1255] The user selects a reference image from the gallery and presses the upload button.

[1256] 3. The device receives user input or uploads and sends the data to the server.

[1257] The text data and image data are encoded together and an HTTPS request is sent to the server.

[1258] Hairstyle image generation phase

[1259] 1. The server prepares to provide the received face photo and desired hairstyle data to the generative AI model.

[1260] The server converts the face photo and desired hairstyle data into a format that the AI ​​model can understand.

[1261] 2. The generative AI model generates an image of the desired hairstyle that matches the user's face photo.

[1262] The AI ​​model generates a hairstyle image based on a face photo and text (or a reference image).

[1263] The generated image is temporarily stored in the server's storage.

[1264] 3. The server receives the generated hairstyle image and sends it to the user's device.

[1265] The generated image is encoded and sent to the user's device in an HTTPS response.

[1266] Checking the image and sharing it with the hairdresser

[1267] 1. The device displays the generated hairstyle image to the user.

[1268] Open an image viewer and view the generated hairstyle image.

[1269] 2. The user reviews the image and can request corrections if necessary.

[1270] When the user presses the "Request revision" button, a form will appear where the user can enter their desired hairstyle again.

[1271] 3. Save the image once the user has confirmed it.

[1272] Click the "Save" button to save the image to your local storage.

[1273] 4. The user shows the saved image to the hairdresser and shares the specific hairstyle image.

[1274] You can show the image directly to your hairdresser or share it on social media or messaging apps.

[1275] NFT token issuance and market registration phase

[1276] 1. The user selects the option to issue an NFT token for the generated hairstyle image.

[1277] Click the "Tokenize NFT" button in the app.

[1278] 2. The device sends a request to the server to issue an NFT token.

[1279] The necessary metadata and image data are collected and sent as a request to the server.

[1280] 3. The server generates an NFT token corresponding to the image and registers it on the blockchain.

[1281] The server communicates with the blockchain network to generate and register tokens.

[1282] 4. The server publishes information related to the issued NFT tokens to the market.

[1283] Upload token information to the NFT marketplace and notify users.

[1284] 5. Users will be able to trade tokens on the market.

[1285] Users can buy, sell, or rent tokens on the marketplace.

[1286] In this way, the present invention not only allows users to easily create and share specific hairstyle requests with their hairdressers, but also allows users to issue and trade the generated images as NFTs. This system reduces miscommunication and improves customer satisfaction.

[1287] The processing flow will be explained below.

[1288] Step 1:

[1289] A user installs and launches the app. The user proceeds to the new account creation screen and enters their name, email address, and password. The device collects this input data and, when the user presses the button to proceed to the next step, sends this data to the server.

[1290] Step 2:

[1291] The server checks for duplicates in the received user data and, if there are no problems, saves it in the database. Once the saving is complete, the server returns a message to the device indicating that account creation is complete.

[1292] Step 3:

[1293] The device displays a UI that prompts the user to take a photo of their face. The user then presses the capture button to launch the camera and take a photo of their face, or selects a photo from the gallery.

[1294] Step 4:

[1295] The user takes or selects a photo of their face and presses the confirmation button. The device encodes the image data of the photo and sends it to the server.

[1296] Step 5:

[1297] The server receives the face photo and stores it in an image database, then associates the image with the user's account.

[1298] Step 6:

[1299] Users can enter their desired hairstyle in text on the app screen, and also have the option to upload an image of the hairstyle they want as a reference.

[1300] Step 7:

[1301] The terminal collects the text data entered by the user and the hairstyle image uploaded and sends them to the server.

[1302] Step 8:

[1303] The server prepares the received face photo and desired hairstyle data to provide to the generative AI model. Specifically, the server converts the face photo and desired hairstyle text or image data into a format that the AI ​​model can understand.

[1304] Step 9:

[1305] The generative AI model uses the user's face photo and desired hairstyle data to generate a specific hairstyle image, which is temporarily stored in the server's storage.

[1306] Step 10:

[1307] The server retrieves the generated hairstyle image and encodes it for transmission to the user's device. The server then sends the hairstyle image data to the device via an HTTPS response.

[1308] Step 11:

[1309] The terminal displays the generated hairstyle image on the user's screen. If the user checks the hairstyle image and requests corrections as necessary, the data is sent to the server again.

[1310] Step 12:

[1311] The user presses the save button to save the image to local storage, and then shows the image directly to the hairdresser or shares it via social media or a messaging app to show the hairdresser the hairstyle.

[1312] Step 13:

[1313] The user selects the option to issue an NFT token for the generated hairstyle image. The device receives the user's selection and sends an NFT token issuance request.

[1314] Step 14:

[1315] The device sends a request to issue an NFT token to the server, along with metadata and image data.

[1316] Step 15:

[1317] The server generates an NFT token for the image and registers it on the blockchain network. Once complete, the issued token information is published on the marketplace.

[1318] Step 16:

[1319] Users will receive notifications and can browse and trade tokens on the marketplace, where they can buy and sell these tokens and earn revenue through trading.

[1320] Example 1

[1321] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1322] In the past, it was difficult for hairdressers and customers to share their hairstyle images, which often led to miscommunication. This could result in lower customer satisfaction. Furthermore, there was a lack of means to protect the generated hairstyle images and use them commercially.

[1323] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1324] In this invention, the server includes a means for a user to register their own facial photo, a means for the user to input their desired hairstyle using text or an image, a generation AI that generates a hairstyle image based on the registered facial photo and the input desired hairstyle information, a means for transmitting and displaying the generated hairstyle image to the user's terminal, and a means for the user to check the hairstyle image and request modifications. This allows for the generation of a specific hairstyle image that meets the user's preferences, enabling smooth communication with the hairdresser. The server also includes a means for issuing an NFT token for the generated hairstyle image and registering it on a blockchain network, and a means for publishing the issued NFT token on a marketplace, enabling the hairstyle image to be converted into a digital asset and used commercially.

[1325] A "user" is someone who uses this system to register a photo of their face and input their desired hairstyle.

[1326] "Generative AI" refers to an artificial intelligence model that generates hairstyle images based on a user's facial photo and desired hairstyle information entered.

[1327] "User terminal" refers to a device used by a user to access this system, such as a smartphone or PC.

[1328] An "NFT token" is a digital proof of ownership issued to the generated hairstyle image and registered on a blockchain network.

[1329] "Blockchain network" refers to a network that uses distributed ledger technology to record and manage data.

[1330] "Marketplace" refers to the digital marketplace where NFT tokens are bought, sold, or rented.

[1331] The "means for requesting modifications" refers to a function for re-inputting information into the system when a user desires to make changes to the generated hairstyle image.

[1332] "Means of registration" refers to the function that allows users to input and save their own face photo and desired hairstyle information into the system.

[1333] The "means for inputting a desired hairstyle" refers to a function that allows a user to provide information about a desired hairstyle using text or an image.

[1334] The "means for transmitting and displaying the generated hairstyle image" refers to a function for transferring the hairstyle image generated by the server to the user's terminal and displaying the image to the user.

[1335] This invention is a system that uses a generative AI model to generate a specific hairstyle image by allowing users to register a photo of their face and input their desired hairstyle via text or image. This system makes it easier for users to share their specific image with their hairdresser, reducing communication errors. It is also possible to issue an NFT token for the generated hairstyle image, register it on the blockchain network, and trade it on the marketplace.

[1336] Hardware and software used

[1337] Hardware: Servers (cloud servers and database servers), user devices (smartphones, PCs)

[1338] Software: AI image generation models (e.g., DALL-E), blockchain technology (e.g., Ethereum), database management systems (e.g., MySQL)

[1339] System Overview

[1340] 1. User Registration:

[1341] A user installs the app and creates an account by entering their name, email address, and password. The device sends this information to the server via HTTPS, and the server stores it in a database.

[1342] After creating an account, the device displays a UI that prompts the user to take a photo of their face or select one from the gallery. The user provides a photo of their face, and the data is sent from the device to the server.

[1343] The server stores the facial photo in a database and associates it with the user account.

[1344] 2. Enter your desired hairstyle:

[1345] The user enters the desired hairstyle into a text input field within the app (e.g., "short bob").

[1346] Users can also upload images of hairstyles for reference.

[1347] The terminal encodes this data and sends it to the server.

[1348] 3. Hairstyle image generation:

[1349] The server receives the face photo and desired hairstyle data and provides it to the AI ​​image generation model, which converts this data into a format that the generative AI model can understand.

[1350] The generative AI model generates an image of the desired hairstyle that matches the user's face photo. As an example of the prompt sentence, we use "A short bob hairstyle that matches this face photo."

[1351] The generated hairstyle image is temporarily stored in the server's storage and then sent to the user's device via an HTTPS response.

[1352] 4. View and share images:

[1353] The terminal displays the generated hairstyle image to the user, who can review the image and request corrections if necessary.

[1354] Save the final image and show it directly to your hairdresser or share it on social media or messaging apps.

[1355] 5. Issuance and trading of NFT tokens:

[1356] The user selects the option to issue an NFT token for the generated hairstyle image, and sends the necessary metadata and image data from the device to the server.

[1357] The server generates an NFT token corresponding to the image and registers it on the blockchain network, then publishes the token information on the marketplace and notifies users.

[1358] Users can buy, sell, or rent tokens on the marketplace.

[1359] In this way, the present invention not only allows users to easily create and share specific hairstyle requests with their hairdressers, but also allows users to issue and trade the generated images as NFTs. This system reduces miscommunication and improves customer satisfaction.

[1360] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1361] Step 1:

[1362] A user installs the app and creates an account.

[1363] Input: Name, email address, password

[1364] How it works: A user downloads and installs the app from the App Store or Google Play, launches the app, clicks the "Sign Up" button, and is presented with a form where they can enter their name, email address, and password.

[1365] Output: The entered user information is saved on the device.

[1366] Step 2:

[1367] The terminal sends the input data to the server.

[1368] Input: User information (name, email address, password)

[1369] How it works: When a user fills out the form and presses the "Register" button, the device sends the input data to the server using HTTPS.

[1370] Output: The server receives the user information.

[1371] Step 3:

[1372] The server stores the user information in a database.

[1373] Input: User information (name, email address, password)

[1374] What it does: After the server receives the data, it checks for duplicates and saves the new user information to the database.

[1375] Output: The registered user information is saved in the database.

[1376] Step 4:

[1377] The device will display a UI for taking or selecting a face photo.

[1378] Input: None (interface provided)

[1379] Operation: After user registration is complete, the device displays a UI for "registering a face photo." It displays a button to take a photo and a button to select from the gallery.

[1380] Output: The face photo registration screen is displayed to the user.

[1381] Step 5:

[1382] The user takes or selects and uploads a photo of their face.

[1383] Input: Face photo data (take a photo or select)

[1384] How it works: The user clicks the camera button to take a photo of their face, then clicks the "OK" button or selects an existing photo from the gallery.

[1385] Output: The selected or taken face photo is temporarily saved on the device.

[1386] Step 6:

[1387] The terminal transmits the facial photo data to the server.

[1388] Input: Facial photo data

[1389] What it does: Encodes the face photo data and sends it to the server using an HTTPS request.

[1390] Output: The server receives the face photo data.

[1391] Step 7:

[1392] The server stores the facial photos in an image database.

[1393] Input: Facial photo data

[1394] How it works: The server receives the image data and stores it in storage, associating the image with the user's account.

[1395] Output: The face photo stored in the image database is registered.

[1396] Step 8:

[1397] The user inputs the desired hairstyle by text.

[1398] Input: Text of desired hairstyle (e.g. "Short bob")

[1399] How it works: A user enters their desired hairstyle into a text input field within the app.

[1400] Output: The text data of the desired hairstyle is temporarily saved on the device.

[1401] Step 9:

[1402] User uploads reference image.

[1403] Input: Reference hairstyle image

[1404] How it works: The user selects a hairstyle reference image from the gallery and presses the "Upload" button.

[1405] Output: The selected reference image is temporarily saved on the device.

[1406] Step 10:

[1407] The terminal sends the input data to the server.

[1408] Input: Hairstyle text data, reference image

[1409] What it does: Encodes text and image data and sends it to the server in an HTTPS request.

[1410] Output: The server receives the desired hairstyle data and reference images.

[1411] Step 11:

[1412] The server prepares the input data to serve as a generative AI model.

[1413] Input: Face photo data, desired hairstyle data, reference image

[1414] How it works: The server converts the received face photo and desired hairstyle data into a format that the generative AI model can understand.

[1415] Output: A dataset is prepared in a format that can be input into an AI model.

[1416] Step 12:

[1417] A generative AI model generates hairstyle images.

[1418] Input: Face photo data, desired hairstyle data (text or reference image)

[1419] How it works: The generative AI model generates a hairstyle image based on input data (a face photo and desired hairstyle). An example of a prompt sentence is "A short bob hairstyle that suits this face photo."

[1420] Output: The generated hairstyle image is temporarily saved.

[1421] Step 13:

[1422] The server transmits the generated hairstyle image to the terminal.

[1423] Input: Generated hairstyle image

[1424] What it does: The generated hairstyle image is encoded and sent to the user's device in an HTTPS response.

[1425] Output: The generated hairstyle image is received on the user's terminal.

[1426] Step 14:

[1427] The terminal displays the generated hairstyle image.

[1428] Input: Generated hairstyle image

[1429] Action: The device opens an image viewer and displays the generated hairstyle image.

[1430] Output: The user can check the generated hairstyle image.

[1431] Step 15:

[1432] The user checks the image and saves it or requests corrections.

[1433] Input: Generated hairstyle image

[1434] How it works: The user checks the image and clicks the "Save" button to save it to local storage. If any corrections are needed, the user clicks the "Request corrections" button and a form is displayed where the user can re-enter their hairstyle preference.

[1435] Output: Saved image data, input data for correction requests (if necessary).

[1436] Step 16:

[1437] The user shares the image with the hairdresser.

[1438] Input: Generated hairstyle image

[1439] How it works: The user shows the image to the hairdresser directly or shares it via social media or messaging apps.

[1440] Output: Hairstyle image shared with hairdresser.

[1441] Step 17:

[1442] The user chooses to issue an NFT token.

[1443] Input: Generated hairstyle image

[1444] How it works: Click the "Tokenize NFT" button in the app.

[1445] Output: The tokenization request data is temporarily saved on the device.

[1446] Step 18:

[1447] The device sends an NFT token issuance request to the server.

[1448] Input: Generated hairstyle image, metadata

[1449] How it works: The necessary metadata and image data are bundled together and sent as a request to the server.

[1450] Output: NFT token issuance request sent to the server.

[1451] Step 19:

[1452] The server generates NFT tokens and registers them on the blockchain.

[1453] Input: Generated hairstyle image, metadata

[1454] How it works: The server communicates with the blockchain network to generate and register tokens.

[1455] Output: NFT token information registered on the blockchain.

[1456] Step 20:

[1457] The server publishes the NFT token information to the market.

[1458] Input: NFT token information

[1459] What it does: Uploads token information to the NFT marketplace and notifies users.

[1460] Output: NFT token information published on the marketplace.

[1461] Step 21:

[1462] Users trade tokens on the market.

[1463] Input: NFT token information

[1464] How it works: Users buy, sell, or rent tokens on the marketplace.

[1465] Output: The traded NFT tokens.

[1466] (Application example 1)

[1467] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1468] Traditional methods for proposing and confirming hairstyles at beauty salons depended on communication between the user and the hairdresser, making it difficult to share specific ideas. As a result, the user's desired hairstyle was not accurately conveyed, leading to a high likelihood of dissatisfaction with the finished product. Furthermore, methods for issuing and trading NFT tokens as a new means of providing value by utilizing the generated hairstyle images had not yet been fully established.

[1469] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1470] In this invention, the server includes: a means for a user to register their own facial photo; a means for the user to input their desired hairstyle in text or image; a means for having a generation AI that generates a hairstyle image based on the registered facial photo and the input desired hairstyle information; a means for transmitting and displaying the generated hairstyle image to a user terminal; and a means for the user to input their desired hairstyle using a smart device and confirm and modify the generated hairstyle image. This allows the user to visually confirm their specific desired hairstyle using the generation AI, facilitating communication with their hairdresser. Furthermore, the generated hairstyle image can be used to issue NFT tokens, which can be registered on a blockchain network and traded on a marketplace.

[1471] The term "user" refers to a person who uses this system to input a desired hairstyle and view the generated hairstyle image.

[1472] "Facial photo" refers to image data of a user's face.

[1473] "Text or image" refers to text information that the user inputs to express the hairstyle they desire, or a hairstyle image for reference.

[1474] "Generative AI" refers to artificial intelligence technology that generates hairstyle images that suit a user based on a photo of the user's face and desired hairstyle information.

[1475] "User terminal" refers to an electronic device such as a smartphone, tablet, or smart glasses that is used to display a hairstyle image.

[1476] A "smart device" refers to a multifunctional electronic device that is connected to the Internet and can run applications.

[1477] "Confirmation and correction" refers to the act of the user checking the generated hairstyle image and requesting changes if necessary.

[1478] "NFT token" refers to a unique token on the blockchain issued for the generated hairstyle image.

[1479] A "blockchain network" refers to a network that uses distributed ledger technology to issue and manage NFT tokens.

[1480] "Marketplace" refers to an online platform for publishing and trading issued NFT tokens.

[1481] "Smart glasses" refers to a wearable device that can display visual information when worn on the head.

[1482] This invention provides a system in which a user registers a photo of their face and inputs their desired hairstyle using text or an image. The system utilizes AI technology to generate a hairstyle image based on the user's input face photo and desired hairstyle information, and transmits it to the user's terminal for display. Furthermore, the generated hairstyle image can be issued as an NFT token as needed, registered on the blockchain network, and published on the marketplace.

[1483] The system is configured as follows:

[1484] 1. Registering a user's face photo

[1485] Users start the application on their smartphone, PC, or other device and register a photo of their face. They can either take a photo using the camera or upload an existing image.

[1486] The server receives the registered facial photograph and stores it in a database.

[1487] 2. Enter your desired hairstyle

[1488] Users can upload their desired hairstyle via text input or a reference image on the application.

[1489] The server receives information about the desired hairstyle and inputs it into a generative AI model.

[1490] 3. Hairstyle Image Generation

[1491] The generative AI model generates hairstyle images based on the user's facial photo and desired hairstyle information.

[1492] The server transmits the generated hairstyle image to the user terminal and displays it.

[1493] 4. Check and correct the generated image

[1494] The user can check the generated hairstyle image on a smart device (such as smart glasses) and request corrections if necessary.

[1495] 5. NFT Tokenization and Trading of Generated Images

[1496] Depending on the user's wishes, the generated hairstyle image will be issued as an NFT token.

[1497] The server registers the NFT tokens on the blockchain network and publishes them on the marketplace.

[1498] The main hardware and software used are as follows:

[1499] Smart glasses: AR-enabled devices such as Oculus Quest 2

[1500] Server: AWS EC2 instance

[1501] AI models: OpenAI's GPT-4, DeepArt's style transfer model

[1502] Database: AWS RDS

[1503] Blockchain technology: Ethereum

[1504] For example, a customer at a beauty salon can put on smart glasses at the reception desk and voice-input the hairstyle they want, such as "shoulder-length bob." Images of hairstyles that fit the description will then appear on the glasses' display. The customer can then review the hairstyle images and consult with the hairdresser to determine the appropriate design. This allows customers to receive more satisfying service and reduces miscommunication.

[1505] The following are examples of possible prompt sentences:

[1506] "A customer visits a beauty salon and wants to use smart glasses to see how their hairstyle will look":

[1507] A customer visits a beauty salon and puts on a pair of smart glasses at the reception desk. They input their desired hairstyle into the smart glasses by voice, saying "a bob that falls over the shoulders," and a generated image of the hairstyle is instantly displayed on the glasses. The customer can then review the image with the hairdresser, who will help them decide on the hairstyle.

[1508] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1509] Step 1:

[1510] Users launch the application on their device, such as a smartphone or PC, and take a photo of their face or upload an existing image.

[1511] Input: User's face photo

[1512] Output: Facial photo data sent to the server

[1513] Data processing / calculation: Encode the face photo and send it to the server as an HTTPS request.

[1514] Step 2:

[1515] The server stores the received facial photos in a database and also performs validation such as checking for duplicates.

[1516] Input: User's face photo data

[1517] Output: Facial photo data stored in the database

[1518] Data processing / calculation: Facial photo data is stored in storage and associated with the user's account.

[1519] Step 3:

[1520] Users can enter their desired hairstyle in text on the application or upload an image of the hairstyle as a reference.

[1521] Input: Text or image of desired hairstyle

[1522] Output: Hair style preference data sent to the server

[1523] Data processing / calculation: Encode text data or image data and send it to the server as an HTTPS request.

[1524] Step 4:

[1525] The server prepares the received facial photo and desired hairstyle information for the generative AI model, which includes pre-processing the data and converting it into an appropriate format.

[1526] Input: Face photo data, desired hairstyle data

[1527] Output: Data format to feed to a generative AI model

[1528] Data processing / calculation: Convert the face photo and desired hairstyle data into a format that the AI ​​model can understand.

[1529] Step 5:

[1530] The generative AI model generates a suitable hairstyle image based on the user's facial photo and desired hairstyle information.

[1531] Input: Preprocessed face photo data, desired hairstyle data

[1532] Output: Generated hairstyle image

[1533] Data processing / calculation: Machine learning algorithms are used to match facial photos and generate hairstyles.

[1534] Step 6:

[1535] The server receives the generated hairstyle image and transmits it to the user's terminal.

[1536] Input: Generated hairstyle image data

[1537] Output: Hairstyle image sent to the user's device

[1538] Data processing / calculation: The generated hairstyle image is encoded and sent to the user's device via an HTTPS response.

[1539] Step 7:

[1540] The user can check the generated hairstyle image on a smart device such as smart glasses and request corrections if necessary.

[1541] Input: Generated hairstyle image

[1542] Output: User's correction request (if necessary)

[1543] Data processing / calculation: Check the generated image and send correction requests to the server as new data.

[1544] Step 8:

[1545] If the user wishes, they can send a request to issue an NFT token for the generated hairstyle image.

[1546] Input: Generated hairstyle image, NFT issuance request

[1547] Output: NFT issuance request sent to the server

[1548] Data processing / calculation: Image data and metadata are sent together to the server.

[1549] Step 9:

[1550] The server generates an NFT token corresponding to the image and registers it on the blockchain network.

[1551] Input: NFT issuance request and image data

[1552] Output: NFT token registered on the blockchain

[1553] Data processing / calculation: Tokens are generated using blockchain technology and registered on the network.

[1554] Step 10:

[1555] The server publishes information related to the issued NFT tokens on the marketplace and notifies users.

[1556] Input: NFT token information registered on the blockchain

[1557] Output: NFT token information published on the marketplace, notification to users

[1558] Data processing / calculation: Convert the data into the format required for the marketplace and publish it.

[1559] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1560] This invention relates to a system that uses generative AI to generate specific hairstyle images by having users register their own facial photos and input their desired hairstyle via text or image. This system makes it easier for users to share specific images with their hairdressers, reducing communication errors. It is also possible to issue NFT tokens for the generated hairstyle images, register them on a blockchain network, and trade them on the marketplace. Furthermore, by combining this with an emotion engine that recognizes the user's emotions, it is possible to suggest hairstyles based on the user's emotional state.

[1561] Program processing explanation

[1562] User registration phase

[1563] 1. The user installs and launches the app. The user proceeds to the new account creation screen and enters their name, email address, and password. The device collects this input data and, when the user presses the button to proceed to the next step, sends this data to the server.

[1564] 2. The server checks for duplicates in the received user data and, if there are no problems, saves it in the database. Once saved, the server returns a message to the device indicating account creation is complete.

[1565] 3. The device displays a UI that prompts the user to take a photo of their face. At this point, the user presses the capture button to launch the camera and take a photo of their face, or selects a photo from the gallery.

[1566] 4. The user takes or selects a photo of their face and presses the confirmation button. The device encodes the image data of the photo and sends it to the server.

[1567] 5. The server receives the face photo and stores it in an image database. Once stored, the image information is associated with the user's account.

[1568] Hairstyle preference input phase

[1569] 1. The user enters the desired hairstyle in text on the app screen. The user also has the option to upload an image of the hairstyle as a reference.

[1570] 2. The device collects the text data entered by the user and the hairstyle image uploaded and sends them to the server.

[1571] 3. The emotion engine recognizes the emotion from the user's facial photo and sends the emotion information to the server. For example, the emotion of the user, such as whether they are happy or sad, is analyzed here.

[1572] Hairstyle image generation phase

[1573] 1. The server prepares the received face photo, desired hairstyle data, and emotion information for the generative AI model. Specifically, the server converts this data into a format that the AI ​​model can understand.

[1574] 2. The generative AI model uses the user's facial photo, desired hairstyle data, and emotional information to generate a specific hairstyle image. This generated hairstyle image is temporarily stored in the server's storage.

[1575] 3. The server retrieves the generated hairstyle image and encodes it for transmission to the user's device. The server sends the hairstyle image data to the device via an HTTPS response.

[1576] Checking the image and sharing it with the hairdresser

[1577] 1. The terminal displays the generated hairstyle image on the user's screen. The user checks the hairstyle image and requests corrections if necessary. The data is then sent to the server again.

[1578] 2. The user presses the save button to save the image to local storage. Then, to show the hairdresser the hairstyle, the user can show the image directly to the hairdresser or share it via social media or a messaging app.

[1579] NFT token issuance and market registration phase

[1580] 1. The user selects the option to issue an NFT token for the generated hairstyle image. The device receives the user's selection and sends an NFT token issuance request.

[1581] 2. The device sends a request to the server to issue an NFT token, along with metadata and image data.

[1582] 3. The server generates an NFT token for the image and registers it on the blockchain network. Once complete, the issued token information is published on the marketplace.

[1583] 4. Users receive notifications and can browse and trade tokens on the marketplace. Users can buy and sell these tokens and earn revenue through trading.

[1584] As a concrete example, after a user uses the app and goes through the registration process, the emotion engine recognizes a "happy emotion" from the user's facial photo. Based on this emotional information, the generative AI model generates a hairstyle image that matches a lively atmosphere, which is ultimately displayed on the user's device. The user can show this image to their hairdresser, making it easier to share the specific hairstyle image. Furthermore, by issuing an NFT token for this hairstyle image, it can be sold and traded on the marketplace.

[1585] The processing flow will be explained below.

[1586] Step 1:

[1587] A user installs and launches the app. They proceed to the new account creation screen and enter their name, email address, and password. The device collects this input data and, when they press the button to proceed to the next step, sends it to the server.

[1588] Step 2:

[1589] The server checks and verifies the received user data for duplicates. After confirming that there are no duplicates, it saves the user information in the database. Once the saving is complete, the server returns a message to the device indicating that the account has been created.

[1590] Step 3:

[1591] The device displays a UI that prompts the user to take a photo of their face. The user presses the capture button to launch the camera and take a photo of their face, or selects a photo from the gallery.

[1592] Step 4:

[1593] The user takes or selects a photo of their face and presses the confirmation button. The device encodes the image data of the photo and sends it to the server.

[1594] Step 5:

[1595] The server receives the face photo and stores it in an image database. After storage is complete, the face photo information is associated with the user's account.

[1596] Step 6:

[1597] Users can enter their desired hairstyle in text on the app screen, and if they have an image of the hairstyle they want to use as a reference, they can also select the option to upload that image.

[1598] Step 7:

[1599] The terminal collects the text data entered by the user and the hairstyle image uploaded, and transmits them to the server.

[1600] Step 8:

[1601] The emotion engine analyzes the user's facial photo and recognizes their emotions, such as whether they look happy or sad, and sends the results to the server.

[1602] Step 9:

[1603] The server prepares the received facial photo, desired hairstyle data, and emotion information for delivery to the generative AI model, which involves converting the data into a format that the AI ​​model can understand.

[1604] Step 10:

[1605] The generative AI model uses the user's facial photo, desired hairstyle data, and emotional information to generate a specific hairstyle image, which is then temporarily stored in the server's storage.

[1606] Step 11:

[1607] The server retrieves the generated hairstyle image and encodes it for transmission to the user's device. The server then sends the hairstyle image data to the device via an HTTPS response.

[1608] Step 12:

[1609] The terminal displays the generated hairstyle image on the user's screen. The user checks the hairstyle image and requests corrections as necessary, and the request is sent to the server.

[1610] Step 13:

[1611] The user confirms the image and presses the save button to save the image to local storage. They can then show the image directly to their hairdresser or share it via social media or messaging apps.

[1612] Step 14:

[1613] The user selects the option to issue an NFT token for the generated hairstyle image, which causes the device to send an NFT token issuance request to the server.

[1614] Step 15:

[1615] The device sends a request to the server to issue an NFT token, along with metadata and image data.

[1616] Step 16:

[1617] Based on the data received, the server generates an NFT token corresponding to the image and registers it on the blockchain network. Once registration is complete, the issued token information is published on the marketplace.

[1618] Step 17:

[1619] Users receive notifications and can browse and trade NFT tokens on the marketplace. By buying and selling these tokens, users can earn revenue. This system not only embodies the user's desired hairstyle and reduces communication errors, but also suggests more suitable hairstyles through emotion recognition using an emotion engine, and further enables digital economic activity using NFT tokens.

[1620] Example 2

[1621] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1622] The present invention aims to provide a means for users to easily generate their desired hairstyle and other images based on their own facial images and to communicate specifically through the generated images. Furthermore, by clarifying ownership of the generated images and tokenizing them to make them tradable, it is possible to give them value as a new form of digital asset. Conventional systems often fail to accurately reflect the user's desired hairstyle or image, resulting in miscommunication. Furthermore, the lack of a means to establish ownership of generated digital images makes it difficult to trade them in the market. There is a need to solve these problems.

[1623] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1624] In this invention, the server includes: a means for a user to register their own image; a means for the user to input their desired image as text or an image; a means for generating an image based on the registered facial image and the input desired image information; a means for transmitting and displaying the generated image to the user's terminal; a means for issuing a token for the generated image and registering it in a distributed network; a means for publishing the issued token in an information disclosure system; a means for providing the user's facial image and desired image information to an algorithmic model to generate an image; a means for transmitting and displaying the generated image to the user's terminal; and a means for the user to request modifications as needed. This allows users to accurately generate their desired image and share specific images with hairdressers and others. Furthermore, by issuing an NFT token for the generated image and establishing ownership, it becomes possible to trade it as a digital asset.

[1625] A "user" is a person who uses this system to register their own facial image or desired image, and to generate hairstyles and other images.

[1626] "Image" refers to the facial image registered by the user and visual data corresponding to the hairstyle or other design desired by the user.

[1627] "Text" refers to information in the form of text that the user inputs about the hairstyle or image they desire.

[1628] "Generative AI" is an artificial intelligence system that automatically generates new hairstyle images and other designs based on the user's facial image, text, and desired image information.

[1629] "Terminal" refers to the device (smartphone, tablet, PC, etc.) that a user uses to operate this system.

[1630] The "server" is a computer system that receives user data, processes it, provides it to the generating AI, stores the generated images, and transmits them to the user.

[1631] "Token" refers to a digital representation of ownership of a generated hairstyle image or other product.

[1632] A "decentralized network" is a system in which tokens are recorded on a common ledger by multiple nodes without a centralized management entity.

[1633] "Information Disclosure System" means an online platform for public disclosure and display of issued Tokens and other information.

[1634] An "algorithmic model" refers to the computational logic and methods used to process a user's facial image or desired image information as input and generate the desired image.

[1635] A "modification request" refers to a user's request for changes or adjustments to a generated image.

[1636] This invention relates to a system that uses generative AI to generate specific images by allowing users to register their own facial images and input their desired hairstyle and other images via text or images. This system makes it easier for users to share specific images with their hairdressers, reducing communication errors. It is also possible to issue NFT tokens for the generated images, register them on a blockchain network, and trade them on a marketplace.

[1637] User registration phase

[1638] 1. The user installs and launches the app. They proceed to the new account creation screen and enter their name, email address, and password. The device collects this input data and sends it to the server when the user presses the button to proceed to the next step. This process is carried out using devices such as smartphones and tablets.

[1639] 2. The server checks for duplicates in the received user data and, if there are no problems, saves it in the database. Once saved, the server returns a message to the device indicating account creation is complete.

[1640] 3. The device displays a UI that prompts the user to take a photo of their face. At this point, the user presses the capture button to activate the camera and take a photo of their face, or select a photo from the gallery. After the user takes or selects a photo of their face and presses the confirmation button, the device encodes the image data of the photo and sends it to the server.

[1641] 4. The server receives the face photo, stores the data in an image database, and associates the image information with the user's account. Specifically, the image file is stored in a file storage or database.

[1642] Hairstyle preference input phase

[1643] 1. The user enters the desired hairstyle in text on the app screen. The user can also select the option to upload an image of the hairstyle as a reference.

[1644] 2. The device collects the text data entered by the user and the hairstyle image uploaded and sends them to the server.

[1645] 3. The emotion engine recognizes the emotion from the user's facial photo and sends the emotion information to the server. For example, the emotion is analyzed to determine whether the user looks happy or sad.

[1646] Hairstyle image generation phase

[1647] 1. The server receives the face photo, desired hairstyle data, and emotion information and prepares them for provision to the generative AI model. The server converts this data into a format that the AI ​​model can understand.

[1648] 2. The generative AI model generates a specific hairstyle image based on the user's facial photo, desired hairstyle data, and emotional information. This generated hairstyle image is temporarily stored in the server's storage.

[1649] 3. The server retrieves the generated hairstyle image and encodes it for transmission to the user's device. The server sends the hairstyle image data to the device via an HTTPS response.

[1650] Checking the image and sharing it with the hairdresser

[1651] 1. The terminal displays the generated hairstyle image on the user's screen. The user checks the hairstyle image and requests corrections if necessary. The data is then sent to the server again.

[1652] 2. The user presses the save button to save the image to local storage. Then, to show the hairdresser the hairstyle, the user can show the image directly to the hairdresser or share it via social media or a messaging app.

[1653] NFT token issuance and market registration phase

[1654] 1. The user selects the option to issue an NFT token for the generated hairstyle image. The device receives the user's selection and sends an NFT token issuance request.

[1655] 2. The device sends a request to the server to issue an NFT token, along with metadata and image data.

[1656] 3. The server generates an NFT token for the image and registers it on the blockchain network. Once complete, the issued token information is published on the marketplace.

[1657] 4. Users receive notifications and can browse and trade tokens on the marketplace. Users can buy and sell these tokens and earn revenue through trading.

[1658] Specific examples

[1659] For example, after a user uses the app and goes through the registration process, the emotion engine recognizes a "happy emotion" from the user's facial photo. Based on this emotional information, the generative AI model generates a hairstyle image that matches a lively atmosphere, which is ultimately displayed on the user's device. The user can show this image to their hairdresser, making it easier to share the specific hairstyle image they want. In addition, by issuing an NFT token for this hairstyle image, it can be sold and traded on the marketplace.

[1660] Prompt Sentence Examples

[1661] "Generate hairstyle images that match a lively atmosphere based on a photo of the user's face that shows a happy expression."

[1662] The above is a description of the embodiment of the present invention. This system allows users to accurately generate desired hairstyles and other images and use them as digital assets.

[1663] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1664] Processing Steps

[1665] User registration phase

[1666] Step 1:

[1667] A user installs and launches the app. The user proceeds to the new account creation screen and enters their name, email address, and password.

[1668] Input: Name, Email Address, Password

[1669] Output: Input data is sent to the server in JSON format

[1670] What it does: Your smartphone or tablet collects input data and sends it to the server via an HTTP POST request.

[1671] Step 2:

[1672] The server checks for duplicates in the received user data, and if there are no duplicates, stores them in the database.

[1673] Input: User data

[1674] Output: Results of duplicate check, saved to database

[1675] What happens: The server runs an SQL query to check for duplicate email addresses, and if there are no problems, it saves them to the database with an INSERT statement.

[1676] Step 3:

[1677] The server sends a message to the device indicating that the account has been created.

[1678] Input: Account creation completion status

[1679] Output: Account creation successful message

[1680] Specific operation: A message is sent to the terminal as an HTTP response with status code 200.

[1681] Step 4:

[1682] The device displays a UI that prompts the user to take a photo of their face. The user takes a photo of their face or selects a photo from the gallery.

[1683] Input: User-initiated camera or selection from gallery

[1684] Output: Captured photo data or selected photo data

[1685] Specific behavior: The camera app launches and a photo is taken, or an image selected from the gallery is retrieved from the device.

[1686] Step 5:

[1687] The user presses the "Confirm Face Photo" button. The device encodes the image data of the face photo and sends it to the server.

[1688] Input: Facial photo data

[1689] Output: Encoded image data

[1690] What happens: The image is encoded in a format such as Base64 and sent to the server as an HTTP request.

[1691] Step 6:

[1692] The server receives the face photo and stores it in an image database, which associates the image information with the user's account.

[1693] Input: Facial photo data

[1694] Output: Save to image database, associate with user account

[1695] Specific behavior: The image file is saved to file storage or a database, and the path to the image file is added to the user's database record.

[1696] Hairstyle preference input phase

[1697] Step 1:

[1698] Users enter their desired hairstyle in text on the app screen, and also have the option to upload an image of the hairstyle as a reference.

[1699] Input: Text data and image data of desired hairstyle

[1700] Output: Uploaded data

[1701] What it does: Collects text and images.

[1702] Step 2:

[1703] The terminal collects the text data entered by the user and the hairstyle image uploaded and sends them to the server.

[1704] Input: Text data, image data

[1705] Output: Data sent to the server

[1706] Specific behavior: Sends data to the server as an HTTP request.

[1707] Step 3:

[1708] The emotion engine recognizes emotions from the user's facial photograph and transmits the emotion information to the server.

[1709] Input: Facial photo data

[1710] Output: Emotion recognition result data

[1711] Specific operation: Image processing is performed and emotion recognition results are generated.

[1712] Hairstyle image generation phase

[1713] Step 1:

[1714] The server prepares the received facial photo, desired hairstyle data, and emotional information to provide to the generative AI model.

[1715] Input: Face photo data, desired hairstyle data, emotional information

[1716] Output: Data format for generative AI models

[1717] What happens: Data is formatted for the AI ​​model.

[1718] Step 2:

[1719] The generative AI model generates a specific hairstyle image based on the user's face photo, desired hairstyle data, and emotional information.

[1720] Input: Reformatted user data

[1721] Output: Generated hairstyle image

[1722] Specific operation: The AI ​​model performs inference processing and generates a hairstyle image.

[1723] Step 3:

[1724] The server acquires the generated hairstyle image and encodes it for transmission to the user's terminal.

[1725] Input: Generated hairstyle image

[1726] Output: Encoded image data

[1727] Specific behavior: Image data is encoded and sent to the device as an HTTPS response.

[1728] Checking the image and sharing it with the hairdresser

[1729] Step 1:

[1730] The terminal displays the generated hairstyle image on the user's screen, and the user checks the hairstyle image and requests corrections as necessary.

[1731] Input: Generated hairstyle image

[1732] Output: User confirmation result and correction request

[1733] What happens: The image is displayed on the device screen and user interactions are processed.

[1734] Step 2:

[1735] The user presses the save button to save the image to local storage, and then shows the image to the hairdresser directly or shares it via social media or messaging apps.

[1736] Input: Saved image data

[1737] Output: Images saved in local storage, shared images

[1738] What it does: The image is saved to your device's storage and can be transferred to other apps or services using the share feature.

[1739] NFT token issuance and market registration phase

[1740] Step 1:

[1741] The user selects the option to issue an NFT token for the generated hairstyle image.

[1742] Input: Token issuance request by user operation

[1743] Output: Token issuance request data

[1744] Specific operation: A token issuance request is generated.

[1745] Step 2:

[1746] The device sends a request to issue an NFT token to the server, along with metadata and image data.

[1747] Input: Metadata, image data

[1748] Output: Token issuance request sent to the server

[1749] What happens: Data is sent to the server as an HTTP request.

[1750] Step 3:

[1751] The server generates an NFT token for the image and registers it on the decentralized network.

[1752] Input: Metadata, image data

[1753] Output: Token registered on the blockchain

[1754] Specific behavior: Token generation is completed and the transaction is added to the blockchain.

[1755] Step 4:

[1756] After the server is complete, it will publish the issued token information to the marketplace.

[1757] Input: Token information

[1758] Output: Published token information

[1759] Specific operation: Token information is registered using the marketplace API.

[1760] Step 5:

[1761] Users receive notifications and can browse and trade tokens on the marketplace.

[1762] Input: Push notification or email

[1763] Output: Tokens traded on the marketplace

[1764] What happens: A notification is sent to the user, who then trades the token on the marketplace.

[1765] (Application example 2)

[1766] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1767] Conventional hairstyle suggestion systems have had problems with insufficient sharing of specific images between users and hairdressers, leading to frequent miscommunication. Furthermore, it is difficult to suggest hairstyles based on the user's emotions or current mood, making it difficult to provide personalized services. Furthermore, there are limited ways to commercially use the generated hairstyle images.

[1768] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1769] In this invention, the server includes a means for recognizing emotions from a user's facial photograph, a means for providing emotion information to a generative AI model, and a means for issuing the generated hairstyle image as an NFT token and registering it on a blockchain network. This enables personalized hairstyle suggestions based on the user's emotions, expanding the commercial use of the generated hairstyle image.

[1770] A "user" is a person who uses this system and provides a photograph of their face and information about their desired hairstyle.

[1771] A "face photo" is image data of a user's face, and is primarily used for analysis by generative AI models and emotion engines.

[1772] "Text" is an information format in which the user inputs the desired hairstyle or style in text.

[1773] "Image" is visual data such as a photograph or illustration that specifically shows the hairstyle desired by the user.

[1774] "Generative AI" is an artificial intelligence that generates specific hairstyle images based on a user's facial photo, desired hairstyle information, and emotional information.

[1775] The "emotion engine" is a system that analyzes the emotions of a user from a facial photograph and acquires the user's emotional information.

[1776] An "NFT token" is a non-fungible token issued for a generated hairstyle image, and is a digital asset that is unique on the blockchain.

[1777] A "blockchain network" is a distributed database technology and infrastructure for securely issuing and trading NFT tokens.

[1778] The "Marketplace" is a market where NFT tokens are bought and sold, and a platform that enables the commercial use of generated hairstyle images.

[1779] A "modification request" is a request from a user for changes or improvements to the generated hairstyle image.

[1780] This invention relates to a system that uses AI to generate a specific hairstyle image by allowing a user to register a photo of their face and input desired hairstyle information. This system uses the following hardware and software:

[1781] Hardware and software used

[1782] 1. Smartphone: A device on which users install and operate apps.

[1783] 2. Cloud server: A server that stores user data and runs generative AI models.

[1784] 3. Emotion Engine: This is a system for recognizing emotions from a user's facial photograph, and Azure Cognitive Services is used as an example.

[1785] 4. Generative AI model: A model for generating hairstyle images based on a user's facial photo, desired hairstyle information, and emotional information. Examples include Stable Diffusion and MidJourney.

[1786] 5. Blockchain network: This is the infrastructure for issuing and registering NFT tokens, and examples include Ethereum and Polygon.

[1787] Processing flow

[1788] This system basically operates in the following steps. First, the user installs and launches the smartphone app to create a new account. After completing the account creation, they register a photo of their face and input their desired hairstyle using text or an image. At this point, the emotion engine analyzes the emotional information from the user's face photo and provides it to the generative AI model. The generative AI model generates a hairstyle image based on this information and saves it on a cloud server. The hairstyle image is then sent to the user's smartphone and displayed.

[1789] Specific data processing

[1790] First, a photo of the user's face is taken with a smartphone and sent to a cloud server. The cloud server stores this face photo data in an image database and simultaneously passes it to an emotion engine for emotional analysis. The analyzed emotional information, along with desired hairstyle information, is provided to a generative AI model. The generative AI model generates a specific hairstyle image based on the user's face photo, emotional information, and hairstyle information. This generated hairstyle image is temporarily stored on the cloud server and then sent to the user's smartphone.

[1791] Prompt Sentence Examples

[1792] The generative AI model generates hairstyle images using prompt sentences such as the following:

[1793] Example prompt: "Generate a cheerful, short hairstyle with bangs for a happy-looking person."

[1794] Usage example

[1795] For example, suppose a user takes a photo of their face with a happy expression. Based on this photo, the emotion engine recognizes the "happy emotion" and inputs this emotion information into the generative AI model. Based on this emotion information and the user's desired hairstyle information, the generative AI model generates an image of a hairstyle that matches a lively atmosphere and displays it on the user's smartphone. The user can check this hairstyle image and show it to their hairdresser, making it easier to share a specific image.

[1796] This system allows users to easily get hairstyles that suit their emotions, reducing miscommunication between them and their hairdressers. Furthermore, by issuing NFT tokens for the generated hairstyle images, it can be used commercially.

[1797] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1798] Step 1: User registration phase

[1799] The user installs and launches the smartphone app. The user proceeds to the new account creation screen and enters their name, email address, and password. This input data is collected by the device, and when the user presses the button to proceed to the next step, the data is sent to the cloud server. The cloud server checks the received user data for duplicates and, if there are no problems, stores it in a database. Once the data is saved, the server returns a message to the device indicating that account creation has been completed. In this phase, the input is user information (name, email address, password), and the output is a message indicating that account creation has been completed.

[1800] Step 2: Register your face photo

[1801] The user takes a photo of their face using a smartphone app. When the app presses the capture button, the camera starts up and the user takes a photo of their face or selects a photo from the gallery. The device encodes the image data of the face photo and sends it to the server. The server receives this image data and stores it in an image database. In this step, the face photo is the input and the image data is registered to the server as the output.

[1802] Step 3: Enter your desired hairstyle

[1803] The user enters the desired hairstyle in text on the app screen. The user can also select the option to upload an image of the hairstyle as a reference. The device collects the entered text data and the uploaded hairstyle image and sends them to the server. In this step, the input is hairstyle information (text and image), and the output is the registration of hairstyle data to the server.

[1804] Step 4: Recognizing emotional information

[1805] The emotion engine recognizes emotions from the user's facial photo. The cloud server calls the emotion engine and analyzes the facial photo. The recognized emotion information is sent back to the server as the analysis result. In this step, the facial photo is the input and the emotion information is the output.

[1806] Step 5: Generate hairstyle images

[1807] The server prepares the received face photo, desired hairstyle information, and emotional information to provide to the generative AI model. Specifically, the server converts this data into a format that the AI ​​model can understand. The generative AI model (e.g., Stable Diffusion) uses the user's face photo, desired hairstyle data, and emotional information to generate a specific hairstyle image. This generated hairstyle image is temporarily stored in the server's storage. In this step, the input is the face photo, hairstyle information, and emotional information, and the output is the generated hairstyle image.

[1808] Step 6: Send and view hairstyle images

[1809] The server obtains the generated hairstyle image and encodes it for sending to the user's device. The server sends the hairstyle image data to the device in an HTTPS response. The device displays the received hairstyle image on the user's screen. If the user checks the hairstyle image and requests corrections as necessary, the data is sent to the server again. In this step, the input is the generated hairstyle image, and the output is a display on the user's device and a request to correct it.

[1810] Step 7: Save and share your image

[1811] The user presses the save button to save the image to local storage. Then, to show this hairstyle image to the hairdresser, the user can show the image directly to the hairdresser or share it via social media or a messaging app. In this step, the hairstyle image is the input, and saving to local storage and sharing are the outputs.

[1812] Step 8: Issue NFT tokens and register them on the market

[1813] The user selects the option to issue an NFT token for the generated hairstyle image. The device receives the user's selection and sends an NFT token issuance request. The server receives the request to issue an NFT token, generates an NFT token for the image, and registers it on the blockchain network. Once completed, the issued token information is published to the marketplace. In this step, the input is the hairstyle image and the NFT issuance request, and the output is the NFT token and registration on the marketplace.

[1814] By sequentially executing the above processing steps, the user is suggested a hairstyle that suits them, making it easier to share specific images with a hairdresser, and furthermore, the generated hairstyle image can be used commercially.

[1815] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1816] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1817] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1818] [Fourth embodiment]

[1819] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1820] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1821] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1822] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1823] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1824] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1825] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1826] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1827] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1828] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1829] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1830] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1831] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1832] This invention relates to a system that uses generative AI to generate a specific hairstyle image by allowing users to register a photo of their face and input their desired hairstyle via text or image. This system makes it easier for users to share their specific image with their hairdresser, reducing communication errors. It is also possible to issue an NFT token for the generated hairstyle image, register it on a blockchain network, and trade it on a marketplace.

[1833] Program processing explanation

[1834] User registration phase

[1835] 1. A user installs the app and creates an account.

[1836] The user enters their name, email address, password, etc.

[1837] The terminal sends the input data to the server.

[1838] 2. The server receives the user information and stores it in a database.

[1839] The server performs a duplicate check on the user information.

[1840] After checking, if there are no problems, the user information is saved in the database.

[1841] 3. The device displays a UI to prompt the user to take a photo of their face.

[1842] It offers a photo button and the option to select from the gallery.

[1843] 4. The user takes a photo of their face or selects one from the gallery and uploads it.

[1844] The user clicks the capture button to start the camera.

[1845] After taking the photo, click the "OK" button to select the face photo.

[1846] 5. The device sends the facial photo data to the server.

[1847] The image data of the face photo is encoded and an HTTPS request is sent to the server.

[1848] 6. The server receives the facial photo and stores it in an image database.

[1849] The server stores the image in storage and associates it with the user account.

[1850] Hairstyle preference input phase

[1851] 1. The user enters the desired hairstyle in text in the app's text input field.

[1852] The user inputs a desired hairstyle, such as "short bob," into a text box.

[1853] 2. Users also have the option to upload an image of their hairstyle as a reference.

[1854] The user selects a reference image from the gallery and presses the upload button.

[1855] 3. The device receives user input or uploads and sends the data to the server.

[1856] The text data and image data are encoded together and an HTTPS request is sent to the server.

[1857] Hairstyle image generation phase

[1858] 1. The server prepares to provide the received face photo and desired hairstyle data to the generative AI model.

[1859] The server converts the face photo and desired hairstyle data into a format that the AI ​​model can understand.

[1860] 2. The generative AI model generates an image of the desired hairstyle that matches the user's face photo.

[1861] The AI ​​model generates a hairstyle image based on a face photo and text (or a reference image).

[1862] The generated image is temporarily stored in the server's storage.

[1863] 3. The server receives the generated hairstyle image and sends it to the user's device.

[1864] The generated image is encoded and sent to the user's device in an HTTPS response.

[1865] Checking the image and sharing it with the hairdresser

[1866] 1. The device displays the generated hairstyle image to the user.

[1867] Open an image viewer and view the generated hairstyle image.

[1868] 2. The user reviews the image and can request corrections if necessary.

[1869] When the user presses the "Request revision" button, a form will appear where the user can enter their desired hairstyle again.

[1870] 3. Save the image once the user has confirmed it.

[1871] Click the "Save" button to save the image to your local storage.

[1872] 4. The user shows the saved image to the hairdresser and shares the specific hairstyle image.

[1873] You can show the image directly to your hairdresser or share it on social media or messaging apps.

[1874] NFT token issuance and market registration phase

[1875] 1. The user selects the option to issue an NFT token for the generated hairstyle image.

[1876] Click the "Tokenize NFT" button in the app.

[1877] 2. The device sends a request to the server to issue an NFT token.

[1878] The necessary metadata and image data are collected and sent as a request to the server.

[1879] 3. The server generates an NFT token corresponding to the image and registers it on the blockchain.

[1880] The server communicates with the blockchain network to generate and register tokens.

[1881] 4. The server publishes information related to the issued NFT tokens to the market.

[1882] Upload token information to the NFT marketplace and notify users.

[1883] 5. Users will be able to trade tokens on the market.

[1884] Users can buy, sell, or rent tokens on the marketplace.

[1885] In this way, the present invention not only allows users to easily create and share specific hairstyle requests with their hairdressers, but also allows users to issue and trade the generated images as NFTs. This system reduces miscommunication and improves customer satisfaction.

[1886] The processing flow will be explained below.

[1887] Step 1:

[1888] A user installs and launches the app. The user proceeds to the new account creation screen and enters their name, email address, and password. The device collects this input data and, when the user presses the button to proceed to the next step, sends this data to the server.

[1889] Step 2:

[1890] The server checks for duplicates in the received user data and, if there are no problems, saves it in the database. Once the saving is complete, the server returns a message to the device indicating that account creation is complete.

[1891] Step 3:

[1892] The device displays a UI that prompts the user to take a photo of their face. The user then presses the capture button to launch the camera and take a photo of their face, or selects a photo from the gallery.

[1893] Step 4:

[1894] The user takes or selects a photo of their face and presses the confirmation button. The device encodes the image data of the photo and sends it to the server.

[1895] Step 5:

[1896] The server receives the face photo and stores it in an image database, then associates the image with the user's account.

[1897] Step 6:

[1898] Users can enter their desired hairstyle in text on the app screen, and also have the option to upload an image of the hairstyle they want as a reference.

[1899] Step 7:

[1900] The terminal collects the text data entered by the user and the hairstyle image uploaded and sends them to the server.

[1901] Step 8:

[1902] The server prepares the received face photo and desired hairstyle data to provide to the generative AI model. Specifically, the server converts the face photo and desired hairstyle text or image data into a format that the AI ​​model can understand.

[1903] Step 9:

[1904] The generative AI model uses the user's face photo and desired hairstyle data to generate a specific hairstyle image, which is temporarily stored in the server's storage.

[1905] Step 10:

[1906] The server retrieves the generated hairstyle image and encodes it for transmission to the user's device. The server then sends the hairstyle image data to the device via an HTTPS response.

[1907] Step 11:

[1908] The terminal displays the generated hairstyle image on the user's screen. If the user checks the hairstyle image and requests corrections as necessary, the data is sent to the server again.

[1909] Step 12:

[1910] The user presses the save button to save the image to local storage, and then shows the image directly to the hairdresser or shares it via social media or a messaging app to show the hairdresser the hairstyle.

[1911] Step 13:

[1912] The user selects the option to issue an NFT token for the generated hairstyle image. The device receives the user's selection and sends an NFT token issuance request.

[1913] Step 14:

[1914] The device sends a request to issue an NFT token to the server, along with metadata and image data.

[1915] Step 15:

[1916] The server generates an NFT token for the image and registers it on the blockchain network. Once complete, the issued token information is published on the marketplace.

[1917] Step 16:

[1918] Users will receive notifications and can browse and trade tokens on the marketplace, where they can buy and sell these tokens and earn revenue through trading.

[1919] Example 1

[1920] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1921] In the past, it was difficult for hairdressers and customers to share their hairstyle images, which often led to miscommunication. This could result in lower customer satisfaction. Furthermore, there was a lack of means to protect the generated hairstyle images and use them commercially.

[1922] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1923] In this invention, the server includes a means for a user to register their own facial photo, a means for the user to input their desired hairstyle using text or an image, a generation AI that generates a hairstyle image based on the registered facial photo and the input desired hairstyle information, a means for transmitting and displaying the generated hairstyle image to the user's terminal, and a means for the user to check the hairstyle image and request modifications. This allows for the generation of a specific hairstyle image that meets the user's preferences, enabling smooth communication with the hairdresser. The server also includes a means for issuing an NFT token for the generated hairstyle image and registering it on a blockchain network, and a means for publishing the issued NFT token on a marketplace, enabling the hairstyle image to be converted into a digital asset and used commercially.

[1924] A "user" is someone who uses this system to register a photo of their face and input their desired hairstyle.

[1925] "Generative AI" refers to an artificial intelligence model that generates hairstyle images based on a user's facial photo and desired hairstyle information entered.

[1926] "User terminal" refers to a device used by a user to access this system, such as a smartphone or PC.

[1927] An "NFT token" is a digital proof of ownership issued to the generated hairstyle image and registered on a blockchain network.

[1928] "Blockchain network" refers to a network that uses distributed ledger technology to record and manage data.

[1929] "Marketplace" refers to the digital marketplace where NFT tokens are bought, sold, or rented.

[1930] The "means for requesting modifications" refers to a function for re-inputting information into the system when a user desires to make changes to the generated hairstyle image.

[1931] "Means of registration" refers to the function that allows users to input and save their own face photo and desired hairstyle information into the system.

[1932] The "means for inputting a desired hairstyle" refers to a function that allows a user to provide information about a desired hairstyle using text or an image.

[1933] The "means for transmitting and displaying the generated hairstyle image" refers to a function for transferring the hairstyle image generated by the server to the user's terminal and displaying the image to the user.

[1934] This invention is a system that uses a generative AI model to generate a specific hairstyle image by allowing users to register a photo of their face and input their desired hairstyle via text or image. This system makes it easier for users to share their specific image with their hairdresser, reducing communication errors. It is also possible to issue an NFT token for the generated hairstyle image, register it on the blockchain network, and trade it on the marketplace.

[1935] Hardware and software used

[1936] Hardware: Servers (cloud servers and database servers), user devices (smartphones, PCs)

[1937] Software: AI image generation models (e.g., DALL-E), blockchain technology (e.g., Ethereum), database management systems (e.g., MySQL)

[1938] System Overview

[1939] 1. User Registration:

[1940] A user installs the app and creates an account by entering their name, email address, and password. The device sends this information to the server via HTTPS, and the server stores it in a database.

[1941] After creating an account, the device displays a UI that prompts the user to take a photo of their face or select one from the gallery. The user provides a photo of their face, and the data is sent from the device to the server.

[1942] The server stores the facial photo in a database and associates it with the user account.

[1943] 2. Enter your desired hairstyle:

[1944] The user enters the desired hairstyle into a text input field within the app (e.g., "short bob").

[1945] Users can also upload images of hairstyles for reference.

[1946] The terminal encodes this data and sends it to the server.

[1947] 3. Hairstyle image generation:

[1948] The server receives the face photo and desired hairstyle data and provides it to the AI ​​image generation model, which converts this data into a format that the generative AI model can understand.

[1949] The generative AI model generates an image of the desired hairstyle that matches the user's face photo. As an example of the prompt sentence, we use "A short bob hairstyle that matches this face photo."

[1950] The generated hairstyle image is temporarily stored in the server's storage and then sent to the user's device via an HTTPS response.

[1951] 4. View and share images:

[1952] The terminal displays the generated hairstyle image to the user, who can review the image and request corrections if necessary.

[1953] Save the final image and show it directly to your hairdresser or share it on social media or messaging apps.

[1954] 5. Issuance and trading of NFT tokens:

[1955] The user selects the option to issue an NFT token for the generated hairstyle image, and sends the necessary metadata and image data from the device to the server.

[1956] The server generates an NFT token corresponding to the image and registers it on the blockchain network, then publishes the token information on the marketplace and notifies users.

[1957] Users can buy, sell, or rent tokens on the marketplace.

[1958] In this way, the present invention not only allows users to easily create and share specific hairstyle requests with their hairdressers, but also allows users to issue and trade the generated images as NFTs. This system reduces miscommunication and improves customer satisfaction.

[1959] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1960] Step 1:

[1961] A user installs the app and creates an account.

[1962] Input: Name, email address, password

[1963] How it works: A user downloads and installs the app from the App Store or Google Play, launches the app, clicks the "Sign Up" button, and is presented with a form where they can enter their name, email address, and password.

[1964] Output: The entered user information is saved on the device.

[1965] Step 2:

[1966] The terminal sends the input data to the server.

[1967] Input: User information (name, email address, password)

[1968] How it works: When a user fills out the form and presses the "Register" button, the device sends the input data to the server using HTTPS.

[1969] Output: The server receives the user information.

[1970] Step 3:

[1971] The server stores the user information in a database.

[1972] Input: User information (name, email address, password)

[1973] What it does: After the server receives the data, it checks for duplicates and saves the new user information to the database.

[1974] Output: The registered user information is saved in the database.

[1975] Step 4:

[1976] The device will display a UI for taking or selecting a face photo.

[1977] Input: None (interface provided)

[1978] Operation: After user registration is complete, the device displays a UI for "registering a face photo." It displays a button to take a photo and a button to select from the gallery.

[1979] Output: The face photo registration screen is displayed to the user.

[1980] Step 5:

[1981] The user takes or selects and uploads a photo of their face.

[1982] Input: Face photo data (take a photo or select)

[1983] How it works: The user clicks the camera button to take a photo of their face, then clicks the "OK" button or selects an existing photo from the gallery.

[1984] Output: The selected or taken face photo is temporarily saved on the device.

[1985] Step 6:

[1986] The terminal transmits the facial photo data to the server.

[1987] Input: Facial photo data

[1988] What it does: Encodes the face photo data and sends it to the server using an HTTPS request.

[1989] Output: The server receives the face photo data.

[1990] Step 7:

[1991] The server stores the facial photos in an image database.

[1992] Input: Facial photo data

[1993] How it works: The server receives the image data and stores it in storage, associating the image with the user's account.

[1994] Output: The face photo stored in the image database is registered.

[1995] Step 8:

[1996] The user inputs the desired hairstyle by text.

[1997] Input: Text of desired hairstyle (e.g. "Short bob")

[1998] How it works: A user enters their desired hairstyle into a text input field within the app.

[1999] Output: The text data of the desired hairstyle is temporarily saved on the device.

[2000] Step 9:

[2001] User uploads reference image.

[2002] Input: Reference hairstyle image

[2003] How it works: The user selects a hairstyle reference image from the gallery and presses the "Upload" button.

[2004] Output: The selected reference image is temporarily saved on the device.

[2005] Step 10:

[2006] The terminal sends the input data to the server.

[2007] Input: Hairstyle text data, reference image

[2008] What it does: Encodes text and image data and sends it to the server in an HTTPS request.

[2009] Output: The server receives the desired hairstyle data and reference images.

[2010] Step 11:

[2011] The server prepares the input data to serve as a generative AI model.

[2012] Input: Face photo data, desired hairstyle data, reference image

[2013] How it works: The server converts the received face photo and desired hairstyle data into a format that the generative AI model can understand.

[2014] Output: A dataset is prepared in a format that can be input into an AI model.

[2015] Step 12:

[2016] A generative AI model generates hairstyle images.

[2017] Input: Face photo data, desired hairstyle data (text or reference image)

[2018] How it works: The generative AI model generates a hairstyle image based on input data (a face photo and desired hairstyle). An example of a prompt sentence is "A short bob hairstyle that suits this face photo."

[2019] Output: The generated hairstyle image is temporarily saved.

[2020] Step 13:

[2021] The server transmits the generated hairstyle image to the terminal.

[2022] Input: Generated hairstyle image

[2023] What it does: The generated hairstyle image is encoded and sent to the user's device in an HTTPS response.

[2024] Output: The generated hairstyle image is received on the user's terminal.

[2025] Step 14:

[2026] The terminal displays the generated hairstyle image.

[2027] Input: Generated hairstyle image

[2028] Action: The device opens an image viewer and displays the generated hairstyle image.

[2029] Output: The user can check the generated hairstyle image.

[2030] Step 15:

[2031] The user checks the image and saves it or requests corrections.

[2032] Input: Generated hairstyle image

[2033] How it works: The user checks the image and clicks the "Save" button to save it to local storage. If any corrections are needed, the user clicks the "Request corrections" button and a form is displayed where the user can re-enter their hairstyle preference.

[2034] Output: Saved image data, input data for correction requests (if necessary).

[2035] Step 16:

[2036] The user shares the image with the hairdresser.

[2037] Input: Generated hairstyle image

[2038] How it works: The user shows the image to the hairdresser directly or shares it via social media or messaging apps.

[2039] Output: Hairstyle image shared with hairdresser.

[2040] Step 17:

[2041] The user chooses to issue an NFT token.

[2042] Input: Generated hairstyle image

[2043] How it works: Click the "Tokenize NFT" button in the app.

[2044] Output: The tokenization request data is temporarily saved on the device.

[2045] Step 18:

[2046] The device sends an NFT token issuance request to the server.

[2047] Input: Generated hairstyle image, metadata

[2048] How it works: The necessary metadata and image data are bundled together and sent as a request to the server.

[2049] Output: NFT token issuance request sent to the server.

[2050] Step 19:

[2051] The server generates NFT tokens and registers them on the blockchain.

[2052] Input: Generated hairstyle image, metadata

[2053] How it works: The server communicates with the blockchain network to generate and register tokens.

[2054] Output: NFT token information registered on the blockchain.

[2055] Step 20:

[2056] The server publishes the NFT token information to the market.

[2057] Input: NFT token information

[2058] What it does: Uploads token information to the NFT marketplace and notifies users.

[2059] Output: NFT token information published on the marketplace.

[2060] Step 21:

[2061] Users trade tokens on the market.

[2062] Input: NFT token information

[2063] How it works: Users buy, sell, or rent tokens on the marketplace.

[2064] Output: The traded NFT tokens.

[2065] (Application example 1)

[2066] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2067] Traditional methods for proposing and confirming hairstyles at beauty salons depended on communication between the user and the hairdresser, making it difficult to share specific ideas. As a result, the user's desired hairstyle was not accurately conveyed, leading to a high likelihood of dissatisfaction with the finished product. Furthermore, methods for issuing and trading NFT tokens as a new means of providing value by utilizing the generated hairstyle images had not yet been fully established.

[2068] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2069] In this invention, the server includes: a means for a user to register their own facial photo; a means for the user to input their desired hairstyle in text or image; a means for having a generation AI that generates a hairstyle image based on the registered facial photo and the input desired hairstyle information; a means for transmitting and displaying the generated hairstyle image to a user terminal; and a means for the user to input their desired hairstyle using a smart device and confirm and modify the generated hairstyle image. This allows the user to visually confirm their specific desired hairstyle using the generation AI, facilitating communication with their hairdresser. Furthermore, the generated hairstyle image can be used to issue NFT tokens, which can be registered on a blockchain network and traded on a marketplace.

[2070] The term "user" refers to a person who uses this system to input a desired hairstyle and view the generated hairstyle image.

[2071] "Facial photo" refers to image data of a user's face.

[2072] "Text or image" refers to text information that the user inputs to express the hairstyle they desire, or a hairstyle image for reference.

[2073] "Generative AI" refers to artificial intelligence technology that generates hairstyle images that suit a user based on a photo of the user's face and desired hairstyle information.

[2074] "User terminal" refers to an electronic device such as a smartphone, tablet, or smart glasses that is used to display a hairstyle image.

[2075] A "smart device" refers to a multifunctional electronic device that is connected to the Internet and can run applications.

[2076] "Confirmation and correction" refers to the act of the user checking the generated hairstyle image and requesting changes if necessary.

[2077] "NFT token" refers to a unique token on the blockchain issued for the generated hairstyle image.

[2078] A "blockchain network" refers to a network that uses distributed ledger technology to issue and manage NFT tokens.

[2079] "Marketplace" refers to an online platform for publishing and trading issued NFT tokens.

[2080] "Smart glasses" refers to a wearable device that can display visual information when worn on the head.

[2081] This invention provides a system in which a user registers a photo of their face and inputs their desired hairstyle using text or an image. The system utilizes AI technology to generate a hairstyle image based on the user's input face photo and desired hairstyle information, and transmits it to the user's terminal for display. Furthermore, the generated hairstyle image can be issued as an NFT token as needed, registered on the blockchain network, and published on the marketplace.

[2082] The system is configured as follows:

[2083] 1. Registering a user's face photo

[2084] Users start the application on their smartphone, PC, or other device and register a photo of their face. They can either take a photo using the camera or upload an existing image.

[2085] The server receives the registered facial photograph and stores it in a database.

[2086] 2. Enter your desired hairstyle

[2087] Users can upload their desired hairstyle via text input or a reference image on the application.

[2088] The server receives information about the desired hairstyle and inputs it into a generative AI model.

[2089] 3. Hairstyle Image Generation

[2090] The generative AI model generates hairstyle images based on the user's facial photo and desired hairstyle information.

[2091] The server transmits the generated hairstyle image to the user terminal and displays it.

[2092] 4. Check and correct the generated image

[2093] The user can check the generated hairstyle image on a smart device (such as smart glasses) and request corrections if necessary.

[2094] 5. NFT Tokenization and Trading of Generated Images

[2095] Depending on the user's wishes, the generated hairstyle image will be issued as an NFT token.

[2096] The server registers the NFT tokens on the blockchain network and publishes them on the marketplace.

[2097] The main hardware and software used are as follows:

[2098] Smart glasses: AR-enabled devices such as Oculus Quest 2

[2099] Server: AWS EC2 instance

[2100] AI models: OpenAI's GPT-4, DeepArt's style transfer model

[2101] Database: AWS RDS

[2102] Blockchain technology: Ethereum

[2103] For example, a customer at a beauty salon can put on smart glasses at the reception desk and voice-input the hairstyle they want, such as "shoulder-length bob." Images of hairstyles that fit the description will then appear on the glasses' display. The customer can then review the hairstyle images and consult with the hairdresser to determine the appropriate design. This allows customers to receive more satisfying service and reduces miscommunication.

[2104] The following are examples of possible prompt sentences:

[2105] "A customer visits a beauty salon and wants to use smart glasses to see how their hairstyle will look":

[2106] A customer visits a beauty salon and puts on a pair of smart glasses at the reception desk. They input their desired hairstyle into the smart glasses by voice, saying "a bob that falls over the shoulders," and a generated image of the hairstyle is instantly displayed on the glasses. The customer can then review the image with the hairdresser, who will help them decide on the hairstyle.

[2107] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2108] Step 1:

[2109] Users launch the application on their device, such as a smartphone or PC, and take a photo of their face or upload an existing image.

[2110] Input: User's face photo

[2111] Output: Facial photo data sent to the server

[2112] Data processing / calculation: Encode the face photo and send it to the server as an HTTPS request.

[2113] Step 2:

[2114] The server stores the received facial photos in a database and also performs validation such as checking for duplicates.

[2115] Input: User's face photo data

[2116] Output: Facial photo data stored in the database

[2117] Data processing / calculation: Facial photo data is stored in storage and associated with the user's account.

[2118] Step 3:

[2119] Users can enter their desired hairstyle in text on the application or upload an image of the hairstyle as a reference.

[2120] Input: Text or image of desired hairstyle

[2121] Output: Hair style preference data sent to the server

[2122] Data processing / calculation: Encode text data or image data and send it to the server as an HTTPS request.

[2123] Step 4:

[2124] The server prepares the received facial photo and desired hairstyle information for the generative AI model, which includes pre-processing the data and converting it into an appropriate format.

[2125] Input: Face photo data, desired hairstyle data

[2126] Output: Data format to feed to a generative AI model

[2127] Data processing / calculation: Convert the face photo and desired hairstyle data into a format that the AI ​​model can understand.

[2128] Step 5:

[2129] The generative AI model generates a suitable hairstyle image based on the user's facial photo and desired hairstyle information.

[2130] Input: Preprocessed face photo data, desired hairstyle data

[2131] Output: Generated hairstyle image

[2132] Data processing / calculation: Machine learning algorithms are used to match facial photos and generate hairstyles.

[2133] Step 6:

[2134] The server receives the generated hairstyle image and transmits it to the user's terminal.

[2135] Input: Generated hairstyle image data

[2136] Output: Hairstyle image sent to the user's device

[2137] Data processing / calculation: The generated hairstyle image is encoded and sent to the user's device via an HTTPS response.

[2138] Step 7:

[2139] The user can check the generated hairstyle image on a smart device such as smart glasses and request corrections if necessary.

[2140] Input: Generated hairstyle image

[2141] Output: User's correction request (if necessary)

[2142] Data processing / calculation: Check the generated image and send correction requests to the server as new data.

[2143] Step 8:

[2144] If the user wishes, they can send a request to issue an NFT token for the generated hairstyle image.

[2145] Input: Generated hairstyle image, NFT issuance request

[2146] Output: NFT issuance request sent to the server

[2147] Data processing / calculation: Image data and metadata are sent together to the server.

[2148] Step 9:

[2149] The server generates an NFT token corresponding to the image and registers it on the blockchain network.

[2150] Input: NFT issuance request and image data

[2151] Output: NFT token registered on the blockchain

[2152] Data processing / calculation: Tokens are generated using blockchain technology and registered on the network.

[2153] Step 10:

[2154] The server publishes information related to the issued NFT tokens on the marketplace and notifies users.

[2155] Input: NFT token information registered on the blockchain

[2156] Output: NFT token information published on the marketplace, notification to users

[2157] Data processing / calculation: Convert the data into the format required for the marketplace and publish it.

[2158] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2159] This invention relates to a system that uses generative AI to generate specific hairstyle images by having users register their own facial photos and input their desired hairstyle via text or image. This system makes it easier for users to share specific images with their hairdressers, reducing communication errors. It is also possible to issue NFT tokens for the generated hairstyle images, register them on a blockchain network, and trade them on the marketplace. Furthermore, by combining this with an emotion engine that recognizes the user's emotions, it is possible to suggest hairstyles based on the user's emotional state.

[2160] Program processing explanation

[2161] User registration phase

[2162] 1. The user installs and launches the app. The user proceeds to the new account creation screen and enters their name, email address, and password. The device collects this input data and, when the user presses the button to proceed to the next step, sends this data to the server.

[2163] 2. The server checks for duplicates in the received user data and, if there are no problems, saves it in the database. Once saved, the server returns a message to the device indicating account creation is complete.

[2164] 3. The device displays a UI that prompts the user to take a photo of their face. At this point, the user presses the capture button to launch the camera and take a photo of their face, or selects a photo from the gallery.

[2165] 4. The user takes or selects a photo of their face and presses the confirmation button. The device encodes the image data of the photo and sends it to the server.

[2166] 5. The server receives the face photo and stores it in an image database. Once stored, the image information is associated with the user's account.

[2167] Hairstyle preference input phase

[2168] 1. The user enters the desired hairstyle in text on the app screen. The user also has the option to upload an image of the hairstyle as a reference.

[2169] 2. The device collects the text data entered by the user and the hairstyle image uploaded and sends them to the server.

[2170] 3. The emotion engine recognizes the emotion from the user's facial photo and sends the emotion information to the server. For example, the emotion of the user, such as whether they are happy or sad, is analyzed here.

[2171] Hairstyle image generation phase

[2172] 1. The server prepares the received face photo, desired hairstyle data, and emotion information for the generative AI model. Specifically, the server converts this data into a format that the AI ​​model can understand.

[2173] 2. The generative AI model uses the user's facial photo, desired hairstyle data, and emotional information to generate a specific hairstyle image. This generated hairstyle image is temporarily stored in the server's storage.

[2174] 3. The server retrieves the generated hairstyle image and encodes it for transmission to the user's device. The server sends the hairstyle image data to the device via an HTTPS response.

[2175] Checking the image and sharing it with the hairdresser

[2176] 1. The terminal displays the generated hairstyle image on the user's screen. The user checks the hairstyle image and requests corrections if necessary. The data is then sent to the server again.

[2177] 2. The user presses the save button to save the image to local storage. Then, to show the hairdresser the hairstyle, the user can show the image directly to the hairdresser or share it via social media or a messaging app.

[2178] NFT token issuance and market registration phase

[2179] 1. The user selects the option to issue an NFT token for the generated hairstyle image. The device receives the user's selection and sends an NFT token issuance request.

[2180] 2. The device sends a request to the server to issue an NFT token, along with metadata and image data.

[2181] 3. The server generates an NFT token for the image and registers it on the blockchain network. Once complete, the issued token information is published on the marketplace.

[2182] 4. Users receive notifications and can browse and trade tokens on the marketplace. Users can buy and sell these tokens and earn revenue through trading.

[2183] As a concrete example, after a user uses the app and goes through the registration process, the emotion engine recognizes a "happy emotion" from the user's facial photo. Based on this emotional information, the generative AI model generates a hairstyle image that matches a lively atmosphere, which is ultimately displayed on the user's device. The user can show this image to their hairdresser, making it easier to share the specific hairstyle image. Furthermore, by issuing an NFT token for this hairstyle image, it can be sold and traded on the marketplace.

[2184] The processing flow will be explained below.

[2185] Step 1:

[2186] A user installs and launches the app. They proceed to the new account creation screen and enter their name, email address, and password. The device collects this input data and, when they press the button to proceed to the next step, sends it to the server.

[2187] Step 2:

[2188] The server checks and verifies the received user data for duplicates. After confirming that there are no duplicates, it saves the user information in the database. Once the saving is complete, the server returns a message to the device indicating that the account has been created.

[2189] Step 3:

[2190] The device displays a UI that prompts the user to take a photo of their face. The user presses the capture button to launch the camera and take a photo of their face, or selects a photo from the gallery.

[2191] Step 4:

[2192] The user takes or selects a photo of their face and presses the confirmation button. The device encodes the image data of the photo and sends it to the server.

[2193] Step 5:

[2194] The server receives the face photo and stores it in an image database. After storage is complete, the face photo information is associated with the user's account.

[2195] Step 6:

[2196] Users can enter their desired hairstyle in text on the app screen, and if they have an image of the hairstyle they want to use as a reference, they can also select the option to upload that image.

[2197] Step 7:

[2198] The terminal collects the text data entered by the user and the hairstyle image uploaded, and transmits them to the server.

[2199] Step 8:

[2200] The emotion engine analyzes the user's facial photo and recognizes their emotions, such as whether they look happy or sad, and sends the results to the server.

[2201] Step 9:

[2202] The server prepares the received facial photo, desired hairstyle data, and emotion information for delivery to the generative AI model, which involves converting the data into a format that the AI ​​model can understand.

[2203] Step 10:

[2204] The generative AI model uses the user's facial photo, desired hairstyle data, and emotional information to generate a specific hairstyle image, which is then temporarily stored in the server's storage.

[2205] Step 11:

[2206] The server retrieves the generated hairstyle image and encodes it for transmission to the user's device. The server then sends the hairstyle image data to the device via an HTTPS response.

[2207] Step 12:

[2208] The terminal displays the generated hairstyle image on the user's screen. The user checks the hairstyle image and requests corrections as necessary, and the request is sent to the server.

[2209] Step 13:

[2210] The user confirms the image and presses the save button to save the image to local storage. They can then show the image directly to their hairdresser or share it via social media or messaging apps.

[2211] Step 14:

[2212] The user selects the option to issue an NFT token for the generated hairstyle image, which causes the device to send an NFT token issuance request to the server.

[2213] Step 15:

[2214] The device sends a request to the server to issue an NFT token, along with metadata and image data.

[2215] Step 16:

[2216] Based on the data received, the server generates an NFT token corresponding to the image and registers it on the blockchain network. Once registration is complete, the issued token information is published on the marketplace.

[2217] Step 17:

[2218] Users receive notifications and can browse and trade NFT tokens on the marketplace. By buying and selling these tokens, users can earn revenue. This system not only embodies the user's desired hairstyle and reduces communication errors, but also suggests more suitable hairstyles through emotion recognition using an emotion engine, and further enables digital economic activity using NFT tokens.

[2219] Example 2

[2220] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2221] The present invention aims to provide a means for users to easily generate their desired hairstyle and other images based on their own facial images and to communicate specifically through the generated images. Furthermore, by clarifying ownership of the generated images and tokenizing them to make them tradable, it is possible to give them value as a new form of digital asset. Conventional systems often fail to accurately reflect the user's desired hairstyle or image, resulting in miscommunication. Furthermore, the lack of a means to establish ownership of generated digital images makes it difficult to trade them in the market. There is a need to solve these problems.

[2222] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2223] In this invention, the server includes: a means for a user to register their own image; a means for the user to input their desired image as text or an image; a means for generating an image based on the registered facial image and the input desired image information; a means for transmitting and displaying the generated image to the user's terminal; a means for issuing a token for the generated image and registering it in a distributed network; a means for publishing the issued token in an information disclosure system; a means for providing the user's facial image and desired image information to an algorithmic model to generate an image; a means for transmitting and displaying the generated image to the user's terminal; and a means for the user to request modifications as needed. This allows users to accurately generate their desired image and share specific images with hairdressers and others. Furthermore, by issuing an NFT token for the generated image and establishing ownership, it becomes possible to trade it as a digital asset.

[2224] A "user" is a person who uses this system to register their own facial image or desired image, and to generate hairstyles and other images.

[2225] "Image" refers to the facial image registered by the user and visual data corresponding to the hairstyle or other design desired by the user.

[2226] "Text" refers to information in the form of text that the user inputs about the hairstyle or image they desire.

[2227] "Generative AI" is an artificial intelligence system that automatically generates new hairstyle images and other designs based on the user's facial image, text, and desired image information.

[2228] "Terminal" refers to the device (smartphone, tablet, PC, etc.) that a user uses to operate this system.

[2229] The "server" is a computer system that receives user data, processes it, provides it to the generating AI, stores the generated images, and transmits them to the user.

[2230] "Token" refers to a digital representation of ownership of a generated hairstyle image or other product.

[2231] A "decentralized network" is a system in which tokens are recorded on a common ledger by multiple nodes without a centralized management entity.

[2232] "Information Disclosure System" means an online platform for public disclosure and display of issued Tokens and other information.

[2233] An "algorithmic model" refers to the computational logic and methods used to process a user's facial image or desired image information as input and generate the desired image.

[2234] A "modification request" refers to a user's request for changes or adjustments to a generated image.

[2235] This invention relates to a system that uses generative AI to generate specific images by allowing users to register their own facial images and input their desired hairstyle and other images via text or images. This system makes it easier for users to share specific images with their hairdressers, reducing communication errors. It is also possible to issue NFT tokens for the generated images, register them on a blockchain network, and trade them on a marketplace.

[2236] User registration phase

[2237] 1. The user installs and launches the app. They proceed to the new account creation screen and enter their name, email address, and password. The device collects this input data and sends it to the server when the user presses the button to proceed to the next step. This process is carried out using devices such as smartphones and tablets.

[2238] 2. The server checks for duplicates in the received user data and, if there are no problems, saves it in the database. Once saved, the server returns a message to the device indicating account creation is complete.

[2239] 3. The device displays a UI that prompts the user to take a photo of their face. At this point, the user presses the capture button to activate the camera and take a photo of their face, or select a photo from the gallery. After the user takes or selects a photo of their face and presses the confirmation button, the device encodes the image data of the photo and sends it to the server.

[2240] 4. The server receives the face photo, stores the data in an image database, and associates the image information with the user's account. Specifically, the image file is stored in a file storage or database.

[2241] Hairstyle preference input phase

[2242] 1. The user enters the desired hairstyle in text on the app screen. The user can also select the option to upload an image of the hairstyle as a reference.

[2243] 2. The device collects the text data entered by the user and the hairstyle image uploaded and sends them to the server.

[2244] 3. The emotion engine recognizes the emotion from the user's facial photo and sends the emotion information to the server. For example, the emotion is analyzed to determine whether the user looks happy or sad.

[2245] Hairstyle image generation phase

[2246] 1. The server receives the face photo, desired hairstyle data, and emotion information and prepares them for provision to the generative AI model. The server converts this data into a format that the AI ​​model can understand.

[2247] 2. The generative AI model generates a specific hairstyle image based on the user's facial photo, desired hairstyle data, and emotional information. This generated hairstyle image is temporarily stored in the server's storage.

[2248] 3. The server retrieves the generated hairstyle image and encodes it for transmission to the user's device. The server sends the hairstyle image data to the device via an HTTPS response.

[2249] Checking the image and sharing it with the hairdresser

[2250] 1. The terminal displays the generated hairstyle image on the user's screen. The user checks the hairstyle image and requests corrections if necessary. The data is then sent to the server again.

[2251] 2. The user presses the save button to save the image to local storage. Then, to show the hairdresser the hairstyle, the user can show the image directly to the hairdresser or share it via social media or a messaging app.

[2252] NFT token issuance and market registration phase

[2253] 1. The user selects the option to issue an NFT token for the generated hairstyle image. The device receives the user's selection and sends an NFT token issuance request.

[2254] 2. The device sends a request to the server to issue an NFT token, along with metadata and image data.

[2255] 3. The server generates an NFT token for the image and registers it on the blockchain network. Once complete, the issued token information is published on the marketplace.

[2256] 4. Users receive notifications and can browse and trade tokens on the marketplace. Users can buy and sell these tokens and earn revenue through trading.

[2257] Specific examples

[2258] For example, after a user uses the app and goes through the registration process, the emotion engine recognizes a "happy emotion" from the user's facial photo. Based on this emotional information, the generative AI model generates a hairstyle image that matches a lively atmosphere, which is ultimately displayed on the user's device. The user can show this image to their hairdresser, making it easier to share the specific hairstyle image they want. In addition, by issuing an NFT token for this hairstyle image, it can be sold and traded on the marketplace.

[2259] Prompt Sentence Examples

[2260] "Generate hairstyle images that match a lively atmosphere based on a photo of the user's face that shows a happy expression."

[2261] The above is a description of the embodiment of the present invention. This system allows users to accurately generate desired hairstyles and other images and use them as digital assets.

[2262] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2263] Processing Steps

[2264] User registration phase

[2265] Step 1:

[2266] A user installs and launches the app. The user proceeds to the new account creation screen and enters their name, email address, and password.

[2267] Input: Name, Email Address, Password

[2268] Output: Input data is sent to the server in JSON format

[2269] What it does: Your smartphone or tablet collects input data and sends it to the server via an HTTP POST request.

[2270] Step 2:

[2271] The server checks for duplicates in the received user data, and if there are no duplicates, stores them in the database.

[2272] Input: User data

[2273] Output: Results of duplicate check, saved to database

[2274] What happens: The server runs an SQL query to check for duplicate email addresses, and if there are no problems, it saves them to the database with an INSERT statement.

[2275] Step 3:

[2276] The server sends a message to the device indicating that the account has been created.

[2277] Input: Account creation completion status

[2278] Output: Account creation successful message

[2279] Specific operation: A message is sent to the terminal as an HTTP response with status code 200.

[2280] Step 4:

[2281] The device displays a UI that prompts the user to take a photo of their face. The user takes a photo of their face or selects a photo from the gallery.

[2282] Input: User-initiated camera or selection from gallery

[2283] Output: Captured photo data or selected photo data

[2284] Specific behavior: The camera app launches and a photo is taken, or an image selected from the gallery is retrieved from the device.

[2285] Step 5:

[2286] The user presses the "Confirm Face Photo" button. The device encodes the image data of the face photo and sends it to the server.

[2287] Input: Facial photo data

[2288] Output: Encoded image data

[2289] What happens: The image is encoded in a format such as Base64 and sent to the server as an HTTP request.

[2290] Step 6:

[2291] The server receives the face photo and stores it in an image database, which associates the image information with the user's account.

[2292] Input: Facial photo data

[2293] Output: Save to image database, associate with user account

[2294] Specific behavior: The image file is saved to file storage or a database, and the path to the image file is added to the user's database record.

[2295] Hairstyle preference input phase

[2296] Step 1:

[2297] Users enter their desired hairstyle in text on the app screen, and also have the option to upload an image of the hairstyle as a reference.

[2298] Input: Text data and image data of desired hairstyle

[2299] Output: Uploaded data

[2300] What it does: Collects text and images.

[2301] Step 2:

[2302] The terminal collects the text data entered by the user and the hairstyle image uploaded and sends them to the server.

[2303] Input: Text data, image data

[2304] Output: Data sent to the server

[2305] Specific behavior: Sends data to the server as an HTTP request.

[2306] Step 3:

[2307] The emotion engine recognizes emotions from the user's facial photograph and transmits the emotion information to the server.

[2308] Input: Facial photo data

[2309] Output: Emotion recognition result data

[2310] Specific operation: Image processing is performed and emotion recognition results are generated.

[2311] Hairstyle image generation phase

[2312] Step 1:

[2313] The server prepares the received facial photo, desired hairstyle data, and emotional information to provide to the generative AI model. 【2314...

Claims

1. A means for a user to register a photograph of his or her face; A means for a user to input a desired hairstyle by text or image; A means for generating a hairstyle image based on a registered face photograph and input desired hairstyle information, means for transmitting the generated hairstyle image to a user terminal and displaying it; A system including:

2. A means to issue an NFT token for the generated hairstyle image and register it on the blockchain network; The system of claim 1 , further comprising means for publishing the issued NFT tokens on a marketplace.

3. A means for providing a user's face photo and desired hairstyle information to an AI model in order to generate a hairstyle image; means for transmitting the generated hairstyle image to a user's terminal and displaying it; 10. The system of claim 1, further comprising means for a user to request modifications if desired.

Images