System

Abstract

A system is provided.SOLUTION: A system, comprising: means for obtaining facial information of a user; means for obtaining favorite hairstyle information of the user; means for generating an optimal hairstyle based on the facial information and the favorite hairstyle information of the user; means for presenting the generated hairstyle information to the user; means for searching for information of a beauty salon or a hairdresser that can realize the presented hairstyle information; means for presenting the searched information of the beauty salon or the hairdresser to the user and sending a reservation request; and means for processing the reservation request and sending a reservation confirmation message to the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Currently, many users face the problem of difficulty in finding the hairstyle that best suits them and in finding a hairdresser who can achieve that hairstyle. As a result, users are likely to not achieve the hairstyle they expected, and they have to spend even more time and effort. Furthermore, if the hair salon or hairdresser they choose does not meet their expectations, it can lead to a decrease in user satisfaction. Therefore, the objective of this invention is to provide a system that allows users to easily find the optimal hairstyle based on their facial information and preferences, quickly recommends a hair salon or hairdresser who can achieve that hairstyle, and easily completes the reservation. [Means for solving the problem]

[0005] The present invention provides a system including means for acquiring face information of a user, means for acquiring information on a hairstyle preferred by the user, means for generating an optimal hairstyle based on the face information and the hairstyle information preferred by the user, means for presenting the generated hairstyle information to the user, means for searching for information on beauty salons and hairdressers who can realize the presented hairstyle information, means for presenting the searched information on beauty salons and hairdressers to the user and sending a reservation request, and means for processing the reservation request and sending a reservation confirmation message to the user. This system enables a user to easily find an optimal hairstyle based on their face information, quickly find a beauty salon or hairdresser who can realize that hairstyle, and easily complete a reservation.

[0006] "User" refers to a person who uses this system to input their facial information and have the system suggest the best hairstyle for them.

[0007] "Facial information" refers to information that represents the features and contours of a user's face, and refers to data obtained by photographing or videotaping.

[0008] "Preferred hairstyle information" refers to information about the type and characteristics of a hairstyle desired by the user.

[0009] A "generative AI model" refers to an artificial intelligence model that generates the optimal hairstyle based on the user's facial information and preferred hairstyle information.

[0010] "Hairstyle generation means" refers to a function for generating the optimal hairstyle for a user using a generative AI model.

[0011] "Overall coordination image" refers to information that helps you imagine the overall style, including clothing and accessories, that will go with the proposed hairstyle.

[0012] A "beauty salon" refers to a facility where a user visits to achieve a hairstyle.

[0013] A "hairdresser" refers to a professional who provides services to help users achieve their desired hairstyle.

[0014] "Reservation Request" refers to information that a user sends to the system to make a reservation with a suggested hair salon or hairdresser.

[0015] "Reservation confirmation message" refers to a confirmation message sent by the system to inform a user that their reservation has been completed. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] The system of the present invention is designed to make it easier for users to achieve their ideal hairstyle by performing a series of processes involving the user, terminal, and server. The program of this system executes the following processes.

[0038] Explanation of program processing

[0039] Acquiring and sending face information

[0040] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or video. The device receives these inputs and sends them to the server as face information. The user is presented with a progress bar and / or a confirmation message indicating that the face information was successfully sent.

[0041] Acquiring and sending information about your favorite hairstyles

[0042] Next, the user enters the desired hairstyle in the "Enter your preferred hairstyle" field. For example, if the user enters "I like long, natural hair," the device sends this information to the server. At this time, a confirmation message is displayed to the user confirming the completion of the transmission.

[0043] Hairstyle generation

[0044] The server uses a generative AI model to generate the optimal hairstyle based on the facial information and preferred hairstyle information received from the device. This generated hairstyle is best suited to the user's facial contours and features. An overall coordinated image is also generated.

[0045] Presenting the proposal

[0046] The server sends the generated hairstyle and overall coordinated image to the terminal, which displays them to the user. The user checks the proposed hairstyle and decides whether or not they want to adopt it.

[0047] Search and book hair salons and hairdressers

[0048] If the user is satisfied with the proposed hairstyle, the system searches for a nearby hair salon or hair stylist based on the user's current location. This information is retrieved by the server from a database, and a list of candidates is displayed on the device. When the user selects a specific salon or hair stylist and clicks the "Book Now" button, the device sends this selection and the desired appointment date and time to the server.

[0049] Confirmation of reservation and confirmation message

[0050] The server receives the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user and ends the process.

[0051] Specific examples

[0052] User Example

[0053] 1. The user opens the app on their smartphone, selects "Take a photo," takes a photo of their face, and uploads it to the system.

[0054] 2. The user enters "I want natural long hair" in the text field and presses the submit button.

[0055] 3. The user checks the optimal hairstyle and overall coordination image displayed on the device.

[0056] 4. The user selects "Get this style" and the system displays nearby salons and stylists.

[0057] 5. The user selects "Beauty Salon A" and clicks the "Book Now" button.

[0058] 6. The server will confirm the reservation and a reservation confirmation message will appear on the device, confirming that "Reservation completed."

[0059] In this way, by using the system of the present invention, a user can easily find the optimal hairstyle based on their facial information and preferences, quickly find a hair salon or hairdresser to achieve that hairstyle, and complete the reservation.

[0060] The processing flow will be explained below.

[0061] Step 1:

[0062] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or video. The face information is saved on the device.

[0063] Step 2:

[0064] The device compresses the stored face information (photo or video file) and sends it to the server. A progress bar and a confirmation message are displayed to the user.

[0065] Step 3:

[0066] The user enters their preferred style (e.g., "long hair," "perm," "bob cut," etc.) in the "Enter your preferred hairstyle" field. The user confirms the input and presses the "Submit" button.

[0067] Step 4:

[0068] The terminal transmits the user's preferred hairstyle information in text format to the server, and displays a confirmation message to the user indicating that the preference information has been transmitted.

[0069] Step 5:

[0070] The server analyzes the facial information received from the device and recognizes the facial contours and features. The server then receives information about the user's preferred hairstyle. The server then uses a generative AI model to generate the optimal hairstyle based on the facial information and preferences.

[0071] Step 6:

[0072] The server generates the optimal hairstyle in text and image format. The server also generates an overall coordinated image and generates an image. The server sends this information to the terminal.

[0073] Step 7:

[0074] The terminal displays the proposal received from the server. The user checks the proposed hairstyle and overall coordinated image. The user clicks the "Choose this style" button.

[0075] Step 8:

[0076] The server obtains the user's current location information (e.g., GPS data) and searches for information on nearby beauty salons and hairdressers. The server then sends the search results in a list format to the device.

[0077] Step 9:

[0078] The terminal displays the list of candidate hair salons and hair stylists received from the server to the user. The user selects "Hair Salon A" and clicks the "Book Now" button.

[0079] Step 10:

[0080] The terminal sends the information about the beauty salon selected by the user and the desired reservation date and time to the server, and displays a notification to the user indicating that the reservation request has been sent.

[0081] Step 11:

[0082] The server processes the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal.

[0083] Step 12:

[0084] The terminal displays the confirmation message received from the server to the user. The message "Reservation completed" is displayed and the process ends.

[0085] Example 1

[0086] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0087] With conventional systems, it takes a lot of time and effort for users to find a hairstyle that suits their facial features. Even if they find the perfect hairstyle, it is difficult to easily find and book a salon or hairdresser who can create that hairstyle. To solve these problems, a system is needed that can automatically generate an optimal hairstyle and overall coordination image based on the user's facial information and preferred hairstyle information, and then efficiently search for and book salons and hairdressers who can create that hairstyle.

[0088] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0089] In this invention, the server includes means for acquiring user face information, means for acquiring user preferred hairstyle information, means for using a generative model that generates an optimal hairstyle and overall coordinated image based on the user's face information and preferred hairstyle information, means for presenting the generated hairstyle and coordinated image to the user, means for searching for information on treatment locations and practitioners who can realize the presented hairstyle and coordinated image, means for presenting the searched information on treatment locations and practitioners to the user and sending a reservation request, and means for processing the reservation request and sending a reservation confirmation message to the user. This allows the user to easily find the optimal hairstyle and coordination based on their own face information and preferences, quickly find the treatment locations and practitioners that can realize it, and complete the reservation.

[0090] The "means for acquiring user's facial information" refers to the means by which a user accesses the system and inputs their own facial information by taking an image or video.

[0091] The "means for acquiring information on a user's preferred hairstyle" is a means for a user to access the system and input a desired hairstyle in text format.

[0092] "Means for using a generative model" refers to means for using a generative AI model that is used to generate an optimal hairstyle and overall coordinated image based on the user's facial information and preferred hairstyle information.

[0093] The "means for presenting the generated hairstyle and coordinated image to the user" refers to a means for transmitting the hairstyle and coordinated image generated by the server to the terminal and displaying it to the user.

[0094] "Means for searching for information on treatment locations and practitioners" refers to the means by which the system searches for information on the most suitable beauty salon or hairdresser from a database or other information source based on the user's current location information, etc.

[0095] "Means for presenting the searched information on treatment locations and practitioners to the user and sending a reservation request" refers to means for displaying candidate treatment locations and practitioners to the user, allowing the user to select the desired treatment location and practitioner and send a reservation request.

[0096] The "means for processing reservation requests and sending reservation confirmation messages to users" refers to the means by which the system receives reservation requests from users, confirms the reservations in cooperation with affiliated reservation systems, and sends confirmation messages to users.

[0097] This invention makes it easier for users to achieve their ideal hairstyle by performing a series of processes involving the user, the terminal, and the server. Below, we will explain how to specifically implement this system.

[0098] This system acquires the user's facial information and preferred hairstyle information, and then uses a generative AI model to generate the optimal hairstyle and overall coordination image based on that information. The generated information is presented to the user, who can then search for and book treatment locations and therapists who can achieve that hairstyle.

[0099] First, a user opens the system's application or website on their device. The device can be a smartphone, tablet, or PC. The user selects the "Enter Face Information" option and takes a photo or video. The camera function is used to take a photo of the user's face, which the device then sends to the server as face information. The user is then presented with a progress bar and a confirmation message indicating that the face information has been successfully sent.

[0100] Next, the user enters the desired style in text format in the "Enter your preferred hairstyle" field. For example, if the user enters "I like long, natural hair," the device will send this information to the server. A confirmation message will be displayed to the user.

[0101] The server uses a generative AI model to generate the optimal hairstyle based on the facial information and preferred hairstyle information received from the device. The generated hairstyle is best suited to the user's facial contours and features, and an overall coordinated image is also generated. The generative AI model used here is trained using a specific dataset.

[0102] The generated hairstyles and coordinated images are sent from the server to the terminal, which then displays them to the user. The user can check the proposed hairstyles and select the one they like best.

[0103] If the user is satisfied with the proposed hairstyle, the system searches for nearby salons and hairdressers based on the user's current location. The server retrieves this information from a database, and a list of candidates is displayed on the device. The user selects a specific salon or hairdresser and clicks the "Book Now" button, sending the selection and desired appointment date and time to the server.

[0104] The server receives the reservation request and confirms the reservation by coordinating with the relevant beauty salon's reservation system. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user, and the process ends.

[0105] Here are some examples of prompts to input to a generative AI model:

[0106] Generate the most suitable hairstyle based on the user's face information and preferred hairstyle information. The user wants natural long hair. The user's face is round. Please provide an image of the overall outfit along with the generated hairstyle.

[0107] In this way, by using the system of the present invention, a user can easily find the optimal hairstyle and coordination based on their facial information and preferences, quickly find the treatment location and practitioner to achieve it, and complete the reservation.

[0108] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0109] Step 1:

[0110] The user opens an application or website on their device, selects the "Enter Face Information" option, and takes a photo or video.

[0111] Input: User action (face photo or video)

[0112] Output: Captured image data

[0113] Specific behavior:

[0114] A user taps an app on their smartphone to launch it.

[0115] The user clicks the "Enter Face Information" button and takes a photo of their face using the camera function.

[0116] The device saves the captured image data and stores it in temporary memory.

[0117] Step 2:

[0118] The face information received by the device is sent to the server.

[0119] Input: Photographed image data

[0120] Output: Face information sent to the server

[0121] Specific behavior:

[0122] The device encodes the image data and sends it to the server as an HTTP request.

[0123] The terminal displays a transmission progress bar and provides a confirmation message to the user that the transmission is complete.

[0124] Step 3:

[0125] The user enters the desired style in the "Enter your desired hairstyle" field.

[0126] Input: User text input (desired hairstyle)

[0127] Output: The input text data

[0128] Specific behavior:

[0129] The user enters "I want natural long hair" in the text field and presses the submit button.

[0130] The device captures and temporarily stores the text data.

[0131] Step 4:

[0132] The terminal transmits the input hairstyle information to the server.

[0133] Input: Text data (preferred hairstyle information)

[0134] Output: Hair style information sent to the server

[0135] Specific behavior:

[0136] The terminal encodes the text data and sends it to the server as an HTTP request.

[0137] The terminal displays a message to the user confirming that transmission is complete.

[0138] Step 5:

[0139] Based on the facial information and hairstyle information received by the server, the optimal hairstyle is generated using a generative AI model.

[0140] Input: Face information, hairstyle information

[0141] Output: Generated hairstyle and outfit image

[0142] Specific behavior:

[0143] The server decodes the received face information and hairstyle information.

[0144] The server sends a request to the generated AI model using a prompt sentence.

[0145] Example prompt: "Generate the most suitable hairstyle based on the user's facial information and preferred hairstyle information."

[0146] The server examines the generated results returned by the generative AI model and also adds an overall coordinated image.

[0147] Step 6:

[0148] The server transmits the generated hairstyle and coordinated image to the terminal.

[0149] Input: Generated hairstyle and outfit image

[0150] Output: Hairstyle and outfit image sent to the device

[0151] Specific behavior:

[0152] The server encodes the generated result and sends it to the terminal as an HTTP response.

[0153] Step 7:

[0154] The terminal displays the received data to the user.

[0155] Input: Response data from the server

[0156] Output: Hairstyle and outfit image displayed to the user

[0157] Specific behavior:

[0158] The device decodes the response data and displays an image of the hairstyle and outfit on the screen.

[0159] Step 8:

[0160] If the user is satisfied with the suggested hairstyle, the system will search for nearby hair salons and hairdressers based on the user's current location information.

[0161] Input: User's current location information

[0162] Output: List of treatment locations and practitioner candidates

[0163] Specific behavior:

[0164] The user selects "Use this style" and clicks the reservation button.

[0165] The device uses the GPS function to obtain the current location information and sends it to the server.

[0166] The server queries and retrieves information about nearby hair salons and hairdressers from a database.

[0167] Step 9:

[0168] The server transmits the acquired information about the treatment location and the practitioner to the terminal.

[0169] Input: Salon and stylist information retrieved from a database

[0170] Output: Candidate list sent to the terminal

[0171] Specific behavior:

[0172] The server encodes the acquired information and sends it to the terminal.

[0173] Step 10:

[0174] The terminal displays a list of potential hair salons and hairstylists to the user.

[0175] Input: Response data from the server

[0176] Output: The candidate list displayed to the user

[0177] Specific behavior:

[0178] The device decodes the candidate list and displays it on the screen.

[0179] Step 11:

[0180] The user selects a particular salon or hairdresser and clicks the "Book Now" button.

[0181] Input: User selection information, desired reservation date and time

[0182] Output: Selection information and desired reservation date and time

[0183] Specific behavior:

[0184] The user selects one of the displayed options and clicks the reservation button.

[0185] The terminal transmits the selected candidate and the desired date and time to the server.

[0186] Step 12:

[0187] The server processes the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon.

[0188] Input: Reservation Request

[0189] Output: Reservation confirmation message

[0190] Specific behavior:

[0191] The server decodes the received request and records the reservation information.

[0192] The server sends an API request to the salon's reservation system to confirm the reservation.

[0193] Step 13:

[0194] The server generates a reservation confirmation message and sends it to the terminal.

[0195] Input: Confirmed reservation information

[0196] Output: Reservation confirmation message

[0197] Specific behavior:

[0198] The server generates a message notifying the completion of the reservation, encodes it, and sends it to the terminal.

[0199] The terminal displays a confirmation message to the user saying "Reservation completed."

[0200] (Application example 1)

[0201] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0202] Conventional hairstyle suggestion systems have difficulty generating optimal hairstyles based on a user's facial information and preferred style information, and also have the problem of making it difficult to search for and book beauty salons and hairdressers. In particular, there has been a lack of individually customized hairstyle suggestions based on facial information, and reservation systems that respond to real-time beauty salon availability.

[0203] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0204] In this invention, the server includes means for acquiring user facial information, means for acquiring user preferred hairstyle information, means for using a generative AI model to generate an optimal hairstyle based on the user's facial information and preferred hairstyle information, means for presenting the generated hairstyle information to the user, means for searching for information on salons and technicians who can realize the presented hairstyle information, means for presenting the searched information on salons and technicians to the user and sending a reservation request, and means for processing the reservation request and sending a reservation confirmation message to the user. This allows the user to generate an optimal hairstyle based on their facial information and preferences, quickly and easily find a beauty salon or hairdresser to realize that style, and complete the reservation.

[0205] "User facial information" refers to image data containing a user's facial features or other biometric information.

[0206] "User's favorite hairstyle information" is information about a hairstyle desired by the user, and is expressed in the form of text, an image, or the like.

[0207] A "generative AI model" is an artificial intelligence model that is trained to generate optimal outputs based on input data.

[0208] "Generated hairstyle information" refers to information about hairstyles generated by a generative AI model based on the user's facial information and preferred hairstyle information.

[0209] The "presentation means" refers to a method or device for visually displaying the generated hairstyle information and search results to the user.

[0210] "Store and technician information" refers to data that includes information about service providers such as beauty salons and hairdressers.

[0211] A "search method" is an algorithm or process used to retrieve targeted information from a database based on specific criteria.

[0212] The "means for sending a reservation request" refers to a communication means for sending a reservation request to the store or technician selected by the user.

[0213] A "reservation confirmation message" is a confirmation message indicating that a reservation request has been confirmed.

[0214] The system of the present invention creates an optimal hairstyle based on facial information and preferred hairstyle information, making it easier for users to achieve their ideal hairstyle, and then searches for and reserves salons and technicians who can achieve that style. In this embodiment, a smartphone and a cloud server are used.

[0215] Program processing

[0216] 1. Acquiring and sending face information

[0217] The user takes a photo of their face using a device (smartphone). The captured facial information is sent to a cloud server as image data. This requires the smartphone's camera as hardware and the ability to import image data and send it to the server as software. Specifically, a face recognition library (e.g., OpenCV) is used.

[0218] 2. Acquisition and transmission of preferred hairstyle information

[0219] The user inputs their desired hairstyle in text format on the device. The input text information is sent to the server, where it is analyzed by a natural language processing engine.

[0220] 3. Hairstyle generation

[0221] The cloud server combines the acquired facial information with the desired hairstyle information and generates the optimal hairstyle using a generative AI model (e.g., Stable Diffusion). In this process, the AI ​​model analyzes and synthesizes facial features and hairstyle elements. The generated hairstyle image is then sent from the cloud server to the device.

[0222] 4. Presenting the proposal

[0223] The terminal visually presents the generated hairstyle information received from the server to the user, allowing the user to confirm the proposed style.

[0224] 5. Search for and book a store or technician

[0225] Based on the device's location, the server searches a database of nearby hairdressers and salons and presents the most suitable candidates to the user. The user then selects a salon and technician from the list and submits a reservation request.

[0226] 6. Confirmation of reservation and confirmation message

[0227] The server processes the received reservation request and confirms the reservation in cooperation with the reservation system of the relevant store. A confirmation message of the reservation completion is sent to the user's terminal and displayed to the user.

[0228] Specific examples

[0229] User operation procedure

[0230] 1. The user opens the smartphone app, uses the "take photo" function to take a photo of their face, and uploads it to the system.

[0231] 2. The user types "Bob cuts are good" in the text field and presses the submit button.

[0232] 3. The user checks the optimal hairstyle and outfit image displayed on their smartphone.

[0233] 4. When the user selects "Get this style," the system will display a list of nearby salons and stylists.

[0234] 5. The user selects "Beauty Salon B" and clicks the "Book Now" button.

[0235] 6. The cloud server will confirm the reservation and the device will display a confirmation message saying "Reservation completed."

[0236] Example prompts for generative AI models

[0237] Generate a "Bob Cut" hairstyle based on the user's face photo.

[0238] In this way, users can easily find their ideal hairstyle, quickly and easily find a hair salon or hairdresser to help them achieve it, and complete a reservation.

[0239] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0240] Step 1:

[0241] A user takes a photo of their face with a device (smartphone) and sends the facial information to a cloud server. The device's camera is used to capture the image data, which is then uploaded directly to the cloud server. The input is the user's facial photo, and the output is the image data sent to the server.

[0242] Step 2:

[0243] The user inputs information about their preferred hairstyle in text format into the device and sends it to the cloud server. The device receives the user's input as text data and sends it to the cloud server. The input is the text information entered by the user, and the output is the text data sent to the server.

[0244] Step 3:

[0245] The cloud server uses a generative AI model based on facial information and preferred hairstyle information to generate the optimal hairstyle. The server converts image data and text data into a prompt sentence, inputs it into the AI ​​model, and outputs a generated hairstyle image. The input is facial image data and text information, and the output is a generated hairstyle image. An example of a prompt sentence: "Generate a 'bob cut' hairstyle based on the user's facial photo."

[0246] Step 4:

[0247] The cloud server sends the generated hairstyle image to the terminal. The server then sends the generated image data to the terminal via an existing communication method, and the terminal performs reception processing. The input is the generated hairstyle image, and the output is the image data sent to the terminal.

[0248] Step 5:

[0249] The device presents the received hairstyle image to the user. The device renders the image data on a display screen so that the user can view it. The input is the received hairstyle image, and the output is the image displayed on the device screen.

[0250] Step 6:

[0251] Based on the hairstyle information provided by the user, the system requests a search for salons and technicians who can create that style. When the user clicks the "Search" button on their device, the request is sent to the cloud server. The input is the user's search request, and the output is the data sent to the cloud server.

[0252] Step 7:

[0253] The cloud server searches the database for the most suitable hair salon and technician based on the user's location and hairstyle information, and sends the results to the device. The server processes the location and hairstyle information as a search query and retrieves a list of candidates from the database. The input is the user's location and hairstyle information, and the output is a list of search results.

[0254] Step 8:

[0255] The terminal presents the search results to the user and sends a reservation request. The terminal renders a candidate list on the display screen and allows the user to select the desired store and technician. The input is the list of search results, and the output is a reservation request based on the list displayed on the terminal screen and the store and technician selected by the user.

[0256] Step 9:

[0257] The cloud server processes the received reservation request and confirms the reservation in conjunction with the relevant store's reservation system. The server analyzes the request data and connects to the store's reservation system via an API. The input is the reservation request data, and the output is the confirmed data sent to the store's reservation system.

[0258] Step 10:

[0259] The cloud server generates a reservation confirmation message and sends it to the terminal. The server generates a confirmation message based on the reservation confirmation data and sends it to the terminal. The input is the reservation confirmation data, and the output is the reservation confirmation message sent to the terminal.

[0260] Step 11:

[0261] The terminal presents the received reservation confirmation message to the user and ends the process. The terminal renders the confirmation message on the display screen for the user to review. The input is the reservation confirmation message and the output is the message displayed on the terminal screen.

[0262] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0263] The system of the present invention is designed to make it easier for users to achieve their ideal hairstyle by performing a series of processes involving the user, terminal, server, and emotion engine. The program of this system executes the following processes.

[0264] Explanation of program processing

[0265] Acquiring and transmitting facial and emotional information

[0266] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or records a video. The device receives these inputs and uses the emotion engine to analyze the user's facial expressions and obtain emotional information. The obtained facial and emotional information is stored on the device and sent to the server. A progress bar and a confirmation message for sending are displayed to the user.

[0267] Acquisition and transmission of preferred hairstyle information

[0268] Next, the user enters the desired style in the "Enter your preferred hairstyle" field. For example, if the user enters "I like long natural hair," the terminal will send this information to the server. A confirmation message will be displayed to the user.

[0269] Hairstyle generation

[0270] The server uses a generative AI model to generate the optimal hairstyle based on the facial information, emotional information, and preferred hairstyle information received from the device. This generated hairstyle is best suited to the user's facial contours and features. An overall coordinated image is also generated.

[0271] Presenting the proposal

[0272] The server sends the generated hairstyle and overall coordinated image to the terminal, which displays them to the user. The user checks the proposed hairstyle and decides whether or not they want to adopt it.

[0273] Search and book salons and hairdressers

[0274] If the user is satisfied with the proposed hairstyle, the system searches for a nearby hair salon or hair stylist based on the user's current location. This information is retrieved by the server from a database, and a list of candidates is displayed on the device. When the user selects a specific salon or hair stylist and clicks the "Book Now" button, the device sends this selection and the desired appointment date and time to the server.

[0275] Confirmation of reservation and confirmation message

[0276] The server receives the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user and ends the process.

[0277] Specific examples

[0278] User Example

[0279] 1. The user opens the app on their smartphone, selects "Take a photo," takes a photo of their face, and uploads it to the system. At this time, the emotion engine reads emotional information from their facial expressions.

[0280] 2. The user enters "I want natural long hair" in the text field and presses the submit button.

[0281] 3. The user checks the optimal hairstyle and overall coordination image displayed on the device.

[0282] 4. The user selects "Get this style" and the system displays nearby salons and stylists.

[0283] 5. The user selects "Beauty Salon A" and clicks the "Book Now" button.

[0284] 6. The server will confirm the reservation and a reservation confirmation message will appear on the device, confirming that "Reservation completed."

[0285] In this way, by using the system of the present invention, users can easily find the optimal hairstyle based on their facial information and preferences, quickly find the hair salon or hairdresser who can create that hairstyle, and complete the reservation.The introduction of an emotion engine makes it possible to suggest hairstyles that reflect the user's current emotions, allowing for the provision of more personalized services.

[0286] The processing flow will be explained below.

[0287] Step 1:

[0288] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or video. The face information is saved on the device.

[0289] Step 2:

[0290] The device passes the stored facial information to the emotion engine, which extracts emotional information from the user's facial expressions. The emotional information is then sent to the server along with the facial information. A progress bar and a confirmation message are displayed to the user.

[0291] Step 3:

[0292] The user inputs the desired hairstyle in the "Enter your desired hairstyle" field. For example, the user inputs "I like long natural hair." The user confirms the input and presses the "Submit" button.

[0293] Step 4:

[0294] The terminal sends the user's preferred hairstyle information in text format to the server, and a confirmation message is displayed to the user to confirm that the transmission has been completed.

[0295] Step 5:

[0296] The server analyzes the facial information, emotional information, and preferred hairstyle information received from the device. The emotional information obtained by the emotion engine is combined and the optimal hairstyle is generated using a generative AI model.

[0297] Step 6:

[0298] The server generates the optimal hairstyle in text and image format, and also generates an overall coordinated image, and sends this information to the terminal.

[0299] Step 7:

[0300] The terminal displays the proposal received from the server. The user checks the proposed hairstyle and overall coordinated image. The user clicks the "Choose this style" button.

[0301] Step 8:

[0302] The server obtains the user's current location information (e.g., GPS data) and searches for information on nearby beauty salons and hairdressers. The server then sends the search results in a list format to the device.

[0303] Step 9:

[0304] The terminal displays the list of candidate hair salons and hair stylists received from the server to the user. The user selects "Hair Salon A" and clicks the "Book Now" button.

[0305] Step 10:

[0306] The terminal sends the information about the beauty salon selected by the user and the desired reservation date and time to the server, and displays a notification to the user indicating that the reservation request has been sent.

[0307] Step 11:

[0308] The server processes the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal.

[0309] Step 12:

[0310] The terminal displays the confirmation message received from the server to the user. The message "Reservation completed" is displayed and the process ends.

[0311] Example 2

[0312] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0313] Conventional hairstyle suggestion systems rarely take into account the user's emotional information, making it difficult for users to easily find a hairstyle that actually satisfies them. In addition, the process of searching for and booking beauty facilities and beauty professionals is complicated, preventing users from receiving appropriate services quickly.

[0314] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0315] In this invention, the server includes means for acquiring user facial information, means for analyzing user emotional information, means for acquiring user preferred hairstyle information, means for generating an optimal hairstyle based on the user's facial information, emotional information, and preferred hairstyle information, means for presenting the generated hairstyle and an overall coordinated image to the user, means for searching for information on beauty facilities and beauty professionals who can realize the presented hairstyle, means for presenting the searched information on beauty facilities and beauty professionals to the user and sending a reservation request, and means for processing the reservation request and sending a reservation confirmation message to the user. This enables a user to easily find an optimal hairstyle based on their facial information and preferences, quickly find a beauty facility or beauty professional who can realize that hairstyle, and complete the reservation.

[0316] The "means for acquiring user's face information" refers to a means for acquiring face information by the user taking a photograph or shooting a video.

[0317] The "means for analyzing the user's emotional information" is a means for analyzing facial photographs and videos taken by the user and obtaining emotional information from facial expressions using an emotion engine.

[0318] The "means for acquiring information on the user's preferred hairstyle" is a means for the user to input the hairstyle he or she desires in text format or in a selection format.

[0319] The "means for generating an optimal hairstyle" is a means for generating a hairstyle that is most suitable for a user using a generative AI model based on the user's facial information, emotional information, and preferred hairstyle information.

[0320] The "means for presenting the generated hairstyle and overall coordinated image to the user" is a means for displaying the generated hairstyle information and the corresponding overall coordinated image on the user's terminal.

[0321] The "means for searching for information on beauty facilities and beauty workers" is a means for searching a database for the most suitable beauty facilities and beauty workers based on the user's location information.

[0322] "Means for presenting information to the user and sending a reservation request" refers to means for displaying information on searched beauty facilities and beauty professionals on the user's terminal, allowing the user to select a specific facility or professional and send a reservation request.

[0323] The "means for sending a reservation confirmation message to the user" is a means for processing a reservation request and sending a confirmation message to the user's terminal indicating that the reservation has been confirmed.

[0324] The system of the present invention is designed to make it easier for users to achieve their ideal hairstyle by performing a series of processes involving the user, terminal, server, and emotion engine. The program of this system executes the following processes.

[0325] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or records a video. The device receives these inputs, analyzes the user's facial expressions with the emotion engine, and acquires emotional information. The acquired facial and emotional information is stored on the device and sent to the server. As a specific example, the Microsoft Azure Emotion API can be used.

[0326] Next, the user enters the desired style in the "Enter your preferred hairstyle" field. For example, if the user enters "I like long natural hair," the terminal will send this information to the server. A confirmation message will be displayed to the user.

[0327] The server uses a generative AI model to generate the optimal hairstyle based on the facial information, emotional information, and preferred hairstyle information received from the device. The generative AI model can be OpenAI's GPT-3 or similar. The generated hairstyle is best suited to the user's facial contours and features. An overall coordinated image is also generated.

[0328] The server sends the generated hairstyle and overall coordinated image to the terminal, which displays them to the user. The user checks the proposed hairstyle and decides whether or not they want to adopt it.

[0329] If the user is satisfied with the proposed hairstyle, the system searches for a nearby hair salon or hair stylist based on the user's current location. This information is retrieved by the server from a database, and a list of candidates is displayed on the device. When the user selects a specific salon or hair stylist and clicks the "Book Now" button, the device sends this selection and the desired appointment date and time to the server.

[0330] The server receives the reservation request and confirms the reservation by connecting with the relevant beauty salon's reservation system. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user, and the entire process is completed.

[0331] Specific examples

[0332] User Example

[0333] 1. The user opens the app on their smartphone, selects "Take a photo," takes a photo of their face, and uploads it to the system. At this time, the emotion engine reads emotional information from their facial expressions.

[0334] 2. The user enters "I want natural long hair" in the text field and presses the submit button.

[0335] 3. The user checks the optimal hairstyle and overall coordination image displayed on the device.

[0336] 4. The user selects "Get this style" and the system displays nearby salons and stylists.

[0337] 5. The user selects "Beauty Salon A" and clicks the "Book Now" button.

[0338] 6. The server will confirm the reservation and a reservation confirmation message will appear on the device, confirming that "Reservation completed."

[0339] Example prompts to input to the generative AI model

[0340] "Analyze the user's facial photo and obtain emotional information using the emotion engine. Next, generate the optimal hairstyle based on the user's desired hairstyle. Send the generated hairstyle and the overall coordinated image to the user's device."

[0341] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0342] Step 1:

[0343] A user opens a system application or website on a smartphone or computer. When the application is launched, a screen appears where the user can select the "Enter Face Information" option.

[0344] Input: Launch application

[0345] Output: Display of face information input screen

[0346] Step 2:

[0347] The user selects the "Enter Face Information" option and takes a photo or video. The device activates the camera and captures the user's face information.

[0348] Input: User's choice of taking a photo or video

[0349] Output: Acquire and save face information

[0350] Step 3:

[0351] The device inputs stored photos and videos into the emotion engine, which analyzes the user's facial expressions to obtain emotional information. Specifically, the emotion engine detects facial features and classifies emotions.

[0352] Input: Photo or video data

[0353] Output: Emotional information

[0354] Step 4:

[0355] The device transmits the acquired facial and emotional information to the server, at which point a progress bar and a confirmation message are displayed to the user.

[0356] Input: Face and emotion information

[0357] Output: Send data to the server, display confirmation message

[0358] Step 5:

[0359] The user enters the desired hairstyle in the "Enter your preferred hairstyle" field. The device sends this input to the server. For example, a user might enter "I like natural long hair."

[0360] Input: Hair style information by text input

[0361] Output: Send text data to the server

[0362] Step 6:

[0363] The server receives facial information, emotional information, and preferred hairstyle information sent from the device and prepares this data to be input into the generative AI model.

[0364] Input: Face information, emotion information, hairstyle information

[0365] Output: Data preparation for input to a generative AI model

[0366] Step 7:

[0367] The server uses a generative AI model to generate the optimal hairstyle, taking into account facial contours, features, and emotional information during the generation process. An example of a generative AI model is OpenAI's GPT-3.

[0368] Input: Face information, emotion information, hairstyle information

[0369] Output: Optimal hairstyle and overall coordination image

[0370] Step 8:

[0371] The server transmits the generated hairstyle and coordinated image to the terminal.

[0372] Input: Results from a generative AI model

[0373] Output: Sending data to the terminal

[0374] Step 9:

[0375] The terminal displays the suggested hairstyle and coordinated image to the user. The user checks the displayed information and selects whether or not to adopt the style.

[0376] Input: Proposal data from the server

[0377] Output: Display to user, display of selection screen

[0378] Step 10:

[0379] When the user selects "Choose this style," the system searches for nearby beauty salons and professionals based on the user's current location. The server retrieves this information from a database and creates a list of candidates.

[0380] Input: User selection, location information

[0381] Output: Creating a candidate list

[0382] Step 11:

[0383] The server sends a list of candidate beauty facilities and beauty professionals to the terminal.

[0384] Input: Information on beauty facilities and beauty professionals

[0385] Output: Sending data to the terminal

[0386] Step 12:

[0387] The terminal displays a list of potential beauty facilities and beauty professionals to the user, who then selects a specific beauty facility or beauty professional and clicks the "Book Now" button.

[0388] Input: candidate list

[0389] Output: Display to user, reservation selection

[0390] Step 13:

[0391] The terminal transmits the selection information and the desired reservation date and time to the server.

[0392] Input: Selection information, desired reservation date and time

[0393] Output: Reservation request sent to server

[0394] Step 14:

[0395] The server receives the reservation request and confirms the reservation in cooperation with the reservation system of the related beauty facility.

[0396] Input: Reservation Request

[0397] Output: Reservation confirmed

[0398] Step 15:

[0399] The server generates a reservation confirmation message and sends it to the terminal.

[0400] Input: Confirmed reservation information

[0401] Output: Reservation confirmation message

[0402] Step 16:

[0403] The terminal will display a reservation confirmation message to the user and the process will be complete.

[0404] Input: Reservation confirmation message

[0405] Output: Display a confirmation message to the user

[0406] (Application example 2)

[0407] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0408] Conventional hairstyle suggestion systems make suggestions based only on the user's facial information and preferred hairstyle information, and therefore are unable to consider the user's emotional state or overall coordination. Furthermore, the system's operation is cumbersome, and it is not possible to centrally manage reservations with beauty salons and hairdressers, resulting in a poor user experience. Therefore, there is a need for a system that can make more accurate hairstyle suggestions that incorporate the user's emotional information, as well as a system that enables easy reservation management with beauty salons and hairdressers.

[0409] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0410] In this invention, the server includes a means for acquiring the user's facial information, a means for analyzing and acquiring the user's emotional information, and a means for acquiring the user's preferred hairstyle information. This makes it possible to generate an optimal hairstyle based on the user's facial information, emotional information, and preferred hairstyle information, and to present the generated hairstyle information and an overall coordinated image to the user. Furthermore, a system is provided that allows users to easily search for beauty salons and hairdressers and manage reservations based on this information.

[0411] A "user" is a person who uses the system and provides his or her facial information and hairstyle preferences.

[0412] "Facial information" is image data of the user's face, and is obtained by photographing or videotaping.

[0413] "Emotion information" is data that represents the emotional state of the user analyzed from facial information.

[0414] "Preferred hairstyle information" refers to information about a hairstyle desired by the user, including information input in text format.

[0415] The "optimal hairstyle" is a hairstyle suggested using a generative AI model based on the user's facial information, emotional information, and preferred hairstyle information.

[0416] The "overall coordinated image" is information that includes an image of the overall fashion and styling that is proposed along with the user's optimal hairstyle.

[0417] A "beauty salon" refers to a hair salon that a user visits to achieve a hairstyle.

[0418] A "hairdresser" is a professional who styles the user's hairstyle.

[0419] A "reservation request" is a request made by a user to a specific beauty salon or hairdresser to have a hairstyle performed.

[0420] An "appointment confirmation message" is a message containing confirmation information that is sent to a user after an appointment with a salon or hairdresser has been confirmed.

[0421] A system for implementing the present invention provides a function in which a user inputs their own facial information, emotional information, and preferred hairstyle information using a device such as a smartphone or tablet terminal, and the system suggests the most suitable hairstyle based on that information. This system mainly includes the following means:

[0422] 1. Acquiring user's facial and emotional information

[0423] The user takes a photo of their face using the device's camera and saves it as image data. This image data is then used by the emotion engine to analyze and extract emotional information from the user's facial expressions. The software used is OpenCV and the DeepFace library.

[0424] 2. Obtaining user's preferred hairstyle information

[0425] The user uses the text input fields to input their preferred hairstyle information, which is sent to the server and serves as input data for future hairstyle generation.

[0426] 3. Generating the best hairstyle

[0427] The server uses a generative AI model to generate the optimal hairstyle based on the facial information, emotional information, and preferred hairstyle information sent by the user. This generative AI model takes into account the user's facial contours, features, and emotional state to suggest the most suitable hairstyle. An overall coordinated image is also generated.

[0428] 4. Presenting the proposal

[0429] The generated hairstyle and overall coordinated image are sent to the user's terminal, which displays them to the user. The user checks the proposed hairstyle and judges their satisfaction.

[0430] 5. Search and book salons and hairdressers

[0431] If the user is satisfied with the proposed hairstyle, the system searches for nearby salons and hairdressers based on the user's current location. This information is obtained from a database on the server. The search results are displayed on the user's device, and the user can select the salon or hairdresser they want and make a reservation.

[0432] 6. Confirmation of reservation and confirmation message

[0433] When a user requests a reservation, the information is processed on the server side and the reservation is confirmed officially in cooperation with the reservation system of the related beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user and ends the process.

[0434] Specific examples

[0435] 1. The user takes a photo of their face using a tablet device and uploads it to the system. At this time, the emotion engine analyzes the facial expression to determine the emotion of "joy."

[0436] 2. The user enters "I want long natural hair" in the text field and submits it to the server.

[0437] 3. The server uses a generative AI model to generate the optimal hairstyle and overall coordinated image based on the user's facial information, emotional information, and preferred hairstyle information.

[0438] 4. The user checks the optimal hairstyle and overall coordination image displayed on the device.

[0439] 5. The user selects "nearby beauty salon A" and makes a reservation on the system.

[0440] 6. The server confirms the reservation and sends a reservation confirmation message to the device, which displays "Reservation completed."

[0441] Prompt Sentence Examples

[0442] Face information: face.jpg

[0443] Desired hairstyle: Natural long hair

[0444] Predominant emotion: Joy

[0445] Suggested style: Natural long hairstyle that emphasizes joy

[0446] Using this system, users can easily find the optimal hairstyle based on their facial information and emotional state, quickly find the salon or hairdresser who can create that hairstyle, and complete the reservation.

[0447] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0448] Step 1:

[0449] The user takes a photo of his or her face using the camera on the terminal and stores the image data in the terminal.

[0450] Specific operation: The user opens the application on the device and uses the camera function to take a photo of their face. The captured image is then saved in the device's storage.

[0451] Input: Face photo

[0452] Output: Saved face photo data

[0453] Step 2:

[0454] The device uses the DeepFace library to analyze the user's emotional information based on the facial photos stored on the device.

[0455] Specific operation: The emotion engine receives face image data as input and performs emotion analysis using the DeepFace library. The analysis results in key emotion information.

[0456] Input: Facial photo data

[0457] Output: Emotion information (e.g., happiness, sadness)

[0458] Step 3:

[0459] The user inputs desired hairstyle information into a text input field on the terminal.

[0460] Specific actions: The user enters the desired hairstyle (e.g., natural long hair) in the text field and presses the "Submit" button.

[0461] Input: Desired hairstyle information

[0462] Output: Hair style information sent

[0463] Step 4:

[0464] The terminal transmits face information, emotion information, and preferred hairstyle information to the server.

[0465] Specific operation: The device sends the captured facial photo data, analyzed emotional information, and input hairstyle information to the server.

[0466] Input: Facial photo data, emotional information, hairstyle information

[0467] Output: Send data to the server

[0468] Step 5:

[0469] Based on the facial information, emotional information, and preferred hairstyle information received by the server, the optimal hairstyle is generated using a generative AI model.

[0470] Specific operation: The server receives this information as input, inputs prompts into the generative AI model, and generates a hairstyle. The generated hairstyle and an overall coordinated image are then obtained.

[0471] Input: Facial photo data, emotional information, hairstyle information

[0472] Output: Generated hairstyle and overall coordination image

[0473] Step 6:

[0474] The server transmits the generated hairstyle and the overall coordinated image to the terminal.

[0475] Specific operation: The server transmits the generated hairstyle data and the overall coordinate image data to the terminal.

[0476] Input: Generated hairstyle and overall coordination image

[0477] Output: Sending data to the terminal

[0478] Step 7:

[0479] The terminal displays the generated hairstyle and overall coordinated image received by the terminal to the user.

[0480] Specific operation: The terminal displays the data received from the server and allows the user to check the proposed hairstyle and overall coordination image.

[0481] Input: Generated hairstyle and overall coordination image

[0482] Output: What is displayed to the user

[0483] Step 8:

[0484] If the user is satisfied with the suggested hairstyle, the terminal searches for nearby beauty salons and hairdressers.

[0485] Specific operation: The user presses the "reserve" button, and the device sends a search request to the server based on the user's current location information.

[0486] Input: Reservation request, current location information

[0487] Output: Search request sent to the server

[0488] Step 9:

[0489] The server searches for nearby beauty salons and hairdressers and sends that information to the terminal.

[0490] Specific operation: The server searches and retrieves information about the hair salon and hairdresser from the database and sends it to the terminal.

[0491] Input: Search request, current location information

[0492] Output: Information on nearby hair salons and hairdressers

[0493] Step 10:

[0494] The terminal displays the received information about the beauty salon or hairdresser to the user, and the user selects a specific beauty salon or hairdresser and makes a reservation.

[0495] Specific operation: The terminal displays a list of potential hair salons and hairstylists to the user, and the user selects one and presses the "Book" button. The reservation information is then sent to the server.

[0496] Input: Hair salon and hairdresser information, reservation selection

[0497] Output: Send reservation information to the server

[0498] Step 11:

[0499] The server processes the reservation request and generates a reservation confirmation message to send to the terminal.

[0500] Specific operation: The server confirms the reservation request in cooperation with the beauty salon's reservation system, generates a reservation confirmation message and sends it to the terminal.

[0501] Input: Reservation information

[0502] Output: Reservation confirmation message

[0503] Step 12:

[0504] The terminal displays a reservation confirmation message to the user, and the process ends.

[0505] Specific operation: The terminal displays the reservation confirmation message received from the server to the user, and the user confirms that the reservation has been completed.

[0506] Input: Reservation confirmation message

[0507] Output: What is displayed to the user

[0508] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0509] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0510] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0511] [Second embodiment]

[0512] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0513] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0514] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0515] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0516] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0517] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0518] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0519] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0520] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0521] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0522] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0523] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0524] The system of the present invention is designed to make it easier for users to achieve their ideal hairstyle by performing a series of processes involving the user, terminal, and server. The program of this system executes the following processes.

[0525] Explanation of program processing

[0526] Acquiring and sending face information

[0527] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or video. The device receives these inputs and sends them to the server as face information. The user is presented with a progress bar and / or a confirmation message indicating that the face information was successfully sent.

[0528] Acquiring and sending information about your favorite hairstyles

[0529] Next, the user enters the desired hairstyle in the "Enter your preferred hairstyle" field. For example, if the user enters "I like long, natural hair," the device sends this information to the server. At this time, a confirmation message is displayed to the user confirming the completion of the transmission.

[0530] Hairstyle generation

[0531] The server uses a generative AI model to generate the optimal hairstyle based on the facial information and preferred hairstyle information received from the device. This generated hairstyle is best suited to the user's facial contours and features. An overall coordinated image is also generated.

[0532] Presenting the proposal

[0533] The server sends the generated hairstyle and overall coordinated image to the terminal, which displays them to the user. The user checks the proposed hairstyle and decides whether or not they want to adopt it.

[0534] Search and book hair salons and hairdressers

[0535] If the user is satisfied with the proposed hairstyle, the system searches for a nearby hair salon or hair stylist based on the user's current location. This information is retrieved by the server from a database, and a list of candidates is displayed on the device. When the user selects a specific salon or hair stylist and clicks the "Book Now" button, the device sends this selection and the desired appointment date and time to the server.

[0536] Confirmation of reservation and confirmation message

[0537] The server receives the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user and ends the process.

[0538] Specific examples

[0539] User Example

[0540] 1. The user opens the app on their smartphone, selects "Take a photo," takes a photo of their face, and uploads it to the system.

[0541] 2. The user enters "I want natural long hair" in the text field and presses the submit button.

[0542] 3. The user checks the optimal hairstyle and overall coordination image displayed on the device.

[0543] 4. The user selects "Get this style" and the system displays nearby salons and stylists.

[0544] 5. The user selects "Beauty Salon A" and clicks the "Book Now" button.

[0545] 6. The server will confirm the reservation and a reservation confirmation message will appear on the device, confirming that "Reservation completed."

[0546] In this way, by using the system of the present invention, a user can easily find the optimal hairstyle based on their facial information and preferences, quickly find a hair salon or hairdresser to achieve that hairstyle, and complete the reservation.

[0547] The processing flow will be explained below.

[0548] Step 1:

[0549] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or video. The face information is saved on the device.

[0550] Step 2:

[0551] The device compresses the stored face information (photo or video file) and sends it to the server. A progress bar and a confirmation message are displayed to the user.

[0552] Step 3:

[0553] The user enters their preferred style (e.g., "long hair," "perm," "bob cut," etc.) in the "Enter your preferred hairstyle" field. The user confirms the input and presses the "Submit" button.

[0554] Step 4:

[0555] The terminal transmits the user's preferred hairstyle information in text format to the server, and displays a confirmation message to the user indicating that the preference information has been transmitted.

[0556] Step 5:

[0557] The server analyzes the facial information received from the device and recognizes the facial contours and features. The server then receives information about the user's preferred hairstyle. The server then uses a generative AI model to generate the optimal hairstyle based on the facial information and preferences.

[0558] Step 6:

[0559] The server generates the optimal hairstyle in text and image format. The server also generates an overall coordinated image and generates an image. The server sends this information to the terminal.

[0560] Step 7:

[0561] The terminal displays the proposal received from the server. The user checks the proposed hairstyle and overall coordinated image. The user clicks the "Choose this style" button.

[0562] Step 8:

[0563] The server obtains the user's current location information (e.g., GPS data) and searches for information on nearby beauty salons and hairdressers. The server then sends the search results in a list format to the device.

[0564] Step 9:

[0565] The terminal displays the list of candidate hair salons and hair stylists received from the server to the user. The user selects "Hair Salon A" and clicks the "Book Now" button.

[0566] Step 10:

[0567] The terminal sends the information about the beauty salon selected by the user and the desired reservation date and time to the server, and displays a notification to the user indicating that the reservation request has been sent.

[0568] Step 11:

[0569] The server processes the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal.

[0570] Step 12:

[0571] The terminal displays the confirmation message received from the server to the user. The message "Reservation completed" is displayed and the process ends.

[0572] Example 1

[0573] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0574] With conventional systems, it takes a lot of time and effort for users to find a hairstyle that suits their facial features. Even if they find the perfect hairstyle, it is difficult to easily find and book a salon or hairdresser who can create that hairstyle. To solve these problems, a system is needed that can automatically generate an optimal hairstyle and overall coordination image based on the user's facial information and preferred hairstyle information, and then efficiently search for and book salons and hairdressers who can create that hairstyle.

[0575] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0576] In this invention, the server includes means for acquiring user face information, means for acquiring user preferred hairstyle information, means for using a generative model that generates an optimal hairstyle and overall coordinated image based on the user's face information and preferred hairstyle information, means for presenting the generated hairstyle and coordinated image to the user, means for searching for information on treatment locations and practitioners who can realize the presented hairstyle and coordinated image, means for presenting the searched information on treatment locations and practitioners to the user and sending a reservation request, and means for processing the reservation request and sending a reservation confirmation message to the user. This allows the user to easily find the optimal hairstyle and coordination based on their own face information and preferences, quickly find the treatment locations and practitioners that can realize it, and complete the reservation.

[0577] The "means for acquiring user's facial information" refers to the means by which a user accesses the system and inputs their own facial information by taking an image or video.

[0578] The "means for acquiring information on a user's preferred hairstyle" is a means for a user to access the system and input a desired hairstyle in text format.

[0579] "Means for using a generative model" refers to means for using a generative AI model that is used to generate an optimal hairstyle and overall coordinated image based on the user's facial information and preferred hairstyle information.

[0580] The "means for presenting the generated hairstyle and coordinated image to the user" refers to a means for transmitting the hairstyle and coordinated image generated by the server to the terminal and displaying it to the user.

[0581] "Means for searching for information on treatment locations and practitioners" refers to the means by which the system searches for information on the most suitable beauty salon or hairdresser from a database or other information source based on the user's current location information, etc.

[0582] "Means for presenting the searched information on treatment locations and practitioners to the user and sending a reservation request" refers to means for displaying candidate treatment locations and practitioners to the user, allowing the user to select the desired treatment location and practitioner and send a reservation request.

[0583] The "means for processing reservation requests and sending reservation confirmation messages to users" refers to the means by which the system receives reservation requests from users, confirms the reservations in cooperation with affiliated reservation systems, and sends confirmation messages to users.

[0584] This invention makes it easier for users to achieve their ideal hairstyle by performing a series of processes involving the user, the terminal, and the server. Below, we will explain how to specifically implement this system.

[0585] This system acquires the user's facial information and preferred hairstyle information, and then uses a generative AI model to generate the optimal hairstyle and overall coordination image based on that information. The generated information is presented to the user, who can then search for and book treatment locations and therapists who can achieve that hairstyle.

[0586] First, a user opens the system's application or website on their device. The device can be a smartphone, tablet, or PC. The user selects the "Enter Face Information" option and takes a photo or video. The camera function is used to take a photo of the user's face, which the device then sends to the server as face information. The user is then presented with a progress bar and a confirmation message indicating that the face information has been successfully sent.

[0587] Next, the user enters the desired style in text format in the "Enter your preferred hairstyle" field. For example, if the user enters "I like long, natural hair," the device will send this information to the server. A confirmation message will be displayed to the user.

[0588] The server uses a generative AI model to generate the optimal hairstyle based on the facial information and preferred hairstyle information received from the device. The generated hairstyle is best suited to the user's facial contours and features, and an overall coordinated image is also generated. The generative AI model used here is trained using a specific dataset.

[0589] The generated hairstyles and coordinated images are sent from the server to the terminal, which then displays them to the user. The user can check the proposed hairstyles and select the one they like best.

[0590] If the user is satisfied with the proposed hairstyle, the system searches for nearby salons and hairdressers based on the user's current location. The server retrieves this information from a database, and a list of candidates is displayed on the device. The user selects a specific salon or hairdresser and clicks the "Book Now" button, sending the selection and desired appointment date and time to the server.

[0591] The server receives the reservation request and confirms the reservation by coordinating with the relevant beauty salon's reservation system. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user, and the process ends.

[0592] Here are some examples of prompts to input to a generative AI model:

[0593] Generate the most suitable hairstyle based on the user's face information and preferred hairstyle information. The user wants natural long hair. The user's face is round. Please provide an image of the overall outfit along with the generated hairstyle.

[0594] In this way, by using the system of the present invention, a user can easily find the optimal hairstyle and coordination based on their facial information and preferences, quickly find the treatment location and practitioner to achieve it, and complete the reservation.

[0595] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0596] Step 1:

[0597] The user opens an application or website on their device, selects the "Enter Face Information" option, and takes a photo or video.

[0598] Input: User action (face photo or video)

[0599] Output: Captured image data

[0600] Specific behavior:

[0601] A user taps an app on their smartphone to launch it.

[0602] The user clicks the "Enter Face Information" button and takes a photo of their face using the camera function.

[0603] The device saves the captured image data and stores it in temporary memory.

[0604] Step 2:

[0605] The face information received by the device is sent to the server.

[0606] Input: Photographed image data

[0607] Output: Face information sent to the server

[0608] Specific behavior:

[0609] The device encodes the image data and sends it to the server as an HTTP request.

[0610] The terminal displays a transmission progress bar and provides a confirmation message to the user that the transmission is complete.

[0611] Step 3:

[0612] The user enters the desired style in the "Enter your desired hairstyle" field.

[0613] Input: User text input (desired hairstyle)

[0614] Output: The input text data

[0615] Specific behavior:

[0616] The user enters "I want natural long hair" in the text field and presses the submit button.

[0617] The device captures and temporarily stores the text data.

[0618] Step 4:

[0619] The terminal transmits the input hairstyle information to the server.

[0620] Input: Text data (preferred hairstyle information)

[0621] Output: Hair style information sent to the server

[0622] Specific behavior:

[0623] The terminal encodes the text data and sends it to the server as an HTTP request.

[0624] The terminal displays a message to the user confirming that transmission is complete.

[0625] Step 5:

[0626] Based on the facial information and hairstyle information received by the server, the optimal hairstyle is generated using a generative AI model.

[0627] Input: Face information, hairstyle information

[0628] Output: Generated hairstyle and outfit image

[0629] Specific behavior:

[0630] The server decodes the received face information and hairstyle information.

[0631] The server sends a request to the generated AI model using a prompt sentence.

[0632] Example prompt: "Generate the most suitable hairstyle based on the user's facial information and preferred hairstyle information."

[0633] The server examines the generated results returned by the generative AI model and also adds an overall coordinated image.

[0634] Step 6:

[0635] The server transmits the generated hairstyle and coordinated image to the terminal.

[0636] Input: Generated hairstyle and outfit image

[0637] Output: Hairstyle and outfit image sent to the device

[0638] Specific behavior:

[0639] The server encodes the generated result and sends it to the terminal as an HTTP response.

[0640] Step 7:

[0641] The terminal displays the received data to the user.

[0642] Input: Response data from the server

[0643] Output: Hairstyle and outfit image displayed to the user

[0644] Specific behavior:

[0645] The device decodes the response data and displays an image of the hairstyle and outfit on the screen.

[0646] Step 8:

[0647] If the user is satisfied with the suggested hairstyle, the system will search for nearby hair salons and hairdressers based on the user's current location information.

[0648] Input: User's current location information

[0649] Output: List of treatment locations and practitioner candidates

[0650] Specific behavior:

[0651] The user selects "Use this style" and clicks the reservation button.

[0652] The device uses the GPS function to obtain the current location information and sends it to the server.

[0653] The server queries and retrieves information about nearby hair salons and hairdressers from a database.

[0654] Step 9:

[0655] The server transmits the acquired information about the treatment location and the practitioner to the terminal.

[0656] Input: Salon and stylist information retrieved from a database

[0657] Output: Candidate list sent to the terminal

[0658] Specific behavior:

[0659] The server encodes the acquired information and sends it to the terminal.

[0660] Step 10:

[0661] The terminal displays a list of potential hair salons and hairstylists to the user.

[0662] Input: Response data from the server

[0663] Output: The candidate list displayed to the user

[0664] Specific behavior:

[0665] The device decodes the candidate list and displays it on the screen.

[0666] Step 11:

[0667] The user selects a particular salon or hairdresser and clicks the "Book Now" button.

[0668] Input: User selection information, desired reservation date and time

[0669] Output: Selection information and desired reservation date and time

[0670] Specific behavior:

[0671] The user selects one of the displayed options and clicks the reservation button.

[0672] The terminal transmits the selected candidate and the desired date and time to the server.

[0673] Step 12:

[0674] The server processes the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon.

[0675] Input: Reservation Request

[0676] Output: Reservation confirmation message

[0677] Specific behavior:

[0678] The server decodes the received request and records the reservation information.

[0679] The server sends an API request to the salon's reservation system to confirm the reservation.

[0680] Step 13:

[0681] The server generates a reservation confirmation message and sends it to the terminal.

[0682] Input: Confirmed reservation information

[0683] Output: Reservation confirmation message

[0684] Specific behavior:

[0685] The server generates a message notifying the completion of the reservation, encodes it, and sends it to the terminal.

[0686] The terminal displays a confirmation message to the user saying "Reservation completed."

[0687] (Application example 1)

[0688] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0689] Conventional hairstyle suggestion systems have difficulty generating optimal hairstyles based on a user's facial information and preferred style information, and also have the problem of making it difficult to search for and book beauty salons and hairdressers. In particular, there has been a lack of individually customized hairstyle suggestions based on facial information, and reservation systems that respond to real-time beauty salon availability.

[0690] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0691] In this invention, the server includes means for acquiring user facial information, means for acquiring user preferred hairstyle information, means for using a generative AI model to generate an optimal hairstyle based on the user's facial information and preferred hairstyle information, means for presenting the generated hairstyle information to the user, means for searching for information on salons and technicians who can realize the presented hairstyle information, means for presenting the searched information on salons and technicians to the user and sending a reservation request, and means for processing the reservation request and sending a reservation confirmation message to the user. This allows the user to generate an optimal hairstyle based on their facial information and preferences, quickly and easily find a beauty salon or hairdresser to realize that style, and complete the reservation.

[0692] "User facial information" refers to image data containing a user's facial features or other biometric information.

[0693] "User's favorite hairstyle information" is information about a hairstyle desired by the user, and is expressed in the form of text, an image, or the like.

[0694] A "generative AI model" is an artificial intelligence model that is trained to generate optimal outputs based on input data.

[0695] "Generated hairstyle information" refers to information about hairstyles generated by a generative AI model based on the user's facial information and preferred hairstyle information.

[0696] The "presentation means" refers to a method or device for visually displaying the generated hairstyle information and search results to the user.

[0697] "Store and technician information" refers to data that includes information about service providers such as beauty salons and hairdressers.

[0698] A "search method" is an algorithm or process used to retrieve targeted information from a database based on specific criteria.

[0699] The "means for sending a reservation request" refers to a communication means for sending a reservation request to the store or technician selected by the user.

[0700] A "reservation confirmation message" is a confirmation message indicating that a reservation request has been confirmed.

[0701] The system of the present invention creates an optimal hairstyle based on facial information and preferred hairstyle information, making it easier for users to achieve their ideal hairstyle, and then searches for and reserves salons and technicians who can achieve that style. In this embodiment, a smartphone and a cloud server are used.

[0702] Program processing

[0703] 1. Acquiring and sending face information

[0704] The user takes a photo of their face using a device (smartphone). The captured facial information is sent to a cloud server as image data. This requires the smartphone's camera as hardware and the ability to import image data and send it to the server as software. Specifically, a face recognition library (e.g., OpenCV) is used.

[0705] 2. Acquisition and transmission of preferred hairstyle information

[0706] The user inputs their desired hairstyle in text format on the device. The input text information is sent to the server, where it is analyzed by a natural language processing engine.

[0707] 3. Hairstyle generation

[0708] The cloud server combines the acquired facial information with the desired hairstyle information and generates the optimal hairstyle using a generative AI model (e.g., Stable Diffusion). In this process, the AI ​​model analyzes and synthesizes facial features and hairstyle elements. The generated hairstyle image is then sent from the cloud server to the device.

[0709] 4. Presenting the proposal

[0710] The terminal visually presents the generated hairstyle information received from the server to the user, allowing the user to confirm the proposed style.

[0711] 5. Search for and book a store or technician

[0712] Based on the device's location, the server searches a database of nearby hairdressers and salons and presents the most suitable candidates to the user. The user then selects a salon and technician from the list and submits a reservation request.

[0713] 6. Confirmation of reservation and confirmation message

[0714] The server processes the received reservation request and confirms the reservation in cooperation with the reservation system of the relevant store. A confirmation message of the reservation completion is sent to the user's terminal and displayed to the user.

[0715] Specific examples

[0716] User operation procedure

[0717] 1. The user opens the smartphone app, uses the "take photo" function to take a photo of their face, and uploads it to the system.

[0718] 2. The user types "Bob cuts are good" in the text field and presses the submit button.

[0719] 3. The user checks the optimal hairstyle and outfit image displayed on their smartphone.

[0720] 4. When the user selects "Get this style," the system will display a list of nearby salons and stylists.

[0721] 5. The user selects "Beauty Salon B" and clicks the "Book Now" button.

[0722] 6. The cloud server will confirm the reservation and the device will display a confirmation message saying "Reservation completed."

[0723] Example prompts for generative AI models

[0724] Generate a "Bob Cut" hairstyle based on the user's face photo.

[0725] In this way, users can easily find their ideal hairstyle, quickly and easily find a hair salon or hairdresser to help them achieve it, and complete a reservation.

[0726] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0727] Step 1:

[0728] A user takes a photo of their face with a device (smartphone) and sends the facial information to a cloud server. The device's camera is used to capture the image data, which is then uploaded directly to the cloud server. The input is the user's facial photo, and the output is the image data sent to the server.

[0729] Step 2:

[0730] The user inputs information about their preferred hairstyle in text format into the device and sends it to the cloud server. The device receives the user's input as text data and sends it to the cloud server. The input is the text information entered by the user, and the output is the text data sent to the server.

[0731] Step 3:

[0732] The cloud server uses a generative AI model based on facial information and preferred hairstyle information to generate the optimal hairstyle. The server converts image data and text data into a prompt sentence, inputs it into the AI ​​model, and outputs a generated hairstyle image. The input is facial image data and text information, and the output is a generated hairstyle image. An example of a prompt sentence: "Generate a 'bob cut' hairstyle based on the user's facial photo."

[0733] Step 4:

[0734] The cloud server sends the generated hairstyle image to the terminal. The server then sends the generated image data to the terminal via an existing communication method, and the terminal performs reception processing. The input is the generated hairstyle image, and the output is the image data sent to the terminal.

[0735] Step 5:

[0736] The device presents the received hairstyle image to the user. The device renders the image data on a display screen so that the user can view it. The input is the received hairstyle image, and the output is the image displayed on the device screen.

[0737] Step 6:

[0738] Based on the hairstyle information provided by the user, the system requests a search for salons and technicians who can create that style. When the user clicks the "Search" button on their device, the request is sent to the cloud server. The input is the user's search request, and the output is the data sent to the cloud server.

[0739] Step 7:

[0740] The cloud server searches the database for the most suitable hair salon and technician based on the user's location and hairstyle information, and sends the results to the device. The server processes the location and hairstyle information as a search query and retrieves a list of candidates from the database. The input is the user's location and hairstyle information, and the output is a list of search results.

[0741] Step 8:

[0742] The terminal presents the search results to the user and sends a reservation request. The terminal renders a candidate list on the display screen and allows the user to select the desired store and technician. The input is the list of search results, and the output is a reservation request based on the list displayed on the terminal screen and the store and technician selected by the user.

[0743] Step 9:

[0744] The cloud server processes the received reservation request and confirms the reservation in conjunction with the relevant store's reservation system. The server analyzes the request data and connects to the store's reservation system via an API. The input is the reservation request data, and the output is the confirmed data sent to the store's reservation system.

[0745] Step 10:

[0746] The cloud server generates a reservation confirmation message and sends it to the terminal. The server generates a confirmation message based on the reservation confirmation data and sends it to the terminal. The input is the reservation confirmation data, and the output is the reservation confirmation message sent to the terminal.

[0747] Step 11:

[0748] The terminal presents the received reservation confirmation message to the user and ends the process. The terminal renders the confirmation message on the display screen for the user to review. The input is the reservation confirmation message and the output is the message displayed on the terminal screen.

[0749] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0750] The system of the present invention is designed to make it easier for users to achieve their ideal hairstyle by performing a series of processes involving the user, terminal, server, and emotion engine. The program of this system executes the following processes.

[0751] Explanation of program processing

[0752] Acquiring and transmitting facial and emotional information

[0753] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or records a video. The device receives these inputs and uses the emotion engine to analyze the user's facial expressions and obtain emotional information. The obtained facial and emotional information is stored on the device and sent to the server. A progress bar and a confirmation message for sending are displayed to the user.

[0754] Acquisition and transmission of preferred hairstyle information

[0755] Next, the user enters the desired style in the "Enter your preferred hairstyle" field. For example, if the user enters "I like long natural hair," the terminal will send this information to the server. A confirmation message will be displayed to the user.

[0756] Hairstyle generation

[0757] The server uses a generative AI model to generate the optimal hairstyle based on the facial information, emotional information, and preferred hairstyle information received from the device. This generated hairstyle is best suited to the user's facial contours and features. An overall coordinated image is also generated.

[0758] Presenting the proposal

[0759] The server sends the generated hairstyle and overall coordinated image to the terminal, which displays them to the user. The user checks the proposed hairstyle and decides whether or not they want to adopt it.

[0760] Search and book salons and hairdressers

[0761] If the user is satisfied with the proposed hairstyle, the system searches for a nearby hair salon or hair stylist based on the user's current location. This information is retrieved by the server from a database, and a list of candidates is displayed on the device. When the user selects a specific salon or hair stylist and clicks the "Book Now" button, the device sends this selection and the desired appointment date and time to the server.

[0762] Confirmation of reservation and confirmation message

[0763] The server receives the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user and ends the process.

[0764] Specific examples

[0765] User Example

[0766] 1. The user opens the app on their smartphone, selects "Take a photo," takes a photo of their face, and uploads it to the system. At this time, the emotion engine reads emotional information from their facial expressions.

[0767] 2. The user enters "I want natural long hair" in the text field and presses the submit button.

[0768] 3. The user checks the optimal hairstyle and overall coordination image displayed on the device.

[0769] 4. The user selects "Get this style" and the system displays nearby salons and stylists.

[0770] 5. The user selects "Beauty Salon A" and clicks the "Book Now" button.

[0771] 6. The server will confirm the reservation and a reservation confirmation message will appear on the device, confirming that "Reservation completed."

[0772] In this way, by using the system of the present invention, users can easily find the optimal hairstyle based on their facial information and preferences, quickly find the hair salon or hairdresser who can create that hairstyle, and complete the reservation.The introduction of an emotion engine makes it possible to suggest hairstyles that reflect the user's current emotions, allowing for the provision of more personalized services.

[0773] The processing flow will be explained below.

[0774] Step 1:

[0775] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or video. The face information is saved on the device.

[0776] Step 2:

[0777] The device passes the stored facial information to the emotion engine, which extracts emotional information from the user's facial expressions. The emotional information is then sent to the server along with the facial information. A progress bar and a confirmation message are displayed to the user.

[0778] Step 3:

[0779] The user inputs the desired hairstyle in the "Enter your desired hairstyle" field. For example, the user inputs "I like long natural hair." The user confirms the input and presses the "Submit" button.

[0780] Step 4:

[0781] The terminal sends the user's preferred hairstyle information in text format to the server, and a confirmation message is displayed to the user to confirm that the transmission has been completed.

[0782] Step 5:

[0783] The server analyzes the facial information, emotional information, and preferred hairstyle information received from the device. The emotional information obtained by the emotion engine is combined and the optimal hairstyle is generated using a generative AI model.

[0784] Step 6:

[0785] The server generates the optimal hairstyle in text and image format, and also generates an overall coordinated image, and sends this information to the terminal.

[0786] Step 7:

[0787] The terminal displays the proposal received from the server. The user checks the proposed hairstyle and overall coordinated image. The user clicks the "Choose this style" button.

[0788] Step 8:

[0789] The server obtains the user's current location information (e.g., GPS data) and searches for information on nearby beauty salons and hairdressers. The server then sends the search results in a list format to the device.

[0790] Step 9:

[0791] The terminal displays the list of candidate hair salons and hair stylists received from the server to the user. The user selects "Hair Salon A" and clicks the "Book Now" button.

[0792] Step 10:

[0793] The terminal sends the information about the beauty salon selected by the user and the desired reservation date and time to the server, and displays a notification to the user indicating that the reservation request has been sent.

[0794] Step 11:

[0795] The server processes the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal.

[0796] Step 12:

[0797] The terminal displays the confirmation message received from the server to the user. The message "Reservation completed" is displayed and the process ends.

[0798] Example 2

[0799] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0800] Conventional hairstyle suggestion systems rarely take into account the user's emotional information, making it difficult for users to easily find a hairstyle that actually satisfies them. In addition, the process of searching for and booking beauty facilities and beauty professionals is complicated, preventing users from receiving appropriate services quickly.

[0801] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0802] In this invention, the server includes means for acquiring user facial information, means for analyzing user emotional information, means for acquiring user preferred hairstyle information, means for generating an optimal hairstyle based on the user's facial information, emotional information, and preferred hairstyle information, means for presenting the generated hairstyle and an overall coordinated image to the user, means for searching for information on beauty facilities and beauty professionals who can realize the presented hairstyle, means for presenting the searched information on beauty facilities and beauty professionals to the user and sending a reservation request, and means for processing the reservation request and sending a reservation confirmation message to the user. This enables a user to easily find an optimal hairstyle based on their facial information and preferences, quickly find a beauty facility or beauty professional who can realize that hairstyle, and complete the reservation.

[0803] The "means for acquiring user's face information" refers to a means for acquiring face information by the user taking a photograph or shooting a video.

[0804] The "means for analyzing the user's emotional information" is a means for analyzing facial photographs and videos taken by the user and obtaining emotional information from facial expressions using an emotion engine.

[0805] The "means for acquiring information on the user's preferred hairstyle" is a means for the user to input the hairstyle he or she desires in text format or in a selection format.

[0806] The "means for generating an optimal hairstyle" is a means for generating a hairstyle that is most suitable for a user using a generative AI model based on the user's facial information, emotional information, and preferred hairstyle information.

[0807] The "means for presenting the generated hairstyle and overall coordinated image to the user" is a means for displaying the generated hairstyle information and the corresponding overall coordinated image on the user's terminal.

[0808] The "means for searching for information on beauty facilities and beauty workers" is a means for searching a database for the most suitable beauty facilities and beauty workers based on the user's location information.

[0809] "Means for presenting information to the user and sending a reservation request" refers to means for displaying information on searched beauty facilities and beauty professionals on the user's terminal, allowing the user to select a specific facility or professional and send a reservation request.

[0810] The "means for sending a reservation confirmation message to the user" is a means for processing a reservation request and sending a confirmation message to the user's terminal indicating that the reservation has been confirmed.

[0811] The system of the present invention is designed to make it easier for users to achieve their ideal hairstyle by performing a series of processes involving the user, terminal, server, and emotion engine. The program of this system executes the following processes.

[0812] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or records a video. The device receives these inputs, analyzes the user's facial expressions with the emotion engine, and acquires emotional information. The acquired facial and emotional information is stored on the device and sent to the server. As a specific example, the Microsoft Azure Emotion API can be used.

[0813] Next, the user enters the desired style in the "Enter your preferred hairstyle" field. For example, if the user enters "I like long natural hair," the terminal will send this information to the server. A confirmation message will be displayed to the user.

[0814] The server uses a generative AI model to generate the optimal hairstyle based on the facial information, emotional information, and preferred hairstyle information received from the device. The generative AI model can be OpenAI's GPT-3 or similar. The generated hairstyle is best suited to the user's facial contours and features. An overall coordinated image is also generated.

[0815] The server sends the generated hairstyle and overall coordinated image to the terminal, which displays them to the user. The user checks the proposed hairstyle and decides whether or not they want to adopt it.

[0816] If the user is satisfied with the proposed hairstyle, the system searches for a nearby hair salon or hair stylist based on the user's current location. This information is retrieved by the server from a database, and a list of candidates is displayed on the device. When the user selects a specific salon or hair stylist and clicks the "Book Now" button, the device sends this selection and the desired appointment date and time to the server.

[0817] The server receives the reservation request and confirms the reservation by connecting with the relevant beauty salon's reservation system. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user, and the entire process is completed.

[0818] Specific examples

[0819] User Example

[0820] 1. The user opens the app on their smartphone, selects "Take a photo," takes a photo of their face, and uploads it to the system. At this time, the emotion engine reads emotional information from their facial expressions.

[0821] 2. The user enters "I want natural long hair" in the text field and presses the submit button.

[0822] 3. The user checks the optimal hairstyle and overall coordination image displayed on the device.

[0823] 4. The user selects "Get this style" and the system displays nearby salons and stylists.

[0824] 5. The user selects "Beauty Salon A" and clicks the "Book Now" button.

[0825] 6. The server will confirm the reservation and a reservation confirmation message will appear on the device, confirming that "Reservation completed."

[0826] Example prompts to input to the generative AI model

[0827] "Analyze the user's facial photo and obtain emotional information using the emotion engine. Next, generate the optimal hairstyle based on the user's desired hairstyle. Send the generated hairstyle and the overall coordinated image to the user's device."

[0828] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0829] Step 1:

[0830] A user opens a system application or website on a smartphone or computer. When the application is launched, a screen appears where the user can select the "Enter Face Information" option.

[0831] Input: Launch application

[0832] Output: Display of face information input screen

[0833] Step 2:

[0834] The user selects the "Enter Face Information" option and takes a photo or video. The device activates the camera and captures the user's face information.

[0835] Input: User's choice of taking a photo or video

[0836] Output: Acquire and save face information

[0837] Step 3:

[0838] The device inputs stored photos and videos into the emotion engine, which analyzes the user's facial expressions to obtain emotional information. Specifically, the emotion engine detects facial features and classifies emotions.

[0839] Input: Photo or video data

[0840] Output: Emotional information

[0841] Step 4:

[0842] The device transmits the acquired facial and emotional information to the server, at which point a progress bar and a confirmation message are displayed to the user.

[0843] Input: Face and emotion information

[0844] Output: Send data to the server, display confirmation message

[0845] Step 5:

[0846] The user enters the desired hairstyle in the "Enter your preferred hairstyle" field. The device sends this input to the server. For example, a user might enter "I like natural long hair."

[0847] Input: Hair style information by text input

[0848] Output: Send text data to the server

[0849] Step 6:

[0850] The server receives facial information, emotional information, and preferred hairstyle information sent from the device and prepares this data to be input into the generative AI model.

[0851] Input: Face information, emotion information, hairstyle information

[0852] Output: Data preparation for input to a generative AI model

[0853] Step 7:

[0854] The server uses a generative AI model to generate the optimal hairstyle, taking into account facial contours, features, and emotional information during the generation process. An example of a generative AI model is OpenAI's GPT-3.

[0855] Input: Face information, emotion information, hairstyle information

[0856] Output: Optimal hairstyle and overall coordination image

[0857] Step 8:

[0858] The server transmits the generated hairstyle and coordinated image to the terminal.

[0859] Input: Results from a generative AI model

[0860] Output: Sending data to the terminal

[0861] Step 9:

[0862] The terminal displays the suggested hairstyle and coordinated image to the user. The user checks the displayed information and selects whether or not to adopt the style.

[0863] Input: Proposal data from the server

[0864] Output: Display to user, display of selection screen

[0865] Step 10:

[0866] When the user selects "Choose this style," the system searches for nearby beauty salons and professionals based on the user's current location. The server retrieves this information from a database and creates a list of candidates.

[0867] Input: User selection, location information

[0868] Output: Creating a candidate list

[0869] Step 11:

[0870] The server sends a list of candidate beauty facilities and beauty professionals to the terminal.

[0871] Input: Information on beauty facilities and beauty professionals

[0872] Output: Sending data to the terminal

[0873] Step 12:

[0874] The terminal displays a list of potential beauty facilities and beauty professionals to the user, who then selects a specific beauty facility or beauty professional and clicks the "Book Now" button.

[0875] Input: candidate list

[0876] Output: Display to user, reservation selection

[0877] Step 13:

[0878] The terminal transmits the selection information and the desired reservation date and time to the server.

[0879] Input: Selection information, desired reservation date and time

[0880] Output: Reservation request sent to server

[0881] Step 14:

[0882] The server receives the reservation request and confirms the reservation in cooperation with the reservation system of the related beauty facility.

[0883] Input: Reservation Request

[0884] Output: Reservation confirmed

[0885] Step 15:

[0886] The server generates a reservation confirmation message and sends it to the terminal.

[0887] Input: Confirmed reservation information

[0888] Output: Reservation confirmation message

[0889] Step 16:

[0890] The terminal will display a reservation confirmation message to the user and the process will be complete.

[0891] Input: Reservation confirmation message

[0892] Output: Display a confirmation message to the user

[0893] (Application example 2)

[0894] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0895] Conventional hairstyle suggestion systems make suggestions based only on the user's facial information and preferred hairstyle information, and therefore are unable to consider the user's emotional state or overall coordination. Furthermore, the system's operation is cumbersome, and it is not possible to centrally manage reservations with beauty salons and hairdressers, resulting in a poor user experience. Therefore, there is a need for a system that can make more accurate hairstyle suggestions that incorporate the user's emotional information, as well as a system that enables easy reservation management with beauty salons and hairdressers.

[0896] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0897] In this invention, the server includes a means for acquiring the user's facial information, a means for analyzing and acquiring the user's emotional information, and a means for acquiring the user's preferred hairstyle information. This makes it possible to generate an optimal hairstyle based on the user's facial information, emotional information, and preferred hairstyle information, and to present the generated hairstyle information and an overall coordinated image to the user. Furthermore, a system is provided that allows users to easily search for beauty salons and hairdressers and manage reservations based on this information.

[0898] A "user" is a person who uses the system and provides his or her facial information and hairstyle preferences.

[0899] "Facial information" is image data of the user's face, and is obtained by photographing or videotaping.

[0900] "Emotion information" is data that represents the emotional state of the user analyzed from facial information.

[0901] "Preferred hairstyle information" refers to information about a hairstyle desired by the user, including information input in text format.

[0902] The "optimal hairstyle" is a hairstyle suggested using a generative AI model based on the user's facial information, emotional information, and preferred hairstyle information.

[0903] The "overall coordinated image" is information that includes an image of the overall fashion and styling that is proposed along with the user's optimal hairstyle.

[0904] A "beauty salon" refers to a hair salon that a user visits to achieve a hairstyle.

[0905] A "hairdresser" is a professional who styles the user's hairstyle.

[0906] A "reservation request" is a request made by a user to a specific beauty salon or hairdresser to have a hairstyle performed.

[0907] An "appointment confirmation message" is a message containing confirmation information that is sent to a user after an appointment with a salon or hairdresser has been confirmed.

[0908] A system for implementing the present invention provides a function in which a user inputs their own facial information, emotional information, and preferred hairstyle information using a device such as a smartphone or tablet terminal, and the system suggests the most suitable hairstyle based on that information. This system mainly includes the following means:

[0909] 1. Acquiring user's facial and emotional information

[0910] The user takes a photo of their face using the device's camera and saves it as image data. This image data is then used by the emotion engine to analyze and extract emotional information from the user's facial expressions. The software used is OpenCV and the DeepFace library.

[0911] 2. Obtaining user's preferred hairstyle information

[0912] The user uses the text input fields to input their preferred hairstyle information, which is sent to the server and serves as input data for future hairstyle generation.

[0913] 3. Generating the best hairstyle

[0914] The server uses a generative AI model to generate the optimal hairstyle based on the facial information, emotional information, and preferred hairstyle information sent by the user. This generative AI model takes into account the user's facial contours, features, and emotional state to suggest the most suitable hairstyle. An overall coordinated image is also generated.

[0915] 4. Presenting the proposal

[0916] The generated hairstyle and overall coordinated image are sent to the user's terminal, which displays them to the user. The user checks the proposed hairstyle and judges their satisfaction.

[0917] 5. Search and book salons and hairdressers

[0918] If the user is satisfied with the proposed hairstyle, the system searches for nearby salons and hairdressers based on the user's current location. This information is obtained from a database on the server. The search results are displayed on the user's device, and the user can select the salon or hairdresser they want and make a reservation.

[0919] 6. Confirmation of reservation and confirmation message

[0920] When a user requests a reservation, the information is processed on the server side and the reservation is confirmed officially in cooperation with the reservation system of the related beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user and ends the process.

[0921] Specific examples

[0922] 1. The user takes a photo of their face using a tablet device and uploads it to the system. At this time, the emotion engine analyzes the facial expression to determine the emotion of "joy."

[0923] 2. The user enters "I want long natural hair" in the text field and submits it to the server.

[0924] 3. The server uses a generative AI model to generate the optimal hairstyle and overall coordinated image based on the user's facial information, emotional information, and preferred hairstyle information.

[0925] 4. The user checks the optimal hairstyle and overall coordination image displayed on the device.

[0926] 5. The user selects "nearby beauty salon A" and makes a reservation on the system.

[0927] 6. The server confirms the reservation and sends a reservation confirmation message to the device, which displays "Reservation completed."

[0928] Prompt Sentence Examples

[0929] Face information: face.jpg

[0930] Desired hairstyle: Natural long hair

[0931] Predominant emotion: Joy

[0932] Suggested style: Natural long hairstyle that emphasizes joy

[0933] Using this system, users can easily find the optimal hairstyle based on their facial information and emotional state, quickly find the salon or hairdresser who can create that hairstyle, and complete the reservation.

[0934] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0935] Step 1:

[0936] The user takes a photo of his or her face using the camera on the terminal and stores the image data in the terminal.

[0937] Specific operation: The user opens the application on the device and uses the camera function to take a photo of their face. The captured image is then saved in the device's storage.

[0938] Input: Face photo

[0939] Output: Saved face photo data

[0940] Step 2:

[0941] The device uses the DeepFace library to analyze the user's emotional information based on the facial photos stored on the device.

[0942] Specific operation: The emotion engine receives face image data as input and performs emotion analysis using the DeepFace library. The analysis results in key emotion information.

[0943] Input: Facial photo data

[0944] Output: Emotion information (e.g., happiness, sadness)

[0945] Step 3:

[0946] The user inputs desired hairstyle information into a text input field on the terminal.

[0947] Specific actions: The user enters the desired hairstyle (e.g., natural long hair) in the text field and presses the "Submit" button.

[0948] Input: Desired hairstyle information

[0949] Output: Hair style information sent

[0950] Step 4:

[0951] The terminal transmits face information, emotion information, and preferred hairstyle information to the server.

[0952] Specific operation: The device sends the captured facial photo data, analyzed emotional information, and input hairstyle information to the server.

[0953] Input: Facial photo data, emotional information, hairstyle information

[0954] Output: Send data to the server

[0955] Step 5:

[0956] Based on the facial information, emotional information, and preferred hairstyle information received by the server, the optimal hairstyle is generated using a generative AI model.

[0957] Specific operation: The server receives this information as input, inputs prompts into the generative AI model, and generates a hairstyle. The generated hairstyle and an overall coordinated image are then obtained.

[0958] Input: Facial photo data, emotional information, hairstyle information

[0959] Output: Generated hairstyle and overall coordination image

[0960] Step 6:

[0961] The server transmits the generated hairstyle and the overall coordinated image to the terminal.

[0962] Specific operation: The server transmits the generated hairstyle data and the overall coordinate image data to the terminal.

[0963] Input: Generated hairstyle and overall coordination image

[0964] Output: Sending data to the terminal

[0965] Step 7:

[0966] The terminal displays the generated hairstyle and overall coordinated image received by the terminal to the user.

[0967] Specific operation: The terminal displays the data received from the server and allows the user to check the proposed hairstyle and overall coordination image.

[0968] Input: Generated hairstyle and overall coordination image

[0969] Output: What is displayed to the user

[0970] Step 8:

[0971] If the user is satisfied with the suggested hairstyle, the terminal searches for nearby beauty salons and hairdressers.

[0972] Specific operation: The user presses the "reserve" button, and the device sends a search request to the server based on the user's current location information.

[0973] Input: Reservation request, current location information

[0974] Output: Search request sent to the server

[0975] Step 9:

[0976] The server searches for nearby beauty salons and hairdressers and sends that information to the terminal.

[0977] Specific operation: The server searches and retrieves information about the hair salon and hairdresser from the database and sends it to the terminal.

[0978] Input: Search request, current location information

[0979] Output: Information on nearby hair salons and hairdressers

[0980] Step 10:

[0981] The terminal displays the received information about the beauty salon or hairdresser to the user, and the user selects a specific beauty salon or hairdresser and makes a reservation.

[0982] Specific operation: The terminal displays a list of potential hair salons and hairstylists to the user, and the user selects one and presses the "Book" button. The reservation information is then sent to the server.

[0983] Input: Hair salon and hairdresser information, reservation selection

[0984] Output: Send reservation information to the server

[0985] Step 11:

[0986] The server processes the reservation request and generates a reservation confirmation message to send to the terminal.

[0987] Specific operation: The server confirms the reservation request in cooperation with the beauty salon's reservation system, generates a reservation confirmation message and sends it to the terminal.

[0988] Input: Reservation information

[0989] Output: Reservation confirmation message

[0990] Step 12:

[0991] The terminal displays a reservation confirmation message to the user, and the process ends.

[0992] Specific operation: The terminal displays the reservation confirmation message received from the server to the user, and the user confirms that the reservation has been completed.

[0993] Input: Reservation confirmation message

[0994] Output: What is displayed to the user

[0995] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0996] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0997] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0998] [Third embodiment]

[0999] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1000] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1001] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1002] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1003] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1004] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1005] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1006] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1007] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1008] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1009] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1010] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1011] The system of the present invention is designed to make it easier for users to achieve their ideal hairstyle by performing a series of processes involving the user, terminal, and server. The program of this system executes the following processes.

[1012] Explanation of program processing

[1013] Acquiring and sending face information

[1014] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or video. The device receives these inputs and sends them to the server as face information. The user is presented with a progress bar and / or a confirmation message indicating that the face information was successfully sent.

[1015] Acquiring and sending information about your favorite hairstyles

[1016] Next, the user enters the desired hairstyle in the "Enter your preferred hairstyle" field. For example, if the user enters "I like long, natural hair," the device sends this information to the server. At this time, a confirmation message is displayed to the user.

[1017] Hairstyle generation

[1018] The server uses a generative AI model to generate the optimal hairstyle based on the facial information and preferred hairstyle information received from the device. This generated hairstyle is best suited to the user's facial contours and features. An overall coordinated image is also generated.

[1019] Presenting the proposal

[1020] The server sends the generated hairstyle and overall coordinated image to the terminal, which displays them to the user. The user checks the proposed hairstyle and decides whether or not they want to adopt it.

[1021] Search and book hair salons and hairdressers

[1022] If the user is satisfied with the proposed hairstyle, the system searches for a nearby hair salon or hair stylist based on the user's current location. This information is retrieved by the server from a database, and a list of candidates is displayed on the device. When the user selects a specific salon or hair stylist and clicks the "Book Now" button, the device sends this selection and the desired appointment date and time to the server.

[1023] Confirmation of reservation and confirmation message

[1024] The server receives the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user and ends the process.

[1025] Specific examples

[1026] User Example

[1027] 1. The user opens the app on their smartphone, selects "Take a photo," takes a photo of their face, and uploads it to the system.

[1028] 2. The user enters "I want natural long hair" in the text field and presses the submit button.

[1029] 3. The user checks the optimal hairstyle and overall coordination image displayed on the device.

[1030] 4. The user selects "Get this style" and the system displays nearby salons and stylists.

[1031] 5. The user selects "Beauty Salon A" and clicks the "Book Now" button.

[1032] 6. The server will confirm the reservation and a reservation confirmation message will appear on the device, confirming that "Reservation completed."

[1033] In this way, by using the system of the present invention, a user can easily find the optimal hairstyle based on their facial information and preferences, quickly find a hair salon or hairdresser to achieve that hairstyle, and complete the reservation.

[1034] The processing flow will be explained below.

[1035] Step 1:

[1036] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or video. The face information is saved on the device.

[1037] Step 2:

[1038] The device compresses the stored face information (photo or video file) and sends it to the server. A progress bar and a confirmation message are displayed to the user.

[1039] Step 3:

[1040] The user enters their preferred style (e.g., "long hair," "perm," "bob cut," etc.) in the "Enter your preferred hairstyle" field. The user confirms the input and presses the "Submit" button.

[1041] Step 4:

[1042] The terminal transmits the user's preferred hairstyle information in text format to the server, and displays a confirmation message to the user indicating that the preference information has been transmitted.

[1043] Step 5:

[1044] The server analyzes the facial information received from the device and recognizes the facial contours and features. The server then receives information about the user's preferred hairstyle. The server then uses a generative AI model to generate the optimal hairstyle based on the facial information and preferences.

[1045] Step 6:

[1046] The server generates the optimal hairstyle in text and image format. The server also generates an overall coordinated image and generates an image. The server sends this information to the terminal.

[1047] Step 7:

[1048] The terminal displays the proposal received from the server. The user checks the proposed hairstyle and overall coordinated image. The user clicks the "Choose this style" button.

[1049] Step 8:

[1050] The server obtains the user's current location information (e.g., GPS data) and searches for information on nearby beauty salons and hairdressers. The server then sends the search results in a list format to the device.

[1051] Step 9:

[1052] The terminal displays the list of candidate hair salons and hair stylists received from the server to the user. The user selects "Hair Salon A" and clicks the "Book Now" button.

[1053] Step 10:

[1054] The terminal sends the information about the beauty salon selected by the user and the desired reservation date and time to the server, and displays a notification to the user indicating that the reservation request has been sent.

[1055] Step 11:

[1056] The server processes the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal.

[1057] Step 12:

[1058] The terminal displays the confirmation message received from the server to the user. The message "Reservation completed" is displayed and the process ends.

[1059] Example 1

[1060] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1061] With conventional systems, it takes a lot of time and effort for users to find a hairstyle that suits their facial features. Even if they find the perfect hairstyle, it is difficult to easily find and book a salon or hairdresser who can create that hairstyle. To solve these problems, a system is needed that can automatically generate an optimal hairstyle and overall coordination image based on the user's facial information and preferred hairstyle information, and then efficiently search for and book salons and hairdressers who can create that hairstyle.

[1062] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1063] In this invention, the server includes means for acquiring user face information, means for acquiring user preferred hairstyle information, means for using a generative model that generates an optimal hairstyle and overall coordinated image based on the user's face information and preferred hairstyle information, means for presenting the generated hairstyle and coordinated image to the user, means for searching for information on treatment locations and practitioners who can realize the presented hairstyle and coordinated image, means for presenting the searched information on treatment locations and practitioners to the user and sending a reservation request, and means for processing the reservation request and sending a reservation confirmation message to the user. This allows the user to easily find the optimal hairstyle and coordination based on their own face information and preferences, quickly find the treatment locations and practitioners that can realize it, and complete the reservation.

[1064] The "means for acquiring user's facial information" refers to the means by which a user accesses the system and inputs their own facial information by taking an image or video.

[1065] The "means for acquiring information on a user's preferred hairstyle" is a means for a user to access the system and input a desired hairstyle in text format.

[1066] "Means for using a generative model" refers to means for using a generative AI model that is used to generate an optimal hairstyle and overall coordinated image based on the user's facial information and preferred hairstyle information.

[1067] The "means for presenting the generated hairstyle and coordinated image to the user" refers to a means for transmitting the hairstyle and coordinated image generated by the server to the terminal and displaying it to the user.

[1068] "Means for searching for information on treatment locations and practitioners" refers to the means by which the system searches for information on the most suitable beauty salon or hairdresser from a database or other information source based on the user's current location information, etc.

[1069] "Means for presenting the searched information on treatment locations and practitioners to the user and sending a reservation request" refers to means for displaying candidate treatment locations and practitioners to the user, allowing the user to select the desired treatment location and practitioner and send a reservation request.

[1070] The "means for processing reservation requests and sending reservation confirmation messages to users" refers to the means by which the system receives reservation requests from users, confirms the reservations in cooperation with affiliated reservation systems, and sends confirmation messages to users.

[1071] This invention makes it easier for users to achieve their ideal hairstyle by performing a series of processes involving the user, the terminal, and the server. Below, we will explain how to specifically implement this system.

[1072] This system acquires the user's facial information and preferred hairstyle information, and then uses a generative AI model to generate the optimal hairstyle and overall coordination image based on that information. The generated information is presented to the user, who can then search for and book treatment locations and therapists who can achieve that hairstyle.

[1073] First, a user opens the system's application or website on their device. The device can be a smartphone, tablet, or PC. The user selects the "Enter Face Information" option and takes a photo or video. The camera function is used to take a photo of the user's face, which the device then sends to the server as face information. The user is then presented with a progress bar and a confirmation message indicating that the face information has been successfully sent.

[1074] Next, the user enters the desired style in text format in the "Enter your preferred hairstyle" field. For example, if the user enters "I like long, natural hair," the device will send this information to the server. A confirmation message will be displayed to the user.

[1075] The server uses a generative AI model to generate the optimal hairstyle based on the facial information and preferred hairstyle information received from the device. The generated hairstyle is best suited to the user's facial contours and features, and an overall coordinated image is also generated. The generative AI model used here is trained using a specific dataset.

[1076] The generated hairstyles and coordinated images are sent from the server to the terminal, which then displays them to the user. The user can check the proposed hairstyles and select the one they like best.

[1077] If the user is satisfied with the proposed hairstyle, the system searches for nearby salons and hairdressers based on the user's current location. The server retrieves this information from a database, and a list of candidates is displayed on the device. The user selects a specific salon or hairdresser and clicks the "Book Now" button, sending the selection and desired appointment date and time to the server.

[1078] The server receives the reservation request and confirms the reservation by coordinating with the relevant beauty salon's reservation system. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user, and the process ends.

[1079] Here are some examples of prompts to input to a generative AI model:

[1080] Generate the most suitable hairstyle based on the user's face information and preferred hairstyle information. The user wants natural long hair. The user's face is round. Please provide an image of the overall outfit along with the generated hairstyle.

[1081] In this way, by using the system of the present invention, a user can easily find the optimal hairstyle and coordination based on their facial information and preferences, quickly find the treatment location and practitioner to achieve it, and complete the reservation.

[1082] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1083] Step 1:

[1084] The user opens an application or website on their device, selects the "Enter Face Information" option, and takes a photo or video.

[1085] Input: User action (face photo or video)

[1086] Output: Captured image data

[1087] Specific behavior:

[1088] A user taps an app on their smartphone to launch it.

[1089] The user clicks the "Enter Face Information" button and takes a photo of their face using the camera function.

[1090] The device saves the captured image data and stores it in temporary memory.

[1091] Step 2:

[1092] The face information received by the device is sent to the server.

[1093] Input: Photographed image data

[1094] Output: Face information sent to the server

[1095] Specific behavior:

[1096] The device encodes the image data and sends it to the server as an HTTP request.

[1097] The terminal displays a transmission progress bar and provides a confirmation message to the user that the transmission is complete.

[1098] Step 3:

[1099] The user enters the desired style in the "Enter your desired hairstyle" field.

[1100] Input: User text input (desired hairstyle)

[1101] Output: The input text data

[1102] Specific behavior:

[1103] The user enters "I want natural long hair" in the text field and presses the submit button.

[1104] The device captures and temporarily stores the text data.

[1105] Step 4:

[1106] The terminal transmits the input hairstyle information to the server.

[1107] Input: Text data (preferred hairstyle information)

[1108] Output: Hair style information sent to the server

[1109] Specific behavior:

[1110] The terminal encodes the text data and sends it to the server as an HTTP request.

[1111] The terminal displays a message to the user confirming that transmission is complete.

[1112] Step 5:

[1113] Based on the facial information and hairstyle information received by the server, the optimal hairstyle is generated using a generative AI model.

[1114] Input: Face information, hairstyle information

[1115] Output: Generated hairstyle and outfit image

[1116] Specific behavior:

[1117] The server decodes the received face information and hairstyle information.

[1118] The server sends a request to the generated AI model using a prompt sentence.

[1119] Example prompt: "Generate the most suitable hairstyle based on the user's facial information and preferred hairstyle information."

[1120] The server examines the generated results returned by the generative AI model and also adds an overall coordinated image.

[1121] Step 6:

[1122] The server transmits the generated hairstyle and coordinated image to the terminal.

[1123] Input: Generated hairstyle and outfit image

[1124] Output: Hairstyle and outfit image sent to the device

[1125] Specific behavior:

[1126] The server encodes the generated result and sends it to the terminal as an HTTP response.

[1127] Step 7:

[1128] The terminal displays the received data to the user.

[1129] Input: Response data from the server

[1130] Output: Hairstyle and outfit image displayed to the user

[1131] Specific behavior:

[1132] The device decodes the response data and displays an image of the hairstyle and outfit on the screen.

[1133] Step 8:

[1134] If the user is satisfied with the suggested hairstyle, the system will search for nearby hair salons and hairdressers based on the user's current location information.

[1135] Input: User's current location information

[1136] Output: List of treatment locations and practitioner candidates

[1137] Specific behavior:

[1138] The user selects "Use this style" and clicks the reservation button.

[1139] The device uses the GPS function to obtain the current location information and sends it to the server.

[1140] The server queries and retrieves information about nearby hair salons and hairdressers from a database.

[1141] Step 9:

[1142] The server transmits the acquired information about the treatment location and the practitioner to the terminal.

[1143] Input: Salon and stylist information retrieved from a database

[1144] Output: Candidate list sent to the terminal

[1145] Specific behavior:

[1146] The server encodes the acquired information and sends it to the terminal.

[1147] Step 10:

[1148] The terminal displays a list of potential hair salons and hairstylists to the user.

[1149] Input: Response data from the server

[1150] Output: The candidate list displayed to the user

[1151] Specific behavior:

[1152] The device decodes the candidate list and displays it on the screen.

[1153] Step 11:

[1154] The user selects a particular salon or hairdresser and clicks the "Book Now" button.

[1155] Input: User selection information, desired reservation date and time

[1156] Output: Selection information and desired reservation date and time

[1157] Specific behavior:

[1158] The user selects one of the displayed options and clicks the reservation button.

[1159] The terminal transmits the selected candidate and the desired date and time to the server.

[1160] Step 12:

[1161] The server processes the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon.

[1162] Input: Reservation Request

[1163] Output: Reservation confirmation message

[1164] Specific behavior:

[1165] The server decodes the received request and records the reservation information.

[1166] The server sends an API request to the salon's reservation system to confirm the reservation.

[1167] Step 13:

[1168] The server generates a reservation confirmation message and sends it to the terminal.

[1169] Input: Confirmed reservation information

[1170] Output: Reservation confirmation message

[1171] Specific behavior:

[1172] The server generates a message notifying the completion of the reservation, encodes it, and sends it to the terminal.

[1173] The terminal displays a confirmation message to the user saying "Reservation completed."

[1174] (Application example 1)

[1175] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1176] Conventional hairstyle suggestion systems have difficulty generating optimal hairstyles based on a user's facial information and preferred style information, and also have the problem of making it difficult to search for and book beauty salons and hairdressers. In particular, there has been a lack of individually customized hairstyle suggestions based on facial information, and reservation systems that respond to real-time beauty salon availability.

[1177] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1178] In this invention, the server includes means for acquiring user facial information, means for acquiring user preferred hairstyle information, means for using a generative AI model to generate an optimal hairstyle based on the user's facial information and preferred hairstyle information, means for presenting the generated hairstyle information to the user, means for searching for information on salons and technicians who can realize the presented hairstyle information, means for presenting the searched information on salons and technicians to the user and sending a reservation request, and means for processing the reservation request and sending a reservation confirmation message to the user. This allows the user to generate an optimal hairstyle based on their facial information and preferences, quickly and easily find a beauty salon or hairdresser to realize that style, and complete the reservation.

[1179] "User facial information" refers to image data containing a user's facial features or other biometric information.

[1180] "User's favorite hairstyle information" is information about a hairstyle desired by the user, and is expressed in the form of text, an image, or the like.

[1181] A "generative AI model" is an artificial intelligence model that is trained to generate optimal outputs based on input data.

[1182] "Generated hairstyle information" refers to information about hairstyles generated by a generative AI model based on the user's facial information and preferred hairstyle information.

[1183] The "presentation means" refers to a method or device for visually displaying the generated hairstyle information and search results to the user.

[1184] "Store and technician information" refers to data that includes information about service providers such as beauty salons and hairdressers.

[1185] A "search method" is an algorithm or process used to retrieve targeted information from a database based on specific criteria.

[1186] The "means for sending a reservation request" refers to a communication means for sending a reservation request to the store or technician selected by the user.

[1187] A "reservation confirmation message" is a confirmation message indicating that a reservation request has been confirmed.

[1188] The system of the present invention creates an optimal hairstyle based on facial information and preferred hairstyle information, making it easier for users to achieve their ideal hairstyle, and then searches for and reserves salons and technicians who can achieve that style. In this embodiment, a smartphone and a cloud server are used.

[1189] Program processing

[1190] 1. Acquiring and sending face information

[1191] The user takes a photo of their face using a device (smartphone). The captured facial information is sent to a cloud server as image data. This requires the smartphone's camera as hardware and the ability to import image data and send it to the server as software. Specifically, a face recognition library (e.g., OpenCV) is used.

[1192] 2. Acquisition and transmission of preferred hairstyle information

[1193] The user inputs their desired hairstyle in text format on the device. The input text information is sent to the server, where it is analyzed by a natural language processing engine.

[1194] 3. Hairstyle generation

[1195] The cloud server combines the acquired facial information with the desired hairstyle information and generates the optimal hairstyle using a generative AI model (e.g., Stable Diffusion). In this process, the AI ​​model analyzes and synthesizes facial features and hairstyle elements. The generated hairstyle image is then sent from the cloud server to the device.

[1196] 4. Presenting the proposal

[1197] The terminal visually presents the generated hairstyle information received from the server to the user, allowing the user to confirm the proposed style.

[1198] 5. Search for and book a store or technician

[1199] Based on the device's location, the server searches a database of nearby hairdressers and salons and presents the most suitable candidates to the user. The user then selects a salon and technician from the list and submits a reservation request.

[1200] 6. Confirmation of reservation and confirmation message

[1201] The server processes the received reservation request and confirms the reservation in cooperation with the reservation system of the relevant store. A confirmation message of the reservation completion is sent to the user's terminal and displayed to the user.

[1202] Specific examples

[1203] User operation procedure

[1204] 1. The user opens the smartphone app, uses the "take photo" function to take a photo of their face, and uploads it to the system.

[1205] 2. The user types "Bob cuts are good" in the text field and presses the submit button.

[1206] 3. The user checks the optimal hairstyle and outfit image displayed on their smartphone.

[1207] 4. When the user selects "Get this style," the system will display a list of nearby salons and stylists.

[1208] 5. The user selects "Beauty Salon B" and clicks the "Book Now" button.

[1209] 6. The cloud server will confirm the reservation and the device will display a confirmation message saying "Reservation completed."

[1210] Example prompts for generative AI models

[1211] Generate a "Bob Cut" hairstyle based on the user's face photo.

[1212] In this way, users can easily find their ideal hairstyle, quickly and easily find a hair salon or hairdresser to help them achieve it, and complete a reservation.

[1213] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1214] Step 1:

[1215] A user takes a photo of their face with a device (smartphone) and sends the facial information to a cloud server. The device's camera is used to capture the image data, which is then uploaded directly to the cloud server. The input is the user's facial photo, and the output is the image data sent to the server.

[1216] Step 2:

[1217] The user inputs information about their preferred hairstyle in text format into the device and sends it to the cloud server. The device receives the user's input as text data and sends it to the cloud server. The input is the text information entered by the user, and the output is the text data sent to the server.

[1218] Step 3:

[1219] The cloud server uses a generative AI model based on facial information and preferred hairstyle information to generate the optimal hairstyle. The server converts image data and text data into a prompt sentence, inputs it into the AI ​​model, and outputs a generated hairstyle image. The input is facial image data and text information, and the output is a generated hairstyle image. An example of a prompt sentence: "Generate a 'bob cut' hairstyle based on the user's facial photo."

[1220] Step 4:

[1221] The cloud server sends the generated hairstyle image to the terminal. The server then sends the generated image data to the terminal via an existing communication method, and the terminal performs reception processing. The input is the generated hairstyle image, and the output is the image data sent to the terminal.

[1222] Step 5:

[1223] The device presents the received hairstyle image to the user. The device renders the image data on a display screen so that the user can view it. The input is the received hairstyle image, and the output is the image displayed on the device screen.

[1224] Step 6:

[1225] Based on the hairstyle information provided by the user, the system requests a search for salons and technicians who can create that style. When the user clicks the "Search" button on their device, the request is sent to the cloud server. The input is the user's search request, and the output is the data sent to the cloud server.

[1226] Step 7:

[1227] The cloud server searches the database for the most suitable hair salon and technician based on the user's location and hairstyle information, and sends the results to the device. The server processes the location and hairstyle information as a search query and retrieves a list of candidates from the database. The input is the user's location and hairstyle information, and the output is a list of search results.

[1228] Step 8:

[1229] The terminal presents the search results to the user and sends a reservation request. The terminal renders a candidate list on the display screen and allows the user to select the desired store and technician. The input is the list of search results, and the output is a reservation request based on the list displayed on the terminal screen and the store and technician selected by the user.

[1230] Step 9:

[1231] The cloud server processes the received reservation request and confirms the reservation in conjunction with the relevant store's reservation system. The server analyzes the request data and connects to the store's reservation system via an API. The input is the reservation request data, and the output is the confirmed data sent to the store's reservation system.

[1232] Step 10:

[1233] The cloud server generates a reservation confirmation message and sends it to the terminal. The server generates a confirmation message based on the reservation confirmation data and sends it to the terminal. The input is the reservation confirmation data, and the output is the reservation confirmation message sent to the terminal.

[1234] Step 11:

[1235] The terminal presents the received reservation confirmation message to the user and ends the process. The terminal renders the confirmation message on the display screen for the user to review. The input is the reservation confirmation message and the output is the message displayed on the terminal screen.

[1236] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1237] The system of the present invention is designed to make it easier for users to achieve their ideal hairstyle by performing a series of processes involving the user, terminal, server, and emotion engine. The program of this system executes the following processes.

[1238] Explanation of program processing

[1239] Acquiring and transmitting facial and emotional information

[1240] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or records a video. The device receives these inputs and uses the emotion engine to analyze the user's facial expressions and obtain emotional information. The obtained facial and emotional information is stored on the device and sent to the server. A progress bar and a confirmation message for sending are displayed to the user.

[1241] Acquisition and transmission of preferred hairstyle information

[1242] Next, the user enters the desired style in the "Enter your preferred hairstyle" field. For example, if the user enters "I like long natural hair," the terminal will send this information to the server. A confirmation message will be displayed to the user.

[1243] Hairstyle generation

[1244] The server uses a generative AI model to generate the optimal hairstyle based on the facial information, emotional information, and preferred hairstyle information received from the device. This generated hairstyle is best suited to the user's facial contours and features. An overall coordinated image is also generated.

[1245] Presenting the proposal

[1246] The server sends the generated hairstyle and overall coordinated image to the terminal, which displays them to the user. The user checks the proposed hairstyle and decides whether or not they want to adopt it.

[1247] Search and book salons and hairdressers

[1248] If the user is satisfied with the proposed hairstyle, the system searches for a nearby hair salon or hair stylist based on the user's current location. This information is retrieved by the server from a database, and a list of candidates is displayed on the device. When the user selects a specific salon or hair stylist and clicks the "Book Now" button, the device sends this selection and the desired appointment date and time to the server.

[1249] Confirmation of reservation and confirmation message

[1250] The server receives the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user and ends the process.

[1251] Specific examples

[1252] User Example

[1253] 1. The user opens the app on their smartphone, selects "Take a photo," takes a photo of their face, and uploads it to the system. At this time, the emotion engine reads emotional information from their facial expressions.

[1254] 2. The user enters "I want natural long hair" in the text field and presses the submit button.

[1255] 3. The user checks the optimal hairstyle and overall coordination image displayed on the device.

[1256] 4. The user selects "Get this style" and the system displays nearby salons and stylists.

[1257] 5. The user selects "Beauty Salon A" and clicks the "Book Now" button.

[1258] 6. The server will confirm the reservation and a reservation confirmation message will appear on the device, confirming that "Reservation completed."

[1259] In this way, by using the system of the present invention, users can easily find the optimal hairstyle based on their facial information and preferences, quickly find the hair salon or hairdresser who can create that hairstyle, and complete the reservation.The introduction of an emotion engine makes it possible to suggest hairstyles that reflect the user's current emotions, allowing for the provision of more personalized services.

[1260] The processing flow will be explained below.

[1261] Step 1:

[1262] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or video. The face information is saved on the device.

[1263] Step 2:

[1264] The device passes the stored facial information to the emotion engine, which extracts emotional information from the user's facial expressions. The emotional information is then sent to the server along with the facial information. A progress bar and a confirmation message are displayed to the user.

[1265] Step 3:

[1266] The user inputs the desired hairstyle in the "Enter your desired hairstyle" field. For example, the user inputs "I like long natural hair." The user confirms the input and presses the "Submit" button.

[1267] Step 4:

[1268] The terminal sends the user's preferred hairstyle information in text format to the server, and a confirmation message is displayed to the user to confirm that the transmission has been completed.

[1269] Step 5:

[1270] The server analyzes the facial information, emotional information, and preferred hairstyle information received from the device. The emotional information obtained by the emotion engine is combined and the optimal hairstyle is generated using a generative AI model.

[1271] Step 6:

[1272] The server generates the optimal hairstyle in text and image format, and also generates an overall coordinated image, and sends this information to the terminal.

[1273] Step 7:

[1274] The terminal displays the proposal received from the server. The user checks the proposed hairstyle and overall coordinated image. The user clicks the "Choose this style" button.

[1275] Step 8:

[1276] The server obtains the user's current location information (e.g., GPS data) and searches for information on nearby beauty salons and hairdressers. The server then sends the search results in a list format to the device.

[1277] Step 9:

[1278] The terminal displays the list of candidate hair salons and hair stylists received from the server to the user. The user selects "Hair Salon A" and clicks the "Book Now" button.

[1279] Step 10:

[1280] The terminal sends the information about the beauty salon selected by the user and the desired reservation date and time to the server, and displays a notification to the user indicating that the reservation request has been sent.

[1281] Step 11:

[1282] The server processes the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal.

[1283] Step 12:

[1284] The terminal displays the confirmation message received from the server to the user. The message "Reservation completed" is displayed and the process ends.

[1285] Example 2

[1286] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1287] Conventional hairstyle suggestion systems rarely take into account the user's emotional information, making it difficult for users to easily find a hairstyle that actually satisfies them. In addition, the process of searching for and booking beauty facilities and beauty professionals is complicated, preventing users from receiving appropriate services quickly.

[1288] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1289] In this invention, the server includes means for acquiring user facial information, means for analyzing user emotional information, means for acquiring user preferred hairstyle information, means for generating an optimal hairstyle based on the user's facial information, emotional information, and preferred hairstyle information, means for presenting the generated hairstyle and an overall coordinated image to the user, means for searching for information on beauty facilities and beauty professionals who can realize the presented hairstyle, means for presenting the searched information on beauty facilities and beauty professionals to the user and sending a reservation request, and means for processing the reservation request and sending a reservation confirmation message to the user. This enables a user to easily find an optimal hairstyle based on their facial information and preferences, quickly find a beauty facility or beauty professional who can realize that hairstyle, and complete the reservation.

[1290] The "means for acquiring user's face information" refers to a means for acquiring face information by the user taking a photograph or shooting a video.

[1291] The "means for analyzing the user's emotional information" is a means for analyzing facial photographs and videos taken by the user and obtaining emotional information from facial expressions using an emotion engine.

[1292] The "means for acquiring information on the user's preferred hairstyle" is a means for the user to input the hairstyle he or she desires in text format or in a selection format.

[1293] The "means for generating an optimal hairstyle" is a means for generating a hairstyle that is most suitable for a user using a generative AI model based on the user's facial information, emotional information, and preferred hairstyle information.

[1294] The "means for presenting the generated hairstyle and overall coordinated image to the user" is a means for displaying the generated hairstyle information and the corresponding overall coordinated image on the user's terminal.

[1295] The "means for searching for information on beauty facilities and beauty workers" is a means for searching a database for the most suitable beauty facilities and beauty workers based on the user's location information.

[1296] "Means for presenting information to the user and sending a reservation request" refers to means for displaying information on searched beauty facilities and beauty professionals on the user's terminal, allowing the user to select a specific facility or professional and send a reservation request.

[1297] The "means for sending a reservation confirmation message to the user" is a means for processing a reservation request and sending a confirmation message to the user's terminal indicating that the reservation has been confirmed.

[1298] The system of the present invention is designed to make it easier for users to achieve their ideal hairstyle by performing a series of processes involving the user, terminal, server, and emotion engine. The program of this system executes the following processes.

[1299] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or records a video. The device receives these inputs, analyzes the user's facial expressions with the emotion engine, and acquires emotional information. The acquired facial and emotional information is stored on the device and sent to the server. As a specific example, the Microsoft Azure Emotion API can be used.

[1300] Next, the user enters the desired style in the "Enter your preferred hairstyle" field. For example, if the user enters "I like long natural hair," the terminal will send this information to the server. A confirmation message will be displayed to the user.

[1301] The server uses a generative AI model to generate the optimal hairstyle based on the facial information, emotional information, and preferred hairstyle information received from the device. The generative AI model can be OpenAI's GPT-3 or similar. The generated hairstyle is best suited to the user's facial contours and features. An overall coordinated image is also generated.

[1302] The server sends the generated hairstyle and overall coordinated image to the terminal, which displays them to the user. The user checks the proposed hairstyle and decides whether or not they want to adopt it.

[1303] If the user is satisfied with the proposed hairstyle, the system searches for a nearby hair salon or hair stylist based on the user's current location. This information is retrieved by the server from a database, and a list of candidates is displayed on the device. When the user selects a specific salon or hair stylist and clicks the "Book Now" button, the device sends this selection and the desired appointment date and time to the server.

[1304] The server receives the reservation request and confirms the reservation by connecting with the relevant beauty salon's reservation system. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user, and the entire process is completed.

[1305] Specific examples

[1306] User Example

[1307] 1. The user opens the app on their smartphone, selects "Take a photo," takes a photo of their face, and uploads it to the system. At this time, the emotion engine reads emotional information from their facial expressions.

[1308] 2. The user enters "I want natural long hair" in the text field and presses the submit button.

[1309] 3. The user checks the optimal hairstyle and overall coordination image displayed on the device.

[1310] 4. The user selects "Get this style" and the system displays nearby salons and stylists.

[1311] 5. The user selects "Beauty Salon A" and clicks the "Book Now" button.

[1312] 6. The server will confirm the reservation and a reservation confirmation message will appear on the device, confirming that "Reservation completed."

[1313] Example prompts to input to the generative AI model

[1314] "Analyze the user's facial photo and obtain emotional information using the emotion engine. Next, generate the optimal hairstyle based on the user's desired hairstyle. Send the generated hairstyle and the overall coordinated image to the user's device."

[1315] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1316] Step 1:

[1317] A user opens a system application or website on a smartphone or computer. When the application is launched, a screen appears where the user can select the "Enter Face Information" option.

[1318] Input: Launch application

[1319] Output: Display of face information input screen

[1320] Step 2:

[1321] The user selects the "Enter Face Information" option and takes a photo or video. The device activates the camera and captures the user's face information.

[1322] Input: User's choice of taking a photo or video

[1323] Output: Acquire and save face information

[1324] Step 3:

[1325] The device inputs stored photos and videos into the emotion engine, which analyzes the user's facial expressions to obtain emotional information. Specifically, the emotion engine detects facial features and classifies emotions.

[1326] Input: Photo or video data

[1327] Output: Emotional information

[1328] Step 4:

[1329] The device transmits the acquired facial and emotional information to the server, at which point a progress bar and a confirmation message are displayed to the user.

[1330] Input: Face and emotion information

[1331] Output: Send data to the server, display confirmation message

[1332] Step 5:

[1333] The user enters the desired hairstyle in the "Enter your preferred hairstyle" field. The device sends this input to the server. For example, a user might enter "I like natural long hair."

[1334] Input: Hair style information by text input

[1335] Output: Send text data to the server

[1336] Step 6:

[1337] The server receives facial information, emotional information, and preferred hairstyle information sent from the device and prepares this data to be input into the generative AI model.

[1338] Input: Face information, emotion information, hairstyle information

[1339] Output: Data preparation for input to a generative AI model

[1340] Step 7:

[1341] The server uses a generative AI model to generate the optimal hairstyle, taking into account facial contours, features, and emotional information during the generation process. An example of a generative AI model is OpenAI's GPT-3.

[1342] Input: Face information, emotion information, hairstyle information

[1343] Output: Optimal hairstyle and overall coordination image

[1344] Step 8:

[1345] The server transmits the generated hairstyle and coordinated image to the terminal.

[1346] Input: Results from a generative AI model

[1347] Output: Sending data to the terminal

[1348] Step 9:

[1349] The terminal displays the suggested hairstyle and coordinated image to the user. The user checks the displayed information and selects whether or not to adopt the style.

[1350] Input: Proposal data from the server

[1351] Output: Display to user, display of selection screen

[1352] Step 10:

[1353] When the user selects "Choose this style," the system searches for nearby beauty salons and professionals based on the user's current location. The server retrieves this information from a database and creates a list of candidates.

[1354] Input: User selection, location information

[1355] Output: Creating a candidate list

[1356] Step 11:

[1357] The server sends a list of candidate beauty facilities and beauty professionals to the terminal.

[1358] Input: Information on beauty facilities and beauty professionals

[1359] Output: Sending data to the terminal

[1360] Step 12:

[1361] The terminal displays a list of potential beauty facilities and beauty professionals to the user, who then selects a specific beauty facility or beauty professional and clicks the "Book Now" button.

[1362] Input: candidate list

[1363] Output: Display to user, reservation selection

[1364] Step 13:

[1365] The terminal transmits the selection information and the desired reservation date and time to the server.

[1366] Input: Selection information, desired reservation date and time

[1367] Output: Reservation request sent to server

[1368] Step 14:

[1369] The server receives the reservation request and confirms the reservation in cooperation with the reservation system of the related beauty facility.

[1370] Input: Reservation Request

[1371] Output: Reservation confirmed

[1372] Step 15:

[1373] The server generates a reservation confirmation message and sends it to the terminal.

[1374] Input: Confirmed reservation information

[1375] Output: Reservation confirmation message

[1376] Step 16:

[1377] The terminal will display a reservation confirmation message to the user and the process will be complete.

[1378] Input: Reservation confirmation message

[1379] Output: Display a confirmation message to the user

[1380] (Application example 2)

[1381] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1382] Conventional hairstyle suggestion systems make suggestions based only on the user's facial information and preferred hairstyle information, and therefore are unable to consider the user's emotional state or overall coordination. Furthermore, the system's operation is cumbersome, and it is not possible to centrally manage reservations with beauty salons and hairdressers, resulting in a poor user experience. Therefore, there is a need for a system that can make more accurate hairstyle suggestions that incorporate the user's emotional information, as well as a system that enables easy reservation management with beauty salons and hairdressers.

[1383] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1384] In this invention, the server includes a means for acquiring the user's facial information, a means for analyzing and acquiring the user's emotional information, and a means for acquiring the user's preferred hairstyle information. This makes it possible to generate an optimal hairstyle based on the user's facial information, emotional information, and preferred hairstyle information, and to present the generated hairstyle information and an overall coordinated image to the user. Furthermore, a system is provided that allows users to easily search for beauty salons and hairdressers and manage reservations based on this information.

[1385] A "user" is a person who uses the system and provides his or her facial information and hairstyle preferences.

[1386] "Facial information" is image data of the user's face, and is obtained by photographing or videotaping.

[1387] "Emotion information" is data that represents the emotional state of the user analyzed from facial information.

[1388] "Preferred hairstyle information" refers to information about a hairstyle desired by the user, including information input in text format.

[1389] The "optimal hairstyle" is a hairstyle suggested using a generative AI model based on the user's facial information, emotional information, and preferred hairstyle information.

[1390] The "overall coordinated image" is information that includes an image of the overall fashion and styling that is proposed along with the user's optimal hairstyle.

[1391] A "beauty salon" refers to a hair salon that a user visits to achieve a hairstyle.

[1392] A "hairdresser" is a professional who styles the user's hairstyle.

[1393] A "reservation request" is a request made by a user to a specific beauty salon or hairdresser to have a hairstyle performed.

[1394] An "appointment confirmation message" is a message containing confirmation information that is sent to a user after an appointment with a salon or hairdresser has been confirmed.

[1395] A system for implementing the present invention provides a function in which a user inputs their own facial information, emotional information, and preferred hairstyle information using a device such as a smartphone or tablet terminal, and the system suggests the most suitable hairstyle based on that information. This system mainly includes the following means:

[1396] 1. Acquiring user's facial and emotional information

[1397] The user takes a photo of their face using the device's camera and saves it as image data. This image data is then used by the emotion engine to analyze and extract emotional information from the user's facial expressions. The software used is OpenCV and the DeepFace library.

[1398] 2. Obtaining user's preferred hairstyle information

[1399] The user uses the text input fields to input their preferred hairstyle information, which is sent to the server and serves as input data for future hairstyle generation.

[1400] 3. Generating the best hairstyle

[1401] The server uses a generative AI model to generate the optimal hairstyle based on the facial information, emotional information, and preferred hairstyle information sent by the user. This generative AI model takes into account the user's facial contours, features, and emotional state to suggest the most suitable hairstyle. An overall coordinated image is also generated.

[1402] 4. Presenting the proposal

[1403] The generated hairstyle and overall coordinated image are sent to the user's terminal, which displays them to the user. The user checks the proposed hairstyle and judges their satisfaction.

[1404] 5. Search and book salons and hairdressers

[1405] If the user is satisfied with the proposed hairstyle, the system searches for nearby salons and hairdressers based on the user's current location. This information is obtained from a database on the server. The search results are displayed on the user's device, and the user can select the salon or hairdresser they want and make a reservation.

[1406] 6. Confirmation of reservation and confirmation message

[1407] When a user requests a reservation, the information is processed on the server side and the reservation is confirmed officially in cooperation with the reservation system of the related beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user and ends the process.

[1408] Specific examples

[1409] 1. The user takes a photo of their face using a tablet device and uploads it to the system. At this time, the emotion engine analyzes the facial expression to determine the emotion of "joy."

[1410] 2. The user enters "I want long natural hair" in the text field and submits it to the server.

[1411] 3. The server uses a generative AI model to generate the optimal hairstyle and overall coordinated image based on the user's facial information, emotional information, and preferred hairstyle information.

[1412] 4. The user checks the optimal hairstyle and overall coordination image displayed on the device.

[1413] 5. The user selects "nearby beauty salon A" and makes a reservation on the system.

[1414] 6. The server confirms the reservation and sends a reservation confirmation message to the device, which displays "Reservation completed."

[1415] Prompt Sentence Examples

[1416] Face information: face.jpg

[1417] Desired hairstyle: Natural long hair

[1418] Predominant emotion: Joy

[1419] Suggested style: Natural long hairstyle that emphasizes joy

[1420] Using this system, users can easily find the optimal hairstyle based on their facial information and emotional state, quickly find the salon or hairdresser who can create that hairstyle, and complete the reservation.

[1421] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1422] Step 1:

[1423] The user takes a photo of his or her face using the camera on the terminal and stores the image data in the terminal.

[1424] Specific operation: The user opens the application on the device and uses the camera function to take a photo of their face. The captured image is then saved in the device's storage.

[1425] Input: Face photo

[1426] Output: Saved face photo data

[1427] Step 2:

[1428] The device uses the DeepFace library to analyze the user's emotional information based on the facial photos stored on the device.

[1429] Specific operation: The emotion engine receives face image data as input and performs emotion analysis using the DeepFace library. The analysis results in key emotion information.

[1430] Input: Facial photo data

[1431] Output: Emotion information (e.g., happiness, sadness)

[1432] Step 3:

[1433] The user inputs desired hairstyle information into a text input field on the terminal.

[1434] Specific actions: The user enters the desired hairstyle (e.g., natural long hair) in the text field and presses the "Submit" button.

[1435] Input: Desired hairstyle information

[1436] Output: Hair style information sent

[1437] Step 4:

[1438] The terminal transmits face information, emotion information, and preferred hairstyle information to the server.

[1439] Specific operation: The device sends the captured facial photo data, analyzed emotional information, and input hairstyle information to the server.

[1440] Input: Facial photo data, emotional information, hairstyle information

[1441] Output: Send data to the server

[1442] Step 5:

[1443] Based on the facial information, emotional information, and preferred hairstyle information received by the server, the optimal hairstyle is generated using a generative AI model.

[1444] Specific operation: The server receives this information as input, inputs prompts into the generative AI model, and generates a hairstyle. The generated hairstyle and an overall coordinated image are then obtained.

[1445] Input: Facial photo data, emotional information, hairstyle information

[1446] Output: Generated hairstyle and overall coordination image

[1447] Step 6:

[1448] The server transmits the generated hairstyle and the overall coordinated image to the terminal.

[1449] Specific operation: The server transmits the generated hairstyle data and the overall coordinate image data to the terminal.

[1450] Input: Generated hairstyle and overall coordination image

[1451] Output: Sending data to the terminal

[1452] Step 7:

[1453] The terminal displays the generated hairstyle and overall coordinated image received by the terminal to the user.

[1454] Specific operation: The terminal displays the data received from the server and allows the user to check the proposed hairstyle and overall coordination image.

[1455] Input: Generated hairstyle and overall coordination image

[1456] Output: What is displayed to the user

[1457] Step 8:

[1458] If the user is satisfied with the suggested hairstyle, the terminal searches for nearby beauty salons and hairdressers.

[1459] Specific operation: The user presses the "reserve" button, and the device sends a search request to the server based on the user's current location information.

[1460] Input: Reservation request, current location information

[1461] Output: Search request sent to the server

[1462] Step 9:

[1463] The server searches for nearby beauty salons and hairdressers and sends that information to the terminal.

[1464] Specific operation: The server searches and retrieves information about the hair salon and hairdresser from the database and sends it to the terminal.

[1465] Input: Search request, current location information

[1466] Output: Information on nearby hair salons and hairdressers

[1467] Step 10:

[1468] The terminal displays the received information about the beauty salon or hairdresser to the user, and the user selects a specific beauty salon or hairdresser and makes a reservation.

[1469] Specific operation: The terminal displays a list of potential hair salons and hairstylists to the user, and the user selects one and presses the "Book" button. The reservation information is then sent to the server.

[1470] Input: Hair salon and hairdresser information, reservation selection

[1471] Output: Send reservation information to the server

[1472] Step 11:

[1473] The server processes the reservation request and generates a reservation confirmation message to send to the terminal.

[1474] Specific operation: The server confirms the reservation request in cooperation with the beauty salon's reservation system, generates a reservation confirmation message and sends it to the terminal.

[1475] Input: Reservation information

[1476] Output: Reservation confirmation message

[1477] Step 12:

[1478] The terminal displays a reservation confirmation message to the user, and the process ends.

[1479] Specific operation: The terminal displays the reservation confirmation message received from the server to the user, and the user confirms that the reservation has been completed.

[1480] Input: Reservation confirmation message

[1481] Output: What is displayed to the user

[1482] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1483] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1484] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1485] [Fourth embodiment]

[1486] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1487] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1488] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1489] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1490] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1491] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1492] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1493] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1494] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1495] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1496] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1497] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1498] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1499] The system of the present invention is designed to make it easier for users to achieve their ideal hairstyle by performing a series of processes involving the user, terminal, and server. The program of this system executes the following processes.

[1500] Explanation of program processing

[1501] Acquiring and sending face information

[1502] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or video. The device receives these inputs and sends them to the server as face information. The user is presented with a progress bar and / or a confirmation message indicating that the face information was successfully sent.

[1503] Acquiring and sending information about your favorite hairstyles

[1504] Next, the user enters the desired hairstyle in the "Enter your preferred hairstyle" field. For example, if the user enters "I like long, natural hair," the device sends this information to the server. At this time, a confirmation message is displayed to the user.

[1505] Hairstyle generation

[1506] The server uses a generative AI model to generate the optimal hairstyle based on the facial information and preferred hairstyle information received from the device. This generated hairstyle is best suited to the user's facial contours and features. An overall coordinated image is also generated.

[1507] Presenting the proposal

[1508] The server sends the generated hairstyle and overall coordinated image to the terminal, which displays them to the user. The user checks the proposed hairstyle and decides whether or not they want to adopt it.

[1509] Search and book hair salons and hairdressers

[1510] If the user is satisfied with the proposed hairstyle, the system searches for a nearby hair salon or hair stylist based on the user's current location. This information is retrieved by the server from a database, and a list of candidates is displayed on the device. When the user selects a specific salon or hair stylist and clicks the "Book Now" button, the device sends this selection and the desired appointment date and time to the server.

[1511] Confirmation of reservation and confirmation message

[1512] The server receives the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user and ends the process.

[1513] Specific examples

[1514] User Example

[1515] 1. The user opens the app on their smartphone, selects "Take a photo," takes a photo of their face, and uploads it to the system.

[1516] 2. The user enters "I want natural long hair" in the text field and presses the submit button.

[1517] 3. The user checks the optimal hairstyle and overall coordination image displayed on the device.

[1518] 4. The user selects "Get this style" and the system displays nearby salons and stylists.

[1519] 5. The user selects "Beauty Salon A" and clicks the "Book Now" button.

[1520] 6. The server will confirm the reservation and a reservation confirmation message will appear on the device, confirming that "Reservation completed."

[1521] In this way, by using the system of the present invention, a user can easily find the optimal hairstyle based on their facial information and preferences, quickly find a hair salon or hairdresser to achieve that hairstyle, and complete the reservation.

[1522] The processing flow will be explained below.

[1523] Step 1:

[1524] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or video. The face information is saved on the device.

[1525] Step 2:

[1526] The device compresses the stored face information (photo or video file) and sends it to the server. A progress bar and a confirmation message are displayed to the user.

[1527] Step 3:

[1528] The user enters their preferred style (e.g., "long hair," "perm," "bob cut," etc.) in the "Enter your preferred hairstyle" field. The user confirms the input and presses the "Submit" button.

[1529] Step 4:

[1530] The terminal transmits the user's preferred hairstyle information in text format to the server, and displays a confirmation message to the user indicating that the preference information has been transmitted.

[1531] Step 5:

[1532] The server analyzes the facial information received from the device and recognizes the facial contours and features. The server then receives information about the user's preferred hairstyle. The server then uses a generative AI model to generate the optimal hairstyle based on the facial information and preferences.

[1533] Step 6:

[1534] The server generates the optimal hairstyle in text and image format. The server also generates an overall coordinated image and generates an image. The server sends this information to the terminal.

[1535] Step 7:

[1536] The terminal displays the proposal received from the server. The user checks the proposed hairstyle and overall coordinated image. The user clicks the "Choose this style" button.

[1537] Step 8:

[1538] The server obtains the user's current location information (e.g., GPS data) and searches for information on nearby beauty salons and hairdressers. The server then sends the search results in a list format to the device.

[1539] Step 9:

[1540] The terminal displays the list of candidate hair salons and hair stylists received from the server to the user. The user selects "Hair Salon A" and clicks the "Book Now" button.

[1541] Step 10:

[1542] The terminal sends the information about the beauty salon selected by the user and the desired reservation date and time to the server, and displays a notification to the user indicating that the reservation request has been sent.

[1543] Step 11:

[1544] The server processes the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal.

[1545] Step 12:

[1546] The terminal displays the confirmation message received from the server to the user. The message "Reservation completed" is displayed and the process ends.

[1547] Example 1

[1548] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1549] With conventional systems, it takes a lot of time and effort for users to find a hairstyle that suits their facial features. Even if they find the perfect hairstyle, it is difficult to easily find and book a salon or hairdresser who can create that hairstyle. To solve these problems, a system is needed that can automatically generate an optimal hairstyle and overall coordination image based on the user's facial information and preferred hairstyle information, and then efficiently search for and book salons and hairdressers who can create that hairstyle.

[1550] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1551] In this invention, the server includes means for acquiring user face information, means for acquiring user preferred hairstyle information, means for using a generative model that generates an optimal hairstyle and overall coordinated image based on the user's face information and preferred hairstyle information, means for presenting the generated hairstyle and coordinated image to the user, means for searching for information on treatment locations and practitioners who can realize the presented hairstyle and coordinated image, means for presenting the searched information on treatment locations and practitioners to the user and sending a reservation request, and means for processing the reservation request and sending a reservation confirmation message to the user. This allows the user to easily find the optimal hairstyle and coordination based on their own face information and preferences, quickly find the treatment locations and practitioners that can realize it, and complete the reservation.

[1552] The "means for acquiring user's facial information" refers to the means by which a user accesses the system and inputs his or her facial information by taking an image or video.

[1553] The "means for acquiring information on a user's preferred hairstyle" is a means for a user to access the system and input a desired hairstyle in text format.

[1554] "Means for using a generative model" refers to means for using a generative AI model that is used to generate an optimal hairstyle and overall coordinated image based on the user's facial information and preferred hairstyle information.

[1555] The "means for presenting the generated hairstyle and coordinated image to the user" refers to a means for transmitting the hairstyle and coordinated image generated by the server to the terminal and displaying it to the user.

[1556] "Means for searching for information on treatment locations and practitioners" refers to the means by which the system searches for information on the most suitable beauty salon or hairdresser from a database or other information source based on the user's current location information, etc.

[1557] "Means for presenting the searched information on treatment locations and practitioners to the user and sending a reservation request" refers to means for displaying candidate treatment locations and practitioners to the user, allowing the user to select the desired treatment location or practitioner and send a reservation request.

[1558] The "means for processing reservation requests and sending reservation confirmation messages to users" refers to the means by which the system receives reservation requests from users, confirms the reservations in cooperation with affiliated reservation systems, and sends confirmation messages to users.

[1559] This invention makes it easier for users to achieve their ideal hairstyle by performing a series of processes involving the user, the terminal, and the server. Below, we will explain how to specifically implement this system.

[1560] This system acquires the user's facial information and preferred hairstyle information, and then uses a generative AI model to generate the optimal hairstyle and overall coordination image based on that information. The generated information is presented to the user, who can then search for and book treatment locations and therapists who can achieve that hairstyle.

[1561] First, a user opens the system's application or website on their device. The device can be a smartphone, tablet, or PC. The user selects the "Enter Face Information" option and takes a photo or video. The camera function is used to take a photo of the user's face, which the device then sends to the server as face information. The user is then presented with a progress bar and a confirmation message indicating that the face information has been successfully sent.

[1562] Next, the user enters the desired style in text format in the "Enter your preferred hairstyle" field. For example, if the user enters "I like long, natural hair," the device will send this information to the server. A confirmation message will be displayed to the user.

[1563] The server uses a generative AI model to generate the optimal hairstyle based on the facial information and preferred hairstyle information received from the device. The generated hairstyle is best suited to the user's facial contours and features, and an overall coordinated image is also generated. The generative AI model used here is trained using a specific dataset.

[1564] The generated hairstyles and coordinated images are sent from the server to the terminal, which then displays them to the user. The user can check the proposed hairstyles and select the one they like best.

[1565] If the user is satisfied with the proposed hairstyle, the system searches for nearby salons and hairdressers based on the user's current location. The server retrieves this information from a database, and a list of candidates is displayed on the device. The user selects a specific salon or hairdresser and clicks the "Book Now" button, sending the selection and desired appointment date and time to the server.

[1566] The server receives the reservation request and confirms the reservation by coordinating with the relevant beauty salon's reservation system. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user, and the process ends.

[1567] Here are some examples of prompts to input to a generative AI model:

[1568] Generate the most suitable hairstyle based on the user's face information and preferred hairstyle information. The user wants natural long hair. The user's face is round. Please provide an image of the overall outfit along with the generated hairstyle.

[1569] In this way, by using the system of the present invention, a user can easily find the optimal hairstyle and coordination based on their facial information and preferences, quickly find the treatment location and practitioner to achieve it, and complete the reservation.

[1570] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1571] Step 1:

[1572] The user opens an application or website on their device, selects the "Enter Face Information" option, and takes a photo or video.

[1573] Input: User action (face photo or video)

[1574] Output: Captured image data

[1575] Specific behavior:

[1576] A user taps an app on their smartphone to launch it.

[1577] The user clicks the "Enter Face Information" button and takes a photo of their face using the camera function.

[1578] The device saves the captured image data and stores it in temporary memory.

[1579] Step 2:

[1580] The face information received by the device is sent to the server.

[1581] Input: Photographed image data

[1582] Output: Face information sent to the server

[1583] Specific behavior:

[1584] The device encodes the image data and sends it to the server as an HTTP request.

[1585] The terminal displays a transmission progress bar and provides a confirmation message to the user that the transmission is complete.

[1586] Step 3:

[1587] The user enters the desired style in the "Enter your desired hairstyle" field.

[1588] Input: User text input (desired hairstyle)

[1589] Output: The input text data

[1590] Specific behavior:

[1591] The user enters "I want natural long hair" in the text field and presses the submit button.

[1592] The device captures and temporarily stores the text data.

[1593] Step 4:

[1594] The terminal transmits the input hairstyle information to the server.

[1595] Input: Text data (preferred hairstyle information)

[1596] Output: Hair style information sent to the server

[1597] Specific behavior:

[1598] The terminal encodes the text data and sends it to the server as an HTTP request.

[1599] The terminal displays a message to the user confirming that transmission is complete.

[1600] Step 5:

[1601] Based on the facial information and hairstyle information received by the server, the optimal hairstyle is generated using a generative AI model.

[1602] Input: Face information, hairstyle information

[1603] Output: Generated hairstyle and outfit image

[1604] Specific behavior:

[1605] The server decodes the received face information and hairstyle information.

[1606] The server sends a request to the generated AI model using a prompt sentence.

[1607] Example prompt: "Generate the most suitable hairstyle based on the user's facial information and preferred hairstyle information."

[1608] The server examines the generated results returned by the generative AI model and also adds an overall coordinated image.

[1609] Step 6:

[1610] The server transmits the generated hairstyle and coordinated image to the terminal.

[1611] Input: Generated hairstyle and outfit image

[1612] Output: Hairstyle and outfit image sent to the device

[1613] Specific behavior:

[1614] The server encodes the generated result and sends it to the terminal as an HTTP response.

[1615] Step 7:

[1616] The terminal displays the received data to the user.

[1617] Input: Response data from the server

[1618] Output: Hairstyle and outfit image displayed to the user

[1619] Specific behavior:

[1620] The device decodes the response data and displays an image of the hairstyle and outfit on the screen.

[1621] Step 8:

[1622] If the user is satisfied with the suggested hairstyle, the system will search for nearby hair salons and hairdressers based on the user's current location information.

[1623] Input: User's current location information

[1624] Output: List of treatment locations and practitioner candidates

[1625] Specific behavior:

[1626] The user selects "Use this style" and clicks the reservation button.

[1627] The device uses the GPS function to obtain the current location information and sends it to the server.

[1628] The server queries and retrieves information about nearby hair salons and hairdressers from a database.

[1629] Step 9:

[1630] The server transmits the acquired information about the treatment location and the practitioner to the terminal.

[1631] Input: Salon and stylist information retrieved from a database

[1632] Output: Candidate list sent to the terminal

[1633] Specific behavior:

[1634] The server encodes the acquired information and sends it to the terminal.

[1635] Step 10:

[1636] The terminal displays a list of potential hair salons and hairstylists to the user.

[1637] Input: Response data from the server

[1638] Output: The candidate list displayed to the user

[1639] Specific behavior:

[1640] The device decodes the candidate list and displays it on the screen.

[1641] Step 11:

[1642] The user selects a particular salon or hairdresser and clicks the "Book Now" button.

[1643] Input: User selection information, desired reservation date and time

[1644] Output: Selection information and desired reservation date and time

[1645] Specific behavior:

[1646] The user selects one of the displayed options and clicks the reservation button.

[1647] The terminal transmits the selected candidate and the desired date and time to the server.

[1648] Step 12:

[1649] The server processes the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon.

[1650] Input: Reservation Request

[1651] Output: Reservation confirmation message

[1652] Specific behavior:

[1653] The server decodes the received request and records the reservation information.

[1654] The server sends an API request to the salon's reservation system to confirm the reservation.

[1655] Step 13:

[1656] The server generates a reservation confirmation message and sends it to the terminal.

[1657] Input: Confirmed reservation information

[1658] Output: Reservation confirmation message

[1659] Specific behavior:

[1660] The server generates a message notifying the completion of the reservation, encodes it, and sends it to the terminal.

[1661] The terminal displays a confirmation message to the user saying "Reservation completed."

[1662] (Application example 1)

[1663] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1664] Conventional hairstyle suggestion systems have difficulty generating optimal hairstyles based on a user's facial information and preferred style information, and also have the problem of making it difficult to search for and book beauty salons and hairdressers. In particular, there has been a lack of individually customized hairstyle suggestions based on facial information, and reservation systems that respond to real-time beauty salon availability.

[1665] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1666] In this invention, the server includes means for acquiring user facial information, means for acquiring user preferred hairstyle information, means for using a generative AI model to generate an optimal hairstyle based on the user's facial information and preferred hairstyle information, means for presenting the generated hairstyle information to the user, means for searching for information on salons and technicians who can realize the presented hairstyle information, means for presenting the searched information on salons and technicians to the user and sending a reservation request, and means for processing the reservation request and sending a reservation confirmation message to the user. This allows the user to generate an optimal hairstyle based on their facial information and preferences, quickly and easily find a beauty salon or hairdresser to realize that style, and complete the reservation.

[1667] "User facial information" refers to image data containing a user's facial features or other biometric information.

[1668] "User's favorite hairstyle information" is information about a hairstyle desired by the user, and is expressed in the form of text, an image, or the like.

[1669] A "generative AI model" is an artificial intelligence model that is trained to generate optimal outputs based on input data.

[1670] "Generated hairstyle information" refers to information about hairstyles generated by a generative AI model based on the user's facial information and preferred hairstyle information.

[1671] The "presentation means" refers to a method or device for visually displaying the generated hairstyle information and search results to the user.

[1672] "Store and technician information" refers to data that includes information about service providers such as beauty salons and hairdressers.

[1673] A "search method" is an algorithm or process used to retrieve targeted information from a database based on specific criteria.

[1674] The "means for sending a reservation request" refers to a communication means for sending a reservation request to the store or technician selected by the user.

[1675] A "reservation confirmation message" is a confirmation message indicating that a reservation request has been confirmed.

[1676] The system of the present invention creates an optimal hairstyle based on facial information and preferred hairstyle information, making it easier for users to achieve their ideal hairstyle, and then searches for and reserves salons and technicians who can achieve that style. In this embodiment, a smartphone and a cloud server are used.

[1677] Program processing

[1678] 1. Acquiring and sending face information

[1679] The user takes a photo of their face using a device (smartphone). The captured facial information is sent to a cloud server as image data. This requires the smartphone's camera as hardware and the ability to import image data and send it to the server as software. Specifically, a face recognition library (e.g., OpenCV) is used.

[1680] 2. Acquisition and transmission of preferred hairstyle information

[1681] The user inputs their desired hairstyle in text format on the device. The input text information is sent to the server, where it is analyzed by a natural language processing engine.

[1682] 3. Hairstyle generation

[1683] The cloud server combines the acquired facial information with the desired hairstyle information and generates the optimal hairstyle using a generative AI model (e.g., Stable Diffusion). In this process, the AI ​​model analyzes and synthesizes facial features and hairstyle elements. The generated hairstyle image is sent from the cloud server to the device.

[1684] 4. Presenting the proposal

[1685] The terminal visually presents the generated hairstyle information received from the server to the user, allowing the user to confirm the proposed style.

[1686] 5. Search for and book a store or technician

[1687] Based on the device's location, the server searches a database of nearby hairdressers and salons and presents the most suitable candidates to the user. The user then selects a salon and technician from the list and submits a reservation request.

[1688] 6. Confirmation of reservation and confirmation message

[1689] The server processes the received reservation request and confirms the reservation in cooperation with the reservation system of the relevant store. A confirmation message of the reservation completion is sent to the user's terminal and displayed to the user.

[1690] Specific examples

[1691] User operation procedure

[1692] 1. The user opens the smartphone app, uses the "take photo" function to take a photo of their face, and uploads it to the system.

[1693] 2. The user types "Bob cuts are good" in the text field and presses the submit button.

[1694] 3. The user checks the optimal hairstyle and outfit image displayed on their smartphone.

[1695] 4. When the user selects "Get this style," the system will display a list of nearby salons and stylists.

[1696] 5. The user selects "Beauty Salon B" and clicks the "Book Now" button.

[1697] 6. The cloud server will confirm the reservation and the device will display a confirmation message saying "Reservation completed."

[1698] Example prompts for generative AI models

[1699] Generate a "Bob Cut" hairstyle based on the user's face photo.

[1700] In this way, users can easily find their ideal hairstyle, quickly and easily find a hair salon or hairdresser to help them achieve it, and complete a reservation.

[1701] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1702] Step 1:

[1703] A user takes a photo of their face with a device (smartphone) and sends the facial information to a cloud server. The device's camera is used to capture the image data, which is then uploaded directly to the cloud server. The input is the user's facial photo, and the output is the image data sent to the server.

[1704] Step 2:

[1705] The user inputs information about their preferred hairstyle in text format into the device and sends it to the cloud server. The device receives the user's input as text data and sends it to the cloud server. The input is the text information entered by the user, and the output is the text data sent to the server.

[1706] Step 3:

[1707] The cloud server uses a generative AI model based on facial information and preferred hairstyle information to generate the optimal hairstyle. The server converts image data and text data into a prompt sentence, inputs it into the AI ​​model, and outputs a generated hairstyle image. The input is facial image data and text information, and the output is a generated hairstyle image. An example of a prompt sentence: "Generate a 'bob cut' hairstyle based on the user's facial photo."

[1708] Step 4:

[1709] The cloud server sends the generated hairstyle image to the terminal. The server then sends the generated image data to the terminal using existing communication means, and the terminal performs reception processing. The input is the generated hairstyle image, and the output is the image data sent to the terminal.

[1710] Step 5:

[1711] The device presents the received hairstyle image to the user. The device renders the image data on a display screen so that the user can view it. The input is the received hairstyle image, and the output is the image displayed on the device screen.

[1712] Step 6:

[1713] Based on the hairstyle information provided by the user, the system requests a search for salons and technicians who can create that style. When the user clicks the "Search" button on their device, the request is sent to the cloud server. The input is the user's search request, and the output is the data sent to the cloud server.

[1714] Step 7:

[1715] The cloud server searches the database for the most suitable hair salon and technician based on the user's location and hairstyle information, and sends the results to the device. The server processes the location and hairstyle information as a search query and retrieves a list of candidates from the database. The input is the user's location and hairstyle information, and the output is a list of search results.

[1716] Step 8:

[1717] The terminal presents the search results to the user and sends a reservation request. The terminal renders a candidate list on the display screen and allows the user to select the desired store and technician. The input is the list of search results, and the output is a reservation request based on the list displayed on the terminal screen and the store and technician selected by the user.

[1718] Step 9:

[1719] The cloud server processes the received reservation request and confirms the reservation in conjunction with the relevant store's reservation system. The server analyzes the request data and connects to the store's reservation system via an API. The input is the reservation request data, and the output is the confirmed data sent to the store's reservation system.

[1720] Step 10:

[1721] The cloud server generates a reservation confirmation message and sends it to the terminal. The server generates a confirmation message based on the reservation confirmation data and sends it to the terminal. The input is the reservation confirmation data, and the output is the reservation confirmation message sent to the terminal.

[1722] Step 11:

[1723] The terminal presents the received reservation confirmation message to the user and ends the process. The terminal renders the confirmation message on the display screen for the user to review. The input is the reservation confirmation message and the output is the message displayed on the terminal screen.

[1724] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1725] The system of the present invention is designed to make it easier for users to achieve their ideal hairstyle by performing a series of processes involving the user, terminal, server, and emotion engine. The program of this system executes the following processes.

[1726] Explanation of program processing

[1727] Acquiring and transmitting facial and emotional information

[1728] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or records a video. The device receives these inputs and uses the emotion engine to analyze the user's facial expressions and obtain emotional information. The obtained facial and emotional information is stored on the device and sent to the server. A progress bar and a confirmation message for sending are displayed to the user.

[1729] Acquisition and transmission of preferred hairstyle information

[1730] Next, the user enters the desired style in the "Enter your preferred hairstyle" field. For example, if the user enters "I like long natural hair," the terminal will send this information to the server. A confirmation message will be displayed to the user confirming the completion of the transmission.

[1731] Hairstyle generation

[1732] The server uses a generative AI model to generate the optimal hairstyle based on the facial information, emotional information, and preferred hairstyle information received from the device. This generated hairstyle is best suited to the user's facial contours and features. An overall coordinated image is also generated.

[1733] Presenting the proposal

[1734] The server sends the generated hairstyle and overall coordinated image to the terminal, which displays them to the user. The user checks the proposed hairstyle and decides whether or not they want to adopt it.

[1735] Search and book salons and hairdressers

[1736] If the user is satisfied with the proposed hairstyle, the system searches for a nearby hair salon or hair stylist based on the user's current location. This information is retrieved by the server from a database, and a list of candidates is displayed on the device. When the user selects a specific salon or hair stylist and clicks the "Book Now" button, the device sends this selection and the desired appointment date and time to the server.

[1737] Confirmation of reservation and confirmation message

[1738] The server receives the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user and ends the process.

[1739] Specific examples

[1740] User Example

[1741] 1. The user opens the app on their smartphone, selects "Take a photo," takes a photo of their face, and uploads it to the system. At this time, the emotion engine reads emotional information from their facial expressions.

[1742] 2. The user enters "I want natural long hair" in the text field and presses the submit button.

[1743] 3. The user checks the optimal hairstyle and overall coordination image displayed on the device.

[1744] 4. The user selects "Get this style" and the system displays nearby salons and stylists.

[1745] 5. The user selects "Beauty Salon A" and clicks the "Book Now" button.

[1746] 6. The server will confirm the reservation and a reservation confirmation message will appear on the device, confirming that "Reservation completed."

[1747] In this way, by using the system of the present invention, users can easily find the optimal hairstyle based on their facial information and preferences, quickly find the hair salon or hairdresser who can create that hairstyle, and complete the reservation.The introduction of an emotion engine makes it possible to suggest hairstyles that reflect the user's current emotions, allowing for the provision of more personalized services.

[1748] The processing flow will be explained below.

[1749] Step 1:

[1750] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or video. The face information is saved on the device.

[1751] Step 2:

[1752] The device passes the stored facial information to the emotion engine, which extracts emotional information from the user's facial expressions. The emotional information is then sent to the server along with the facial information. A progress bar and a confirmation message are displayed to the user.

[1753] Step 3:

[1754] The user inputs the desired hairstyle in the "Enter your desired hairstyle" field. For example, the user inputs "I like long natural hair." The user confirms the input and presses the "Submit" button.

[1755] Step 4:

[1756] The terminal sends the user's preferred hairstyle information in text format to the server, and a confirmation message is displayed to the user to confirm that the transmission has been completed.

[1757] Step 5:

[1758] The server analyzes the facial information, emotional information, and preferred hairstyle information received from the device. The emotional information obtained by the emotion engine is combined and the optimal hairstyle is generated using a generative AI model.

[1759] Step 6:

[1760] The server generates the optimal hairstyle in text and image format, and also generates an overall coordinated image, and sends this information to the terminal.

[1761] Step 7:

[1762] The terminal displays the proposal received from the server. The user checks the proposed hairstyle and overall coordinated image. The user clicks the "Choose this style" button.

[1763] Step 8:

[1764] The server obtains the user's current location information (e.g., GPS data) and searches for information on nearby beauty salons and hairdressers. The server then sends the search results in a list format to the device.

[1765] Step 9:

[1766] The terminal displays the list of candidate hair salons and hair stylists received from the server to the user. The user selects "Hair Salon A" and clicks the "Book Now" button.

[1767] Step 10:

[1768] The terminal sends the information about the beauty salon selected by the user and the desired reservation date and time to the server, and displays a notification to the user indicating that the reservation request has been sent.

[1769] Step 11:

[1770] The server processes the reservation request and confirms the reservation in cooperation with the reservation system of the relevant beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal.

[1771] Step 12:

[1772] The terminal displays the confirmation message received from the server to the user. The message "Reservation completed" is displayed and the process ends.

[1773] Example 2

[1774] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1775] Conventional hairstyle suggestion systems rarely take into account the user's emotional information, making it difficult for users to easily find a hairstyle that actually satisfies them. In addition, the process of searching for and booking beauty facilities and beauty professionals is complicated, preventing users from receiving appropriate services quickly.

[1776] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1777] In this invention, the server includes means for acquiring user facial information, means for analyzing user emotional information, means for acquiring user preferred hairstyle information, means for generating an optimal hairstyle based on the user's facial information, emotional information, and preferred hairstyle information, means for presenting the generated hairstyle and an overall coordinated image to the user, means for searching for information on beauty facilities and beauty professionals who can realize the presented hairstyle, means for presenting the searched information on beauty facilities and beauty professionals to the user and sending a reservation request, and means for processing the reservation request and sending a reservation confirmation message to the user. This enables a user to easily find an optimal hairstyle based on their facial information and preferences, quickly find a beauty facility or beauty professional who can realize that hairstyle, and complete the reservation.

[1778] The "means for acquiring user's face information" refers to a means for acquiring face information by the user taking a photograph or shooting a video.

[1779] The "means for analyzing the user's emotional information" is a means for analyzing facial photos and videos taken by the user and obtaining emotional information from facial expressions using an emotion engine.

[1780] The "means for acquiring information on the user's preferred hairstyle" is a means for the user to input the hairstyle he or she desires in text format or in a selection format.

[1781] The "means for generating an optimal hairstyle" is a means for generating a hairstyle that is most suitable for a user using a generative AI model based on the user's facial information, emotional information, and preferred hairstyle information.

[1782] The "means for presenting the generated hairstyle and overall coordinated image to the user" is a means for displaying the generated hairstyle information and the corresponding overall coordinated image on the user's terminal.

[1783] The "means for searching for information on beauty facilities and beauty workers" is a means for searching a database for the most suitable beauty facilities and beauty workers based on the user's location information.

[1784] "Means for presenting information to the user and sending a reservation request" refers to means for displaying information on searched beauty facilities and beauty professionals on the user's terminal, allowing the user to select a specific facility or professional and send a reservation request.

[1785] The "means for sending a reservation confirmation message to the user" is a means for processing a reservation request and sending a confirmation message to the user's terminal indicating that the reservation has been confirmed.

[1786] The system of the present invention is designed to make it easier for users to achieve their ideal hairstyle by performing a series of processes involving the user, terminal, server, and emotion engine. The program of this system executes the following processes.

[1787] The user opens a system application or website on their device. The user selects the "Enter Face Information" option and takes a photo or records a video. The device receives these inputs, analyzes the user's facial expressions with the emotion engine, and acquires emotional information. The acquired facial and emotional information is stored on the device and sent to the server. As a specific example, the Microsoft Azure Emotion API can be used.

[1788] Next, the user enters the desired style in the "Enter your preferred hairstyle" field. For example, if the user enters "I like long natural hair," the terminal will send this information to the server. A confirmation message will be displayed to the user confirming the completion of the transmission.

[1789] The server uses a generative AI model to generate the optimal hairstyle based on the facial information, emotional information, and preferred hairstyle information received from the device. Generative AI models such as OpenAI's GPT-3 can be used. The generated hairstyle is best suited to the user's facial contours and features. An overall coordinated image is also generated.

[1790] The server sends the generated hairstyle and overall coordinated image to the terminal, which displays them to the user. The user checks the proposed hairstyle and decides whether or not they want to adopt it.

[1791] If the user is satisfied with the proposed hairstyle, the system searches for a nearby hair salon or hair stylist based on the user's current location. This information is retrieved by the server from a database, and a list of candidates is displayed on the device. When the user selects a specific salon or hair stylist and clicks the "Book Now" button, the device sends this selection and the desired appointment date and time to the server.

[1792] The server receives the reservation request and confirms the reservation by connecting with the relevant beauty salon's reservation system. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user, and the entire process is completed.

[1793] Specific examples

[1794] User Example

[1795] 1. The user opens the app on their smartphone, selects "Take a photo," takes a photo of their face, and uploads it to the system. At this time, the emotion engine reads emotional information from their facial expressions.

[1796] 2. The user enters "I want natural long hair" in the text field and presses the submit button.

[1797] 3. The user checks the optimal hairstyle and overall coordination image displayed on the device.

[1798] 4. The user selects "Get this style" and the system displays nearby salons and stylists.

[1799] 5. The user selects "Beauty Salon A" and clicks the "Book Now" button.

[1800] 6. The server will confirm the reservation and a reservation confirmation message will appear on the device, confirming that "Reservation completed."

[1801] Example prompts to input to the generative AI model

[1802] "Analyze the user's facial photo and obtain emotional information using the emotion engine. Next, generate the optimal hairstyle based on the user's desired hairstyle. Send the generated hairstyle and the overall coordinated image to the user's device."

[1803] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1804] Step 1:

[1805] A user opens a system application or website on a smartphone or computer. When the application is launched, a screen appears where the user can select the "Enter Face Information" option.

[1806] Input: Launch application

[1807] Output: Display of face information input screen

[1808] Step 2:

[1809] The user selects the "Enter Face Information" option and takes a photo or video. The device activates the camera and captures the user's face information.

[1810] Input: User's choice of taking a photo or video

[1811] Output: Acquire and save face information

[1812] Step 3:

[1813] The device inputs stored photos and videos into the emotion engine, which analyzes the user's facial expressions to obtain emotional information. Specifically, the emotion engine detects facial features and classifies emotions.

[1814] Input: Photo or video data

[1815] Output: Emotional information

[1816] Step 4:

[1817] The device transmits the acquired facial and emotional information to the server, at which point a progress bar and a confirmation message are displayed to the user.

[1818] Input: Face and emotion information

[1819] Output: Send data to the server, display confirmation message

[1820] Step 5:

[1821] The user enters the desired hairstyle in the "Enter your preferred hairstyle" field. The device sends this input to the server. For example, a user might enter "I like natural long hair."

[1822] Input: Hair style information by text input

[1823] Output: Send text data to the server

[1824] Step 6:

[1825] The server receives facial information, emotional information, and preferred hairstyle information sent from the device and prepares this data to be input into the generative AI model.

[1826] Input: Face information, emotion information, hairstyle information

[1827] Output: Data preparation for input to a generative AI model

[1828] Step 7:

[1829] The server uses a generative AI model to generate the optimal hairstyle, taking into account facial contours, features, and emotional information during the generation process. An example of a generative AI model is OpenAI's GPT-3.

[1830] Input: Face information, emotion information, hairstyle information

[1831] Output: Optimal hairstyle and overall coordination image

[1832] Step 8:

[1833] The server transmits the generated hairstyle and coordinated image to the terminal.

[1834] Input: Results from a generative AI model

[1835] Output: Sending data to the terminal

[1836] Step 9:

[1837] The terminal displays the suggested hairstyle and coordinated image to the user. The user checks the displayed information and selects whether or not to adopt the style.

[1838] Input: Proposal data from the server

[1839] Output: Display to user, display of selection screen

[1840] Step 10:

[1841] When the user selects "Choose this style," the system searches for nearby beauty salons and professionals based on the user's current location. The server retrieves this information from a database and creates a list of candidates.

[1842] Input: User selection, location information

[1843] Output: Creating a candidate list

[1844] Step 11:

[1845] The server sends a list of candidate beauty facilities and beauty professionals to the terminal.

[1846] Input: Information on beauty facilities and beauty professionals

[1847] Output: Sending data to the terminal

[1848] Step 12:

[1849] The terminal displays a list of potential beauty facilities and beauty professionals to the user, who then selects a specific beauty facility or beauty professional and clicks the "Book Now" button.

[1850] Input: candidate list

[1851] Output: Display to user, reservation selection

[1852] Step 13:

[1853] The terminal transmits the selection information and the desired reservation date and time to the server.

[1854] Input: Selection information, desired reservation date and time

[1855] Output: Reservation request sent to server

[1856] Step 14:

[1857] The server receives the reservation request and confirms the reservation in cooperation with the reservation system of the related beauty facility.

[1858] Input: Reservation Request

[1859] Output: Reservation confirmed

[1860] Step 15:

[1861] The server generates a reservation confirmation message and sends it to the terminal.

[1862] Input: Confirmed reservation information

[1863] Output: Reservation confirmation message

[1864] Step 16:

[1865] The terminal will display a reservation confirmation message to the user and the process will be complete.

[1866] Input: Reservation confirmation message

[1867] Output: Display a confirmation message to the user

[1868] (Application example 2)

[1869] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1870] Conventional hairstyle suggestion systems make suggestions based only on the user's facial information and preferred hairstyle information, and therefore are unable to consider the user's emotional state or overall coordination. Furthermore, the system's operation is cumbersome, and it is not possible to centrally manage reservations with beauty salons and hairdressers, resulting in a poor user experience. Therefore, there is a need for a system that can make more accurate hairstyle suggestions that incorporate the user's emotional information, as well as a system that enables easy reservation management with beauty salons and hairdressers.

[1871] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1872] In this invention, the server includes a means for acquiring the user's facial information, a means for analyzing and acquiring the user's emotional information, and a means for acquiring the user's preferred hairstyle information. This makes it possible to generate an optimal hairstyle based on the user's facial information, emotional information, and preferred hairstyle information, and to present the generated hairstyle information and an overall coordinated image to the user. Furthermore, a system is provided that allows users to easily search for beauty salons and hairdressers and manage reservations based on this information.

[1873] A "user" is a person who uses the system and provides his or her facial information and hairstyle preferences.

[1874] "Facial information" is image data of the user's face, and is obtained by photographing or videotaping.

[1875] "Emotion information" is data that represents the emotional state of the user analyzed from facial information.

[1876] "Preferred hairstyle information" refers to information about a hairstyle desired by the user, including information input in text format.

[1877] The "optimal hairstyle" is a hairstyle suggested using a generative AI model based on the user's facial information, emotional information, and preferred hairstyle information.

[1878] The "overall coordinated image" is information that includes an image of the overall fashion and styling that is proposed along with the user's optimal hairstyle.

[1879] A "beauty salon" refers to a hair salon that a user visits to achieve a hairstyle.

[1880] A "hairdresser" is a professional who styles the user's hairstyle.

[1881] A "reservation request" is a request made by a user to a specific beauty salon or hairdresser to have a hairstyle performed.

[1882] An "appointment confirmation message" is a message containing confirmation information that is sent to a user after an appointment with a salon or hairdresser has been confirmed.

[1883] A system for implementing the present invention provides a function in which a user inputs their own facial information, emotional information, and preferred hairstyle information using a device such as a smartphone or tablet terminal, and the system suggests the most suitable hairstyle based on that information. This system mainly includes the following means:

[1884] 1. Acquiring user's facial and emotional information

[1885] The user takes a photo of their face using the device's camera and saves it as image data. This image data is then used by the emotion engine to analyze and extract emotional information from the user's facial expressions. The software used is OpenCV and the DeepFace library.

[1886] 2. Obtaining user's preferred hairstyle information

[1887] The user enters their preferred hairstyle information using a text input field, which is sent to the server and serves as input data for future hairstyle generation.

[1888] 3. Generating the best hairstyle

[1889] The server uses a generative AI model to generate the optimal hairstyle based on the facial information, emotional information, and preferred hairstyle information sent by the user. This generative AI model takes into account the user's facial contours, features, and emotional state to suggest the most suitable hairstyle. An overall coordinated image is also generated.

[1890] 4. Presenting the proposal

[1891] The generated hairstyle and overall coordinated image are sent to the user's terminal, which displays them to the user. The user checks the proposed hairstyle and judges their satisfaction.

[1892] 5. Search and book salons and hairdressers

[1893] If the user is satisfied with the proposed hairstyle, the system searches for nearby salons and hairdressers based on the user's current location. This information is obtained from a database on the server. The search results are displayed on the user's device, and the user can select the salon or hairdresser they want and make a reservation.

[1894] 6. Confirmation of reservation and confirmation message

[1895] When a user requests a reservation, the information is processed on the server side and the reservation is confirmed officially in cooperation with the reservation system of the related beauty salon. Once the reservation is completed, the server generates a reservation confirmation message and sends it to the terminal. The terminal displays this confirmation message to the user and ends the process.

[1896] Specific examples

[1897] 1. The user takes a photo of their face using a tablet device and uploads it to the system. At this time, the emotion engine analyzes the facial expression to determine the emotion of "joy."

[1898] 2. The user enters "I want long natural hair" in the text field and submits it to the server.

[1899] 3. The server uses a generative AI model to generate the optimal hairstyle and overall coordinated image based on the user's facial information, emotional information, and preferred hairstyle information.

[1900] 4. The user checks the optimal hairstyle and overall coordination image displayed on the device.

[1901] 5. The user selects "nearby beauty salon A" and makes a reservation on the system.

[1902] 6. The server confirms the reservation and sends a reservation confirmation message to the device, which displays "Reservation completed."

[1903] Prompt Sentence Examples

[1904] Face information: face.jpg

[1905] Desired hairstyle: Natural long hair

[1906] Predominant emotion: Joy

[1907] Suggested style: Natural long hairstyle that emphasizes joy

[1908] Using this system, users can easily find the optimal hairstyle based on their facial information and emotional state, quickly find the salon or hairdresser who can create that hairstyle, and complete the reservation.

[1909] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1910] Step 1:

[1911] The user takes a photo of his or her face using the camera on the terminal and stores the image data in the terminal.

[1912] Specific operation: The user opens the application on the device and uses the camera function to take a photo of their face. The captured image is then saved in the device's storage.

[1913] Input: Face photo

[1914] Output: Saved face photo data

[1915] Step 2:

[1916] The device uses the DeepFace library to analyze the user's emotional information based on the facial photos stored on the device.

[1917] Specific operation: The emotion engine receives face image data as input and performs emotion analysis using the DeepFace library. The analysis results in key emotion information.

[1918] Input: Facial photo data

[1919] Output: Emotion information (e.g., happiness, sadness)

[1920] Step 3:

[1921] The user inputs desired hairstyle information into a text input field on the terminal.

[1922] Specific actions: The user enters the desired hairstyle (e.g., natural long hair) in the text field and presses the "Submit" button.

[1923] Input: Desired hairstyle information

[1924] Output: Hair style information sent

[1925] Step 4:

[1926] The terminal transmits face information, emotion information, and preferred hairstyle information to the server.

[1927] Specific operation: The device sends the captured facial photo data, analyzed emotional information, and input hairstyle information to the server.

[1928] Input: Facial photo data, emotional information, hairstyle information

[1929] Output: Send data to the server

[1930] Step 5:

[1931] Based on the facial information, emotional information, and preferred hairstyle information received by the server, the optimal hairstyle is generated using a generative AI model.

[1932] Specific operation: The server receives this information as input, inputs prompts into the generative AI model, and generates a hairstyle. The generated hairstyle and an overall coordinated image are then obtained.

[1933] Input: Facial photo data, emotional information, hairstyle information

[1934] Output: Generated hairstyle and overall coordination image

[1935] Step 6:

[1936] The server transmits the generated hairstyle and the overall coordinated image to the terminal.

[1937] Specific operation: The server transmits the generated hairstyle data and the overall coordinate image data to the terminal.

[1938] Input: Generated hairstyle and overall coordination image

[1939] Output: Sending data to the terminal

[1940] Step 7:

[1941] The terminal displays the generated hairstyle and overall coordinated image received by the terminal to the user.

[1942] Specific operation: The terminal displays the data received from the server and allows the user to check the proposed hairstyle and overall coordination image.

[1943] Input: Generated hairstyle and overall coordination image

[1944] Output: What is displayed to the user

[1945] Step 8:

[1946] If the user is satisfied with the suggested hairstyle, the terminal searches for nearby beauty salons and hairdressers.

[1947] Specific operation: The user presses the "reserve" button, and the device sends a search request to the server based on the user's current location information.

[1948] Input: Reservation request, current location information

[1949] Output: Search request sent to the server

[1950] Step 9:

[1951] The server searches for nearby beauty salons and hairdressers and sends that information to the terminal.

[1952] Specific operation: The server searches and retrieves information about the hair salon and hairdresser from the database and sends it to the terminal.

[1953] Input: Search request, current location information

[1954] Output: Information on nearby hair salons and hairdressers

[1955] Step 10:

[1956] The terminal displays the received information about the beauty salon or hairdresser to the user, and the user selects a specific beauty salon or hairdresser and makes a reservation.

[1957] Specific operation: The terminal displays a list of potential hair salons and hairstylists to the user, and the user selects one and presses the "Book" button. The reservation information is then sent to the server.

[1958] Input: Hair salon and hairdresser information, reservation selection

[1959] Output: Send reservation information to the server

[1960] Step 11:

[1961] The server processes the reservation request and generates a reservation confirmation message to send to the terminal.

[1962] Specific operation: The server confirms the reservation request in cooperation with the beauty salon's reservation system, generates a reservation confirmation message and sends it to the terminal.

[1963] Input: Reservation information

[1964] Output: Reservation confirmation message

[1965] Step 12:

[1966] The terminal displays a reservation confirmation message to the user, and the process ends.

[1967] Specific operation: The terminal displays the reservation confirmation message received from the server to the user, and the user confirms that the reservation has been completed.

[1968] Input: Reservation confirmation message

[1969] Output: What is displayed to the user

[1970] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1971] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1972] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1973] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1974] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1975] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1976] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1977] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1978] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1979] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1980] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1981] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1982] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1983] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1984] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1985] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1986] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1987] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1988] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1989] The above-described description and illustrations are a detailed explanation of ...

Claims

1. A means for acquiring face information of a user; A means for acquiring information on a user's preferred hairstyle; means for generating an optimal hairstyle based on the user's face information and preferred hairstyle information; means for presenting the generated hairstyle information to a user; A means for searching for information on beauty salons and hairdressers who can realize the presented hairstyle information; means for presenting the searched information of the beauty salon or hairdresser to the user and sending a reservation request; means for processing the reservation request and sending a reservation confirmation message to the user; A system including:

2. 2. The system according to claim 1, wherein the means for acquiring the user's face information is means for acquiring the face information through photographing or video recording.

3. 2. The system according to claim 1, wherein the means for acquiring the user's preferred hairstyle information is a means for inputting the user's desired hairstyle in text format.

Images