System

Abstract

A system is provided.SOLUTION: A system comprising: means for a user to input a name, a mail address, and a password and perform registration; means for an illustrator to input an amount of money and a sample image and create profile information; means for a client to input text information and generate a sketch or a rough picture using a generation AI; means for the client to view profile information of illustrators, select a corresponding illustrator, and transmit request content; and communication means that enables messages to be exchanged between the illustrator and the client.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Current image generation AI services allow even those who are not good at drawing to easily generate illustrations from text. However, the generated illustrations often have issues such as blurred details and unnatural shapes, so there is still a demand for outsourcing the illustrations to other people. Additionally, misunderstandings and lack of communication between illustrators and clients are also issues. This invention aims to solve these issues, streamlining the matching process between illustrators and clients, and reducing misunderstandings between the two parties by utilizing AI-based sketch generation. [Means for solving the problem]

[0005] This invention solves the above problem by providing a system that includes: a means for a user to register by inputting their name, email address, and password; a means for an illustrator to input a price and a sample image and create profile information; a means for a client to input text information and generate a sketch or rough sketch using a generation AI; a means for a client to view illustrator profile information, select a corresponding illustrator, and send the request details; and a communication means that allows the illustrator and client to exchange messages.

[0006] "User" means an individual or organization that uses the system to request or create illustrations.

[0007] An "illustrator" is an individual or group with the skills to draw illustrations upon receiving a request from a client.

[0008] "Client" refers to an individual or organization that uses the system to request an illustrator to create an illustration.

[0009] "Registration" is the process of creating an account on the system by providing your name, email address, and password.

[0010] "Profile information" refers to information that an illustrator posts on the system, including self-introduction, fees, sample images, etc.

[0011] "Generative AI" is an artificial intelligence program that automatically generates sketches and rough drawings based on text information.

[0012] A "rough sketch" refers to a sketch or rough drawing that forms the basis of the finished illustration.

[0013] A "rough sketch" is an early drawing that roughly depicts an illustration before the artist begins to draw it in detail.

[0014] "Text information" refers to written information describing the content of the illustration and instructions that the user inputs to the generating AI.

[0015] "Means of communication" refers to functions such as chat that allow illustrators and clients to exchange messages.

[0016] The "request details" are the specific details and requirements of the illustration that the client provides to the illustrator. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] ---

[0039] This invention is a system that efficiently matches users with illustrators and uses generative AI to refine rough sketches and preliminary drawings. This system is configured and operates as follows.

[0040] User Registration Module

[0041] Using the terminal, users (illustrators and clients) can register by entering their name, email address, and password, which allows them to create an account within the system.

[0042] The server receives the submitted data, performs validation (for example, checking the format of the email address, the length and complexity of the password), and then stores it in a database. If registration is successful, the server returns a message such as "Registration completed" to the terminal.

[0043] Illustrator Profile Creation Module

[0044] Using the terminal, illustrators can input their price and sample images and create profile information, which can include a self-introduction and examples of their past work.

[0045] The server receives the data and stores it in a database after validating it (for example, checking the format of the amount or the file format of the sample image). When the profile information has been created, the server returns a message to the terminal saying "Your profile has been created."

[0046] A module that uses generative AI to generate sketches / rough drawings

[0047] Using the terminal, the requester enters the text information for the desired illustration (for example, "a cat reading a book") and clicks the "Generate sketch" button.

[0048] The server receives the text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The server then receives the generated image data and sends it to the client's device. The client then checks the received sketch.

[0049] Illustrator selection and production request module

[0050] Using a terminal, the client browses the profile pages of multiple illustrators within the system, selects the illustrator who best meets their requirements, and enters details into a production request form, including details of the desired illustration and any special requirements.

[0051] The server receives the production request data and notifies the selected illustrator, who then receives the notification and confirms the details of the request.

[0052] Communication module between illustrator and client

[0053] The illustrator and client can exchange chat-style messages within the system via a terminal, allowing for detailed discussions and confirmation of corrections.

[0054] The server receives each message and forwards it to the other party's device. Messages are exchanged in real time, enabling quick communication.

[0055] Specific examples

[0056] For example, if a client requests an illustration of a cat reading a book, they can input the text information and have the AI ​​generate a rough sketch. This rough sketch can then be used to communicate with the illustrator, minimizing misunderstandings and producing the finished illustration.

[0057] In this way, this system efficiently supports the entire process, starting from user registration, selecting an illustrator, generating a rough sketch using generative AI, and communicating with the illustrator.

[0058] ---

[0059] The processing flow will be explained below.

[0060] (User registration module)

[0061] Step 1:

[0062] The user enters their name, email address, and password and clicks the Register button.

[0063] Step 2:

[0064] The terminal sends the input data to the server.

[0065] Step 3:

[0066] The server receives the submitted data and validates the name, email address, and password to ensure they are valid, for example, checking that the email address is formatted correctly and that the password is of a required length.

[0067] Step 4:

[0068] The server saves the successfully validated data to the database.

[0069] Step 5:

[0070] The server returns a message to the terminal indicating successful registration.

[0071] Step 6:

[0072] The device displays a "Registration complete" message to the user.

[0073] (Illustrator profile creation module)

[0074] Step 1:

[0075] The illustrator enters profile information including the amount and sample image, and clicks the [Save Profile] button.

[0076] Step 2:

[0077] The terminal sends the input data to the server.

[0078] Step 3:

[0079] The server receives the data sent and validates it to ensure the amount is appropriate and the file format of the sample image is correct.

[0080] Step 4:

[0081] The server saves the successfully validated data to the database.

[0082] Step 5:

[0083] The server returns a message to the device indicating that the profile was created successfully.

[0084] Step 6:

[0085] The device will display the message "Profile created" in Illustrator.

[0086] (Module that uses generative AI to generate sketches / rough drawings)

[0087] Step 1:

[0088] The client enters the text information for the illustration they want (e.g., "A cat reading a book") and clicks the "Generate sketch" button.

[0089] Step 2:

[0090] The terminal transmits the text data to the server.

[0091] Step 3:

[0092] The server receives the transmitted text data.

[0093] Step 4:

[0094] The server passes the text data to the generation AI.

[0095] Step 5:

[0096] The generative AI generates a sketch or rough drawing based on text information.

[0097] Step 6:

[0098] The server receives the generated image data.

[0099] Step 7:

[0100] The server transmits the generated image data to the client's terminal.

[0101] Step 8:

[0102] The image received by the terminal is displayed to the requester.

[0103] (Illustrator selection and production request module)

[0104] Step 1:

[0105] The client browses the profiles of multiple illustrators within the system.

[0106] Step 2:

[0107] The client selects the illustrator who best suits their requirements.

[0108] Step 3:

[0109] The requester enters details into the production request form and clicks the [Request] button.

[0110] Step 4:

[0111] The terminal transmits the production request data to the server.

[0112] Step 5:

[0113] The server receives the production request data.

[0114] Step 6:

[0115] The server sends a production request notification to the selected illustrator.

[0116] Step 7:

[0117] The illustrator will receive a notification and confirm the details of the request.

[0118] (Communication module between illustrators and clients)

[0119] Step 1:

[0120] The client or illustrator enters a message in the chat box and clicks the Send button.

[0121] Step 2:

[0122] The terminal transmits the message data to the server.

[0123] Step 3:

[0124] The server receives the message data.

[0125] Step 4:

[0126] The server forwards the received message to the other party's terminal.

[0127] Step 5:

[0128] The message received by the other terminal is displayed on the screen.

[0129] ---

[0130] In this way, this system achieves smooth communication between the user, illustrator, and client through each step.

[0131] Example 1

[0132] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0133] In modern digital art production, the challenge is to efficiently match clients with digital artists and quickly and accurately produce works that reflect their requests. Furthermore, there is a lack of systems that use generative AI to generate rough sketches and quickly exchange corrections. This creates a need for an environment that accurately reflects client requests and efficiently delivers high-quality illustrations.

[0134] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0135] In this invention, the server includes a means for a user to register by inputting their name, email address, and password, a means for a digital artist to input a price and sample images and create profile information, and a means for a client to input text information and generate a rough sketch using a generation AI. This allows a client to view the profile information of digital artists, select the artist that best suits their requirements, and submit their request, enabling rapid communication.

[0136] "User" refers to a person who uses this system, such as a client or a digital artist.

[0137] An "email address" is a personal identifier for sending and receiving messages over the Internet.

[0138] A "password" is a sequence of characters or symbols used for user authentication and to protect a user's account.

[0139] "Registration" refers to the process by which a User enters their information into the System and creates an account.

[0140] A "digital artist" is a professional who creates art using digital technology.

[0141] "Price" refers to the amount of compensation set by a digital artist for the services they provide.

[0142] "Example images" are sample images of works that digital artists have created in the past.

[0143] "Profile Information" is a collection of information about a user or digital artist, including a self-introduction, examples of past work, pricing, etc.

[0144] A "client" is a person who commissions a digital artist to create a particular piece of art.

[0145] "Text information" is text that describes the specific details and requests regarding the illustration desired by the client.

[0146] "Generative AI" is an artificial intelligence technology that automatically generates rough sketches and drafts based on given text information.

[0147] A "rough sketch" is an early sketch made before creating a finished illustration, depicting the basic composition and shapes.

[0148] A "rough sketch" is synonymous with a rough sketch, a simple sketch that forms the basis of a finished product.

[0149] "Communication means" is a function that allows clients and digital artists to exchange messages on the system to discuss details and confirm corrections.

[0150] A "database" is a system that organizes and stores information about users and digital artists.

[0151] "Saving" is the act of recording the input information in a database.

[0152] "Validation" is the process of checking whether entered data is accurate.

[0153] "Transmission" is the act of moving data from one point to another.

[0154] "Receiving" is the act of receiving transmitted data.

[0155] The above are definitions of important terms contained in the claims.

[0156] This invention is a system that efficiently matches users with digital artists and utilizes generative AI to refine rough sketches and sketches. This system is configured and operates as follows.

[0157] User Registration Module

[0158] The terminal allows the user to register by entering their name, email address, and password, which allows the user to create an account within the system.

[0159] The server receives the data and stores it in a database after validating it (for example, checking the format of the email address, the length and complexity of the password). If registration is successful, the server returns a message to the terminal saying "Registration completed."

[0160] Illustrator Profile Creation Module

[0161] The device allows digital artists to input prices and sample images and create profile information, which can include a biographical description and examples of previous work.

[0162] The server receives the data and stores it in a database after validating it (for example, checking the format of the price or the file format of the sample image). When the profile information creation is complete, the server returns a message to the terminal saying "Your profile has been created."

[0163] A module that uses generative AI to generate sketches / rough drawings

[0164] Using the terminal, the requester enters the text information for the desired illustration (for example, "a cat reading a book") and clicks the "Generate sketch" button.

[0165] The server receives the text data and prepares it for transmission to the generative AI model. The generative AI model generates a sketch or rough sketch based on the text information. The server then receives the generated image data and sends it to the client's device. The client then checks the received sketch.

[0166] Illustrator selection and production request module

[0167] Using a terminal, the client browses the profile pages of multiple digital artists within the system, selects the digital artist who best meets their requirements, and enters details into a production request form, including details of the desired illustration and any special requirements.

[0168] The server receives the production request data and notifies the selected digital artist, who then receives the notification and confirms the details of the request.

[0169] Communication module between illustrator and client

[0170] The digital artist and client exchange chat-style messages via the terminal within the system, allowing for detailed discussions and confirmation of corrections.

[0171] The server receives each message and forwards it to the other party's device. Messages are exchanged in real time, enabling quick communication.

[0172] Specific examples

[0173] For example, if a client requests an illustration of a cat reading a book, they can input the text information and have the AI ​​generate a rough sketch. Based on this rough sketch, they can communicate with the digital artist and produce the finished illustration with minimal misunderstandings.

[0174] Prompt Sentence Examples

[0175] Enter the following prompt into the generative AI model:

[0176] "Generate a rough sketch of a cat reading a book."

[0177] In this way, this system efficiently supports a series of processes, starting from user registration, selecting a digital artist, generating a sketch using generative AI, and communicating with the digital artist.

[0178] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0179] Step 1:

[0180] The user enters user information from the terminal.

[0181] The user enters their name, email address, and password and clicks the Register button.

[0182] The terminal receives the input user information and transmits it to the server.

[0183] Input data: Name, email address, password

[0184] Output data: User information sent to the server

[0185] Step 2:

[0186] The server receives and validates the user information

[0187] The server receives the name, email address, and password submitted by the user.

[0188] The server checks the format of the email address and validates the length and complexity of the password.

[0189] Input data: User information

[0190] Output data: Validation result (success or failure)

[0191] Step 3:

[0192] The server stores the user information in a database

[0193] If validation is successful, the server saves the user information in the database.

[0194] If the save is successful, the server returns a message to the terminal saying "Registration completed."

[0195] Input data: User information that has passed validation

[0196] Output data: User information stored in the database, registration completion message

[0197] Step 4:

[0198] Digital artists enter their profile information on their devices

[0199] Digital artists enter their price, sample images, a self-introduction, and examples of their past work, then click the profile creation button.

[0200] The terminal transmits this information to the server.

[0201] Input data: price, sample images, self-introduction, examples of past work

[0202] Output data: Profile information sent to the server

[0203] Step 5:

[0204] The server receives and validates the profile information

[0205] The server checks the received price, file format of the sample image, etc.

[0206] Input data: Profile information

[0207] Output data: Validation result (success or failure)

[0208] Step 6:

[0209] The server stores the profile information in a database

[0210] If validation passes, the server stores the profile information in a database.

[0211] When the creation of the profile information is complete, the server returns a message to the terminal saying "Profile created."

[0212] Input data: Validated profile information

[0213] Output data: Profile information saved in the database, profile creation completion message

[0214] Step 7:

[0215] The client enters the text information for the illustration from the device.

[0216] The client enters the text information for the desired illustration (e.g., "A cat reading a book") and clicks the "Generate sketch" button.

[0217] The terminal transmits the text information to the server.

[0218] Input data: Text information of the desired illustration

[0219] Output data: Text information sent to the server

[0220] Step 8:

[0221] The server passes the text information to the AI ​​generator, which generates a rough sketch.

[0222] The server passes the received text information to the generative AI model.

[0223] The generative AI model generates a rough sketch or outline based on text information.

[0224] Input data: Text information

[0225] Output data: Generated sketch or rough drawing

[0226] Step 9:

[0227] The server receives the generated image data and sends it to the terminal.

[0228] The server receives the image data generated from the generative AI model.

[0229] The server transmits the image data to the client's terminal and causes the client to display the image data.

[0230] Input data: Generated image data

[0231] Output data: Image data sent to the terminal, displayed sketch

[0232] Step 10:

[0233] Clients can browse multiple digital artists from their device

[0234] The client uses the device to view the profile pages of multiple digital artists.

[0235] Input data: None

[0236] Output data: Displayed digital artist profile information

[0237] Step 11:

[0238] The client fills out the production request form

[0239] The client fills out and submits a production request form, including details of the desired illustration and any special requirements.

[0240] The terminal transmits this information to the server.

[0241] Input data: Production request information

[0242] Output data: Production request information sent to the server

[0243] Step 12:

[0244] The server receives the production request data and notifies the digital artist.

[0245] The server receives production request data from the client.

[0246] The server notifies the selected digital artist of the request.

[0247] Input data: Production request information

[0248] Output data: Request details notified to the digital artist

[0249] Step 13:

[0250] Digital artists and clients can use chat within the system from their devices.

[0251] Digital artists and clients use the chat-style messaging function within the system to hold detailed discussions and confirm corrections.

[0252] Input data: Message content

[0253] Output data: Received and sent messages

[0254] Step 14:

[0255] The server receives and forwards messages

[0256] The server receives the message and forwards it to the other device, allowing for real-time message exchange.

[0257] Input data: Message content

[0258] Output data: Forwarded message

[0259] In this way, we can detail how specific inputs and outputs are handled at each step.

[0260] (Application example 1)

[0261] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0262] In conventional illustration request systems, it was difficult for users to reach a common image when communicating their request to an illustrator, resulting in frequent discrepancies between the request and the finished product. Furthermore, even in remote communication, the exchange of opinions between the illustrator and the client was often not smooth, making it difficult to realize an optimal illustration request. The present invention aims to solve these problems and provide a system that allows users to efficiently and accurately request illustrations in a virtual space.

[0263] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0264] In this invention, the server includes: a means for a user to register by entering their name, email address, and password; a means for an illustrator to enter a price and a sample image and create profile information; a means for a client to enter text information and use a generation AI to generate a sketch or rough sketch; a means for a client to view illustrator profile information, select a corresponding illustrator, and send the request details; a means for the client to check the sketch or rough sketch created by the generation AI in a virtual space; and a communication means for exchanging messages between the illustrator and the client. This makes it possible to proceed with the work while checking and adjusting the request details in real time in the virtual space.

[0265] "User" refers to the client and illustrator who uses the system.

[0266] An "illustrator" is a professional who creates profile information within the system and responds to illustration requests from clients.

[0267] "Text information" refers to the text information that the client inputs to generate a sketch or rough drawing using the generation AI.

[0268] "Generative AI" is an artificial intelligence technology that automatically generates sketches or rough drawings based on text information.

[0269] A "rough sketch" is a simplified drawing that serves as the basis for creating the final illustration.

[0270] A "rough drawing" is a rough illustration sketch that helps to visually grasp the client's intentions.

[0271] "Virtual space" is a virtual environment where clients and illustrators can check and adjust rough sketches and drawings in real time.

[0272] "Profile information" is a self-introduction created by the illustrator, detailed information about past works, and services provided.

[0273] "Means of communication" refers to the method used to exchange messages between the illustrator and the client.

[0274] This invention is a system that efficiently matches users with illustrators and uses AI to refine rough sketches and rough drafts. The following is a detailed description of the invention.

[0275] 1. User Registration Module

[0276] The user uses the terminal to enter their name, email address, and password to register with the system. The server receives the data sent, validates it (for example, checks the format of the email address, the length and complexity of the password), and stores it in a database. If registration is successful, the server returns a message to the user's terminal saying "Registration completed."

[0277] 2. Illustrator Profile Creation Module

[0278] The illustrator uses the terminal to input the amount and a sample image to create profile information. The server receives the transmitted data, validates it, and then saves it in the database. When the profile information creation is complete, the server returns a message to the terminal saying "Profile created."

[0279] 3. A module that uses generative AI to generate sketches / rough drawings

[0280] The requester uses their device to input the text information for the desired illustration (for example, "A cat reading a book") and clicks the "Generate sketch" button. The server receives the sent text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The server receives the generated image data and sends it to the requester's device. The requester can then check the received sketch in virtual space.

[0281] As an example, suppose the user enters the following prompt sentence:

[0282] Prompt: "Please draw a cat flying through space. I'd like the background to be filled with stars, with the cat gliding through the starry sky."

[0283] 4. Illustrator selection and production request module

[0284] The client uses a terminal to view the profile pages of multiple illustrators. The client selects the illustrator who best meets their requirements and enters details into the request form, including details of the desired illustration and any special requirements. The server receives the production request data and notifies the selected illustrator. The illustrator receives the notification and confirms the detailed request.

[0285] 5. Communication module between illustrator and client

[0286] Illustrators and clients can exchange chat-style messages within the system using their devices. The server receives the messages and forwards them to the other party's device. Messages are exchanged in real time, enabling rapid communication.

[0287] The system uses React Native on the front end, Django on the back end, and GPT-3-based APIs as a generative AI model, allowing users to order and customize illustrations with high efficiency and accuracy.

[0288] The above is a detailed embodiment of the present invention.

[0289] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0290] Step 1:

[0291] User Registration

[0292] The user uses a terminal to enter their name, email address, and password to register. The entered data is sent to the server. The server receives the data and performs validation (checks the format of the email address, and the length and complexity of the password). If validation is successful, the server saves the data in the database and returns a message to the user's terminal saying "Registration completed."

[0293] Step 2:

[0294] Illustrator profile creation

[0295] Illustrators use their devices to enter the amount, sample image, self-introduction, and examples of past work to create their profile information. The entered data is sent to the server. The server receives the data and validates it (checks the format of the sample image and the amount). If validation is successful, the server saves the data in the database and returns a message to the illustrator's device saying "Your profile has been created."

[0296] Step 3:

[0297] Generate sketches / rough drawings using generative AI

[0298] The requester uses their device to enter the text information for the desired illustration (e.g., a cat reading a book) and clicks the "Generate sketch" button. The entered text data is sent to the server, which prepares to pass the data to the generation AI. The generation AI automatically generates a sketch or rough drawing based on the text information. The server then receives the generated image data and sends it to the requester's device. The requester can then check the received sketch in virtual space.

[0299] Step 4:

[0300] Illustrator selection and production request

[0301] The client uses a terminal to view the profile pages of multiple illustrators. They select the illustrator who best meets their requirements and enter details of the desired illustration and any special requirements into the request form. The entered request data is sent to the server. The server receives the data and notifies the selected illustrator. The illustrator receives the notification and confirms the detailed request content.

[0302] Step 5:

[0303] Communication between illustrator and client

[0304] Illustrators and clients use their devices to exchange chat-style messages within the system. Messages are sent and received via a server, which stores the messages as a log and forwards them to the other party's device in real time. This allows for fast and efficient communication.

[0305] The above are the specific processing steps of this system.

[0306] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0307] ---

[0308] This invention is a system that efficiently matches users with illustrators and uses a generative AI and emotion engine to refine rough sketches and rough drafts. This system is configured and operates as follows.

[0309] User Registration Module

[0310] Using the terminal, users (illustrators and clients) can register by entering their name, email address, and password, which allows them to create an account within the system.

[0311] The server receives the submitted data, performs validation (for example, checking the format of the email address, the length and complexity of the password), and then stores it in a database. If registration is successful, the server returns a message such as "Registration completed" to the terminal.

[0312] Illustrator Profile Creation Module

[0313] Using the terminal, illustrators can input their price and sample images and create profile information, which can include a self-introduction and examples of their past work.

[0314] The server receives the data and stores it in a database after validating it (for example, checking the format of the amount or the file format of the sample image). When the profile information has been created, the server returns a message to the terminal saying "Your profile has been created."

[0315] A module that uses generative AI to generate sketches / rough drawings

[0316] Using the terminal, the requester enters the text information for the desired illustration (for example, "a cat reading a book") and clicks the "Generate sketch" button.

[0317] The server receives the text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The server then receives the generated image data and sends it to the client's device. The client then checks the received sketch.

[0318] Use of emotion engine

[0319] The server analyzes the text information and operational behavior entered by the user and recognizes the user's emotions using an emotion engine. Emotions can be extracted from specific keywords entered by the user and the timing of operations, and the style and expression of the sketches and rough drawings created by the generation AI can be adjusted based on these emotions.

[0320] Illustrator selection and production request module

[0321] Using a terminal, the client browses the profile pages of multiple illustrators within the system, selects the illustrator who best meets their requirements, and enters details into a production request form, including details of the desired illustration and any special requirements.

[0322] The server receives the production request data and notifies the selected illustrator, who then receives the notification and confirms the details of the request.

[0323] Communication module between illustrator and client

[0324] The illustrator and client exchange chat-style messages within the system via the device. The emotion engine analyzes emotions in real time during the exchange and can suggest message tone and content based on the recognized emotions. For example, if the client expresses anxiety or dissatisfaction, the emotion engine will suggest appropriate comfort or solutions.

[0325] The server receives each message and forwards it to the other party's device. Messages are exchanged in real time, enabling quick communication.

[0326] Specific examples

[0327] For example, if a client requests an illustration of a cat reading a book, they input text information and the AI ​​generates a rough sketch. The emotion engine then extracts emotions from the client's input and actions. For example, if the emotion is joy or excitement, the rough sketch will include expressions that reflect that emotion. This rough sketch can then be used to communicate with the illustrator, minimizing misunderstandings and producing the finished illustration.

[0328] In this way, the system can accurately analyze the user's emotions and reflect them in the production process, thereby providing illustrations of higher quality that meet the user's expectations.

[0329] ---

[0330] The processing flow will be explained below.

[0331] (User registration module)

[0332] Step 1:

[0333] The user enters their name, email address, and password and clicks the Register button.

[0334] Step 2:

[0335] The terminal sends the input data to the server.

[0336] Step 3:

[0337] The server receives the submitted data and validates the name, email address, and password to ensure they are valid, for example, checking that the email address is formatted correctly and that the password is of a required length.

[0338] Step 4:

[0339] The server saves the successfully validated data to the database.

[0340] Step 5:

[0341] The server returns a message to the terminal indicating successful registration.

[0342] Step 6:

[0343] The device displays a "Registration complete" message to the user.

[0344] (Illustrator profile creation module)

[0345] Step 1:

[0346] The illustrator enters profile information including the amount and sample image, and clicks the [Save Profile] button.

[0347] Step 2:

[0348] The terminal sends the input data to the server.

[0349] Step 3:

[0350] The server receives the data sent and validates it to ensure the amount is appropriate and the file format of the sample image is correct.

[0351] Step 4:

[0352] The server saves the successfully validated data to the database.

[0353] Step 5:

[0354] The server returns a message to the device indicating that the profile was created successfully.

[0355] Step 6:

[0356] The device will display the message "Profile created" in Illustrator.

[0357] (Module that uses generative AI to generate sketches / rough drawings)

[0358] Step 1:

[0359] The client enters the text information for the illustration they want (e.g., "A cat reading a book") and clicks the "Generate sketch" button.

[0360] Step 2:

[0361] The terminal transmits the text data to the server.

[0362] Step 3:

[0363] The server receives the transmitted text data.

[0364] Step 4:

[0365] The server passes the text data to the generation AI.

[0366] Step 5:

[0367] The generative AI generates a sketch or rough drawing based on text information.

[0368] Step 6:

[0369] The server receives the generated image data.

[0370] Step 7:

[0371] The server transmits the generated image data to the client's terminal.

[0372] Step 8:

[0373] The image received by the terminal is displayed to the requester.

[0374] (Using Emotion Engine)

[0375] Step 1:

[0376] The server receives the text information and operation actions entered by the user.

[0377] Step 2:

[0378] The server uses an emotion engine to analyze the user's emotions. For example, emotions can be extracted from keywords contained in text information, input speed, operation timing, etc.

[0379] Step 3:

[0380] The server passes the recognized emotional information to the generation AI.

[0381] Step 4:

[0382] The generative AI adjusts the style and expression of the sketch or rough draft based on emotional information.

[0383] (Illustrator selection and production request module)

[0384] Step 1:

[0385] The client browses the profiles of multiple illustrators within the system.

[0386] Step 2:

[0387] The client selects the illustrator who best suits their requirements.

[0388] Step 3:

[0389] The requester enters details into the production request form and clicks the [Request] button.

[0390] Step 4:

[0391] The terminal transmits the production request data to the server.

[0392] Step 5:

[0393] The server receives the production request data.

[0394] Step 6:

[0395] The server sends a production request notification to the selected illustrator.

[0396] Step 7:

[0397] The illustrator will receive a notification and confirm the details of the request.

[0398] (Communication module between illustrators and clients)

[0399] Step 1:

[0400] The client or illustrator enters a message in the chat box and clicks the Send button.

[0401] Step 2:

[0402] The terminal transmits the message data to the server.

[0403] Step 3:

[0404] The server receives the message data.

[0405] Step 4:

[0406] The server forwards the received message to the other party's terminal.

[0407] Step 5:

[0408] The message received by the other terminal is displayed on the screen.

[0409] Step 6:

[0410] The server uses an emotion engine to analyze the tone and content of the message and make appropriate suggestions. For example, if the requester expresses anxiety, it will suggest appropriate comfort or solutions.

[0411] ---

[0412] In this way, this system analyzes the user's emotions and reflects them in the generation AI and communication, providing illustrations of higher quality that meet the user's expectations.

[0413] Example 2

[0414] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0415] In traditional illustration production, there is a problem that mismatches in intentions and emotions between the client and the illustrator easily occur, resulting in an inefficient production process. It is also difficult to generate rough sketches or sketches that accurately reflect the client's emotions and intentions, which can result in a decrease in client satisfaction. Furthermore, if communication between the client and the illustrator is not effective enough, the efficiency and quality of the production can be compromised.

[0416] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for a user to enter their name, email address, and password and perform registration; a means for an illustrator to enter a price and a sample image, create and save profile information, and perform validation; a means for using a generation AI to generate a sketch or rough sketch from the client's text information and using an emotion engine to reflect the user's emotions in the generated sketch; a means including an emotion engine for a client to view the illustrator's profile information, select a corresponding illustrator, submit the request, and make appropriate suggestions; and a communication means for exchanging messages between the illustrator and the client. This enables the generation of a sketch or rough sketch that accurately reflects the user's emotions and intentions, facilitates communication between the client and the illustrator, and makes the production process efficient and high-quality.

[0417] "User Registration" is the process of creating an account within the system by entering your name, email address, and password.

[0418] "Illustrator Profile Creation" is the process by which an illustrator builds a profile page by entering information such as price, sample images, a self-introduction, and examples of past work.

[0419] "Data validation" is the process of checking whether the entered information conforms to the specified format and conditions.

[0420] "Generative AI" is artificial intelligence that automatically generates sketches or rough drawings based on text information.

[0421] An "emotion engine" is a technology that analyzes a user's input text and behavioral data to recognize and reflect the user's emotions.

[0422] "Sketch / rough drawing generation" is the process in which the generation AI creates a sketch or rough drawing based on the text information entered by the client.

[0423] "Submit Request" is the process by which a client sends production details and special requirements to the illustrator of their choice.

[0424] "Communication means" refers to an interface that allows illustrators and clients to exchange messages within the system, enabling real-time communication.

[0425] This invention is a system that efficiently matches users with illustrators and uses a generative AI and emotion engine to refine rough sketches and drafts. The system aims to provide a higher level of completion and satisfaction by analyzing the user's emotions and generating rough sketches that reflect those emotions. The detailed configuration and operation of this system are described below.

[0426] User Registration Module

[0427] The terminal prompts the user to enter their name, email address, and password, and sends this information to the server. The server then checks the format of the email address and validates the password length and complexity, and stores the data in a database. If registration is successful, it returns a message to the terminal saying "Registration completed."

[0428] Illustrator Profile Creation Module

[0429] The device prompts the illustrator to enter the price, sample image, self-introduction, examples of past work, etc., and sends this to the server. The server validates the received data, checking the format of the price and the file format of the sample image, and stores it in a database. When the profile information has been created, it returns a message to the device saying "Your profile has been created."

[0430] A module that uses generative AI to generate sketches / rough drawings

[0431] The terminal prompts the requester to enter text information for the desired illustration and click the "Generate sketch" button. The server receives the text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The generated image data is sent to the terminal via the server, and the requester confirms it.

[0432] For example, if a client wants to create a picture of a cat reading a book, they input the text "cat reading a book" into the device, and the AI ​​generates a rough sketch based on this information. The prompt will then be "Generate an image of a cat reading a book."

[0433] Use of emotion engine

[0434] The server uses an emotion engine to analyze the user's input text and operational behavior and recognize the user's emotions. The recognized emotions are reflected in the parameters of the generation AI, and the style and expression of the sketch and rough illustration are adjusted. For example, if the user enters the text "Amazing!", the emotion engine recognizes a high level of positive emotion and adds a prompt to the generation AI saying "Reflect positive emotion in the sketch," thereby reflecting that emotion in the rough illustration that is generated.

[0435] Illustrator selection and production request module

[0436] The terminal allows the requester to view the profile pages of multiple illustrators in the system and select the illustrator who best suits their requirements. The requester enters the details of the production request for the selected illustrator and sends them to the server. The server notifies the selected illustrator of the received production request data, and the illustrator confirms the detailed request content.

[0437] Communication module between illustrator and client

[0438] The device allows the illustrator and client to exchange messages in chat format. The emotion engine analyzes emotions in real time during the message exchange and suggests message tone and content based on the recognized emotion. For example, if the client types "I'm a little anxious...", the emotion engine recognizes the emotion of anxiety and suggests appropriate comfort or solutions. The server supports rapid communication by sending messages and forwarding them to the other party's device.

[0439] The above system enables efficient and high-quality illustration production that focuses on the user's emotions and intentions.

[0440] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0441] Program processing step details

[0442] Step 1: Enter and submit user information

[0443] Input: User enters name, email address, and password.

[0444] Processing: The terminal displays the input form and temporarily saves the entered information. When the user clicks the submit button, the entered data is sent to the server.

[0445] Output: A transmission completion notification and data are sent to the server.

[0446] Step 2: Validate and save user information

[0447] Input: User data sent to the server.

[0448] Processing: The server validates the submitted data. Specifically, it checks the format of the email address and the length and complexity of the password. Data that passes validation is saved in the database.

[0449] Output: A registration completion message is returned to the terminal. User information is saved in the database.

[0450] Step 3: Enter and submit your Illustrator profile information

[0451] Input: The illustrator will enter the price, sample image, self-introduction, and examples of past work.

[0452] Processing: The terminal displays the input form and temporarily saves the information entered by the illustrator. When the submit button is clicked, the input data is sent to the server.

[0453] Output: A transmission completion notification and data are sent to the server.

[0454] Step 4: Validate and save profile information

[0455] Input: Profile data sent to the server.

[0456] Processing: The server checks the format of the amount and the file format of the sample image for the submitted data. Data that passes validation is saved in the database.

[0457] Output: A message is returned to the terminal saying that the profile has been created. The profile information is saved in the database.

[0458] Step 5: Enter and submit requester's text information

[0459] Input: The requester enters the text information for the requested illustration.

[0460] Processing: The terminal displays a text input field and temporarily stores the information entered by the requester. When the user clicks the sketch generation button, the text data is sent to the server.

[0461] Output: A transmission completion notification and data are sent to the server.

[0462] Step 6: Convert text information and send it to the generation AI

[0463] Input: The text data sent to the server.

[0464] Processing: The server converts the text data into a prompt that can be interpreted by the generative AI model. The input "An image of a cat reading a book" is converted into a prompt such as "Generate an image of a cat reading a book." This is then sent to the generative AI.

[0465] Output: The prompt sent to the generation AI.

[0466] Step 7: Create and send rough sketches

[0467] Input: A prompt from the generative AI.

[0468] Processing: The AI ​​generates a rough sketch based on the prompt and returns the image data to the server.

[0469] Output: Image data returned to the server. Transferred to the requester's device and displayed.

[0470] Step 8: Sentiment analysis and reflection of emotional data

[0471] Input: The requester's input text and operation behavior data.

[0472] Processing: The server uses an emotion engine to analyze the text and behavioral data. For example, the text "Amazing!" is recognized as a highly positive emotion. This data is used as a parameter for the generation AI, and the instruction "Reflect positive emotion in the sketch" is sent to the generation AI.

[0473] Output: Emotion recognition data from the emotion engine. Emotion reflection parameters sent to the generation AI.

[0474] Step 9: Browse and select an Illustrator profile

[0475] Input: Illustrator selection by client.

[0476] Processing: The terminal displays the profile pages of multiple illustrators, allowing the client to select the illustrator who best suits their needs. Data is then sent to the server to notify the selected illustrator.

[0477] Output: Selected Illustrator. Submitted request data.

[0478] Step 10: Submit your production request

[0479] Input: Detailed information about the request.

[0480] Processing: The requester fills in the request form with detailed illustration information and special requests, then clicks the submit button. The server receives the data and notifies the selected illustrator.

[0481] Output: Request details. Notification to illustrator.

[0482] Step 11: Message exchange and sentiment analysis

[0483] Input: Message data between illustrator and client.

[0484] Processing: The device displays a chat interface and supports sending and receiving messages. The server uses an emotion engine to analyze the message content and suggest appropriate replies.

[0485] Output: Suggested reply. Sent message.

[0486] This detailed processing step clarifies how the system operates to provide high quality service to users.

[0487] (Application example 2)

[0488] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0489] In conventional illustration production request systems, misunderstandings easily occur between the client and the illustrator, making it difficult to create an illustration that fully reflects the client's feelings and wishes. Furthermore, communication often becomes complicated and does not flow smoothly. A means of analyzing the client's feelings in real time and providing appropriate feedback was needed.

[0490] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0491] In this invention, the server includes: a means for a user to register by entering their name, email address, and password; a means for an illustrator to enter a price and a sample image and create profile information; a means for a client to enter text information and use a generation AI to generate a sketch or rough sketch; a means for a client to view illustrator profile information, select a corresponding illustrator, and send the request; a communication means for exchanging messages between the illustrator and the client; and a means for analyzing the user's emotions using an emotion engine and adjusting the style and expression of the sketch or rough sketch generated by the generation AI. This makes it possible to create illustrations that accurately reflect the client's emotions and wishes.

[0492] "User" refers to an individual or corporation that accesses and uses the system, specifically an illustrator or client.

[0493] "Email address" refers to the email address that a user uses to register with or contact the system.

[0494] A "password" is a character string used as authentication information when a user logs into a system.

[0495] An "illustrator" is a professional who creates illustrations at the request of a client.

[0496] "Amount" refers to the fee set for the services provided by the illustrator.

[0497] "Sample images" are images that show the illustrator's previous work and style.

[0498] "Profile information" is detailed information about the illustrator, including a self-introduction, examples of past work, and fees.

[0499] "Client" refers to an individual or corporation that uses the system to request the creation of an illustration.

[0500] "Text information" refers to information that specifically describes the content of the illustration desired by the client in text form.

[0501] "Generative AI" is an artificial intelligence that automatically generates sketches and rough drawings based on the client's text information.

[0502] A "pre-drawing" is a rough sketch created before creating the final illustration.

[0503] A "rough sketch" is a type of preliminary sketch, a rougher and more simplified sketch.

[0504] An "emotion engine" is a system that analyzes a user's emotions and reflects them in specific processes and generated content.

[0505] "Style" refers to the way an illustration is expressed and its characteristics, and changes depending on the preferences of the client and illustrator.

[0506] "Communication means" refers to the functions within the system that allow clients and illustrators to exchange messages.

[0507] This invention is a system that efficiently matches users with illustrators and uses a generative AI and emotion engine to refine rough sketches and rough drafts. This system is configured and operates as follows.

[0508] User Registration Module

[0509] The user enters their name, email address, and password from the terminal to register. The server receives the data sent, performs validation (for example, checking the format of the email address, the length and complexity of the password), and then saves it in the database. If registration is successful, the server returns a message to the terminal such as "Registration completed."

[0510] Illustrator Profile Creation Module

[0511] The illustrator enters the amount and sample image from the terminal and creates profile information. This can also include a self-introduction and examples of past work. The server receives the transmitted data, performs validation (for example, checking the format of the amount and the file format of the sample image), and then saves it in the database. When the profile information creation is complete, the server returns a message to the terminal saying, "Your profile has been created."

[0512] A module that uses generative AI to generate sketches / rough drawings

[0513] The requester enters the text information of the desired illustration (for example, "A cat reading a book") from their device and clicks the "Generate sketch" button. The server receives the sent text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The server then receives the generated image data and sends it to the requester's device. The requester then checks the received sketch.

[0514] Use of emotion engine

[0515] The server analyzes the text information and operational behavior entered by the user and recognizes the user's emotions using an emotion engine. Emotions can be extracted from specific keywords entered by the user and the timing of operations, and the style and expression of the sketches and rough drawings created by the generation AI can be adjusted based on these emotions.

[0516] Illustrator selection and production request module

[0517] The requester browses the profile pages of multiple illustrators within the system from their terminal. The requester selects the illustrator who best suits their requirements and enters details into the production request form, including details of the desired illustration and any special requirements. The server receives the production request data and notifies the selected illustrator. The illustrator receives the notification and confirms the detailed request.

[0518] Communication module between illustrator and client

[0519] The illustrator and client exchange chat-style messages within the system from their devices. The emotion engine analyzes emotions in real time during the exchange and can suggest message tone and content based on the recognized emotion. For example, if the client expresses anxiety or dissatisfaction, the emotion engine will suggest appropriate comfort or solutions. The server receives each message and forwards it to the other party's device. Messages are exchanged in real time, enabling rapid communication.

[0520] Specific examples

[0521] For example, if a client requests an illustration of a cat reading a book, they input text information and the AI ​​generates a rough sketch. The emotion engine then extracts emotions from the client's input and actions. For example, if the emotion is joy or excitement, the rough sketch will include expressions that reflect that emotion. This rough sketch can then be used to communicate with the illustrator, minimizing misunderstandings and producing the finished illustration.

[0522] Hardware and software used

[0523] The hardware used to realize this system is a smartphone (iOS or Android), and the software used is a mobile app development platform (React Native). The generative AI uses OpenAI's API, and the emotion engine uses IBM Watson's Tone Analyzer. Below is a specific example of a prompt sentence to input to the generative AI model.

[0524] "You are the AI ​​of an art request system. The user inputs a scene of a dog playing in a flower field. Generate a rough sketch based on this information. Also, if you sense enjoyment in the user's text or actions, reflect that emotion as well."

[0525] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0526] Step 1:

[0527] The user enters their name, email address, and password from the terminal to register. The entered data is sent from the terminal to the server. The server receives this data and performs validation (checks the format of the email address, and the length and complexity of the password). If successful, it saves the user data in the database and returns a message to the terminal saying "Registration completed."

[0528] Input: User's name, email address, and password

[0529] Output: Validation result and registration confirmation message

[0530] Step 2:

[0531] The illustrator enters the amount and sample image from the terminal and creates profile information. The server receives the transmitted data and performs validation (for example, checking the format of the amount and the file format of the sample image). If successful, it saves the profile data in the database and returns a message to the terminal saying "Profile created."

[0532] Input: Illustrator price, sample image, profile

[0533] Output: Validation result and creation confirmation message

[0534] Step 3:

[0535] The requester enters the text information for the desired illustration on their device and clicks the "Generate rough sketch" button. The server receives the text data and passes it to the generation AI model to generate a rough sketch. The generated image data is sent to the requester's device, and the requester can check the received rough sketch.

[0536] Input: Requester's text information (e.g., "A cat reading a book")

[0537] Output: Generated rough sketch

[0538] Step 4:

[0539] The server analyzes the text information and operational behavior entered by the user and recognizes the user's emotions using an emotion engine (IBM Watson's Tone Analyzer). The recognized emotion data is fed back to the generation AI, which adjusts the style and expression of the sketches and rough drawings. The client can then review the adjusted rough drawings and request further revisions if necessary.

[0540] Input: User text information, operation actions

[0541] Output: Rough drawing after adjustments

[0542] Step 5:

[0543] The requester browses the profile pages of multiple illustrators within the system from their terminal. The requester selects the most suitable illustrator and enters details into the production request form. The server receives the production request data and notifies the selected illustrator.

[0544] Input: Request details, illustrator profile information

[0545] Output: Request notification, selection confirmation message

[0546] Step 6:

[0547] The illustrator and client exchange chat-style messages within the system from their devices. The server transfers the messages in real time, and the emotion engine analyzes the tone and content of the messages to provide appropriate feedback.

[0548] Input: User-to-user messages

[0549] Output: Analysis results and appropriate feedback

[0550] Specifically, the following example prompt sentences are used to input the generative AI model:

[0551] "You are the AI ​​of an art request system. The user inputs a scene of a dog playing in a flower field. Generate a rough sketch based on this information. Also, if you sense enjoyment in the user's text or actions, reflect that emotion as well."

[0552] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0553] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0554] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0555] [Second embodiment]

[0556] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0557] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0558] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0559] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0560] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0561] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0562] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0563] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0564] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0565] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0566] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0567] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0568] ---

[0569] This invention is a system that efficiently matches users with illustrators and uses generative AI to refine rough sketches and preliminary drawings. This system is configured and operates as follows.

[0570] User Registration Module

[0571] Using the terminal, users (illustrators and clients) can register by entering their name, email address, and password, which allows them to create an account within the system.

[0572] The server receives the submitted data, performs validation (for example, checking the format of the email address, the length and complexity of the password), and then stores it in a database. If registration is successful, the server returns a message such as "Registration completed" to the terminal.

[0573] Illustrator Profile Creation Module

[0574] Using the terminal, illustrators can input their price and sample images and create profile information, which can include a self-introduction and examples of their past work.

[0575] The server receives the data and stores it in a database after validating it (for example, checking the format of the amount or the file format of the sample image). When the profile information has been created, the server returns a message to the terminal saying "Your profile has been created."

[0576] A module that uses generative AI to generate sketches / rough drawings

[0577] Using the terminal, the requester enters the text information for the desired illustration (for example, "a cat reading a book") and clicks the "Generate sketch" button.

[0578] The server receives the text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The server then receives the generated image data and sends it to the client's device. The client then checks the received sketch.

[0579] Illustrator selection and production request module

[0580] Using a terminal, the client browses the profile pages of multiple illustrators within the system, selects the illustrator who best meets their requirements, and enters details into a production request form, including details of the desired illustration and any special requirements.

[0581] The server receives the production request data and notifies the selected illustrator, who then receives the notification and confirms the details of the request.

[0582] Communication module between illustrator and client

[0583] The illustrator and client can exchange chat-style messages within the system via a terminal, allowing for detailed discussions and confirmation of corrections.

[0584] The server receives each message and forwards it to the other party's device. Messages are exchanged in real time, enabling quick communication.

[0585] Specific examples

[0586] For example, if a client requests an illustration of a cat reading a book, they can input the text information and have the AI ​​generate a rough sketch. This rough sketch can then be used to communicate with the illustrator, minimizing misunderstandings and producing the finished illustration.

[0587] In this way, this system efficiently supports the entire process, starting from user registration, selecting an illustrator, generating a rough sketch using generative AI, and communicating with the illustrator.

[0588] ---

[0589] The processing flow will be explained below.

[0590] (User registration module)

[0591] Step 1:

[0592] The user enters their name, email address, and password and clicks the Register button.

[0593] Step 2:

[0594] The terminal sends the input data to the server.

[0595] Step 3:

[0596] The server receives the submitted data and validates the name, email address, and password to ensure they are valid, for example, checking that the email address is formatted correctly and that the password is of a required length.

[0597] Step 4:

[0598] The server saves the successfully validated data to the database.

[0599] Step 5:

[0600] The server returns a message to the terminal indicating successful registration.

[0601] Step 6:

[0602] The device displays a "Registration complete" message to the user.

[0603] (Illustrator profile creation module)

[0604] Step 1:

[0605] The illustrator enters profile information including the amount and sample image, and clicks the [Save Profile] button.

[0606] Step 2:

[0607] The terminal sends the input data to the server.

[0608] Step 3:

[0609] The server receives the data sent and validates it to ensure the amount is appropriate and the file format of the sample image is correct.

[0610] Step 4:

[0611] The server saves the successfully validated data to the database.

[0612] Step 5:

[0613] The server returns a message to the device indicating that the profile was created successfully.

[0614] Step 6:

[0615] The device will display the message "Profile created" in Illustrator.

[0616] (Module that uses generative AI to generate sketches / rough drawings)

[0617] Step 1:

[0618] The client enters the text information for the illustration they want (e.g., "A cat reading a book") and clicks the "Generate sketch" button.

[0619] Step 2:

[0620] The terminal transmits the text data to the server.

[0621] Step 3:

[0622] The server receives the transmitted text data.

[0623] Step 4:

[0624] The server passes the text data to the generation AI.

[0625] Step 5:

[0626] The generative AI generates a sketch or rough drawing based on text information.

[0627] Step 6:

[0628] The server receives the generated image data.

[0629] Step 7:

[0630] The server transmits the generated image data to the client's terminal.

[0631] Step 8:

[0632] The image received by the terminal is displayed to the requester.

[0633] (Illustrator selection and production request module)

[0634] Step 1:

[0635] The client browses the profiles of multiple illustrators within the system.

[0636] Step 2:

[0637] The client selects the illustrator who best suits their requirements.

[0638] Step 3:

[0639] The requester enters details into the production request form and clicks the [Request] button.

[0640] Step 4:

[0641] The terminal transmits the production request data to the server.

[0642] Step 5:

[0643] The server receives the production request data.

[0644] Step 6:

[0645] The server sends a production request notification to the selected illustrator.

[0646] Step 7:

[0647] The illustrator will receive a notification and confirm the details of the request.

[0648] (Communication module between illustrators and clients)

[0649] Step 1:

[0650] The client or illustrator enters a message in the chat box and clicks the Send button.

[0651] Step 2:

[0652] The terminal transmits the message data to the server.

[0653] Step 3:

[0654] The server receives the message data.

[0655] Step 4:

[0656] The server forwards the received message to the other party's terminal.

[0657] Step 5:

[0658] The message received by the other terminal is displayed on the screen.

[0659] ---

[0660] In this way, this system achieves smooth communication between the user, illustrator, and client through each step.

[0661] Example 1

[0662] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0663] In modern digital art production, the challenge is to efficiently match clients with digital artists and quickly and accurately produce works that reflect their requests. Furthermore, there is a lack of systems that use generative AI to generate rough sketches and quickly exchange corrections. This creates a need for an environment that accurately reflects client requests and efficiently delivers high-quality illustrations.

[0664] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0665] In this invention, the server includes a means for a user to register by inputting their name, email address, and password, a means for a digital artist to input a price and sample images and create profile information, and a means for a client to input text information and generate a rough sketch using a generation AI. This allows a client to view the profile information of digital artists, select the artist that best suits their requirements, and submit their request, enabling rapid communication.

[0666] "User" refers to a person who uses this system, such as a client or a digital artist.

[0667] An "email address" is a personal identifier for sending and receiving messages over the Internet.

[0668] A "password" is a sequence of characters or symbols used for user authentication and to protect a user's account.

[0669] "Registration" refers to the process by which a User enters their information into the System and creates an account.

[0670] A "digital artist" is a professional who creates art using digital technology.

[0671] "Price" refers to the amount of compensation set by a digital artist for the services they provide.

[0672] "Example images" are sample images of works that digital artists have created in the past.

[0673] "Profile Information" is a collection of information about a user or digital artist, including a self-introduction, examples of past work, pricing, etc.

[0674] A "client" is a person who commissions a digital artist to create a particular piece of art.

[0675] "Text information" is text that describes the specific details and requests regarding the illustration desired by the client.

[0676] "Generative AI" is an artificial intelligence technology that automatically generates rough sketches and drafts based on given text information.

[0677] A "rough sketch" is an early sketch made before creating a finished illustration, depicting the basic composition and shapes.

[0678] A "rough sketch" is synonymous with a rough sketch, a simple sketch that forms the basis of a finished product.

[0679] "Communication means" is a function that allows clients and digital artists to exchange messages on the system to discuss details and confirm corrections.

[0680] A "database" is a system that organizes and stores information about users and digital artists.

[0681] "Saving" is the act of recording the input information in a database.

[0682] "Validation" is the process of checking whether entered data is accurate.

[0683] "Transmission" is the act of moving data from one point to another.

[0684] "Receiving" is the act of receiving transmitted data.

[0685] The above are definitions of important terms contained in the claims.

[0686] This invention is a system that efficiently matches users with digital artists and utilizes generative AI to refine rough sketches and sketches. This system is configured and operates as follows.

[0687] User Registration Module

[0688] The terminal allows the user to register by entering their name, email address, and password, which allows the user to create an account within the system.

[0689] The server receives the data and stores it in a database after validating it (for example, checking the format of the email address, the length and complexity of the password). If registration is successful, the server returns a message to the terminal saying "Registration completed."

[0690] Illustrator Profile Creation Module

[0691] The device allows digital artists to input prices and sample images and create profile information, which can include a biographical description and examples of previous work.

[0692] The server receives the data and stores it in a database after validating it (for example, checking the format of the price or the file format of the sample image). When the profile information creation is complete, the server returns a message to the terminal saying "Your profile has been created."

[0693] A module that uses generative AI to generate sketches / rough drawings

[0694] Using the terminal, the requester enters the text information for the desired illustration (for example, "a cat reading a book") and clicks the "Generate sketch" button.

[0695] The server receives the text data and prepares it for transmission to the generative AI model. The generative AI model generates a sketch or rough sketch based on the text information. The server then receives the generated image data and sends it to the client's device. The client then checks the received sketch.

[0696] Illustrator selection and production request module

[0697] Using a terminal, the client browses the profile pages of multiple digital artists within the system, selects the digital artist who best meets their requirements, and enters details into a production request form, including details of the desired illustration and any special requirements.

[0698] The server receives the production request data and notifies the selected digital artist, who then receives the notification and confirms the details of the request.

[0699] Communication module between illustrator and client

[0700] The digital artist and client exchange chat-style messages via the terminal within the system, allowing for detailed discussions and confirmation of corrections.

[0701] The server receives each message and forwards it to the other party's device. Messages are exchanged in real time, enabling quick communication.

[0702] Specific examples

[0703] For example, if a client requests an illustration of a cat reading a book, they can input the text information and have the AI ​​generate a rough sketch. Based on this rough sketch, they can communicate with the digital artist and produce the finished illustration with minimal misunderstandings.

[0704] Prompt Sentence Examples

[0705] Enter the following prompt into the generative AI model:

[0706] "Generate a rough sketch of a cat reading a book."

[0707] In this way, this system efficiently supports a series of processes, starting from user registration, selecting a digital artist, generating a sketch using generative AI, and communicating with the digital artist.

[0708] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0709] Step 1:

[0710] The user enters user information from the terminal.

[0711] The user enters their name, email address, and password and clicks the Register button.

[0712] The terminal receives the input user information and transmits it to the server.

[0713] Input data: Name, email address, password

[0714] Output data: User information sent to the server

[0715] Step 2:

[0716] The server receives and validates the user information

[0717] The server receives the name, email address, and password submitted by the user.

[0718] The server checks the format of the email address and validates the length and complexity of the password.

[0719] Input data: User information

[0720] Output data: Validation result (success or failure)

[0721] Step 3:

[0722] The server stores the user information in a database

[0723] If validation is successful, the server saves the user information in the database.

[0724] If the save is successful, the server returns a message to the terminal saying "Registration completed."

[0725] Input data: User information that has passed validation

[0726] Output data: User information stored in the database, registration completion message

[0727] Step 4:

[0728] Digital artists enter their profile information on their devices

[0729] Digital artists enter their price, sample images, a self-introduction, and examples of their past work, then click the profile creation button.

[0730] The terminal transmits this information to the server.

[0731] Input data: price, sample images, self-introduction, examples of past work

[0732] Output data: Profile information sent to the server

[0733] Step 5:

[0734] The server receives and validates the profile information

[0735] The server checks the received price, file format of the sample image, etc.

[0736] Input data: Profile information

[0737] Output data: Validation result (success or failure)

[0738] Step 6:

[0739] The server stores the profile information in a database

[0740] If validation passes, the server stores the profile information in a database.

[0741] When the creation of the profile information is complete, the server returns a message to the terminal saying "Profile created."

[0742] Input data: Validated profile information

[0743] Output data: Profile information saved in the database, profile creation completion message

[0744] Step 7:

[0745] The client enters the text information for the illustration from the device.

[0746] The client enters the text information for the desired illustration (e.g., "A cat reading a book") and clicks the "Generate sketch" button.

[0747] The terminal transmits the text information to the server.

[0748] Input data: Text information of the desired illustration

[0749] Output data: Text information sent to the server

[0750] Step 8:

[0751] The server passes the text information to the AI ​​generator, which generates a rough sketch.

[0752] The server passes the received text information to the generative AI model.

[0753] The generative AI model generates a rough sketch or outline based on text information.

[0754] Input data: Text information

[0755] Output data: Generated sketch or rough drawing

[0756] Step 9:

[0757] The server receives the generated image data and sends it to the terminal.

[0758] The server receives the image data generated from the generative AI model.

[0759] The server transmits the image data to the client's terminal and causes the client to display the image data.

[0760] Input data: Generated image data

[0761] Output data: Image data sent to the terminal, displayed sketch

[0762] Step 10:

[0763] Clients can browse multiple digital artists from their device

[0764] The client uses the device to view the profile pages of multiple digital artists.

[0765] Input data: None

[0766] Output data: Displayed digital artist profile information

[0767] Step 11:

[0768] The client fills out the production request form

[0769] The client fills out and submits a production request form, including details of the desired illustration and any special requirements.

[0770] The terminal transmits this information to the server.

[0771] Input data: Production request information

[0772] Output data: Production request information sent to the server

[0773] Step 12:

[0774] The server receives the production request data and notifies the digital artist.

[0775] The server receives production request data from the client.

[0776] The server notifies the selected digital artist of the request.

[0777] Input data: Production request information

[0778] Output data: Request details notified to the digital artist

[0779] Step 13:

[0780] Digital artists and clients can use chat within the system from their devices.

[0781] Digital artists and clients use the chat-style messaging function within the system to hold detailed discussions and confirm corrections.

[0782] Input data: Message content

[0783] Output data: Received and sent messages

[0784] Step 14:

[0785] The server receives and forwards messages

[0786] The server receives the message and forwards it to the other device, allowing for real-time message exchange.

[0787] Input data: Message content

[0788] Output data: Forwarded message

[0789] In this way, we can detail how specific inputs and outputs are handled at each step.

[0790] (Application example 1)

[0791] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0792] In conventional illustration request systems, it was difficult for users to reach a common image when communicating their request to an illustrator, resulting in frequent discrepancies between the request and the finished product. Furthermore, even in remote communication, the exchange of opinions between the illustrator and the client was often not smooth, making it difficult to realize an optimal illustration request. The present invention aims to solve these problems and provide a system that allows users to efficiently and accurately request illustrations in a virtual space.

[0793] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0794] In this invention, the server includes: a means for a user to register by entering their name, email address, and password; a means for an illustrator to enter a price and a sample image and create profile information; a means for a client to enter text information and use a generation AI to generate a sketch or rough sketch; a means for a client to view illustrator profile information, select a corresponding illustrator, and send the request details; a means for the client to check the sketch or rough sketch created by the generation AI in a virtual space; and a communication means for exchanging messages between the illustrator and the client. This makes it possible to proceed with the work while checking and adjusting the request details in real time in the virtual space.

[0795] "User" refers to the client and illustrator who uses the system.

[0796] An "illustrator" is a professional who creates profile information within the system and responds to illustration requests from clients.

[0797] "Text information" refers to the text information that the client inputs to generate a sketch or rough drawing using the generation AI.

[0798] "Generative AI" is an artificial intelligence technology that automatically generates sketches or rough drawings based on text information.

[0799] A "rough sketch" is a simplified drawing that serves as the basis for creating the final illustration.

[0800] A "rough drawing" is a rough illustration sketch that helps to visually grasp the client's intentions.

[0801] "Virtual space" is a virtual environment where clients and illustrators can check and adjust rough sketches and drawings in real time.

[0802] "Profile information" is a self-introduction created by the illustrator, detailed information about past works, and services provided.

[0803] "Means of communication" refers to the method used to exchange messages between the illustrator and the client.

[0804] This invention is a system that efficiently matches users with illustrators and uses AI to refine rough sketches and rough drafts. The following is a detailed description of the invention.

[0805] 1. User Registration Module

[0806] The user uses the terminal to enter their name, email address, and password to register with the system. The server receives the data sent, validates it (for example, checks the format of the email address, the length and complexity of the password), and stores it in a database. If registration is successful, the server returns a message to the user's terminal saying "Registration completed."

[0807] 2. Illustrator Profile Creation Module

[0808] The illustrator uses the terminal to input the amount and a sample image to create profile information. The server receives the transmitted data, validates it, and then saves it in the database. When the profile information creation is complete, the server returns a message to the terminal saying "Profile created."

[0809] 3. A module that uses generative AI to generate sketches / rough drawings

[0810] The requester uses their device to input the text information for the desired illustration (for example, "A cat reading a book") and clicks the "Generate sketch" button. The server receives the sent text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The server receives the generated image data and sends it to the requester's device. The requester can then check the received sketch in virtual space.

[0811] As an example, suppose the user enters the following prompt sentence:

[0812] Prompt: "Please draw a cat flying through space. I'd like the background to be filled with stars, with the cat gliding through the starry sky."

[0813] 4. Illustrator selection and production request module

[0814] The client uses a terminal to view the profile pages of multiple illustrators. The client selects the illustrator who best meets their requirements and enters details into the request form, including details of the desired illustration and any special requirements. The server receives the production request data and notifies the selected illustrator. The illustrator receives the notification and confirms the detailed request.

[0815] 5. Communication module between illustrator and client

[0816] Illustrators and clients can exchange chat-style messages within the system using their devices. The server receives the messages and forwards them to the other party's device. Messages are exchanged in real time, enabling rapid communication.

[0817] The system uses React Native on the front end, Django on the back end, and GPT-3-based APIs as a generative AI model, allowing users to order and customize illustrations with high efficiency and accuracy.

[0818] The above is a detailed embodiment of the present invention.

[0819] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0820] Step 1:

[0821] User Registration

[0822] The user uses a terminal to enter their name, email address, and password to register. The entered data is sent to the server. The server receives the data and performs validation (checks the format of the email address, and the length and complexity of the password). If validation is successful, the server saves the data in the database and returns a message to the user's terminal saying "Registration completed."

[0823] Step 2:

[0824] Illustrator profile creation

[0825] Illustrators use their devices to enter the amount, sample image, self-introduction, and examples of past work to create their profile information. The entered data is sent to the server. The server receives the data and validates it (checks the format of the sample image and the amount). If validation is successful, the server saves the data in the database and returns a message to the illustrator's device saying "Your profile has been created."

[0826] Step 3:

[0827] Generate sketches / rough drawings using generative AI

[0828] The requester uses their device to enter the text information for the desired illustration (e.g., a cat reading a book) and clicks the "Generate sketch" button. The entered text data is sent to the server, which prepares to pass the data to the generation AI. The generation AI automatically generates a sketch or rough drawing based on the text information. The server then receives the generated image data and sends it to the requester's device. The requester can then check the received sketch in virtual space.

[0829] Step 4:

[0830] Illustrator selection and production request

[0831] The client uses a terminal to view the profile pages of multiple illustrators. They select the illustrator who best meets their requirements and enter details of the desired illustration and any special requirements into the request form. The entered request data is sent to the server. The server receives the data and notifies the selected illustrator. The illustrator receives the notification and confirms the detailed request content.

[0832] Step 5:

[0833] Communication between illustrator and client

[0834] Illustrators and clients use their devices to exchange chat-style messages within the system. Messages are sent and received via a server, which stores the messages as a log and forwards them to the other party's device in real time. This allows for fast and efficient communication.

[0835] The above are the specific processing steps of this system.

[0836] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0837] ---

[0838] This invention is a system that efficiently matches users with illustrators and uses a generative AI and emotion engine to refine rough sketches and rough drafts. This system is configured and operates as follows.

[0839] User Registration Module

[0840] Using the terminal, users (illustrators and clients) can register by entering their name, email address, and password, which allows them to create an account within the system.

[0841] The server receives the submitted data, performs validation (for example, checking the format of the email address, the length and complexity of the password), and then stores it in a database. If registration is successful, the server returns a message such as "Registration completed" to the terminal.

[0842] Illustrator Profile Creation Module

[0843] Using the terminal, illustrators can input their price and sample images and create profile information, which can include a self-introduction and examples of their past work.

[0844] The server receives the data and stores it in a database after validating it (for example, checking the format of the amount or the file format of the sample image). When the profile information has been created, the server returns a message to the terminal saying "Your profile has been created."

[0845] A module that uses generative AI to generate sketches / rough drawings

[0846] Using the terminal, the requester enters the text information for the desired illustration (for example, "a cat reading a book") and clicks the "Generate sketch" button.

[0847] The server receives the text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The server then receives the generated image data and sends it to the client's device. The client then checks the received sketch.

[0848] Use of emotion engine

[0849] The server analyzes the text information and operational behavior entered by the user and recognizes the user's emotions using an emotion engine. Emotions can be extracted from specific keywords entered by the user and the timing of operations, and the style and expression of the sketches and rough drawings created by the generation AI can be adjusted based on these emotions.

[0850] Illustrator selection and production request module

[0851] Using a terminal, the client browses the profile pages of multiple illustrators within the system, selects the illustrator who best meets their requirements, and enters details into a production request form, including details of the desired illustration and any special requirements.

[0852] The server receives the production request data and notifies the selected illustrator, who then receives the notification and confirms the details of the request.

[0853] Communication module between illustrator and client

[0854] The illustrator and client exchange chat-style messages within the system via the device. The emotion engine analyzes emotions in real time during the exchange and can suggest message tone and content based on the recognized emotions. For example, if the client expresses anxiety or dissatisfaction, the emotion engine will suggest appropriate comfort or solutions.

[0855] The server receives each message and forwards it to the other party's device. Messages are exchanged in real time, enabling quick communication.

[0856] Specific examples

[0857] For example, if a client requests an illustration of a cat reading a book, they input text information and the AI ​​generates a rough sketch. The emotion engine then extracts emotions from the client's input and actions. For example, if the emotion is joy or excitement, the rough sketch will include expressions that reflect that emotion. This rough sketch can then be used to communicate with the illustrator, minimizing misunderstandings and producing the finished illustration.

[0858] In this way, the system can accurately analyze the user's emotions and reflect them in the production process, thereby providing illustrations of higher quality that meet the user's expectations.

[0859] ---

[0860] The processing flow will be explained below.

[0861] (User registration module)

[0862] Step 1:

[0863] The user enters their name, email address, and password and clicks the Register button.

[0864] Step 2:

[0865] The terminal sends the input data to the server.

[0866] Step 3:

[0867] The server receives the submitted data and validates the name, email address, and password to ensure they are valid, for example, checking that the email address is formatted correctly and that the password is of a required length.

[0868] Step 4:

[0869] The server saves the successfully validated data to the database.

[0870] Step 5:

[0871] The server returns a message to the terminal indicating successful registration.

[0872] Step 6:

[0873] The device displays a "Registration complete" message to the user.

[0874] (Illustrator profile creation module)

[0875] Step 1:

[0876] The illustrator enters profile information including the amount and sample image, and clicks the [Save Profile] button.

[0877] Step 2:

[0878] The terminal sends the input data to the server.

[0879] Step 3:

[0880] The server receives the data sent and validates it to ensure the amount is appropriate and the file format of the sample image is correct.

[0881] Step 4:

[0882] The server saves the successfully validated data to the database.

[0883] Step 5:

[0884] The server returns a message to the device indicating that the profile was created successfully.

[0885] Step 6:

[0886] The device will display the message "Profile created" in Illustrator.

[0887] (Module that uses generative AI to generate sketches / rough drawings)

[0888] Step 1:

[0889] The client enters the text information for the illustration they want (e.g., "A cat reading a book") and clicks the "Generate sketch" button.

[0890] Step 2:

[0891] The terminal transmits the text data to the server.

[0892] Step 3:

[0893] The server receives the transmitted text data.

[0894] Step 4:

[0895] The server passes the text data to the generation AI.

[0896] Step 5:

[0897] The generative AI generates a sketch or rough drawing based on text information.

[0898] Step 6:

[0899] The server receives the generated image data.

[0900] Step 7:

[0901] The server transmits the generated image data to the client's terminal.

[0902] Step 8:

[0903] The image received by the terminal is displayed to the requester.

[0904] (Using Emotion Engine)

[0905] Step 1:

[0906] The server receives the text information and operation actions entered by the user.

[0907] Step 2:

[0908] The server uses an emotion engine to analyze the user's emotions. For example, emotions can be extracted from keywords contained in text information, input speed, operation timing, etc.

[0909] Step 3:

[0910] The server passes the recognized emotional information to the generation AI.

[0911] Step 4:

[0912] The generative AI adjusts the style and expression of the sketch or rough draft based on emotional information.

[0913] (Illustrator selection and production request module)

[0914] Step 1:

[0915] The client browses the profiles of multiple illustrators within the system.

[0916] Step 2:

[0917] The client selects the illustrator who best suits their requirements.

[0918] Step 3:

[0919] The requester enters details into the production request form and clicks the [Request] button.

[0920] Step 4:

[0921] The terminal transmits the production request data to the server.

[0922] Step 5:

[0923] The server receives the production request data.

[0924] Step 6:

[0925] The server sends a production request notification to the selected illustrator.

[0926] Step 7:

[0927] The illustrator will receive a notification and confirm the details of the request.

[0928] (Communication module between illustrators and clients)

[0929] Step 1:

[0930] The client or illustrator enters a message in the chat box and clicks the Send button.

[0931] Step 2:

[0932] The terminal transmits the message data to the server.

[0933] Step 3:

[0934] The server receives the message data.

[0935] Step 4:

[0936] The server forwards the received message to the other party's terminal.

[0937] Step 5:

[0938] The message received by the other terminal is displayed on the screen.

[0939] Step 6:

[0940] The server uses an emotion engine to analyze the tone and content of the message and make appropriate suggestions. For example, if the requester expresses anxiety, it will suggest appropriate comfort or solutions.

[0941] ---

[0942] In this way, this system analyzes the user's emotions and reflects them in the generation AI and communication, providing illustrations of higher quality that meet the user's expectations.

[0943] Example 2

[0944] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0945] In traditional illustration production, there is a problem that mismatches in intentions and emotions between the client and the illustrator easily occur, resulting in an inefficient production process. It is also difficult to generate rough sketches or sketches that accurately reflect the client's emotions and intentions, which can result in a decrease in client satisfaction. Furthermore, if communication between the client and the illustrator is not effective enough, the efficiency and quality of the production can be compromised.

[0946] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for a user to enter their name, email address, and password and perform registration; a means for an illustrator to enter a price and a sample image, create and save profile information, and perform validation; a means for using a generation AI to generate a sketch or rough sketch from the client's text information and using an emotion engine to reflect the user's emotions in the generated sketch; a means including an emotion engine for a client to view the illustrator's profile information, select a corresponding illustrator, submit the request, and make appropriate suggestions; and a communication means for exchanging messages between the illustrator and the client. This enables the generation of a sketch or rough sketch that accurately reflects the user's emotions and intentions, facilitates communication between the client and the illustrator, and makes the production process efficient and high-quality.

[0947] "User Registration" is the process of creating an account within the system by entering your name, email address, and password.

[0948] "Illustrator Profile Creation" is the process by which an illustrator builds a profile page by entering information such as price, sample images, a self-introduction, and examples of past work.

[0949] "Data validation" is the process of checking whether the entered information conforms to the specified format and conditions.

[0950] "Generative AI" is artificial intelligence that automatically generates sketches or rough drawings based on text information.

[0951] An "emotion engine" is a technology that analyzes a user's input text and behavioral data to recognize and reflect the user's emotions.

[0952] "Sketch / rough drawing generation" is the process in which the generation AI creates a sketch or rough drawing based on the text information entered by the client.

[0953] "Submit Request" is the process by which a client sends production details and special requirements to the illustrator of their choice.

[0954] "Communication means" refers to an interface that allows illustrators and clients to exchange messages within the system, enabling real-time communication.

[0955] This invention is a system that efficiently matches users with illustrators and uses a generative AI and emotion engine to refine rough sketches and drafts. The system aims to provide a higher level of completion and satisfaction by analyzing the user's emotions and generating rough sketches that reflect those emotions. The detailed configuration and operation of this system are described below.

[0956] User Registration Module

[0957] The terminal prompts the user to enter their name, email address, and password, and sends this information to the server. The server then checks the format of the email address and validates the password length and complexity, and stores the data in a database. If registration is successful, it returns a message to the terminal saying "Registration completed."

[0958] Illustrator Profile Creation Module

[0959] The device prompts the illustrator to enter the price, sample image, self-introduction, examples of past work, etc., and sends this to the server. The server validates the received data, checking the format of the price and the file format of the sample image, and stores it in a database. When the profile information has been created, it returns a message to the device saying "Your profile has been created."

[0960] A module that uses generative AI to generate sketches / rough drawings

[0961] The terminal prompts the requester to enter text information for the desired illustration and click the "Generate sketch" button. The server receives the text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The generated image data is sent to the terminal via the server, and the requester confirms it.

[0962] For example, if a client wants to create a picture of a cat reading a book, they input the text "cat reading a book" into the device, and the AI ​​generates a rough sketch based on this information. The prompt will then be "Generate an image of a cat reading a book."

[0963] Use of emotion engine

[0964] The server uses an emotion engine to analyze the user's input text and operational behavior and recognize the user's emotions. The recognized emotions are reflected in the parameters of the generation AI, and the style and expression of the sketch and rough illustration are adjusted. For example, if the user enters the text "Amazing!", the emotion engine recognizes a high level of positive emotion and adds a prompt to the generation AI saying "Reflect positive emotion in the sketch," thereby reflecting that emotion in the rough illustration that is generated.

[0965] Illustrator selection and production request module

[0966] The terminal allows the requester to view the profile pages of multiple illustrators in the system and select the illustrator who best suits their requirements. The requester enters the details of the production request for the selected illustrator and sends them to the server. The server notifies the selected illustrator of the received production request data, and the illustrator confirms the detailed request content.

[0967] Communication module between illustrator and client

[0968] The device allows the illustrator and client to exchange messages in chat format. The emotion engine analyzes emotions in real time during the message exchange and suggests message tone and content based on the recognized emotion. For example, if the client types "I'm a little anxious...", the emotion engine recognizes the emotion of anxiety and suggests appropriate comfort or solutions. The server supports rapid communication by sending messages and forwarding them to the other party's device.

[0969] The above system enables efficient and high-quality illustration production that focuses on the user's emotions and intentions.

[0970] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0971] Program processing step details

[0972] Step 1: Enter and submit user information

[0973] Input: User enters name, email address, and password.

[0974] Processing: The terminal displays the input form and temporarily saves the entered information. When the user clicks the submit button, the entered data is sent to the server.

[0975] Output: A transmission completion notification and data are sent to the server.

[0976] Step 2: Validate and save user information

[0977] Input: User data sent to the server.

[0978] Processing: The server validates the submitted data. Specifically, it checks the format of the email address and the length and complexity of the password. Data that passes validation is saved in the database.

[0979] Output: A registration completion message is returned to the terminal. User information is saved in the database.

[0980] Step 3: Enter and submit your Illustrator profile information

[0981] Input: The illustrator will enter the price, sample image, self-introduction, and examples of past work.

[0982] Processing: The terminal displays the input form and temporarily saves the information entered by the illustrator. When the submit button is clicked, the input data is sent to the server.

[0983] Output: A transmission completion notification and data are sent to the server.

[0984] Step 4: Validate and save profile information

[0985] Input: Profile data sent to the server.

[0986] Processing: The server checks the format of the amount and the file format of the sample image for the submitted data. Data that passes validation is saved in the database.

[0987] Output: A message is returned to the terminal saying that the profile has been created. The profile information is saved in the database.

[0988] Step 5: Enter and submit requester's text information

[0989] Input: The requester enters the text information for the requested illustration.

[0990] Processing: The terminal displays a text input field and temporarily stores the information entered by the requester. When the user clicks the sketch generation button, the text data is sent to the server.

[0991] Output: A transmission completion notification and data are sent to the server.

[0992] Step 6: Convert text information and send it to the generation AI

[0993] Input: The text data sent to the server.

[0994] Processing: The server converts the text data into a prompt that can be interpreted by the generative AI model. The input "An image of a cat reading a book" is converted into a prompt such as "Generate an image of a cat reading a book." This is then sent to the generative AI.

[0995] Output: The prompt sent to the generation AI.

[0996] Step 7: Create and send rough sketches

[0997] Input: A prompt from the generative AI.

[0998] Processing: The AI ​​generates a rough sketch based on the prompt and returns the image data to the server.

[0999] Output: Image data returned to the server. Transferred to the requester's device and displayed.

[1000] Step 8: Sentiment analysis and reflection of emotional data

[1001] Input: The requester's input text and operation behavior data.

[1002] Processing: The server uses an emotion engine to analyze the text and behavioral data. For example, the text "Amazing!" is recognized as a highly positive emotion. This data is used as a parameter for the generation AI, and the instruction "Reflect positive emotion in the sketch" is sent to the generation AI.

[1003] Output: Emotion recognition data from the emotion engine. Emotion reflection parameters sent to the generation AI.

[1004] Step 9: Browse and select an Illustrator profile

[1005] Input: Illustrator selection by client.

[1006] Processing: The terminal displays the profile pages of multiple illustrators, allowing the client to select the illustrator who best suits their needs. Data is then sent to the server to notify the selected illustrator.

[1007] Output: Selected Illustrator. Submitted request data.

[1008] Step 10: Submit your production request

[1009] Input: Detailed information about the request.

[1010] Processing: The requester fills in the request form with detailed illustration information and special requests, then clicks the submit button. The server receives the data and notifies the selected illustrator.

[1011] Output: Request details. Notification to illustrator.

[1012] Step 11: Message exchange and sentiment analysis

[1013] Input: Message data between illustrator and client.

[1014] Processing: The device displays a chat interface and supports sending and receiving messages. The server uses an emotion engine to analyze the message content and suggest appropriate replies.

[1015] Output: Suggested reply. Sent message.

[1016] This detailed processing step clarifies how the system operates to provide high quality service to users.

[1017] (Application example 2)

[1018] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1019] In conventional illustration production request systems, misunderstandings easily occur between the client and the illustrator, making it difficult to create an illustration that fully reflects the client's feelings and wishes. Furthermore, communication often becomes complicated and does not flow smoothly. A means of analyzing the client's feelings in real time and providing appropriate feedback was needed.

[1020] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1021] In this invention, the server includes: a means for a user to register by entering their name, email address, and password; a means for an illustrator to enter a price and a sample image and create profile information; a means for a client to enter text information and use a generation AI to generate a sketch or rough sketch; a means for a client to view illustrator profile information, select a corresponding illustrator, and send the request; a communication means for exchanging messages between the illustrator and the client; and a means for analyzing the user's emotions using an emotion engine and adjusting the style and expression of the sketch or rough sketch generated by the generation AI. This makes it possible to create illustrations that accurately reflect the client's emotions and wishes.

[1022] "User" refers to an individual or corporation that accesses and uses the system, specifically an illustrator or client.

[1023] "Email address" refers to the email address that a user uses to register with or contact the system.

[1024] A "password" is a character string used as authentication information when a user logs into a system.

[1025] An "illustrator" is a professional who creates illustrations at the request of a client.

[1026] "Amount" refers to the fee set for the services provided by the illustrator.

[1027] "Sample images" are images that show the illustrator's previous work and style.

[1028] "Profile information" is detailed information about the illustrator, including a self-introduction, examples of past work, and fees.

[1029] "Client" refers to an individual or corporation that uses the system to request the creation of an illustration.

[1030] "Text information" refers to information that specifically describes the content of the illustration desired by the client in text form.

[1031] "Generative AI" is an artificial intelligence that automatically generates sketches and rough drawings based on the client's text information.

[1032] A "pre-drawing" is a rough sketch created before creating the final illustration.

[1033] A "rough sketch" is a type of preliminary sketch, a rougher and more simplified sketch.

[1034] An "emotion engine" is a system that analyzes a user's emotions and reflects them in specific processes and generated content.

[1035] "Style" refers to the way an illustration is expressed and its characteristics, and changes depending on the preferences of the client and illustrator.

[1036] "Communication means" refers to the functions within the system that allow clients and illustrators to exchange messages.

[1037] This invention is a system that efficiently matches users with illustrators and uses a generative AI and emotion engine to refine rough sketches and rough drafts. This system is configured and operates as follows.

[1038] User Registration Module

[1039] The user enters their name, email address, and password from the terminal to register. The server receives the data sent, performs validation (for example, checking the format of the email address, the length and complexity of the password), and then saves it in the database. If registration is successful, the server returns a message to the terminal such as "Registration completed."

[1040] Illustrator Profile Creation Module

[1041] The illustrator enters the amount and sample image from the terminal and creates profile information. This can also include a self-introduction and examples of past work. The server receives the transmitted data, performs validation (for example, checking the format of the amount and the file format of the sample image), and then saves it in the database. When the profile information creation is complete, the server returns a message to the terminal saying, "Your profile has been created."

[1042] A module that uses generative AI to generate sketches / rough drawings

[1043] The requester enters the text information of the desired illustration (for example, "A cat reading a book") from their device and clicks the "Generate sketch" button. The server receives the sent text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The server then receives the generated image data and sends it to the requester's device. The requester then checks the received sketch.

[1044] Use of emotion engine

[1045] The server analyzes the text information and operational behavior entered by the user and recognizes the user's emotions using an emotion engine. Emotions can be extracted from specific keywords entered by the user and the timing of operations, and the style and expression of the sketches and rough drawings created by the generation AI can be adjusted based on these emotions.

[1046] Illustrator selection and production request module

[1047] The requester browses the profile pages of multiple illustrators within the system from their terminal. The requester selects the illustrator who best suits their requirements and enters details into the production request form, including details of the desired illustration and any special requirements. The server receives the production request data and notifies the selected illustrator. The illustrator receives the notification and confirms the detailed request.

[1048] Communication module between illustrator and client

[1049] The illustrator and client exchange chat-style messages within the system from their devices. The emotion engine analyzes emotions in real time during the exchange and can suggest message tone and content based on the recognized emotion. For example, if the client expresses anxiety or dissatisfaction, the emotion engine will suggest appropriate comfort or solutions. The server receives each message and forwards it to the other party's device. Messages are exchanged in real time, enabling rapid communication.

[1050] Specific examples

[1051] For example, if a client requests an illustration of a cat reading a book, they input text information and the AI ​​generates a rough sketch. The emotion engine then extracts emotions from the client's input and actions. For example, if the emotion is joy or excitement, the rough sketch will include expressions that reflect that emotion. This rough sketch can then be used to communicate with the illustrator, minimizing misunderstandings and producing the finished illustration.

[1052] Hardware and software used

[1053] The hardware used to realize this system is a smartphone (iOS or Android), and the software used is a mobile app development platform (React Native). The generative AI uses OpenAI's API, and the emotion engine uses IBM Watson's Tone Analyzer. Below is a specific example of a prompt sentence to input to the generative AI model.

[1054] "You are the AI ​​of an art request system. The user inputs a scene of a dog playing in a flower field. Generate a rough sketch based on this information. Also, if you sense enjoyment in the user's text or actions, reflect that emotion as well."

[1055] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1056] Step 1:

[1057] The user enters their name, email address, and password from the terminal to register. The entered data is sent from the terminal to the server. The server receives this data and performs validation (checks the format of the email address, and the length and complexity of the password). If successful, it saves the user data in the database and returns a message to the terminal saying "Registration completed."

[1058] Input: User's name, email address, and password

[1059] Output: Validation result and registration confirmation message

[1060] Step 2:

[1061] The illustrator enters the amount and sample image from the terminal and creates profile information. The server receives the transmitted data and performs validation (for example, checking the format of the amount and the file format of the sample image). If successful, it saves the profile data in the database and returns a message to the terminal saying "Profile created."

[1062] Input: Illustrator price, sample image, profile

[1063] Output: Validation result and creation confirmation message

[1064] Step 3:

[1065] The requester enters the text information for the desired illustration on their device and clicks the "Generate rough sketch" button. The server receives the text data and passes it to the generation AI model to generate a rough sketch. The generated image data is sent to the requester's device, and the requester can check the received rough sketch.

[1066] Input: Requester's text information (e.g., "A cat reading a book")

[1067] Output: Generated rough sketch

[1068] Step 4:

[1069] The server analyzes the text information and operational behavior entered by the user and recognizes the user's emotions using an emotion engine (IBM Watson's Tone Analyzer). The recognized emotion data is fed back to the generation AI, which adjusts the style and expression of the sketches and rough drawings. The client can then review the adjusted rough drawings and request further revisions if necessary.

[1070] Input: User text information, operation actions

[1071] Output: Rough drawing after adjustments

[1072] Step 5:

[1073] The requester browses the profile pages of multiple illustrators within the system from their terminal. The requester selects the most suitable illustrator and enters details into the production request form. The server receives the production request data and notifies the selected illustrator.

[1074] Input: Request details, illustrator profile information

[1075] Output: Request notification, selection confirmation message

[1076] Step 6:

[1077] The illustrator and client exchange chat-style messages within the system from their devices. The server transfers the messages in real time, and the emotion engine analyzes the tone and content of the messages to provide appropriate feedback.

[1078] Input: User-to-user messages

[1079] Output: Analysis results and appropriate feedback

[1080] Specifically, the following example prompt sentences are used to input the generative AI model:

[1081] "You are the AI ​​of an art request system. The user inputs a scene of a dog playing in a flower field. Generate a rough sketch based on this information. Also, if you sense enjoyment in the user's text or actions, reflect that emotion as well."

[1082] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1083] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1084] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1085] [Third embodiment]

[1086] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1087] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1088] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1089] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1090] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1091] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1092] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1093] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1094] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1095] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1096] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1097] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1098] ---

[1099] This invention is a system that efficiently matches users with illustrators and uses generative AI to refine rough sketches and preliminary drawings. This system is configured and operates as follows.

[1100] User Registration Module

[1101] Using the terminal, users (illustrators and clients) can register by entering their name, email address, and password, which allows them to create an account within the system.

[1102] The server receives the submitted data, performs validation (for example, checking the format of the email address, the length and complexity of the password), and then stores it in a database. If registration is successful, the server returns a message such as "Registration completed" to the terminal.

[1103] Illustrator Profile Creation Module

[1104] Using the terminal, illustrators can input their price and sample images and create profile information, which can include a self-introduction and examples of their past work.

[1105] The server receives the data and stores it in a database after validating it (for example, checking the format of the amount or the file format of the sample image). When the profile information has been created, the server returns a message to the terminal saying "Your profile has been created."

[1106] A module that uses generative AI to generate sketches / rough drawings

[1107] Using the terminal, the requester enters the text information for the desired illustration (for example, "a cat reading a book") and clicks the "Generate sketch" button.

[1108] The server receives the text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The server then receives the generated image data and sends it to the client's device. The client then checks the received sketch.

[1109] Illustrator selection and production request module

[1110] Using a terminal, the client browses the profile pages of multiple illustrators within the system, selects the illustrator who best meets their requirements, and enters details into a production request form, including details of the desired illustration and any special requirements.

[1111] The server receives the production request data and notifies the selected illustrator, who then receives the notification and confirms the details of the request.

[1112] Communication module between illustrator and client

[1113] The illustrator and client can exchange chat-style messages within the system via a terminal, allowing for detailed discussions and confirmation of corrections.

[1114] The server receives each message and forwards it to the other party's device. Messages are exchanged in real time, enabling quick communication.

[1115] Specific examples

[1116] For example, if a client requests an illustration of a cat reading a book, they can input the text information and have the AI ​​generate a rough sketch. This rough sketch can then be used to communicate with the illustrator, minimizing misunderstandings and producing the finished illustration.

[1117] In this way, this system efficiently supports the entire process, starting from user registration, selecting an illustrator, generating a rough sketch using generative AI, and communicating with the illustrator.

[1118] ---

[1119] The processing flow will be explained below.

[1120] (User registration module)

[1121] Step 1:

[1122] The user enters their name, email address, and password and clicks the Register button.

[1123] Step 2:

[1124] The terminal sends the input data to the server.

[1125] Step 3:

[1126] The server receives the submitted data and validates the name, email address, and password to ensure they are valid, for example, checking that the email address is formatted correctly and that the password is of a required length.

[1127] Step 4:

[1128] The server saves the successfully validated data to the database.

[1129] Step 5:

[1130] The server returns a message to the terminal indicating successful registration.

[1131] Step 6:

[1132] The device displays a "Registration complete" message to the user.

[1133] (Illustrator profile creation module)

[1134] Step 1:

[1135] The illustrator enters profile information including the amount and sample image, and clicks the [Save Profile] button.

[1136] Step 2:

[1137] The terminal sends the input data to the server.

[1138] Step 3:

[1139] The server receives the data sent and validates it to ensure the amount is appropriate and the file format of the sample image is correct.

[1140] Step 4:

[1141] The server saves the successfully validated data to the database.

[1142] Step 5:

[1143] The server returns a message to the device indicating that the profile was created successfully.

[1144] Step 6:

[1145] The device will display the message "Profile created" in Illustrator.

[1146] (Module that uses generative AI to generate sketches / rough drawings)

[1147] Step 1:

[1148] The client enters the text information for the illustration they want (e.g., "A cat reading a book") and clicks the "Generate sketch" button.

[1149] Step 2:

[1150] The terminal transmits the text data to the server.

[1151] Step 3:

[1152] The server receives the transmitted text data.

[1153] Step 4:

[1154] The server passes the text data to the generation AI.

[1155] Step 5:

[1156] The generative AI generates a sketch or rough drawing based on text information.

[1157] Step 6:

[1158] The server receives the generated image data.

[1159] Step 7:

[1160] The server transmits the generated image data to the client's terminal.

[1161] Step 8:

[1162] The image received by the terminal is displayed to the requester.

[1163] (Illustrator selection and production request module)

[1164] Step 1:

[1165] The client browses the profiles of multiple illustrators within the system.

[1166] Step 2:

[1167] The client selects the illustrator who best suits their requirements.

[1168] Step 3:

[1169] The requester enters details into the production request form and clicks the [Request] button.

[1170] Step 4:

[1171] The terminal transmits the production request data to the server.

[1172] Step 5:

[1173] The server receives the production request data.

[1174] Step 6:

[1175] The server sends a production request notification to the selected illustrator.

[1176] Step 7:

[1177] The illustrator will receive a notification and confirm the details of the request.

[1178] (Communication module between illustrators and clients)

[1179] Step 1:

[1180] The client or illustrator enters a message in the chat box and clicks the Send button.

[1181] Step 2:

[1182] The terminal transmits the message data to the server.

[1183] Step 3:

[1184] The server receives the message data.

[1185] Step 4:

[1186] The server forwards the received message to the other party's terminal.

[1187] Step 5:

[1188] The message received by the other terminal is displayed on the screen.

[1189] ---

[1190] In this way, this system achieves smooth communication between the user, illustrator, and client through each step.

[1191] Example 1

[1192] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1193] In modern digital art production, the challenge is to efficiently match clients with digital artists and quickly and accurately produce works that reflect their requests. Furthermore, there is a lack of systems that use generative AI to generate rough sketches and quickly exchange corrections. This creates a need for an environment that accurately reflects client requests and efficiently delivers high-quality illustrations.

[1194] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1195] In this invention, the server includes a means for a user to register by inputting their name, email address, and password, a means for a digital artist to input a price and sample images and create profile information, and a means for a client to input text information and generate a rough sketch using a generation AI. This allows a client to view the profile information of digital artists, select the artist that best suits their requirements, and submit their request, enabling rapid communication.

[1196] "User" refers to a person who uses this system, such as a client or a digital artist.

[1197] An "email address" is a personal identifier for sending and receiving messages over the Internet.

[1198] A "password" is a sequence of characters or symbols used for user authentication and to protect a user's account.

[1199] "Registration" refers to the process by which a User enters their information into the System and creates an account.

[1200] A "digital artist" is a professional who creates art using digital technology.

[1201] "Price" refers to the amount of compensation set by a digital artist for the services they provide.

[1202] "Example images" are sample images of works that digital artists have created in the past.

[1203] "Profile Information" is a collection of information about a user or digital artist, including a self-introduction, examples of past work, pricing, etc.

[1204] A "client" is a person who commissions a digital artist to create a particular piece of art.

[1205] "Text information" is text that describes the specific details and requests regarding the illustration desired by the client.

[1206] "Generative AI" is an artificial intelligence technology that automatically generates rough sketches and drafts based on given text information.

[1207] A "rough sketch" is an early sketch made before creating a finished illustration, depicting the basic composition and shapes.

[1208] A "rough sketch" is synonymous with a rough sketch, a simple sketch that forms the basis of a finished product.

[1209] "Communication means" is a function that allows clients and digital artists to exchange messages on the system to discuss details and confirm corrections.

[1210] A "database" is a system that organizes and stores information about users and digital artists.

[1211] "Saving" is the act of recording the input information in a database.

[1212] "Validation" is the process of checking whether entered data is accurate.

[1213] "Transmission" is the act of moving data from one point to another.

[1214] "Receiving" is the act of receiving transmitted data.

[1215] The above are definitions of important terms contained in the claims.

[1216] This invention is a system that efficiently matches users with digital artists and utilizes generative AI to refine rough sketches and sketches. This system is configured and operates as follows.

[1217] User Registration Module

[1218] The terminal allows the user to register by entering their name, email address, and password, which allows the user to create an account within the system.

[1219] The server receives the data and stores it in a database after validating it (for example, checking the format of the email address, the length and complexity of the password). If registration is successful, the server returns a message to the terminal saying "Registration completed."

[1220] Illustrator Profile Creation Module

[1221] The device allows digital artists to input prices and sample images and create profile information, which can include a biographical description and examples of previous work.

[1222] The server receives the data and stores it in a database after validating it (for example, checking the format of the price or the file format of the sample image). When the profile information creation is complete, the server returns a message to the terminal saying "Your profile has been created."

[1223] A module that uses generative AI to generate sketches / rough drawings

[1224] Using the terminal, the requester enters the text information for the desired illustration (for example, "a cat reading a book") and clicks the "Generate sketch" button.

[1225] The server receives the text data and prepares it for transmission to the generative AI model. The generative AI model generates a sketch or rough sketch based on the text information. The server then receives the generated image data and sends it to the client's device. The client then checks the received sketch.

[1226] Illustrator selection and production request module

[1227] Using a terminal, the client browses the profile pages of multiple digital artists within the system, selects the digital artist who best meets their requirements, and enters details into a production request form, including details of the desired illustration and any special requirements.

[1228] The server receives the production request data and notifies the selected digital artist, who then receives the notification and confirms the details of the request.

[1229] Communication module between illustrator and client

[1230] The digital artist and client exchange chat-style messages via the terminal within the system, allowing for detailed discussions and confirmation of corrections.

[1231] The server receives each message and forwards it to the other party's device. Messages are exchanged in real time, enabling quick communication.

[1232] Specific examples

[1233] For example, if a client requests an illustration of a cat reading a book, they can input the text information and have the AI ​​generate a rough sketch. Based on this rough sketch, they can communicate with the digital artist and produce the finished illustration with minimal misunderstandings.

[1234] Prompt Sentence Examples

[1235] Enter the following prompt into the generative AI model:

[1236] "Generate a rough sketch of a cat reading a book."

[1237] In this way, this system efficiently supports a series of processes, starting from user registration, selecting a digital artist, generating a sketch using generative AI, and communicating with the digital artist.

[1238] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1239] Step 1:

[1240] The user enters user information from the terminal.

[1241] The user enters their name, email address, and password and clicks the Register button.

[1242] The terminal receives the input user information and transmits it to the server.

[1243] Input data: Name, email address, password

[1244] Output data: User information sent to the server

[1245] Step 2:

[1246] The server receives and validates the user information

[1247] The server receives the name, email address, and password submitted by the user.

[1248] The server checks the format of the email address and validates the length and complexity of the password.

[1249] Input data: User information

[1250] Output data: Validation result (success or failure)

[1251] Step 3:

[1252] The server stores the user information in a database

[1253] If validation is successful, the server saves the user information in the database.

[1254] If the save is successful, the server returns a message to the terminal saying "Registration completed."

[1255] Input data: User information that has passed validation

[1256] Output data: User information stored in the database, registration completion message

[1257] Step 4:

[1258] Digital artists enter their profile information on their devices

[1259] Digital artists enter their price, sample images, a self-introduction, and examples of their past work, then click the profile creation button.

[1260] The terminal transmits this information to the server.

[1261] Input data: price, sample images, self-introduction, examples of past work

[1262] Output data: Profile information sent to the server

[1263] Step 5:

[1264] The server receives and validates the profile information

[1265] The server checks the received price, file format of the sample image, etc.

[1266] Input data: Profile information

[1267] Output data: Validation result (success or failure)

[1268] Step 6:

[1269] The server stores the profile information in a database

[1270] If validation passes, the server stores the profile information in a database.

[1271] When the creation of the profile information is complete, the server returns a message to the terminal saying "Profile created."

[1272] Input data: Validated profile information

[1273] Output data: Profile information saved in the database, profile creation completion message

[1274] Step 7:

[1275] The client enters the text information for the illustration from the device.

[1276] The client enters the text information for the desired illustration (e.g., "A cat reading a book") and clicks the "Generate sketch" button.

[1277] The terminal transmits the text information to the server.

[1278] Input data: Text information of the desired illustration

[1279] Output data: Text information sent to the server

[1280] Step 8:

[1281] The server passes the text information to the AI ​​generator, which generates a rough sketch.

[1282] The server passes the received text information to the generative AI model.

[1283] The generative AI model generates a rough sketch or outline based on text information.

[1284] Input data: Text information

[1285] Output data: Generated sketch or rough drawing

[1286] Step 9:

[1287] The server receives the generated image data and sends it to the terminal.

[1288] The server receives the image data generated from the generative AI model.

[1289] The server transmits the image data to the client's terminal and causes the client to display the image data.

[1290] Input data: Generated image data

[1291] Output data: Image data sent to the terminal, displayed sketch

[1292] Step 10:

[1293] Clients can browse multiple digital artists from their device

[1294] The client uses the device to view the profile pages of multiple digital artists.

[1295] Input data: None

[1296] Output data: Displayed digital artist profile information

[1297] Step 11:

[1298] The client fills out the production request form

[1299] The client fills out and submits a production request form, including details of the desired illustration and any special requirements.

[1300] The terminal transmits this information to the server.

[1301] Input data: Production request information

[1302] Output data: Production request information sent to the server

[1303] Step 12:

[1304] The server receives the production request data and notifies the digital artist.

[1305] The server receives production request data from the client.

[1306] The server notifies the selected digital artist of the request.

[1307] Input data: Production request information

[1308] Output data: Request details notified to the digital artist

[1309] Step 13:

[1310] Digital artists and clients can use chat within the system from their devices.

[1311] Digital artists and clients use the chat-style messaging function within the system to hold detailed discussions and confirm corrections.

[1312] Input data: Message content

[1313] Output data: Received and sent messages

[1314] Step 14:

[1315] The server receives and forwards messages

[1316] The server receives the message and forwards it to the other device, allowing for real-time message exchange.

[1317] Input data: Message content

[1318] Output data: Forwarded message

[1319] In this way, we can detail how specific inputs and outputs are handled at each step.

[1320] (Application example 1)

[1321] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1322] In conventional illustration request systems, it was difficult for users to reach a common image when communicating their request to an illustrator, resulting in frequent discrepancies between the request and the finished product. Furthermore, even in remote communication, the exchange of opinions between the illustrator and the client was often not smooth, making it difficult to realize an optimal illustration request. The present invention aims to solve these problems and provide a system that allows users to efficiently and accurately request illustrations in a virtual space.

[1323] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1324] In this invention, the server includes: a means for a user to register by entering their name, email address, and password; a means for an illustrator to enter a price and a sample image and create profile information; a means for a client to enter text information and use a generation AI to generate a sketch or rough sketch; a means for a client to view illustrator profile information, select a corresponding illustrator, and send the request details; a means for the client to check the sketch or rough sketch created by the generation AI in a virtual space; and a communication means for exchanging messages between the illustrator and the client. This makes it possible to proceed with the work while checking and adjusting the request details in real time in the virtual space.

[1325] "User" refers to the client and illustrator who uses the system.

[1326] An "illustrator" is a professional who creates profile information within the system and responds to illustration requests from clients.

[1327] "Text information" refers to the text information that the client inputs to generate a sketch or rough drawing using the generation AI.

[1328] "Generative AI" is an artificial intelligence technology that automatically generates sketches or rough drawings based on text information.

[1329] A "rough sketch" is a simplified drawing that serves as the basis for creating the final illustration.

[1330] A "rough drawing" is a rough illustration sketch that helps to visually grasp the client's intentions.

[1331] "Virtual space" is a virtual environment where clients and illustrators can check and adjust rough sketches and drawings in real time.

[1332] "Profile information" is a self-introduction created by the illustrator, detailed information about past works, and services provided.

[1333] "Means of communication" refers to the method used to exchange messages between the illustrator and the client.

[1334] This invention is a system that efficiently matches users with illustrators and uses AI to refine rough sketches and rough drafts. The following is a detailed description of the invention.

[1335] 1. User Registration Module

[1336] The user uses the terminal to enter their name, email address, and password to register with the system. The server receives the data sent, validates it (for example, checks the format of the email address, the length and complexity of the password), and stores it in a database. If registration is successful, the server returns a message to the user's terminal saying "Registration completed."

[1337] 2. Illustrator Profile Creation Module

[1338] The illustrator uses the terminal to input the amount and a sample image to create profile information. The server receives the transmitted data, validates it, and then saves it in the database. When the profile information creation is complete, the server returns a message to the terminal saying "Profile created."

[1339] 3. A module that uses generative AI to generate sketches / rough drawings

[1340] The requester uses their device to input the text information for the desired illustration (for example, "A cat reading a book") and clicks the "Generate sketch" button. The server receives the sent text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The server receives the generated image data and sends it to the requester's device. The requester can then check the received sketch in virtual space.

[1341] As an example, suppose the user enters the following prompt sentence:

[1342] Prompt: "Please draw a cat flying through space. I'd like the background to be filled with stars, with the cat gliding through the starry sky."

[1343] 4. Illustrator selection and production request module

[1344] The client uses a terminal to view the profile pages of multiple illustrators. The client selects the illustrator who best meets their requirements and enters details into the request form, including details of the desired illustration and any special requirements. The server receives the production request data and notifies the selected illustrator. The illustrator receives the notification and confirms the detailed request.

[1345] 5. Communication module between illustrator and client

[1346] Illustrators and clients can exchange chat-style messages within the system using their devices. The server receives the messages and forwards them to the other party's device. Messages are exchanged in real time, enabling rapid communication.

[1347] The system uses React Native on the front end, Django on the back end, and GPT-3-based APIs as a generative AI model, allowing users to order and customize illustrations with high efficiency and accuracy.

[1348] The above is a detailed embodiment of the present invention.

[1349] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1350] Step 1:

[1351] User Registration

[1352] The user uses a terminal to enter their name, email address, and password to register. The entered data is sent to the server. The server receives the data and performs validation (checks the format of the email address, and the length and complexity of the password). If validation is successful, the server saves the data in the database and returns a message to the user's terminal saying "Registration completed."

[1353] Step 2:

[1354] Illustrator profile creation

[1355] Illustrators use their devices to enter the amount, sample image, self-introduction, and examples of past work to create their profile information. The entered data is sent to the server. The server receives the data and validates it (checks the format of the sample image and the amount). If validation is successful, the server saves the data in the database and returns a message to the illustrator's device saying "Your profile has been created."

[1356] Step 3:

[1357] Generate sketches / rough drawings using generative AI

[1358] The requester uses their device to enter the text information for the desired illustration (e.g., a cat reading a book) and clicks the "Generate sketch" button. The entered text data is sent to the server, which prepares to pass the data to the generation AI. The generation AI automatically generates a sketch or rough drawing based on the text information. The server then receives the generated image data and sends it to the requester's device. The requester can then check the received sketch in virtual space.

[1359] Step 4:

[1360] Illustrator selection and production request

[1361] The client uses a terminal to view the profile pages of multiple illustrators. They select the illustrator who best meets their requirements and enter details of the desired illustration and any special requirements into the request form. The entered request data is sent to the server. The server receives the data and notifies the selected illustrator. The illustrator receives the notification and confirms the detailed request content.

[1362] Step 5:

[1363] Communication between illustrator and client

[1364] Illustrators and clients use their devices to exchange chat-style messages within the system. Messages are sent and received via a server, which stores the messages as a log and forwards them to the other party's device in real time. This allows for fast and efficient communication.

[1365] The above are the specific processing steps of this system.

[1366] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1367] ---

[1368] This invention is a system that efficiently matches users with illustrators and uses a generative AI and emotion engine to refine rough sketches and rough drafts. This system is configured and operates as follows.

[1369] User Registration Module

[1370] Using the terminal, users (illustrators and clients) can register by entering their name, email address, and password, which allows them to create an account within the system.

[1371] The server receives the submitted data, performs validation (for example, checking the format of the email address, the length and complexity of the password), and then stores it in a database. If registration is successful, the server returns a message such as "Registration completed" to the terminal.

[1372] Illustrator Profile Creation Module

[1373] Using the terminal, illustrators can input their price and sample images and create profile information, which can include a self-introduction and examples of their past work.

[1374] The server receives the data and stores it in a database after validating it (for example, checking the format of the amount or the file format of the sample image). When the profile information has been created, the server returns a message to the terminal saying "Your profile has been created."

[1375] A module that uses generative AI to generate sketches / rough drawings

[1376] Using the terminal, the requester enters the text information for the desired illustration (for example, "a cat reading a book") and clicks the "Generate sketch" button.

[1377] The server receives the text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The server then receives the generated image data and sends it to the client's device. The client then checks the received sketch.

[1378] Use of emotion engine

[1379] The server analyzes the text information and operational behavior entered by the user and recognizes the user's emotions using an emotion engine. Emotions can be extracted from specific keywords entered by the user and the timing of operations, and the style and expression of the sketches and rough drawings created by the generation AI can be adjusted based on these emotions.

[1380] Illustrator selection and production request module

[1381] Using a terminal, the client browses the profile pages of multiple illustrators within the system, selects the illustrator who best meets their requirements, and enters details into a production request form, including details of the desired illustration and any special requirements.

[1382] The server receives the production request data and notifies the selected illustrator, who then receives the notification and confirms the details of the request.

[1383] Communication module between illustrator and client

[1384] The illustrator and client exchange chat-style messages within the system via the device. The emotion engine analyzes emotions in real time during the exchange and can suggest message tone and content based on the recognized emotions. For example, if the client expresses anxiety or dissatisfaction, the emotion engine will suggest appropriate comfort or solutions.

[1385] The server receives each message and forwards it to the other party's device. Messages are exchanged in real time, enabling quick communication.

[1386] Specific examples

[1387] For example, if a client requests an illustration of a cat reading a book, they input text information and the AI ​​generates a rough sketch. The emotion engine then extracts emotions from the client's input and actions. For example, if the emotion is joy or excitement, the rough sketch will include expressions that reflect that emotion. This rough sketch can then be used to communicate with the illustrator, minimizing misunderstandings and producing the finished illustration.

[1388] In this way, the system can accurately analyze the user's emotions and reflect them in the production process, thereby providing illustrations of higher quality that meet the user's expectations.

[1389] ---

[1390] The processing flow will be explained below.

[1391] (User registration module)

[1392] Step 1:

[1393] The user enters their name, email address, and password and clicks the Register button.

[1394] Step 2:

[1395] The terminal sends the input data to the server.

[1396] Step 3:

[1397] The server receives the submitted data and validates the name, email address, and password to ensure they are valid, for example, checking that the email address is formatted correctly and that the password is of a required length.

[1398] Step 4:

[1399] The server saves the successfully validated data to the database.

[1400] Step 5:

[1401] The server returns a message to the terminal indicating successful registration.

[1402] Step 6:

[1403] The device displays a "Registration complete" message to the user.

[1404] (Illustrator profile creation module)

[1405] Step 1:

[1406] The illustrator enters profile information including the amount and sample image, and clicks the [Save Profile] button.

[1407] Step 2:

[1408] The terminal sends the input data to the server.

[1409] Step 3:

[1410] The server receives the data sent and validates it to ensure the amount is appropriate and the file format of the sample image is correct.

[1411] Step 4:

[1412] The server saves the successfully validated data to the database.

[1413] Step 5:

[1414] The server returns a message to the device indicating that the profile was created successfully.

[1415] Step 6:

[1416] The device will display the message "Profile created" in Illustrator.

[1417] (Module that uses generative AI to generate sketches / rough drawings)

[1418] Step 1:

[1419] The client enters the text information for the illustration they want (e.g., "A cat reading a book") and clicks the "Generate sketch" button.

[1420] Step 2:

[1421] The terminal transmits the text data to the server.

[1422] Step 3:

[1423] The server receives the transmitted text data.

[1424] Step 4:

[1425] The server passes the text data to the generation AI.

[1426] Step 5:

[1427] The generative AI generates a sketch or rough drawing based on text information.

[1428] Step 6:

[1429] The server receives the generated image data.

[1430] Step 7:

[1431] The server transmits the generated image data to the client's terminal.

[1432] Step 8:

[1433] The image received by the terminal is displayed to the requester.

[1434] (Using Emotion Engine)

[1435] Step 1:

[1436] The server receives the text information and operation actions entered by the user.

[1437] Step 2:

[1438] The server uses an emotion engine to analyze the user's emotions. For example, emotions can be extracted from keywords contained in text information, input speed, operation timing, etc.

[1439] Step 3:

[1440] The server passes the recognized emotional information to the generation AI.

[1441] Step 4:

[1442] The generative AI adjusts the style and expression of the sketch or rough draft based on emotional information.

[1443] (Illustrator selection and production request module)

[1444] Step 1:

[1445] The client browses the profiles of multiple illustrators within the system.

[1446] Step 2:

[1447] The client selects the illustrator who best suits their requirements.

[1448] Step 3:

[1449] The requester enters details into the production request form and clicks the [Request] button.

[1450] Step 4:

[1451] The terminal transmits the production request data to the server.

[1452] Step 5:

[1453] The server receives the production request data.

[1454] Step 6:

[1455] The server sends a production request notification to the selected illustrator.

[1456] Step 7:

[1457] The illustrator will receive a notification and confirm the details of the request.

[1458] (Communication module between illustrators and clients)

[1459] Step 1:

[1460] The client or illustrator enters a message in the chat box and clicks the Send button.

[1461] Step 2:

[1462] The terminal transmits the message data to the server.

[1463] Step 3:

[1464] The server receives the message data.

[1465] Step 4:

[1466] The server forwards the received message to the other party's terminal.

[1467] Step 5:

[1468] The message received by the other terminal is displayed on the screen.

[1469] Step 6:

[1470] The server uses an emotion engine to analyze the tone and content of the message and make appropriate suggestions. For example, if the requester expresses anxiety, it will suggest appropriate comfort or solutions.

[1471] ---

[1472] In this way, this system analyzes the user's emotions and reflects them in the generation AI and communication, providing illustrations of higher quality that meet the user's expectations.

[1473] Example 2

[1474] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1475] In traditional illustration production, there is a problem that mismatches in intentions and emotions between the client and the illustrator easily occur, resulting in an inefficient production process. It is also difficult to generate rough sketches or sketches that accurately reflect the client's emotions and intentions, which can result in a decrease in client satisfaction. Furthermore, if communication between the client and the illustrator is not effective enough, the efficiency and quality of the production can be compromised.

[1476] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for a user to enter their name, email address, and password and perform registration; a means for an illustrator to enter a price and a sample image, create and save profile information, and perform validation; a means for using a generation AI to generate a sketch or rough sketch from the client's text information and using an emotion engine to reflect the user's emotions in the generated sketch; a means including an emotion engine for a client to view the illustrator's profile information, select a corresponding illustrator, submit the request, and make appropriate suggestions; and a communication means for exchanging messages between the illustrator and the client. This enables the generation of a sketch or rough sketch that accurately reflects the user's emotions and intentions, facilitates communication between the client and the illustrator, and makes the production process efficient and high-quality.

[1477] "User Registration" is the process of creating an account within the system by entering your name, email address, and password.

[1478] "Illustrator Profile Creation" is the process by which an illustrator builds a profile page by entering information such as price, sample images, a self-introduction, and examples of past work.

[1479] "Data validation" is the process of checking whether the entered information conforms to the specified format and conditions.

[1480] "Generative AI" is artificial intelligence that automatically generates sketches or rough drawings based on text information.

[1481] An "emotion engine" is a technology that analyzes a user's input text and behavioral data to recognize and reflect the user's emotions.

[1482] "Sketch / rough drawing generation" is the process in which the generation AI creates a sketch or rough drawing based on the text information entered by the client.

[1483] "Submit Request" is the process by which a client sends production details and special requirements to the illustrator of their choice.

[1484] "Communication means" refers to an interface that allows illustrators and clients to exchange messages within the system, enabling real-time communication.

[1485] This invention is a system that efficiently matches users with illustrators and uses a generative AI and emotion engine to refine rough sketches and drafts. The system aims to provide a higher level of completion and satisfaction by analyzing the user's emotions and generating rough sketches that reflect those emotions. The detailed configuration and operation of this system are described below.

[1486] User Registration Module

[1487] The terminal prompts the user to enter their name, email address, and password, and sends this information to the server. The server then checks the format of the email address and validates the password length and complexity, and stores the data in a database. If registration is successful, it returns a message to the terminal saying "Registration completed."

[1488] Illustrator Profile Creation Module

[1489] The device prompts the illustrator to enter the price, sample image, self-introduction, examples of past work, etc., and sends this to the server. The server validates the received data, checking the format of the price and the file format of the sample image, and stores it in a database. When the profile information has been created, it returns a message to the device saying "Your profile has been created."

[1490] A module that uses generative AI to generate sketches / rough drawings

[1491] The terminal prompts the requester to enter text information for the desired illustration and click the "Generate sketch" button. The server receives the text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The generated image data is sent to the terminal via the server, and the requester confirms it.

[1492] For example, if a client wants to create a picture of a cat reading a book, they input the text "cat reading a book" into the device, and the AI ​​generates a rough sketch based on this information. The prompt will then be "Generate an image of a cat reading a book."

[1493] Use of emotion engine

[1494] The server uses an emotion engine to analyze the user's input text and operational behavior and recognize the user's emotions. The recognized emotions are reflected in the parameters of the generation AI, and the style and expression of the sketch and rough illustration are adjusted. For example, if the user enters the text "Amazing!", the emotion engine recognizes a high level of positive emotion and adds a prompt to the generation AI saying "Reflect positive emotion in the sketch," thereby reflecting that emotion in the rough illustration that is generated.

[1495] Illustrator selection and production request module

[1496] The terminal allows the requester to view the profile pages of multiple illustrators in the system and select the illustrator who best suits their requirements. The requester enters the details of the production request for the selected illustrator and sends them to the server. The server notifies the selected illustrator of the received production request data, and the illustrator confirms the detailed request content.

[1497] Communication module between illustrator and client

[1498] The device allows the illustrator and client to exchange messages in chat format. The emotion engine analyzes emotions in real time during the message exchange and suggests message tone and content based on the recognized emotion. For example, if the client types "I'm a little anxious...", the emotion engine recognizes the emotion of anxiety and suggests appropriate comfort or solutions. The server supports rapid communication by sending messages and forwarding them to the other party's device.

[1499] The above system enables efficient and high-quality illustration production that focuses on the user's emotions and intentions.

[1500] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1501] Program processing step details

[1502] Step 1: Enter and submit user information

[1503] Input: User enters name, email address, and password.

[1504] Processing: The terminal displays the input form and temporarily saves the entered information. When the user clicks the submit button, the entered data is sent to the server.

[1505] Output: A transmission completion notification and data are sent to the server.

[1506] Step 2: Validate and save user information

[1507] Input: User data sent to the server.

[1508] Processing: The server validates the submitted data. Specifically, it checks the format of the email address and the length and complexity of the password. Data that passes validation is saved in the database.

[1509] Output: A registration completion message is returned to the terminal. User information is saved in the database.

[1510] Step 3: Enter and submit your Illustrator profile information

[1511] Input: The illustrator will enter the price, sample image, self-introduction, and examples of past work.

[1512] Processing: The terminal displays the input form and temporarily saves the information entered by the illustrator. When the submit button is clicked, the input data is sent to the server.

[1513] Output: A transmission completion notification and data are sent to the server.

[1514] Step 4: Validate and save profile information

[1515] Input: Profile data sent to the server.

[1516] Processing: The server checks the format of the amount and the file format of the sample image for the submitted data. Data that passes validation is saved in the database.

[1517] Output: A message is returned to the terminal saying that the profile has been created. The profile information is saved in the database.

[1518] Step 5: Enter and submit requester's text information

[1519] Input: The requester enters the text information for the requested illustration.

[1520] Processing: The terminal displays a text input field and temporarily stores the information entered by the requester. When the user clicks the sketch generation button, the text data is sent to the server.

[1521] Output: A transmission completion notification and data are sent to the server.

[1522] Step 6: Convert text information and send it to the generation AI

[1523] Input: The text data sent to the server.

[1524] Processing: The server converts the text data into a prompt that can be interpreted by the generative AI model. The input "An image of a cat reading a book" is converted into a prompt such as "Generate an image of a cat reading a book." This is then sent to the generative AI.

[1525] Output: The prompt sent to the generation AI.

[1526] Step 7: Create and send rough sketches

[1527] Input: A prompt from the generative AI.

[1528] Processing: The AI ​​generates a rough sketch based on the prompt and returns the image data to the server.

[1529] Output: Image data returned to the server. Transferred to the requester's device and displayed.

[1530] Step 8: Sentiment analysis and reflection of emotional data

[1531] Input: The requester's input text and operation behavior data.

[1532] Processing: The server uses an emotion engine to analyze the text and behavioral data. For example, the text "Amazing!" is recognized as a highly positive emotion. This data is used as a parameter for the generation AI, and the instruction "Reflect positive emotion in the sketch" is sent to the generation AI.

[1533] Output: Emotion recognition data from the emotion engine. Emotion reflection parameters sent to the generation AI.

[1534] Step 9: Browse and select an Illustrator profile

[1535] Input: Illustrator selection by client.

[1536] Processing: The terminal displays the profile pages of multiple illustrators, allowing the client to select the illustrator who best suits their needs. Data is then sent to the server to notify the selected illustrator.

[1537] Output: Selected Illustrator. Submitted request data.

[1538] Step 10: Submit your production request

[1539] Input: Detailed information about the request.

[1540] Processing: The requester fills in the request form with detailed illustration information and special requests, then clicks the submit button. The server receives the data and notifies the selected illustrator.

[1541] Output: Request details. Notification to illustrator.

[1542] Step 11: Message exchange and sentiment analysis

[1543] Input: Message data between illustrator and client.

[1544] Processing: The device displays a chat interface and supports sending and receiving messages. The server uses an emotion engine to analyze the message content and suggest appropriate replies.

[1545] Output: Suggested reply. Sent message.

[1546] This detailed processing step clarifies how the system operates to provide high quality service to users.

[1547] (Application example 2)

[1548] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1549] In conventional illustration production request systems, misunderstandings easily occur between the client and the illustrator, making it difficult to create an illustration that fully reflects the client's feelings and wishes. Furthermore, communication often becomes complicated and does not flow smoothly. A means of analyzing the client's feelings in real time and providing appropriate feedback was needed.

[1550] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1551] In this invention, the server includes: a means for a user to register by entering their name, email address, and password; a means for an illustrator to enter a price and a sample image and create profile information; a means for a client to enter text information and use a generation AI to generate a sketch or rough sketch; a means for a client to view illustrator profile information, select a corresponding illustrator, and send the request; a communication means for exchanging messages between the illustrator and the client; and a means for analyzing the user's emotions using an emotion engine and adjusting the style and expression of the sketch or rough sketch generated by the generation AI. This makes it possible to create illustrations that accurately reflect the client's emotions and wishes.

[1552] "User" refers to an individual or corporation that accesses and uses the system, specifically an illustrator or client.

[1553] "Email address" refers to the email address that a user uses to register with or contact the system.

[1554] A "password" is a character string used as authentication information when a user logs into a system.

[1555] An "illustrator" is a professional who creates illustrations at the request of a client.

[1556] "Amount" refers to the fee set for the services provided by the illustrator.

[1557] "Sample images" are images that show the illustrator's previous work and style.

[1558] "Profile information" is detailed information about the illustrator, including a self-introduction, examples of past work, and fees.

[1559] "Client" refers to an individual or corporation that uses the system to request the creation of an illustration.

[1560] "Text information" refers to information that specifically describes the content of the illustration desired by the client in text form.

[1561] "Generative AI" is an artificial intelligence that automatically generates sketches and rough drawings based on the client's text information.

[1562] A "pre-drawing" is a rough sketch created before creating the final illustration.

[1563] A "rough sketch" is a type of preliminary sketch, a rougher and more simplified sketch.

[1564] An "emotion engine" is a system that analyzes a user's emotions and reflects them in specific processes and generated content.

[1565] "Style" refers to the way an illustration is expressed and its characteristics, and changes depending on the preferences of the client and illustrator.

[1566] "Communication means" refers to the functions within the system that allow clients and illustrators to exchange messages.

[1567] This invention is a system that efficiently matches users with illustrators and uses a generative AI and emotion engine to refine rough sketches and rough drafts. This system is configured and operates as follows.

[1568] User Registration Module

[1569] The user enters their name, email address, and password from the terminal to register. The server receives the data sent, performs validation (for example, checking the format of the email address, the length and complexity of the password), and then saves it in the database. If registration is successful, the server returns a message to the terminal such as "Registration completed."

[1570] Illustrator Profile Creation Module

[1571] The illustrator enters the amount and sample image from the terminal and creates profile information. This can also include a self-introduction and examples of past work. The server receives the transmitted data, performs validation (for example, checking the format of the amount and the file format of the sample image), and then saves it in the database. When the profile information creation is complete, the server returns a message to the terminal saying, "Your profile has been created."

[1572] A module that uses generative AI to generate sketches / rough drawings

[1573] The requester enters the text information of the desired illustration (for example, "A cat reading a book") from their device and clicks the "Generate sketch" button. The server receives the sent text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The server then receives the generated image data and sends it to the requester's device. The requester then checks the received sketch.

[1574] Use of emotion engine

[1575] The server analyzes the text information and operational behavior entered by the user and recognizes the user's emotions using an emotion engine. Emotions can be extracted from specific keywords entered by the user and the timing of operations, and the style and expression of the sketches and rough drawings created by the generation AI can be adjusted based on these emotions.

[1576] Illustrator selection and production request module

[1577] The requester browses the profile pages of multiple illustrators within the system from their terminal. The requester selects the illustrator who best suits their requirements and enters details into the production request form, including details of the desired illustration and any special requirements. The server receives the production request data and notifies the selected illustrator. The illustrator receives the notification and confirms the detailed request.

[1578] Communication module between illustrator and client

[1579] The illustrator and client exchange chat-style messages within the system from their devices. The emotion engine analyzes emotions in real time during the exchange and can suggest message tone and content based on the recognized emotion. For example, if the client expresses anxiety or dissatisfaction, the emotion engine will suggest appropriate comfort or solutions. The server receives each message and forwards it to the other party's device. Messages are exchanged in real time, enabling rapid communication.

[1580] Specific examples

[1581] For example, if a client requests an illustration of a cat reading a book, they input text information and the AI ​​generates a rough sketch. The emotion engine then extracts emotions from the client's input and actions. For example, if the emotion is joy or excitement, the rough sketch will include expressions that reflect that emotion. This rough sketch can then be used to communicate with the illustrator, minimizing misunderstandings and producing the finished illustration.

[1582] Hardware and software used

[1583] The hardware used to realize this system is a smartphone (iOS or Android), and the software used is a mobile app development platform (React Native). The generative AI uses OpenAI's API, and the emotion engine uses IBM Watson's Tone Analyzer. Below is a specific example of a prompt sentence to input to the generative AI model.

[1584] "You are the AI ​​of an art request system. The user inputs a scene of a dog playing in a flower field. Generate a rough sketch based on this information. Also, if you sense enjoyment in the user's text or actions, reflect that emotion as well."

[1585] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1586] Step 1:

[1587] The user enters their name, email address, and password from the terminal to register. The entered data is sent from the terminal to the server. The server receives this data and performs validation (checks the format of the email address, and the length and complexity of the password). If successful, it saves the user data in the database and returns a message to the terminal saying "Registration completed."

[1588] Input: User's name, email address, and password

[1589] Output: Validation result and registration confirmation message

[1590] Step 2:

[1591] The illustrator enters the amount and sample image from the terminal and creates profile information. The server receives the transmitted data and performs validation (for example, checking the format of the amount and the file format of the sample image). If successful, it saves the profile data in the database and returns a message to the terminal saying "Profile created."

[1592] Input: Illustrator price, sample image, profile

[1593] Output: Validation result and creation confirmation message

[1594] Step 3:

[1595] The requester enters the text information for the desired illustration on their device and clicks the "Generate rough sketch" button. The server receives the text data and passes it to the generation AI model to generate a rough sketch. The generated image data is sent to the requester's device, and the requester can check the received rough sketch.

[1596] Input: Requester's text information (e.g., "A cat reading a book")

[1597] Output: Generated rough sketch

[1598] Step 4:

[1599] The server analyzes the text information and operational behavior entered by the user and recognizes the user's emotions using an emotion engine (IBM Watson's Tone Analyzer). The recognized emotion data is fed back to the generation AI, which adjusts the style and expression of the sketches and rough drawings. The client can then review the adjusted rough drawings and request further revisions if necessary.

[1600] Input: User text information, operation actions

[1601] Output: Rough drawing after adjustments

[1602] Step 5:

[1603] The requester browses the profile pages of multiple illustrators within the system from their terminal. The requester selects the most suitable illustrator and enters details into the production request form. The server receives the production request data and notifies the selected illustrator.

[1604] Input: Request details, illustrator profile information

[1605] Output: Request notification, selection confirmation message

[1606] Step 6:

[1607] The illustrator and client exchange chat-style messages within the system from their devices. The server transfers the messages in real time, and the emotion engine analyzes the tone and content of the messages to provide appropriate feedback.

[1608] Input: User-to-user messages

[1609] Output: Analysis results and appropriate feedback

[1610] Specifically, the following example prompt sentences are used to input the generative AI model:

[1611] "You are the AI ​​of an art request system. The user inputs a scene of a dog playing in a flower field. Generate a rough sketch based on this information. Also, if you sense enjoyment in the user's text or actions, reflect that emotion as well."

[1612] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1613] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1614] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1615] [Fourth embodiment]

[1616] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1617] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1618] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1619] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1620] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1621] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1622] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1623] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1624] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1625] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1626] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1627] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1628] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1629] ---

[1630] This invention is a system that efficiently matches users with illustrators and uses generative AI to refine rough sketches and preliminary drawings. This system is configured and operates as follows.

[1631] User Registration Module

[1632] Using the terminal, users (illustrators and clients) can register by entering their name, email address, and password, which allows them to create an account within the system.

[1633] The server receives the submitted data, performs validation (for example, checking the format of the email address, the length and complexity of the password), and then stores it in a database. If registration is successful, the server returns a message such as "Registration completed" to the terminal.

[1634] Illustrator Profile Creation Module

[1635] Using the terminal, illustrators can input their price and sample images and create profile information, which can include a self-introduction and examples of their past work.

[1636] The server receives the data and stores it in a database after validating it (for example, checking the format of the amount or the file format of the sample image). When the profile information has been created, the server returns a message to the terminal saying "Your profile has been created."

[1637] A module that uses generative AI to generate sketches / rough drawings

[1638] Using the terminal, the requester enters the text information for the desired illustration (for example, "a cat reading a book") and clicks the "Generate sketch" button.

[1639] The server receives the text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The server then receives the generated image data and sends it to the client's device. The client then checks the received sketch.

[1640] Illustrator selection and production request module

[1641] Using a terminal, the client browses the profile pages of multiple illustrators within the system, selects the illustrator who best meets their requirements, and enters details into a production request form, including details of the desired illustration and any special requirements.

[1642] The server receives the production request data and notifies the selected illustrator, who then receives the notification and confirms the details of the request.

[1643] Communication module between illustrator and client

[1644] The illustrator and client can exchange chat-style messages within the system via a terminal, allowing for detailed discussions and confirmation of corrections.

[1645] The server receives each message and forwards it to the other party's device. Messages are exchanged in real time, enabling quick communication.

[1646] Specific examples

[1647] For example, if a client requests an illustration of a cat reading a book, they can input the text information and have the AI ​​generate a rough sketch. This rough sketch can then be used to communicate with the illustrator, minimizing misunderstandings and producing the finished illustration.

[1648] In this way, this system efficiently supports the entire process, starting from user registration, selecting an illustrator, generating a rough sketch using generative AI, and communicating with the illustrator.

[1649] ---

[1650] The processing flow will be explained below.

[1651] (User registration module)

[1652] Step 1:

[1653] The user enters their name, email address, and password and clicks the Register button.

[1654] Step 2:

[1655] The terminal sends the input data to the server.

[1656] Step 3:

[1657] The server receives the submitted data and validates the name, email address, and password to ensure they are valid, for example, checking that the email address is formatted correctly and that the password is of a required length.

[1658] Step 4:

[1659] The server saves the successfully validated data to the database.

[1660] Step 5:

[1661] The server returns a message to the terminal indicating successful registration.

[1662] Step 6:

[1663] The device displays a "Registration complete" message to the user.

[1664] (Illustrator profile creation module)

[1665] Step 1:

[1666] The illustrator enters profile information including the amount and sample image, and clicks the [Save Profile] button.

[1667] Step 2:

[1668] The terminal sends the input data to the server.

[1669] Step 3:

[1670] The server receives the data sent and validates it to ensure the amount is appropriate and the file format of the sample image is correct.

[1671] Step 4:

[1672] The server saves the successfully validated data to the database.

[1673] Step 5:

[1674] The server returns a message to the device indicating that the profile was created successfully.

[1675] Step 6:

[1676] The device will display the message "Profile created" in Illustrator.

[1677] (Module that uses generative AI to generate sketches / rough drawings)

[1678] Step 1:

[1679] The client enters the text information for the illustration they want (e.g., "A cat reading a book") and clicks the "Generate sketch" button.

[1680] Step 2:

[1681] The terminal transmits the text data to the server.

[1682] Step 3:

[1683] The server receives the transmitted text data.

[1684] Step 4:

[1685] The server passes the text data to the generation AI.

[1686] Step 5:

[1687] The generative AI generates a sketch or rough drawing based on text information.

[1688] Step 6:

[1689] The server receives the generated image data.

[1690] Step 7:

[1691] The server transmits the generated image data to the client's terminal.

[1692] Step 8:

[1693] The image received by the terminal is displayed to the requester.

[1694] (Illustrator selection and production request module)

[1695] Step 1:

[1696] The client browses the profiles of multiple illustrators within the system.

[1697] Step 2:

[1698] The client selects the illustrator who best suits their requirements.

[1699] Step 3:

[1700] The requester enters details into the production request form and clicks the [Request] button.

[1701] Step 4:

[1702] The terminal transmits the production request data to the server.

[1703] Step 5:

[1704] The server receives the production request data.

[1705] Step 6:

[1706] The server sends a production request notification to the selected illustrator.

[1707] Step 7:

[1708] The illustrator will receive a notification and confirm the details of the request.

[1709] (Communication module between illustrators and clients)

[1710] Step 1:

[1711] The client or illustrator enters a message in the chat box and clicks the Send button.

[1712] Step 2:

[1713] The terminal transmits the message data to the server.

[1714] Step 3:

[1715] The server receives the message data.

[1716] Step 4:

[1717] The server forwards the received message to the other party's terminal.

[1718] Step 5:

[1719] The message received by the other terminal is displayed on the screen.

[1720] ---

[1721] In this way, this system achieves smooth communication between the user, illustrator, and client through each step.

[1722] Example 1

[1723] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1724] In modern digital art production, the challenge is to efficiently match clients with digital artists and quickly and accurately produce works that reflect their requests. Furthermore, there is a lack of systems that use generative AI to generate rough sketches and quickly exchange corrections. This creates a need for an environment that accurately reflects client requests and efficiently delivers high-quality illustrations.

[1725] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1726] In this invention, the server includes a means for a user to register by inputting their name, email address, and password, a means for a digital artist to input a price and sample images and create profile information, and a means for a client to input text information and generate a rough sketch using a generation AI. This allows a client to view the profile information of digital artists, select the artist that best suits their requirements, and submit their request, enabling rapid communication.

[1727] "User" refers to a person who uses this system, such as a client or a digital artist.

[1728] An "email address" is a personal identifier for sending and receiving messages over the Internet.

[1729] A "password" is a sequence of characters or symbols used for user authentication and to protect a user's account.

[1730] "Registration" refers to the process by which a User enters their information into the System and creates an account.

[1731] A "digital artist" is a professional who creates art using digital technology.

[1732] "Price" refers to the amount of compensation set by a digital artist for the services they provide.

[1733] "Example images" are sample images of works that digital artists have created in the past.

[1734] "Profile Information" is a collection of information about a user or digital artist, including a self-introduction, examples of past work, pricing, etc.

[1735] A "client" is a person who commissions a digital artist to create a particular piece of art.

[1736] "Text information" is text that describes the specific details and requests regarding the illustration desired by the client.

[1737] "Generative AI" is an artificial intelligence technology that automatically generates rough sketches and drafts based on given text information.

[1738] A "rough sketch" is an early sketch made before creating a finished illustration, depicting the basic composition and shapes.

[1739] A "rough sketch" is synonymous with a rough sketch, a simple sketch that forms the basis of a finished product.

[1740] "Communication means" is a function that allows clients and digital artists to exchange messages on the system to discuss details and confirm corrections.

[1741] A "database" is a system that organizes and stores information about users and digital artists.

[1742] "Saving" is the act of recording the input information in a database.

[1743] "Validation" is the process of checking whether entered data is accurate.

[1744] "Transmission" is the act of moving data from one point to another.

[1745] "Receiving" is the act of receiving transmitted data.

[1746] The above are definitions of important terms contained in the claims.

[1747] This invention is a system that efficiently matches users with digital artists and utilizes generative AI to refine rough sketches and sketches. This system is configured and operates as follows.

[1748] User Registration Module

[1749] The terminal allows the user to register by entering their name, email address, and password, which allows the user to create an account within the system.

[1750] The server receives the data and stores it in a database after validating it (for example, checking the format of the email address, the length and complexity of the password). If registration is successful, the server returns a message to the terminal saying "Registration completed."

[1751] Illustrator Profile Creation Module

[1752] The device allows digital artists to input prices and sample images and create profile information, which can include a biographical description and examples of previous work.

[1753] The server receives the data and stores it in a database after validating it (for example, checking the format of the price or the file format of the sample image). When the profile information creation is complete, the server returns a message to the terminal saying "Your profile has been created."

[1754] A module that uses generative AI to generate sketches / rough drawings

[1755] Using the terminal, the requester enters the text information for the desired illustration (for example, "a cat reading a book") and clicks the "Generate sketch" button.

[1756] The server receives the text data and prepares it for transmission to the generative AI model. The generative AI model generates a sketch or rough sketch based on the text information. The server then receives the generated image data and sends it to the client's device. The client then checks the received sketch.

[1757] Illustrator selection and production request module

[1758] Using a terminal, the client browses the profile pages of multiple digital artists within the system, selects the digital artist who best meets their requirements, and enters details into a production request form, including details of the desired illustration and any special requirements.

[1759] The server receives the production request data and notifies the selected digital artist, who then receives the notification and confirms the details of the request.

[1760] Communication module between illustrator and client

[1761] The digital artist and client exchange chat-style messages via the terminal within the system, allowing for detailed discussions and confirmation of corrections.

[1762] The server receives each message and forwards it to the other party's device. Messages are exchanged in real time, enabling quick communication.

[1763] Specific examples

[1764] For example, if a client requests an illustration of a cat reading a book, they can input the text information and have the AI ​​generate a rough sketch. Based on this rough sketch, they can communicate with the digital artist and produce the finished illustration with minimal misunderstandings.

[1765] Prompt Sentence Examples

[1766] Enter the following prompt into the generative AI model:

[1767] "Generate a rough sketch of a cat reading a book."

[1768] In this way, this system efficiently supports a series of processes, starting from user registration, selecting a digital artist, generating a sketch using generative AI, and communicating with the digital artist.

[1769] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1770] Step 1:

[1771] The user enters user information from the terminal.

[1772] The user enters their name, email address, and password and clicks the Register button.

[1773] The terminal receives the input user information and transmits it to the server.

[1774] Input data: Name, email address, password

[1775] Output data: User information sent to the server

[1776] Step 2:

[1777] The server receives and validates the user information

[1778] The server receives the name, email address, and password submitted by the user.

[1779] The server checks the format of the email address and validates the length and complexity of the password.

[1780] Input data: User information

[1781] Output data: Validation result (success or failure)

[1782] Step 3:

[1783] The server stores the user information in a database

[1784] If validation is successful, the server saves the user information in the database.

[1785] If the save is successful, the server returns a message to the terminal saying "Registration completed."

[1786] Input data: User information that has passed validation

[1787] Output data: User information stored in the database, registration completion message

[1788] Step 4:

[1789] Digital artists enter their profile information on their devices

[1790] Digital artists enter their price, sample images, a self-introduction, and examples of their past work, then click the profile creation button.

[1791] The terminal transmits this information to the server.

[1792] Input data: price, sample images, self-introduction, examples of past work

[1793] Output data: Profile information sent to the server

[1794] Step 5:

[1795] The server receives and validates the profile information

[1796] The server checks the received price, file format of the sample image, etc.

[1797] Input data: Profile information

[1798] Output data: Validation result (success or failure)

[1799] Step 6:

[1800] The server stores the profile information in a database

[1801] If validation passes, the server stores the profile information in a database.

[1802] When the creation of the profile information is complete, the server returns a message to the terminal saying "Profile created."

[1803] Input data: Validated profile information

[1804] Output data: Profile information saved in the database, profile creation completion message

[1805] Step 7:

[1806] The client enters the text information for the illustration from the device.

[1807] The client enters the text information for the desired illustration (e.g., "A cat reading a book") and clicks the "Generate sketch" button.

[1808] The terminal transmits the text information to the server.

[1809] Input data: Text information of the desired illustration

[1810] Output data: Text information sent to the server

[1811] Step 8:

[1812] The server passes the text information to the AI ​​generator, which generates a rough sketch.

[1813] The server passes the received text information to the generative AI model.

[1814] The generative AI model generates a rough sketch or outline based on text information.

[1815] Input data: Text information

[1816] Output data: Generated sketch or rough drawing

[1817] Step 9:

[1818] The server receives the generated image data and sends it to the terminal.

[1819] The server receives the image data generated from the generative AI model.

[1820] The server transmits the image data to the client's terminal and causes the client to display the image data.

[1821] Input data: Generated image data

[1822] Output data: Image data sent to the terminal, displayed sketch

[1823] Step 10:

[1824] Clients can browse multiple digital artists from their device

[1825] The client uses the device to view the profile pages of multiple digital artists.

[1826] Input data: None

[1827] Output data: Displayed digital artist profile information

[1828] Step 11:

[1829] The client fills out the production request form

[1830] The client fills out and submits a production request form, including details of the desired illustration and any special requirements.

[1831] The terminal transmits this information to the server.

[1832] Input data: Production request information

[1833] Output data: Production request information sent to the server

[1834] Step 12:

[1835] The server receives the production request data and notifies the digital artist.

[1836] The server receives production request data from the client.

[1837] The server notifies the selected digital artist of the request.

[1838] Input data: Production request information

[1839] Output data: Request details notified to the digital artist

[1840] Step 13:

[1841] Digital artists and clients can use chat within the system from their devices.

[1842] Digital artists and clients use the chat-style messaging function within the system to hold detailed discussions and confirm corrections.

[1843] Input data: Message content

[1844] Output data: Received and sent messages

[1845] Step 14:

[1846] The server receives and forwards messages

[1847] The server receives the message and forwards it to the other device, allowing for real-time message exchange.

[1848] Input data: Message content

[1849] Output data: Forwarded message

[1850] In this way, we can detail how specific inputs and outputs are handled at each step.

[1851] (Application example 1)

[1852] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1853] In conventional illustration request systems, it was difficult for users to reach a common image when communicating their request to an illustrator, resulting in frequent discrepancies between the request and the finished product. Furthermore, even in remote communication, the exchange of opinions between the illustrator and the client was often not smooth, making it difficult to realize an optimal illustration request. The present invention aims to solve these problems and provide a system that allows users to efficiently and accurately request illustrations in a virtual space.

[1854] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1855] In this invention, the server includes: a means for a user to register by entering their name, email address, and password; a means for an illustrator to enter a price and a sample image and create profile information; a means for a client to enter text information and use a generation AI to generate a sketch or rough sketch; a means for a client to view illustrator profile information, select a corresponding illustrator, and send the request details; a means for the client to check the sketch or rough sketch created by the generation AI in a virtual space; and a communication means for exchanging messages between the illustrator and the client. This makes it possible to proceed with the work while checking and adjusting the request details in real time in the virtual space.

[1856] "User" refers to the client and illustrator who uses the system.

[1857] An "illustrator" is a professional who creates profile information within the system and responds to illustration requests from clients.

[1858] "Text information" refers to the text information that the client inputs to generate a sketch or rough drawing using the generation AI.

[1859] "Generative AI" is an artificial intelligence technology that automatically generates sketches or rough drawings based on text information.

[1860] A "rough sketch" is a simplified drawing that serves as the basis for creating the final illustration.

[1861] A "rough drawing" is a rough illustration sketch that helps to visually grasp the client's intentions.

[1862] "Virtual space" is a virtual environment where clients and illustrators can check and adjust rough sketches and drawings in real time.

[1863] "Profile information" is a self-introduction created by the illustrator, detailed information about past works, and services provided.

[1864] "Means of communication" refers to the method used to exchange messages between the illustrator and the client.

[1865] This invention is a system that efficiently matches users with illustrators and uses AI to refine rough sketches and rough drafts. The following is a detailed description of the invention.

[1866] 1. User Registration Module

[1867] The user uses the terminal to enter their name, email address, and password to register with the system. The server receives the data sent, validates it (for example, checks the format of the email address, the length and complexity of the password), and stores it in a database. If registration is successful, the server returns a message to the user's terminal saying "Registration completed."

[1868] 2. Illustrator Profile Creation Module

[1869] The illustrator uses the terminal to input the amount and a sample image to create profile information. The server receives the transmitted data, validates it, and then saves it in the database. When the profile information creation is complete, the server returns a message to the terminal saying "Profile created."

[1870] 3. A module that uses generative AI to generate sketches / rough drawings

[1871] The requester uses their device to input the text information for the desired illustration (for example, "A cat reading a book") and clicks the "Generate sketch" button. The server receives the sent text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The server receives the generated image data and sends it to the requester's device. The requester can then check the received sketch in virtual space.

[1872] As an example, suppose the user enters the following prompt sentence:

[1873] Prompt: "Please draw a cat flying through space. I'd like the background to be filled with stars, with the cat gliding through the starry sky."

[1874] 4. Illustrator selection and production request module

[1875] The client uses a terminal to view the profile pages of multiple illustrators. The client selects the illustrator who best meets their requirements and enters details into the request form, including details of the desired illustration and any special requirements. The server receives the production request data and notifies the selected illustrator. The illustrator receives the notification and confirms the detailed request.

[1876] 5. Communication module between illustrator and client

[1877] Illustrators and clients can exchange chat-style messages within the system using their devices. The server receives the messages and forwards them to the other party's device. Messages are exchanged in real time, enabling rapid communication.

[1878] The system uses React Native on the front end, Django on the back end, and GPT-3-based APIs as a generative AI model, allowing users to order and customize illustrations with high efficiency and accuracy.

[1879] The above is a detailed embodiment of the present invention.

[1880] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1881] Step 1:

[1882] User Registration

[1883] The user uses a terminal to enter their name, email address, and password to register. The entered data is sent to the server. The server receives the data and performs validation (checks the format of the email address, and the length and complexity of the password). If validation is successful, the server saves the data in the database and returns a message to the user's terminal saying "Registration completed."

[1884] Step 2:

[1885] Illustrator profile creation

[1886] Illustrators use their devices to enter the amount, sample image, self-introduction, and examples of past work to create their profile information. The entered data is sent to the server. The server receives the data and validates it (checks the format of the sample image and the amount). If validation is successful, the server saves the data in the database and returns a message to the illustrator's device saying "Your profile has been created."

[1887] Step 3:

[1888] Generate sketches / rough drawings using generative AI

[1889] The requester uses their device to enter the text information for the desired illustration (e.g., a cat reading a book) and clicks the "Generate sketch" button. The entered text data is sent to the server, which prepares to pass the data to the generation AI. The generation AI automatically generates a sketch or rough drawing based on the text information. The server then receives the generated image data and sends it to the requester's device. The requester can then check the received sketch in virtual space.

[1890] Step 4:

[1891] Illustrator selection and production request

[1892] The client uses a terminal to view the profile pages of multiple illustrators. They select the illustrator who best meets their requirements and enter details of the desired illustration and any special requirements into the request form. The entered request data is sent to the server. The server receives the data and notifies the selected illustrator. The illustrator receives the notification and confirms the detailed request content.

[1893] Step 5:

[1894] Communication between illustrator and client

[1895] Illustrators and clients use their devices to exchange chat-style messages within the system. Messages are sent and received via a server, which stores the messages as a log and forwards them to the other party's device in real time. This allows for fast and efficient communication.

[1896] The above are the specific processing steps of this system.

[1897] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1898] ---

[1899] This invention is a system that efficiently matches users with illustrators and uses a generative AI and emotion engine to refine rough sketches and rough drafts. This system is configured and operates as follows.

[1900] User Registration Module

[1901] Using the terminal, users (illustrators and clients) can register by entering their name, email address, and password, which allows them to create an account within the system.

[1902] The server receives the submitted data, performs validation (for example, checking the format of the email address, the length and complexity of the password), and then stores it in a database. If registration is successful, the server returns a message such as "Registration completed" to the terminal.

[1903] Illustrator Profile Creation Module

[1904] Using the terminal, illustrators can input their price and sample images and create profile information, which can include a self-introduction and examples of their past work.

[1905] The server receives the data and stores it in a database after validating it (for example, checking the format of the amount or the file format of the sample image). When the profile information has been created, the server returns a message to the terminal saying "Your profile has been created."

[1906] A module that uses generative AI to generate sketches / rough drawings

[1907] Using the terminal, the requester enters the text information for the desired illustration (for example, "a cat reading a book") and clicks the "Generate sketch" button.

[1908] The server receives the text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The server then receives the generated image data and sends it to the client's device. The client then checks the received sketch.

[1909] Use of emotion engine

[1910] The server analyzes the text information and operational behavior entered by the user and recognizes the user's emotions using an emotion engine. Emotions can be extracted from specific keywords entered by the user and the timing of operations, and the style and expression of the sketches and rough drawings created by the generation AI can be adjusted based on these emotions.

[1911] Illustrator selection and production request module

[1912] Using a terminal, the client browses the profile pages of multiple illustrators within the system, selects the illustrator who best meets their requirements, and enters details into a production request form, including details of the desired illustration and any special requirements.

[1913] The server receives the production request data and notifies the selected illustrator, who then receives the notification and confirms the details of the request.

[1914] Communication module between illustrator and client

[1915] The illustrator and client exchange chat-style messages within the system via the device. The emotion engine analyzes emotions in real time during the exchange and can suggest message tone and content based on the recognized emotions. For example, if the client expresses anxiety or dissatisfaction, the emotion engine will suggest appropriate comfort or solutions.

[1916] The server receives each message and forwards it to the other party's device. Messages are exchanged in real time, enabling quick communication.

[1917] Specific examples

[1918] For example, if a client requests an illustration of a cat reading a book, they input text information and the AI ​​generates a rough sketch. The emotion engine then extracts emotions from the client's input and actions. For example, if the emotion is joy or excitement, the rough sketch will include expressions that reflect that emotion. This rough sketch can then be used to communicate with the illustrator, minimizing misunderstandings and producing the finished illustration.

[1919] In this way, the system can accurately analyze the user's emotions and reflect them in the production process, thereby providing illustrations of higher quality that meet the user's expectations.

[1920] ---

[1921] The processing flow will be explained below.

[1922] (User registration module)

[1923] Step 1:

[1924] The user enters their name, email address, and password and clicks the Register button.

[1925] Step 2:

[1926] The terminal sends the input data to the server.

[1927] Step 3:

[1928] The server receives the submitted data and validates the name, email address, and password to ensure they are valid, for example, checking that the email address is formatted correctly and that the password is of a required length.

[1929] Step 4:

[1930] The server saves the successfully validated data to the database.

[1931] Step 5:

[1932] The server returns a message to the terminal indicating successful registration.

[1933] Step 6:

[1934] The device displays a "Registration complete" message to the user.

[1935] (Illustrator profile creation module)

[1936] Step 1:

[1937] The illustrator enters profile information including the amount and sample image, and clicks the [Save Profile] button.

[1938] Step 2:

[1939] The terminal sends the input data to the server.

[1940] Step 3:

[1941] The server receives the data sent and validates it to ensure the amount is appropriate and the file format of the sample image is correct.

[1942] Step 4:

[1943] The server saves the successfully validated data to the database.

[1944] Step 5:

[1945] The server returns a message to the device indicating that the profile was created successfully.

[1946] Step 6:

[1947] The device will display the message "Profile created" in Illustrator.

[1948] (Module that uses generative AI to generate sketches / rough drawings)

[1949] Step 1:

[1950] The client enters the text information for the illustration they want (e.g., "A cat reading a book") and clicks the "Generate sketch" button.

[1951] Step 2:

[1952] The terminal transmits the text data to the server.

[1953] Step 3:

[1954] The server receives the transmitted text data.

[1955] Step 4:

[1956] The server passes the text data to the generation AI.

[1957] Step 5:

[1958] The generative AI generates a sketch or rough drawing based on text information.

[1959] Step 6:

[1960] The server receives the generated image data.

[1961] Step 7:

[1962] The server transmits the generated image data to the client's terminal.

[1963] Step 8:

[1964] The image received by the terminal is displayed to the requester.

[1965] (Using Emotion Engine)

[1966] Step 1:

[1967] The server receives the text information and operation actions entered by the user.

[1968] Step 2:

[1969] The server uses an emotion engine to analyze the user's emotions. For example, emotions can be extracted from keywords contained in text information, input speed, operation timing, etc.

[1970] Step 3:

[1971] The server passes the recognized emotional information to the generation AI.

[1972] Step 4:

[1973] The generative AI adjusts the style and expression of the sketch or rough draft based on emotional information.

[1974] (Illustrator selection and production request module)

[1975] Step 1:

[1976] The client browses the profiles of multiple illustrators within the system.

[1977] Step 2:

[1978] The client selects the illustrator who best suits their requirements.

[1979] Step 3:

[1980] The requester enters details into the production request form and clicks the [Request] button.

[1981] Step 4:

[1982] The terminal transmits the production request data to the server.

[1983] Step 5:

[1984] The server receives the production request data.

[1985] Step 6:

[1986] The server sends a production request notification to the selected illustrator.

[1987] Step 7:

[1988] The illustrator will receive a notification and confirm the details of the request.

[1989] (Communication module between illustrators and clients)

[1990] Step 1:

[1991] The client or illustrator enters a message in the chat box and clicks the Send button.

[1992] Step 2:

[1993] The terminal transmits the message data to the server.

[1994] Step 3:

[1995] The server receives the message data.

[1996] Step 4:

[1997] The server forwards the received message to the other party's terminal.

[1998] Step 5:

[1999] The message received by the other terminal is displayed on the screen.

[2000] Step 6:

[2001] The server uses an emotion engine to analyze the tone and content of the message and make appropriate suggestions. For example, if the requester expresses anxiety, it will suggest appropriate comfort or solutions.

[2002] ---

[2003] In this way, this system analyzes the user's emotions and reflects them in the generation AI and communication, providing illustrations of higher quality that meet the user's expectations.

[2004] Example 2

[2005] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2006] In traditional illustration production, there is a problem that mismatches in intentions and emotions between the client and the illustrator easily occur, resulting in an inefficient production process. It is also difficult to generate rough sketches or sketches that accurately reflect the client's emotions and intentions, which can result in a decrease in client satisfaction. Furthermore, if communication between the client and the illustrator is not effective enough, the efficiency and quality of the production can be compromised.

[2007] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for a user to enter their name, email address, and password and perform registration; a means for an illustrator to enter a price and a sample image, create and save profile information, and perform validation; a means for using a generation AI to generate a sketch or rough sketch from the client's text information and using an emotion engine to reflect the user's emotions in the generated sketch; a means including an emotion engine for a client to view the illustrator's profile information, select a corresponding illustrator, submit the request, and make appropriate suggestions; and a communication means for exchanging messages between the illustrator and the client. This enables the generation of a sketch or rough sketch that accurately reflects the user's emotions and intentions, facilitates communication between the client and the illustrator, and makes the production process efficient and high-quality.

[2008] "User Registration" is the process of creating an account within the system by entering your name, email address, and password.

[2009] "Illustrator Profile Creation" is the process by which an illustrator builds a profile page by entering information such as price, sample images, a self-introduction, and examples of past work.

[2010] "Data validation" is the process of checking whether the entered information conforms to the specified format and conditions.

[2011] "Generative AI" is artificial intelligence that automatically generates sketches or rough drawings based on text information.

[2012] An "emotion engine" is a technology that analyzes a user's input text and behavioral data to recognize and reflect the user's emotions.

[2013] "Sketch / rough drawing generation" is the process in which the generation AI creates a sketch or rough drawing based on the text information entered by the client.

[2014] "Submit Request" is the process by which a client sends production details and special requirements to the illustrator of their choice.

[2015] "Communication means" refers to an interface that allows illustrators and clients to exchange messages within the system, enabling real-time communication.

[2016] This invention is a system that efficiently matches users with illustrators and uses a generative AI and emotion engine to refine rough sketches and drafts. The system aims to provide a higher level of completion and satisfaction by analyzing the user's emotions and generating rough sketches that reflect those emotions. The detailed configuration and operation of this system are described below.

[2017] User Registration Module

[2018] The terminal prompts the user to enter their name, email address, and password, and sends this information to the server. The server then checks the format of the email address and validates the password length and complexity, and stores the data in a database. If registration is successful, it returns a message to the terminal saying "Registration completed."

[2019] Illustrator Profile Creation Module

[2020] The device prompts the illustrator to enter the price, sample image, self-introduction, examples of past work, etc., and sends this to the server. The server validates the received data, checking the format of the price and the file format of the sample image, and stores it in a database. When the profile information has been created, it returns a message to the device saying "Your profile has been created."

[2021] A module that uses generative AI to generate sketches / rough drawings

[2022] The terminal prompts the requester to enter text information for the desired illustration and click the "Generate sketch" button. The server receives the text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The generated image data is sent to the terminal via the server, and the requester confirms it.

[2023] For example, if a client wants to create a picture of a cat reading a book, they input the text "cat reading a book" into the device, and the AI ​​generates a rough sketch based on this information. The prompt will then be "Generate an image of a cat reading a book."

[2024] Use of emotion engine

[2025] The server uses an emotion engine to analyze the user's input text and operational behavior and recognize the user's emotions. The recognized emotions are reflected in the parameters of the generation AI, and the style and expression of the sketch and rough illustration are adjusted. For example, if the user enters the text "Amazing!", the emotion engine recognizes a high level of positive emotion and adds a prompt to the generation AI saying "Reflect positive emotion in the sketch," thereby reflecting that emotion in the rough illustration that is generated.

[2026] Illustrator selection and production request module

[2027] The terminal allows the requester to view the profile pages of multiple illustrators in the system and select the illustrator who best suits their requirements. The requester enters the details of the production request for the selected illustrator and sends them to the server. The server notifies the selected illustrator of the received production request data, and the illustrator confirms the detailed request content.

[2028] Communication module between illustrator and client

[2029] The device allows the illustrator and client to exchange messages in chat format. The emotion engine analyzes emotions in real time during the message exchange and suggests message tone and content based on the recognized emotion. For example, if the client types "I'm a little anxious...", the emotion engine recognizes the emotion of anxiety and suggests appropriate comfort or solutions. The server supports rapid communication by sending messages and forwarding them to the other party's device.

[2030] The above system enables efficient and high-quality illustration production that focuses on the user's emotions and intentions.

[2031] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2032] Program processing step details

[2033] Step 1: Enter and submit user information

[2034] Input: User enters name, email address, and password.

[2035] Processing: The terminal displays the input form and temporarily saves the entered information. When the user clicks the submit button, the entered data is sent to the server.

[2036] Output: A transmission completion notification and data are sent to the server.

[2037] Step 2: Validate and save user information

[2038] Input: User data sent to the server.

[2039] Processing: The server validates the submitted data. Specifically, it checks the format of the email address and the length and complexity of the password. Data that passes validation is saved in the database.

[2040] Output: A registration completion message is returned to the terminal. User information is saved in the database.

[2041] Step 3: Enter and submit your Illustrator profile information

[2042] Input: The illustrator will enter the price, sample image, self-introduction, and examples of past work.

[2043] Processing: The terminal displays the input form and temporarily saves the information entered by the illustrator. When the submit button is clicked, the input data is sent to the server.

[2044] Output: A transmission completion notification and data are sent to the server.

[2045] Step 4: Validate and save profile information

[2046] Input: Profile data sent to the server.

[2047] Processing: The server checks the format of the amount and the file format of the sample image for the submitted data. Data that passes validation is saved in the database.

[2048] Output: A message is returned to the terminal saying that the profile has been created. The profile information is saved in the database.

[2049] Step 5: Enter and submit requester's text information

[2050] Input: The requester enters the text information for the requested illustration.

[2051] Processing: The terminal displays a text input field and temporarily stores the information entered by the requester. When the user clicks the sketch generation button, the text data is sent to the server.

[2052] Output: A transmission completion notification and data are sent to the server.

[2053] Step 6: Convert text information and send it to the generation AI

[2054] Input: The text data sent to the server.

[2055] Processing: The server converts the text data into a prompt that can be interpreted by the generative AI model. The input "An image of a cat reading a book" is converted into a prompt such as "Generate an image of a cat reading a book." This is then sent to the generative AI.

[2056] Output: The prompt sent to the generation AI.

[2057] Step 7: Create and send rough sketches

[2058] Input: A prompt from the generative AI.

[2059] Processing: The AI ​​generates a rough sketch based on the prompt and returns the image data to the server.

[2060] Output: Image data returned to the server. Transferred to the requester's device and displayed.

[2061] Step 8: Sentiment analysis and reflection of emotional data

[2062] Input: The requester's input text and operation behavior data.

[2063] Processing: The server uses an emotion engine to analyze the text and behavioral data. For example, the text "Amazing!" is recognized as a highly positive emotion. This data is used as a parameter for the generation AI, and the instruction "Reflect positive emotion in the sketch" is sent to the generation AI.

[2064] Output: Emotion recognition data from the emotion engine. Emotion reflection parameters sent to the generation AI.

[2065] Step 9: Browse and select an Illustrator profile

[2066] Input: Illustrator selection by client.

[2067] Processing: The terminal displays the profile pages of multiple illustrators, allowing the client to select the illustrator who best suits their needs. Data is then sent to the server to notify the selected illustrator.

[2068] Output: Selected Illustrator. Submitted request data.

[2069] Step 10: Submit your production request

[2070] Input: Detailed information about the request.

[2071] Processing: The requester fills in the request form with detailed illustration information and special requests, then clicks the submit button. The server receives the data and notifies the selected illustrator.

[2072] Output: Request details. Notification to illustrator.

[2073] Step 11: Message exchange and sentiment analysis

[2074] Input: Message data between illustrator and client.

[2075] Processing: The device displays a chat interface and supports sending and receiving messages. The server uses an emotion engine to analyze the message content and suggest appropriate replies.

[2076] Output: Suggested reply. Sent message.

[2077] This detailed processing step clarifies how the system operates to provide high quality service to users.

[2078] (Application example 2)

[2079] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2080] In conventional illustration production request systems, misunderstandings easily occur between the client and the illustrator, making it difficult to create an illustration that fully reflects the client's feelings and wishes. Furthermore, communication often becomes complicated and does not flow smoothly. A means of analyzing the client's feelings in real time and providing appropriate feedback was needed.

[2081] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2082] In this invention, the server includes: a means for a user to register by entering their name, email address, and password; a means for an illustrator to enter a price and a sample image and create profile information; a means for a client to enter text information and use a generation AI to generate a sketch or rough sketch; a means for a client to view illustrator profile information, select a corresponding illustrator, and send the request; a communication means for exchanging messages between the illustrator and the client; and a means for analyzing the user's emotions using an emotion engine and adjusting the style and expression of the sketch or rough sketch generated by the generation AI. This makes it possible to create illustrations that accurately reflect the client's emotions and wishes.

[2083] "User" refers to an individual or corporation that accesses and uses the system, specifically an illustrator or client.

[2084] "Email address" refers to the email address that a user uses to register with or contact the system.

[2085] A "password" is a character string used as authentication information when a user logs into a system.

[2086] An "illustrator" is a professional who creates illustrations at the request of a client.

[2087] "Amount" refers to the fee set for the services provided by the illustrator.

[2088] "Sample images" are images that show the illustrator's previous work and style.

[2089] "Profile information" is detailed information about the illustrator, including a self-introduction, examples of past work, and fees.

[2090] "Client" refers to an individual or corporation that uses the system to request the creation of an illustration.

[2091] "Text information" refers to information that specifically describes the content of the illustration desired by the client in text form.

[2092] "Generative AI" is an artificial intelligence that automatically generates sketches and rough drawings based on the client's text information.

[2093] A "pre-drawing" is a rough sketch created before creating the final illustration.

[2094] A "rough sketch" is a type of preliminary sketch, a rougher and more simplified sketch.

[2095] An "emotion engine" is a system that analyzes a user's emotions and reflects them in specific processes and generated content.

[2096] "Style" refers to the way an illustration is expressed and its characteristics, and changes depending on the preferences of the client and illustrator.

[2097] "Communication means" refers to the functions within the system that allow clients and illustrators to exchange messages.

[2098] This invention is a system that efficiently matches users with illustrators and uses a generative AI and emotion engine to refine rough sketches and rough drafts. This system is configured and operates as follows.

[2099] User Registration Module

[2100] The user enters their name, email address, and password from the terminal to register. The server receives the data sent, performs validation (for example, checking the format of the email address, the length and complexity of the password), and then saves it in the database. If registration is successful, the server returns a message to the terminal such as "Registration completed."

[2101] Illustrator Profile Creation Module

[2102] The illustrator enters the amount and sample image from the terminal and creates profile information. This can also include a self-introduction and examples of past work. The server receives the transmitted data, performs validation (for example, checking the format of the amount and the file format of the sample image), and then saves it in the database. When the profile information creation is complete, the server returns a message to the terminal saying, "Your profile has been created."

[2103] A module that uses generative AI to generate sketches / rough drawings

[2104] The requester enters the text information of the desired illustration (for example, "A cat reading a book") from their device and clicks the "Generate sketch" button. The server receives the sent text data and prepares to pass it to the generation AI. The generation AI generates a sketch or rough drawing based on the text information. The server then receives the generated image data and sends it to the requester's device. The requester then checks the received sketch.

[2105] Use of emotion engine

[2106] The server analyzes the text information and operational behavior entered by the user and recognizes the user's emotions using an emotion engine. Emotions can be extracted from specific keywords entered by the user and the timing of operations, and the style and expression of the sketches and rough drawings created by the generation AI can be adjusted based on these emotions.

[2107] Illustrator selection and production request module

[2108] The requester browses the profile pages of multiple illustrators within the system from their terminal. The requester selects the illustrator who best suits their requirements and enters details into the production request form, including details of the desired illustration and any special requirements. The server receives the production request data and notifies the selected illustrator. The illustrator receives the notification and confirms the detailed request.

[2109] Communication module between illustrator and client

[2110] The illustrator and client exchange chat-style messages within the system from their devices. The emotion engine analyzes emotions in real time during the exchange and can suggest message tone and content based on the recognized emotion. For example, if the client expresses anxiety or dissatisfaction, the emotion engine will suggest appropriate comfort or solutions. The server receives each message and forwards it to the other party's device. Messages are exchanged in real time, enabling rapid communication.

[2111] Specific examples

[2112] For example, if a client requests an illustration of a cat reading a book, they input text information and the AI ​​generates a rough sketch. The emotion engine then extracts emotions from the client's input and actions. For example, if the emotion is joy or excitement, the rough sketch will include expressions that reflect that emotion. This rough sketch can then be used to communicate with the illustrator, minimizing misunderstandings and producing the finished illustration.

[2113] Hardware and software used

[2114] The hardware used to realize this system is a smartphone (iOS or Android), and the software used is a mobile app development platform (React Native). The generative AI uses OpenAI's API, and the emotion engine uses IBM Watson's Tone Analyzer. Below is a specific example of a prompt sentence to input to the generative AI model.

[2115] "You are the AI ​​of an art request system. The user inputs a scene of a dog playing in a flower field. Generate a rough sketch based on this information. Also, if you sense enjoyment in the user's text or actions, reflect that emotion as well."

[2116] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2117] Step 1:

[2118] The user enters their name, email address, and password from the terminal to register. The entered data is sent from the terminal to the server. The server receives this data and performs validation (checks the format of the email address, and the length and complexity of the password). If successful, it saves the user data in the database and returns a message to the terminal saying "Registration completed."

[2119] Input: User's name, email address, and password

[2120] Output: Validation result and registration confirmation message

[2121] Step 2:

[2122] The illustrator enters the amount and sample image from the terminal and creates profile information. The server receives the transmitted data and performs validation (for example, checking the format of the amount and the file format of the sample image). If successful, it saves the profile data in the database and returns a message to the terminal saying "Profile created."

[2123] Input: Illustrator price, sample image, profile

[2124] Output: Validation result and creation confirmation message

[2125] Step 3:

[2126] The requester enters the text information for the desired illustration on their device and clicks the "Generate rough sketch" button. The server receives the text data and passes it to the generation AI model to generate a rough sketch. The generated image data is sent to the requester's device, and the requester can check the received rough sketch.

[2127] Input: Requester's text information (e.g., "A cat reading a book")

[2128] Output: Generated rough sketch

[2129] Step 4:

[2130] The server analyzes the text information and operational behavior entered by the user and recognizes the user's emotions using an emotion engine (IBM Watson's Tone Analyzer). The recognized emotion data is fed back to the generation AI, which adjusts the style and expression of the sketches and rough drawings. The client can then review the adjusted rough drawings and request further revisions if necessary.

[2131] Input: User text information, operation actions

[2132] Output: Rough drawing after adjustments

[2133] Step 5:

[2134] The requester browses the profile pages of multiple illustrators within the system from their terminal. The requester selects the most suitable illustrator and enters details into the production request form. The server receives the production request data and notifies the selected illustrator.

[2135] Input: Request details, illustrator profile information

[2136] Output: Request notification, selection confirmation message

[2137] Step 6:

[2138] The illustrator and client exchange chat-style messages within the system from their devices. The server transfers the messages in real time, and the emotion engine analyzes the tone and content of the messages to provide appropriate feedback.

[2139] Input: User-to-user messages

[2140] Output: Analysis results and appropriate feedback

[2141] Specifically, the following example prompt sentences are used to input the generative AI model:

[2142] "You are the AI ​​of an art request system. The user inputs a scene of a dog playing in a flower field. Generate a rough sketch based on this information. Also, if you sense enjoyment in the user's text or actions, reflect that emotion as well."

[2143] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2144] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2145] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2146] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2147] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2148] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2149] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2150] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2151] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2152] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2153] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2154] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2155] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2156] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2157] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2158] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2159] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2160] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2161] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2162] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2163] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2164] The following is further disclosed regarding the above embodiment.

[2165] (Claim 1)

[2166] A means for users to register by entering their name, email address, and password;

[2167] A means for an illustrator to input the amount and a sample image and create profile information;

[2168] A method in which the client inputs text information and uses generation AI to generate a sketch or rough drawing;

[2169] A means for a requester to view the profile information of illustrators, select a corresponding illustrator, and send the request details;

[2170] A means of communication that allows illustrators and clients to exchange messages,

[2171] A system including:

[2172] (Claim 2)

[2173] The system of claim 1, wherein the generation AI automatically generates a sketch or rough drawing based on text information and provides it to the client.

[2174] (Claim 3)

[2175] 2. The system according to claim 1, wherein the requester refers to the profile information of the illustrators to select them and then submits the request.

[2176] "Example 1"

[2177] (Claim 1)

[2178] A means for users to register by entering their name, email address, and password;

[2179] A means for digital artists to input prices and sample images and create profile information;

[2180] A method whereby the client inputs text information and uses generation AI to generate a rough sketch or draft;

[2181] A means for a requester to view profile information of digital artists, select a corresponding digital artist, and send the request content;

[2182] A means of communication that allows digital artists and clients to exchange messages,

[2183] A system including:

[2184] (Claim 2)

[2185] The system of claim 1, wherein the generation AI automatically generates a draft or rough sketch based on text information and provides it to the client.

[2186] (Claim 3)

[2187] 2. The system according to claim 1, wherein the requester refers to profile information of the digital artists to select them and then transmits the request.

[2188] "Application Example 1"

[2189] (Claim 1)

[2190] A means for users to register by entering their name, email address, and password;

[2191] A means for an illustrator to input the amount and a sample image and create profile information;

[2192] A method in which the client inputs text information and uses generation AI to generate a sketch or rough drawing;

[2193] A means for a requester to view the profile information of illustrators, select a corresponding illustrator, and send the request details;

[2194] A means for the client to check the sketch or rough drawing created by the AI ​​in a virtual space,

[2195] A means of communication that allows illustrators and clients to exchange messages,

[2196] A system including:

[2197] (Claim 2)

[2198] The system of claim 1, wherein the generation AI automatically generates a sketch or rough drawing based on text inform...

Claims

1. A means for users to register by entering their name, email address, and password; A means for an illustrator to input the amount and a sample image and create profile information; A method in which the client inputs text information and uses generation AI to generate a sketch or rough drawing; A means for a requester to view the profile information of illustrators, select a corresponding illustrator, and send the request details; A means of communication that allows illustrators and clients to exchange messages, A system including:

2. The system according to claim 1, wherein the generating AI automatically generates a sketch or rough drawing based on text information and provides it to the client.

3. 2. The system according to claim 1, wherein the requester refers to profile information of the illustrators to select them and then transmits the request contents.

Images