System

Abstract

A system is provided.SOLUTION: This system is provided with a means for selling the own illustration on a platform by an illustration provider, a means for purchasing the sold illustration and constructing a AI model by a model constructor and a means for selling the constructed AI model on the platform.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, copyright issues surrounding illustrations generated using AI technology have emerged. There have been numerous cases of copyright infringement caused by illustration providers using their work without their permission. Furthermore, the legality and proper copyright procedures for building AI models are unclear, creating situations that are detrimental to both parties. This makes it difficult for illustration providers and model builders to conduct transactions with peace of mind. [Means for solving the problem]

[0005] To solve the above-mentioned problems, the present invention provides the following means. The system includes a means for an illustration provider to sell their own illustrations on a platform, a means for a model builder to purchase the sold illustrations and build an AI model, and a means for selling the built AI model on the platform. The system also includes a means for making the AI ​​model available for sale as a non-fungible token (NFT) and a means for selling generated prompts on the platform. This allows illustration providers to earn revenue while properly managing their work, and model builders to legally build and sell AI models.

[0006] An "illustration provider" is an individual or organization that provides illustrations they have created on the platform and sells them to others.

[0007] "Model Builder" refers to an individual or organization that builds an AI model using illustrations purchased on the platform and sells the model.

[0008] "Platform" refers to an online service that allows illustration providers and model builders to create accounts and trade illustrations and AI models.

[0009] An "AI model" is a trained algorithm or dataset used to create illustrations generated using artificial intelligence technology.

[0010] A non-fungible token (NFT) is a digital token that uses blockchain technology to prove ownership of a digital asset and ensure its uniqueness and scarcity.

[0011] A "generative prompt" is a set of input text and parameters provided to an AI model to generate a specific illustration.

[0012] "Means of selling" refers to the functions and services that make illustrations and AI models tradable on the platform.

[0013] "Storage" means a data storage system for the appropriate storage of digital files and metadata uploaded to the Platform.

[0014] "Login Means" means the functionality by which a User accesses the Platform and authenticates to an individual account. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] This invention is a system in which illustrators sell their illustrations on a platform, model builders purchase them, build AI models, and then sell the AI ​​models. This system solves copyright issues while realizing legal and advantageous transactions for both parties.

[0037] Program processing

[0038] This system is composed of a server, a terminal, and a user. The flow of each process will be explained in detail below.

[0039] Upload and sell illustrations

[0040] 1. The user (illustrator) logs in to the platform.

[0041] The device prompts the user to enter their email address and password. After the user enters the information, the device sends it to the server.

[0042] The server authenticates the user by checking the user information in the database. If authentication is successful, the server generates a token and returns it to the terminal.

[0043] 2. The user accesses their profile page and opens the upload page for their work.

[0044] The terminal displays a form for uploading artwork, allowing the user to select an illustration file and enter metadata such as title, description, and price.

[0045] 3. The user clicks the upload button.

[0046] The terminal transmits the selected illustration file and metadata to the server.

[0047] The server saves the illustration file to storage, records the corresponding metadata in a database, and returns a success message to the device once the save is confirmed.

[0048] 4. The server adds the newly uploaded illustration to the for sale list.

[0049] The server will update the public page, making the new illustration available for viewing.

[0050] Building and selling AI models

[0051] 5. The user (model builder) logs in to the platform and browses the illustration page for sale.

[0052] The terminal displays details of illustrations for sale. The user selects the illustration they want and clicks the purchase button.

[0053] 6. Complete the purchase process.

[0054] The terminal prompts for payment information and transmits that information to the server.

[0055] The server processes the payment and, if successful, provides a purchase confirmation message and download link to the device.

[0056] 7. Users download the purchased illustrations and use them to build AI models.

[0057] The device allows users to use downloaded illustrations in a local environment.

[0058] 8. Upload the AI ​​model you built to the platform.

[0059] The terminal displays an upload page for the AI ​​model file, where the user selects the file and enters sales information (price, quantity, etc.).

[0060] The device sends this to the server, which saves the AI ​​model file and records the sales information in a database.

[0061] 9. The server sets the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[0062] The server processes the NFT and adds it to the sales list.

[0063] Prompt Sales

[0064] 10. Users (prompt engineers) sell the generated prompts on the platform.

[0065] The terminal displays the generated prompt sales page, and the user inputs the prompt content and price.

[0066] The terminal transmits the input prompt information to the server.

[0067] The server records the prompt information in a database and adds it to the sales list.

[0068] Specific examples

[0069] Illustration provider's scenario

[0070] Illustrator A accesses the platform to sell a landscape painting he or she has created. After logging in, A goes to the profile page and opens the work upload page. A selects a file, enters the title "Beautiful Evening Scenery," the description "A landscape with a tranquil sunset," and the price of 5,000 yen, and clicks the upload button. The data is saved by the server, and A's work is published in the sales list.

[0071] Model Builder Scenarios

[0072] Model builder B wants to build a new AI model using a landscape painting, so he logs into the platform. He browses the illustration page for sale, selects A's "Beautiful Sunset Scene," and clicks the purchase button. B enters his payment information and receives a download link once the process is complete. B uses the downloaded image to build an AI model, and then applies for and sells the model as an NFT for limited time only.

[0073] The present invention provides an appropriate environment for both illustration providers and model builders to conduct transactions safely and fairly, thereby realizing a system that allows both parties to enjoy mutual benefits while resolving copyright issues.

[0074] The processing flow will be explained below.

[0075] Upload and sell illustrations

[0076] Step 1:

[0077] The user (illustrator) accesses the platform's login page.

[0078] The device will display a login page and prompt you to enter your email address and password.

[0079] The user enters an email address and password.

[0080] Step 2:

[0081] The information entered by the user is sent to the server.

[0082] The device sends the entered email address and password to the server.

[0083] Step 3:

[0084] The server authenticates the user by checking the user information in the database.

[0085] The server compares the entered information with the user information stored in a database and performs authentication.

[0086] If the authentication is successful, the server generates a token and returns it to the terminal.

[0087] Step 4:

[0088] Users access their profile page and open the upload page for their work.

[0089] The device provides an interface with a profile page and an upload page.

[0090] Step 5:

[0091] The user selects an illustration file and enters metadata such as title, description, and price.

[0092] The terminal displays a file selection button and an input form.

[0093] The user inputs the necessary information.

[0094] Step 6:

[0095] The user clicks the upload button.

[0096] The terminal transmits the selected illustration file and metadata to the server.

[0097] Step 7:

[0098] The server stores the illustration files and records the corresponding metadata in a database.

[0099] The server stores the illustration files in storage.

[0100] Saves the metadata (title, description, price, etc.) to the database, confirms the save, and returns a success message to the terminal.

[0101] Step 8:

[0102] The server adds the newly uploaded illustration to the for sale list.

[0103] The server updates the public page and makes the new illustration available for viewing.

[0104] Building and selling AI models

[0105] Step 1:

[0106] Users (model builders) log in to the platform and access the illustration page for sale.

[0107] The terminal displays a login page and the user enters authentication information.

[0108] After authentication, the page of illustrations currently for sale will be displayed.

[0109] Step 2:

[0110] The server provides the terminal with data on illustrations currently on sale.

[0111] The server retrieves illustration information for sale from the database and returns it to the terminal.

[0112] Step 3:

[0113] The user selects the illustration they want to purchase and clicks the purchase button.

[0114] The device displays detailed information about the selected illustration and provides a purchase button.

[0115] Step 4:

[0116] The user enters payment information.

[0117] The terminal provides a form for inputting payment information, and the user enters the information.

[0118] Step 5:

[0119] The terminal transmits the entered payment information to the server.

[0120] The terminal transmits the payment information to the server.

[0121] Step 6:

[0122] The server processes the payment and records the transaction.

[0123] The server sends the information to a payment system to process the payment.

[0124] Once you have confirmed the payment was successful, record the transaction in your database.

[0125] If the payment is successful, the server will return a download link to the device along with a purchase completion message.

[0126] Step 7:

[0127] Users can download the illustrations they purchase and use them to build AI models.

[0128] The terminal displays a download link to the user.

[0129] Users click on the link to download the illustration.

[0130] Step 8:

[0131] Users build AI models in a local environment using the illustrations they purchase.

[0132] Step 9:

[0133] Users upload the AI ​​model they have built to the platform and set up sales.

[0134] The device will display the AI ​​model upload page.

[0135] The user selects an AI model file and enters the title, description, price, quantity, etc.

[0136] Step 10:

[0137] The device sends the AI ​​model file and metadata to the server.

[0138] The terminal transmits the input data to the server.

[0139] Step 11:

[0140] The server stores the AI ​​model and records sales information in a database.

[0141] The server stores the AI ​​model file in storage.

[0142] The metadata is saved in the database, and after confirming the save, a success message is returned to the terminal.

[0143] Step 12:

[0144] The server sets up the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[0145] The server processes the NFT and adds it to the sales list.

[0146] Prompt Sales

[0147] Step 1:

[0148] Users (prompt engineers) sell the generated prompts on the platform.

[0149] The terminal displays the generated prompt sales page.

[0150] The user enters the prompt and the price.

[0151] Step 2:

[0152] The terminal transmits the input prompt information to the server.

[0153] The terminal transmits the entered prompt and price information to the server.

[0154] Step 3:

[0155] The server records the prompt information in a database and adds it to the sales list.

[0156] The server stores the prompt information in a database.

[0157] Update the prompt sales page and add the new prompt to the sales list.

[0158] Example 1

[0159] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0160] Previously, selling illustrations and building AI models had issues with copyright and the reliability of transactions. Furthermore, the process of model builders purchasing illustrations and then building and selling AI models based on them was complicated, and there was a lack of proper data management and processing. Therefore, there is a need for a safe and efficient means of transaction for both illustration providers and model builders.

[0161] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0162] In this invention, the server includes an authentication means for users to log in to the platform, a means for inputting illustration metadata and uploading illustration files, a means for saving the uploaded illustrations in storage and recording the metadata in a database, a means for adding newly uploaded illustrations to a list of items for sale, a payment processing means for completing the purchase process, a means for downloading purchased illustration files, a means for uploading constructed AI models for sale on the platform, and a means for setting the AI ​​models for sale as non-fungible tokens (NFTs). This enables both illustration providers and model builders to conduct transactions safely and efficiently.

[0163] "Illustration provider" refers to a user who sells their own illustrations on the platform.

[0164] "Model builders" refer to users who purchase illustrations sold on the platform and build AI models.

[0165] "Authentication means" refers to the means for verifying an email address and password and generating a token for a user to log in to the platform.

[0166] "Metadata" refers to additional information such as the title, description, and price of an illustration file.

[0167] "Storage" refers to the storage device that stores uploaded illustration files in digital format.

[0168] "Database" refers to a system for systematically storing and managing information about illustration providers and illustration metadata.

[0169] "For Sale List" refers to a list that displays illustrations currently for sale on a public page.

[0170] "Payment processing means" refers to the means for receiving and processing payment information from the user during the purchase procedure.

[0171] "Download link" refers to the link on the Internet that allows a user to download the illustration file they have purchased.

[0172] "AI model" refers to an artificial intelligence model built by the user based on the purchased illustration.

[0173] A "non-fungible token (NFT)" refers to a token that represents a unique digital asset issued based on blockchain technology.

[0174] "Generation prompt" refers to the textual input instructions used to generate an AI model.

[0175] This system allows illustration providers to sell their illustrations on a platform, and model builders can purchase those illustrations to build AI models, which can then be sold. The system consists of a server, terminals, and users.

[0176] Hardware and software used

[0177] Server: Includes database, storage, authentication, payment processing, and NFT issuance functions. As a specific example, AWS (Amazon Web Services) can be used.

[0178] Terminal: A device that uses a web browser to provide a user interface and input, send, and receive data. For example, Google Chrome can be used.

[0179] Database: Manages user information, illustration metadata, AI model metadata, and sales information. As a concrete example, MySQL can be used.

[0180] Storage: Stores uploaded illustration files and AI model files. For example, Amazon S3 can be used.

[0181] Specific actions of the illustration provider

[0182] 1. The illustrator accesses the platform using a web browser. They enter their email address and password on the login screen and send the authentication information to the server. The server compares the information with the information in the database and authenticates the user.

[0183] 2. After successful authentication, the illustrator can access their profile page and open the upload page for their artwork. The user selects an illustration file, adds metadata such as title, description, and price, and clicks the upload button.

[0184] 3. The device sends this data to the server, which then stores the received illustration file in storage. At the same time, it records the metadata in a database and updates the for-sale listing on the public page.

[0185] Specific actions of the model builder

[0186] 1. The model builder logs in to the platform using a web browser, browses the illustrations for sale page, selects the desired illustration, and clicks the purchase button.

[0187] 2. The terminal displays a payment information input screen and prompts the model builder to enter the payment information. The payment information is sent to the server, which processes the payment through a payment provider.

[0188] 3. If the payment is successful, the server generates a purchase confirmation message and a download link and returns them to the device, allowing the model builder to download the purchased illustration.

[0189] 4. The model builder builds an AI model based on the downloaded illustration and uploads it to the platform. The device sends this information to the server, which then stores the AI ​​model file in storage and records the metadata in a database.

[0190] Issuance and sale of NFTs

[0191] 1. Once the AI ​​model is uploaded, the server processes the AI ​​model to issue it as a non-fungible token (NFT), which registers the AI ​​model as a unique digital asset.

[0192] 2. The server adds the issued NFT to the for sale list and updates the public page.

[0193] Prompt Sales

[0194] 1. After logging in to the platform, the prompt engineer accesses the page for selling generated prompts, enters the content and price of the generated prompt, and clicks the Save button.

[0195] 2. The terminal sends this information to the server, which records the prompt information in the database, adding a new prompt to the sales list.

[0196] Specific examples

[0197] Prompt Sentence Examples

[0198] "Simulate a mountain landscape with a sunset in the background."

[0199] This invention provides an environment where users can safely and efficiently sell and purchase illustrations, and build and sell AI models based on them, thereby maximizing the profits of both parties while resolving copyright issues.

[0200] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0201] Step 1:

[0202] A user logs into the platform.

[0203] Input: The user enters their email address and password on the device.

[0204] Specific behavior: The device displays a login screen and prompts the user to enter their email address and password.

[0205] Data processing: Convert the entered email address and password into JSON format and send it to the server.

[0206] Output: The server checks the user information against the database, and if authentication is successful, generates an authentication token and returns it to the terminal.

[0207] Description: The terminal receives the authentication token and displays a successful login to the user.

[0208] Step 2:

[0209] A user accesses their profile page and opens the upload page for their work.

[0210] Input: User clicks on the "Profile Page" link on their device.

[0211] Specific operation: The device will display the profile page and also display a link to the "work upload page."

[0212] Output: When the user clicks on the link, the device will display a form for uploading the work.

[0213] Description: The user selects an illustration file and enters metadata such as title, description, and price.

[0214] Step 3:

[0215] The user uploads the illustration file and metadata.

[0216] Input: User clicks the upload button.

[0217] Specific operation: The device sends the selected illustration file and the entered metadata to the server.

[0218] Data processing: The illustration file is sent as binary data, and the metadata is sent as JSON format to the server.

[0219] Output: The server saves the illustration files to storage and records the metadata in a database.

[0220] Description: If the save is successful, the server generates a success message and returns it to the terminal, which displays the success message to the user.

[0221] Step 4:

[0222] The server adds the newly uploaded illustration to the for sale list.

[0223] Input: Illustration files and metadata stored on the server.

[0224] Specific action: The server updates the data on the public page and adds the new illustration to the sales list.

[0225] Output: The for sale listing on the public page is updated to show the new illustration.

[0226] Description: When a user visits a public page, a new illustration appears.

[0227] Step 5:

[0228] Model builders browse the illustrations for sale page and purchase illustrations.

[0229] Input: A model builder browses an illustration page for sale on their device.

[0230] Specific operation: The device displays details of illustrations for sale. The user selects the desired illustration and clicks the purchase button.

[0231] Output: The checkout screen is displayed.

[0232] Description: Model builder enters payment information.

[0233] Step 6:

[0234] Complete the purchase process.

[0235] Input: The model builder enters payment information and clicks the confirm button.

[0236] Specific operation: The terminal sends the entered payment information to the server.

[0237] Data processing: Payment information is encrypted and sent to our servers.

[0238] Output: If the payment is successful, the server generates a purchase confirmation message and a download link and returns them to the device.

[0239] Description: Model builder receives a purchase confirmation message and download link on their device.

[0240] Step 7:

[0241] The illustrations purchased by users are downloaded and used to build AI models.

[0242] Input: Model builder clicks on download link.

[0243] Specific operation: The device downloads the illustration file and saves it locally.

[0244] Output: The illustration file is saved locally.

[0245] Description: The model builder builds an AI model based on the downloaded illustration file.

[0246] Step 8:

[0247] Users upload their built AI models to the platform.

[0248] Input: The model builder selects the AI ​​model file and enters sales information.

[0249] Specific operation: The device sends the AI ​​model file and sales information to the server.

[0250] Data processing: The AI ​​model file is sent as binary data, and sales information is sent in JSON format to the server.

[0251] Output: The server saves the AI ​​model file to storage and records the metadata in a database.

[0252] Description: A new AI model is added to the for sale list.

[0253] Step 9:

[0254] The server sets the AI ​​model as an NFT and updates the sales page.

[0255] Input: Uploaded AI model data.

[0256] Specific operation: The server processes the NFT and adds it to the sales list.

[0257] Output: The sales page is updated and the AI ​​model is sold as an NFT.

[0258] Description: When users visit the sales page, they can see that the new AI model is being sold as an NFT.

[0259] Step 10:

[0260] Users (prompt engineers) sell generated prompts.

[0261] Input: The prompt engineer enters the content and price of the generated prompt.

[0262] Specific operation: The terminal displays the generated prompt sales page and provides a form for the user to enter the prompt content and price.

[0263] Data processing: The entered prompt information is converted into JSON format and sent to the server.

[0264] Output: The server records the prompt information in a database and adds it to the sales list.

[0265] Description: The generated prompt is added to the sales list and becomes visible to the user.

[0266] (Application example 1)

[0267] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0268] In the past, copyright management and fair distribution of rewards have been issues in the trading of illustrations and digital content. Furthermore, in the trading of AI models generated from illustrations and the content that utilizes them, there has been a lack of rights protection and transparency, which has led to a decline in the reliability of the transactions. Furthermore, there has been little progress in developing a platform for utilizing this content across a wide range of devices. It is necessary to solve these issues and provide a fair and transparent trading system.

[0269] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0270] In this invention, the server includes a means for an illustration provider to sell their illustrations on an e-commerce platform, a means for a model builder to purchase sold illustrations and build an AI model, a means for selling the built AI model on the e-commerce platform, a means for generating content using the AI ​​model based on the purchased illustrations, and a means for displaying the generated content on a smart device. This solves issues of copyright management and fair remuneration distribution, enabling fair and transparent transactions. Furthermore, the generated content can be used on a variety of devices such as smartphones and smart glasses, making it possible to provide high-quality digital content to a wide range of users.

[0271] An "illustration provider" is a person who sells illustrations that he or she has created on an e-commerce platform.

[0272] An "e-commerce platform" is an online system for buying and selling goods and services over the Internet.

[0273] A "model builder" is someone who purchases illustrations for sale and builds an AI model based on those illustrations.

[0274] An "AI model" is a digital model built using artificial intelligence technology to perform a specific task.

[0275] A "non-fungible token (NFT)" is a unique tokenized digital asset that proves ownership of a digital asset.

[0276] "Generated prompts" are sentences containing instructions or hints that the AI ​​model uses to improve the quality of the generated content.

[0277] A "smart device" is an electronic device that has internet connectivity and can run various applications. Examples include smartphones, smart glasses, and head-mounted displays.

[0278] "Content" refers to information or data that is electronically generated or distributed, and specifically includes artwork, animated characters, etc.

[0279] A "server" is a computer system that provides information or services in response to requests from clients over a network.

[0280] An embodiment of the present invention will be described. This invention is a system in which an illustration provider sells their own illustrations on an e-commerce platform, and a model builder builds an AI model based on the purchased illustrations. This allows the built AI model to be sold again on the e-commerce platform, and the generated content to be displayed on a smart device.

[0281] The server provides a function that allows illustrators to sell their illustrations on an e-commerce platform. Specifically, illustrators can access the platform, upload their works, and assign metadata such as title, description, price, etc. The server stores this information in a database and instantly updates the sales list.

[0282] Model builders use a means to purchase illustrations for sale. Based on the purchased illustrations, they can build AI models in a local environment. The built AI models can then be used by users to generate any content they want. For example, they can use the AI ​​models to generate digital content such as animated characters and background images.

[0283] The constructed AI models will then be sold on the e-commerce platform. Furthermore, purchased AI models will be set up as non-fungible tokens (NFTs) to prove digital ownership, facilitating copyright management and ensuring fair reward distribution.

[0284] The system also includes a function to display the generated content on smart devices, allowing users to view and use the generated content in real time on devices such as smartphones, smart glasses, and head-mounted displays.

[0285] Specific examples are given below.

[0286] For example, a user can upload an illustration of a riverside landscape, and another user who purchases that illustration can build an AI model. Using that AI model, a user can input a prompt such as, "Draw a new animated character based on the riverside landscape. Add colorful flowers and a blue sky as the background." This generated content can then be easily displayed and used on smartphones or smart glasses.

[0287] By having each stakeholder, server, terminal, and user, fulfill their respective roles, fair and transparent content transactions and use across a variety of devices will be realized.

[0288] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0289] Step 1:

[0290] The user (illustrator) logs in to the platform.

[0291] Enter your email address and password.

[0292] The server receives this information and compares it with the user information in its database for authentication. If authentication is successful, the server generates a token and returns it to the terminal.

[0293] Output: The authenticated token.

[0294] Step 2:

[0295] Users access their profile page and open the upload page for their work.

[0296] Input: User-selected illustration file, metadata such as title, description, and price.

[0297] The terminal provides a form to display this information, receives input from the user, and then transmits the selected illustration file and metadata to the server.

[0298] Output: Illustration file and metadata.

[0299] Step 3:

[0300] The server stores the received illustration files in storage and records the metadata in a database.

[0301] Input: Uploaded illustration file and metadata.

[0302] The server saves this data in the storage and database, respectively. Once the saving is confirmed, the server returns a success message to the terminal.

[0303] Output: Save confirmation success message.

[0304] Step 4:

[0305] The server adds the newly uploaded illustration to the for sale list.

[0306] Input: Saved illustrations and metadata.

[0307] The server will update the public page, making the new illustration available for viewing.

[0308] Output: The updated public list.

[0309] Step 5:

[0310] Users (model builders) log in to the platform and view pages of illustrations available for sale.

[0311] Input: The user's access request.

[0312] The terminal displays details of illustrations for sale. The user selects the illustration they want and clicks the purchase button.

[0313] Output: Displayed illustration details.

[0314] Step 6:

[0315] Complete the purchase process.

[0316] Input: Payment information.

[0317] The server receives and processes the payment information, and upon successful payment, provides the user with a purchase confirmation message and a download link.

[0318] Output: Purchase confirmation message and download link.

[0319] Step 7:

[0320] Users can download the illustrations they purchase and use them to build AI models.

[0321] Input: Download link.

[0322] The device uses the download link to obtain the illustration file and saves it locally, allowing the user to build an AI model based on the illustration.

[0323] Output: Downloaded illustration file.

[0324] Step 8:

[0325] Users upload their built AI models to the platform.

[0326] Input: AI model file and sales information (price, quantity, etc.).

[0327] The device sends the AI ​​model file and sales information to the server, which stores it and adds it to the sales list.

[0328] Output: Saved AI model file and sales information.

[0329] Step 9:

[0330] The server sets up the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[0331] Input: A saved AI model file.

[0332] The server processes the NFT and adds it to the sales list.

[0333] Output: Added NFT to the for sale list.

[0334] Step 10:

[0335] Users (prompt engineers) sell the generated prompts on the platform.

[0336] Input: Generate prompt and price.

[0337] The terminal displays the generated prompt sales page, and the user inputs the prompt content and price, which are then sent to the server, recorded in the database, and added to the sales list.

[0338] Output: Recorded prompt information and updated sales list.

[0339] These steps will enable illustrators and model builders to sell their work and the AI ​​models they generate, enabling a fair and transparent trade of content.

[0340] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0341] This invention combines an emotion engine with a system in which illustrators sell their illustrations on a platform, model builders purchase them to build AI models, and then sell the AI ​​models. This system can recognize users' emotions and adjust content recommendations and generation prompts based on those emotions.

[0342] Program processing

[0343] This system is composed of a server, a terminal, a user, and an emotion engine. The flow of each process will be explained in detail below.

[0344] Upload and sell illustrations

[0345] 1. The user (illustrator) logs in to the platform.

[0346] The device displays a login page and prompts the user to enter their email address and password. After the user enters the information, the device sends it to the server.

[0347] The server authenticates the user by checking the user information in the database. If authentication is successful, the server generates a token and returns it to the terminal.

[0348] 2. The user accesses their profile page and opens the upload page for their work.

[0349] The terminal displays a form for uploading artwork, allowing the user to select an illustration file and enter metadata such as title, description, and price.

[0350] 3. The user clicks the upload button.

[0351] The terminal transmits the selected illustration file and metadata to the server.

[0352] The server saves the illustration file to storage, records the corresponding metadata in a database, and returns a success message to the device once the save is confirmed.

[0353] 4. The server adds the newly uploaded illustration to the for sale list.

[0354] The server updates the public page and makes the new illustration available for viewing.

[0355] Building and selling AI models

[0356] 5. The user (model builder) logs in to the platform and accesses the illustration page for sale.

[0357] The terminal displays a login page, where the user enters their authentication information. After authentication, the terminal displays a page of illustrations for sale.

[0358] 6. The server provides the terminal with data on illustrations currently on sale.

[0359] The server retrieves illustration information for sale from the database and returns it to the terminal.

[0360] 7. The user selects the illustration they want to purchase and clicks the purchase button.

[0361] The device displays detailed information about the selected illustration and provides a purchase button.

[0362] 8. The user enters payment information.

[0363] The terminal provides a form for inputting payment information, and the user enters the information.

[0364] 9. The terminal sends the entered payment information to the server.

[0365] The terminal transmits the payment information to the server.

[0366] 10. The server processes the payment and records the transaction.

[0367] The server sends the information to a payment system to process the payment.

[0368] Once you have confirmed the payment was successful, record the transaction in your database.

[0369] If the payment is successful, the server will return a download link to the device along with a purchase completion message.

[0370] 11. Users download the purchased illustrations and use them to build AI models.

[0371] The terminal displays a download link to the user.

[0372] Users click on the link to download the illustration.

[0373] 12. Users build AI models in their local environment using the illustrations they purchased.

[0374] 13. Users upload the AI ​​model they have built to the platform and set up sales.

[0375] The device will display the AI ​​model upload page.

[0376] The user selects an AI model file and enters the title, description, price, quantity, etc.

[0377] 14. The device sends the AI ​​model file and metadata to the server.

[0378] The terminal transmits the input data to the server.

[0379] 15. The server stores the AI ​​model and records sales information in a database.

[0380] The server stores the AI ​​model file in storage.

[0381] The metadata is saved in the database, and after confirming the save, a success message is returned to the terminal.

[0382] 16. The server sets up the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[0383] The server processes the NFT and adds it to the sales list.

[0384] Prompt Sales

[0385] 17. Users (prompt engineers) sell the generated prompts on the platform.

[0386] The terminal displays the generated prompt sales page, and the user inputs the prompt content and price.

[0387] The terminal transmits the input prompt information to the server.

[0388] The server records the prompt information in a database and adds it to the sales list.

[0389] Utilizing the Emotion Engine

[0390] 18. The emotion engine receives the user's facial expression data as input and analyzes emotions in real time.

[0391] The device captures facial expression data through the camera and sends it to the emotion engine.

[0392] The emotion engine analyzes the received facial expression data and identifies the emotional state.

[0393] 19. The emotion engine sends the analysis results to the server to optimize the user experience.

[0394] The server recommends content to improve the user experience based on the emotion analysis results received from the emotion engine.

[0395] 20. The emotion engine adjusts the prompts generated by the AI ​​model based on the user's emotional state.

[0396] The server selects the most appropriate generated prompt depending on the emotional state and provides it to the user.

[0397] Specific examples

[0398] Illustration provider's scenario

[0399] Illustrator A accesses the platform to sell a landscape painting he or she has created. After logging in, A goes to the profile page and opens the work upload page. A selects a file, enters the title "Beautiful Evening Scenery," the description "A landscape with a tranquil sunset," and the price of 5,000 yen, and clicks the upload button. The data is saved by the server, and A's work is published in the sales list.

[0400] Model Builder Scenarios

[0401] Model builder B wants to build a new AI model using a landscape painting, so he logs into the platform. He browses the illustration page for sale, selects A's "Beautiful Sunset Scene," and clicks the purchase button. B enters his payment information and receives a download link once the process is complete. B uses the downloaded image to build an AI model, and then applies for and sells the model as an NFT for limited time only.

[0402] Emotion Engine Scenario

[0403] When user C logs in to the platform and browses illustrations, facial expression data is captured via the camera. The emotion engine recognizes C's happy facial expression and sends the emotion analysis results to the server. The server then recommends illustrations with a cheerful tone to enhance C's joy. In addition, when C builds an AI model, the generated prompts are automatically adjusted to match C's emotional state.

[0404] This invention provides a comprehensive system for safe and fair transactions that considers the emotional state of illustration providers, model builders, and general users, thereby resolving copyright issues and realizing a mutually beneficial environment.

[0405] The processing flow will be explained below.

[0406] Upload and sell illustrations

[0407] Step 1:

[0408] The user (illustrator) accesses the platform's login page.

[0409] The device will display a login page and prompt you to enter your email address and password.

[0410] Step 2:

[0411] The user enters an email address and password.

[0412] The terminal transmits the authentication information entered by the user to the server.

[0413] Step 3:

[0414] The server authenticates the user by checking the user information in the database.

[0415] The server compares the entered information with the information in the database, and if authentication is successful, generates a session token and returns it to the terminal.

[0416] Step 4:

[0417] Users access their profile page and open the upload page for their work.

[0418] The device provides an interface with a profile page and an upload page.

[0419] Step 5:

[0420] The user selects an illustration file and enters metadata such as title, description, and price.

[0421] The terminal displays a file selection button and an information input form.

[0422] Step 6:

[0423] The user clicks the upload button.

[0424] The terminal transmits the selected illustration file and metadata to the server.

[0425] Step 7:

[0426] The server stores the illustration files and records the corresponding metadata in a database.

[0427] The server saves the illustration file to storage and saves the metadata to a database. Once the saving is complete, the server returns a success message to the device.

[0428] Step 8:

[0429] The server adds the newly uploaded illustration to the for sale list.

[0430] The server updates the public page and displays the new illustration in the for sale listing.

[0431] Building and selling AI models

[0432] Step 1:

[0433] Users (model builders) log in to the platform and access the illustration page for sale.

[0434] The terminal displays a login page where the user can enter their authentication information. After authentication, the terminal displays a page listing illustrations currently for sale.

[0435] Step 2:

[0436] The server retrieves data on illustrations currently on sale and provides it to the terminal.

[0437] The server retrieves information about illustrations currently on sale from the database and transmits it to the terminal.

[0438] Step 3:

[0439] The user selects the illustration they want to purchase and clicks the purchase button.

[0440] The device will display detailed information about the selected illustration and a purchase button.

[0441] Step 4:

[0442] The user enters payment information.

[0443] The terminal provides a form for inputting payment information, and the user enters the information.

[0444] Step 5:

[0445] The terminal transmits the entered payment information to the server.

[0446] The terminal transmits the payment information to the server.

[0447] Step 6:

[0448] The server processes the payment and records the transaction.

[0449] The server processes the payment by sending the information to the payment system, records the transaction in a database after confirming the payment was successful, and returns a download link to the device along with a purchase completion message.

[0450] Step 7:

[0451] Users can download the illustrations they purchase and use them to build AI models.

[0452] The terminal displays a download link, allowing the user to click on the link to download the illustration.

[0453] Step 8:

[0454] Users build AI models in a local environment using the illustrations they purchase.

[0455] Step 9:

[0456] Users upload the AI ​​model they have built to the platform and set up sales.

[0457] The terminal displays an AI model upload page, where the user selects an AI model file and enters metadata such as title, description, price, and quantity.

[0458] Step 10:

[0459] The device sends the AI ​​model file and metadata to the server.

[0460] The terminal transmits the input data to the server.

[0461] Step 11:

[0462] The server stores the AI ​​model and records sales information in a database.

[0463] The server saves the AI ​​model file to storage, saves the metadata to a database, and returns a success message to the device once the save is complete.

[0464] Step 12:

[0465] The server sets up the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[0466] The server will process the NFT and add it to the sales list.

[0467] Prompt Sales

[0468] Step 1:

[0469] Users (prompt engineers) sell the generated prompts on the platform.

[0470] The terminal displays the generated prompt sales page and allows the prompt content and price to be entered.

[0471] Step 2:

[0472] The terminal transmits the input prompt information to the server.

[0473] The terminal transmits the entered prompt and price information to the server.

[0474] Step 3:

[0475] The server records the prompt information in a database and adds it to the sales list.

[0476] The server saves the prompt information in a database and updates the sales page.

[0477] Utilizing the Emotion Engine

[0478] Step 1:

[0479] The device captures the user's facial expression data with a camera and sends it to the emotion engine.

[0480] The device captures the user's facial expressions in real time and sends the data to the emotion engine.

[0481] Step 2:

[0482] The emotion engine analyzes the facial expression data to identify the user's emotional state.

[0483] The emotion engine analyzes the input facial expression data and identifies the user's emotional state.

[0484] Step 3:

[0485] The emotion engine sends the analysis results to the server.

[0486] The emotion engine transmits the analysis results of the identified emotional state to the server.

[0487] Step 4:

[0488] The server recommends appropriate content to the user based on the results of the sentiment analysis.

[0489] Based on the results of the sentiment analysis, the server recommends appropriate illustrations and prompts to the user.

[0490] Step 5:

[0491] The server adjusts the generated prompts based on the user's emotional state.

[0492] The server selects the most appropriate prompt to generate based on the emotion analysis results and presents it to the user.

[0493] Specific examples

[0494] Illustration provider's scenario

[0495] Illustrator A accesses the platform to sell a landscape painting he or she has created. After logging in, A goes to the profile page and opens the work upload page. A selects a file, enters the title "Beautiful Evening Scenery," the description "A landscape with a tranquil sunset," and the price of 5,000 yen, and clicks the upload button. The data is saved by the server, and A's work is published in the sales list.

[0496] Model Builder Scenarios

[0497] Model builder B wants to build a new AI model using a landscape painting, so he logs into the platform. He browses the illustration page for sale, selects A's "Beautiful Sunset Scene," and clicks the purchase button. B enters his payment information and receives a download link once the process is complete. B uses the downloaded image to build an AI model, and then applies for and sells the model as an NFT for limited time only.

[0498] Emotion Engine Scenario

[0499] When user C logs in to the platform and views an illustration, facial expression data is captured via the camera. The emotion engine recognizes C's happy expression and sends the emotion analysis results to the server. The server then recommends illustrations with a cheerful tone to enhance C's joy. Furthermore, when C builds an AI model, the generated prompts are automatically adjusted to match C's emotional state. The present invention realizes safe and fair transactions by taking into account the emotional states of the illustration provider, model builder, and general users.

[0500] Example 2

[0501] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0502] In conventional systems, the process for illustrators to sell their illustrations and the process for model builders to use those illustrations to build and sell AI models are complicated, and the user experience is not sufficiently improved. Furthermore, the system lacks the ability to recognize the user's emotional state in real time and recommend optimal content or adjust generated prompts based on that emotion. This makes it difficult for users to achieve emotionally satisfying transactions.

[0503] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for an illustration provider to sell their own illustrations on the platform; a means for a terminal to authenticate a user; a means for saving illustration files and metadata and adding them to a sales list; a means for a model builder to purchase sold illustrations; a means for processing payments and recording transactions; a means for providing users with links to download the illustrations; a means for a user to build an AI model and sell it on the platform; a means for recording the metadata of the AI ​​model and adding it to a sales list; a means for an emotion engine to analyze the user's emotions; a means for recommending content based on the emotion analysis results; and a means for adjusting generation prompts according to the user's emotional state. This enables users to achieve emotionally satisfying transactions through a simple and efficient process.

[0504] "Illustration provider" refers to a user who sells illustrations they have drawn on the platform.

[0505] "Model builders" refer to users who purchase illustrations for sale and build AI models.

[0506] "Terminal" refers to a computer or information processing device operated by a user, and is responsible for user authentication, data entry, display, etc.

[0507] "Server" refers to a central computer that stores and processes data, authenticates users, records transactions, etc.

[0508] "Platform" refers to an online service infrastructure for selling illustrations, building AI models, and selling generation prompts.

[0509] "Metadata" refers to accompanying information about an illustration or AI model (e.g., title, description, price, etc.).

[0510] "Storage" refers to a digital storage medium for long-term data preservation.

[0511] A "token" refers to identification information generated by a server when a user is successfully authenticated.

[0512] "Transaction" refers to data that records a series of processes related to the purchase and sale of illustrations and AI models.

[0513] A "non-fungible token (NFT)" is a token that uses blockchain technology to prove the uniqueness and ownership of a digital asset.

[0514] "Emotion engine" refers to a program for analyzing a user's emotional state.

[0515] A "generation prompt" refers to an input sentence that provides specific generation instructions to an AI model.

[0516] "Content" refers to information and data provided to users (e.g., illustrations, recommended images, text, etc.).

[0517] The present invention is a system in which illustrators sell their illustrations on a platform, model builders purchase them, build AI models, and sell the AI ​​models. Furthermore, by combining this system with an emotion engine, it can recognize the user's emotional state and adjust content recommendations and generated prompts based on that state. Specific embodiments of the invention are described below.

[0518] Configuration and Usage

[0519] This system mainly consists of a server, a terminal, a user, and an emotion engine.

[0520] Upload and sell illustrations

[0521] The user (illustrator) enters their email address and password on their device and sends the authentication information to the server. The server compares the user information with that in the database, and if authentication is successful, generates a token and returns it to the device. The user then accesses their profile page and opens the work upload page. The device prompts them to select an illustration file and enter metadata such as title, description, and price, which are then sent to the server. The server saves the illustration file in storage and records the metadata in the database. Once saved, the server adds the newly uploaded illustration to the for sale list and updates the public page.

[0522] Building and selling AI models

[0523] The model builder accesses the page of illustrations for sale and selects the illustration they wish to purchase. The terminal prompts them to enter payment information and sends it to the server. The server sends the information to the payment system and processes the payment. If the payment is successful, it records the transaction and returns a download link to the terminal along with a purchase completion message. The model builder uses the downloaded illustration to build an AI model in a local environment, uploads it to the platform, and sets it up for sale. The server saves the AI ​​model file in storage and records the metadata in a database. Once saved, the server sets the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[0524] Prompt Sales

[0525] The prompt engineer sells the generated prompts on the platform. The terminal allows the user to input the prompt content and price, and sends it to the server. The server records the prompt information in the database and adds it to the sales list.

[0526] Utilizing the Emotion Engine

[0527] The emotion engine receives the user's facial expression data as input and analyzes emotions in real time. The device captures the facial expression data through the camera and sends it to the emotion engine. The emotion engine then sends the analysis results to the server, which then recommends content to improve the user experience. The emotion engine also adjusts the generated prompts based on the user's emotional state. For example, if the user shows a happy expression, the server will recommend an illustration with a cheerful tone, and the generated prompts will also be adjusted to match that emotion.

[0528] Specific examples

[0529] Illustration provider's scenario

[0530] Illustrator A accesses the platform to sell a landscape painting he or she has created. After logging in, A goes to the profile page and opens the work upload page. A selects the file, enters the title "Beautiful Evening Scenery," the description "A landscape with a tranquil sunset," and the price of 5,000 yen, and clicks the upload button. The data is saved by the server, and A's work is published in the sales list.

[0531] Model Builder Scenarios

[0532] Model builder B logs into the platform, browses the list of illustrations for sale, and purchases A's "Beautiful Sunset." After entering payment information and completing the purchase, B obtains a download link from the server. B uses this illustration to build a new AI model, which he then uploads back to the platform and sells as an NFT.

[0533] Emotion Engine Scenario

[0534] User C logs in to the platform and browses various illustrations. C's facial expression data is captured through the camera, and the emotion engine detects the emotion of joy. Based on this analysis, the server recommends cheerful illustrations that enhance C's joy. In addition, when C builds an AI model, the generated prompts are automatically adjusted to provide instructions that best suit C's emotions.

[0535] In this way, the system smoothly carries out the entire process from providing illustrations to building AI models and sales, and further optimizes the experience based on the user's emotions, providing an overall excellent user experience.

[0536] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0537] Step 1:

[0538] The user (illustrator) logs in to the platform

[0539] Input: Email address, Password

[0540] Specific behavior:

[0541] 1. The device displays the login page.

[0542] 2. The user enters their email address and password and clicks the login button.

[0543] 3. The terminal sends the entered information to the server.

[0544] Data processing / calculation and output:

[0545] The server compares the user information with that in the database, and if authentication is successful, generates a token and returns it to the terminal.

[0546] Step 2:

[0547] A user accesses their profile page and opens the upload page for their work.

[0548] Input: Token

[0549] Specific behavior:

[0550] 1. The device receives the authenticated token and displays the profile page.

[0551] 2. The user selects the upload page for the work.

[0552] Data processing / calculation and output:

[0553] The server verifies the authentication token and sends the upload form to the device.

[0554] Step 3:

[0555] Upload your work

[0556] Input: Illustration file, metadata (title, description, price, etc.)

[0557] Specific behavior:

[0558] 1. The device displays the illustration file and a metadata input form.

[0559] 2. The user fills out the input form and clicks the upload button.

[0560] 3. The device sends the illustration file and metadata to the server.

[0561] Data processing / calculation and output:

[0562] The server saves the illustration file to storage, records the metadata in the database, and sends a success message to the device after saving is complete.

[0563] Step 4:

[0564] Add to for sale list

[0565] Input: Saved illustration file and metadata

[0566] Specific behavior:

[0567] The server adds the newly uploaded illustration to the for sale list.

[0568] Data processing / calculation and output:

[0569] The server will update the public page and make the new illustrations available for viewing.

[0570] Step 5:

[0571] The user (model builder) accesses the illustration page for sale.

[0572] Input: User authentication

[0573] Specific behavior:

[0574] 1. The terminal displays a user authentication page and the user logs in.

[0575] 2. The user enters their login information and accesses the illustrations for sale page.

[0576] Data processing / calculation and output:

[0577] The server retrieves information about illustrations for sale from the database and returns it to the terminal, which then displays it.

[0578] Step 6:

[0579] Selecting and purchasing illustrations

[0580] Input: Selected illustration and payment information

[0581] Specific behavior:

[0582] 1. The user selects the illustration they want to purchase and clicks the purchase button.

[0583] 2. The terminal provides a form for entering payment information, and the user enters the information.

[0584] 3. The terminal sends the entered information to the server.

[0585] Data processing / calculation and output:

[0586] The server sends the information to the payment system, processes the payment, and if the payment is successful, records the transaction in a database and returns a purchase completion message and a download link to the device.

[0587] Step 7:

[0588] Download illustrations

[0589] Input: Purchase completion message and download link

[0590] Specific behavior:

[0591] 1. The device will display a purchase completion message and a download link.

[0592] 2. The user clicks on the download link to download the illustration.

[0593] Data processing / calculation and output:

[0594] The user obtains the downloaded illustration file and saves it in their local environment.

[0595] Step 8:

[0596] Building and uploading an AI model

[0597] Input: Downloaded illustration file, AI model file, metadata

[0598] Specific behavior:

[0599] 1. The user builds an AI model in a local environment using the illustrations they purchased.

[0600] 2. Upload the AI ​​model you have built to the platform and set it up for sales.

[0601] Data processing / calculation and output:

[0602] The server saves the AI ​​model file to storage, records the metadata in the database, and sends a success message to the device when the save is complete.

[0603] Step 9:

[0604] NFT issuance and sales page updates

[0605] Input: AI model file and metadata

[0606] Specific behavior:

[0607] The server sets the AI ​​model as an NFT and updates the sales page.

[0608] Data processing / calculation and output:

[0609] The server processes the NFT and adds it to the sales list.

[0610] Step 10:

[0611] Sales Generated Prompts

[0612] Input: Generate prompt content, price

[0613] Specific behavior:

[0614] 1. The user (prompt engineer) accesses a page that sells generated prompts.

[0615] 2. Enter the prompt content and price and send it from the terminal to the server.

[0616] Data processing / calculation and output:

[0617] The server records the prompt information in a database and adds it to the sales list.

[0618] Step 11:

[0619] Emotion analysis using an emotion engine

[0620] Input: User's facial expression data

[0621] Specific behavior:

[0622] 1. The device acquires facial expression data through the camera and sends it to the emotion engine.

[0623] 2. The emotion engine analyzes facial expression data and identifies emotional states.

[0624] Data processing / calculation and output:

[0625] The sentiment analysis results are sent to the server, which then recommends content to improve the user experience.

[0626] Step 12:

[0627] Adjusting the generated prompt

[0628] Input: Sentiment analysis results

[0629] Specific behavior:

[0630] The server selects the most appropriate generated prompt according to the emotional state and provides it to the user.

[0631] Data processing / calculation and output:

[0632] The emotional engine adjusts the generated prompts based on the emotional state to provide the user with the most appropriate generated content.

[0633] (Application example 2)

[0634] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0635] While existing platforms allow transactions between illustration providers and model builders, they lack the ability to customize or recommend products based on customer sentiment. Furthermore, they lack real-time customer support and prompt generation for appropriate sales promotion, making it difficult to provide an optimal customer experience. Therefore, there is a need for a system that can maximize the profits of illustration providers and model builders while improving customer satisfaction.

[0636] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0637] In this invention, the server includes a means for an illustrator to sell his / her own illustrations on the platform, a means for a model builder to purchase sold illustrations and build an AI model, a means for recognizing a customer's facial expression in real time and analyzing their emotions, a means for recommending appropriate products based on the analyzed emotions, and a means for generating customer service prompts for sales promotion based on the customer's emotions. This enables personalized product recommendations and customer service support that take customer emotions into consideration.

[0638] "Platform" refers to a series of online systems that multiple users can access via the Internet and use to trade illustrations and AI models.

[0639] "Illustration Provider" refers to an individual or organization that uploads and sells illustrations they have created on the Platform.

[0640] "Model Builder" refers to an individual or organization that purchases illustrations for sale on the Platform, creates AI models based on those illustrations, and then sells them on the Platform.

[0641] An "AI model" refers to a program or system built using machine learning algorithms to perform a specific task.

[0642] A "non-fungible token (NFT)" is a token that uses blockchain technology to prove ownership of a digital asset and guarantee its uniqueness.

[0643] "Generation prompts" refer to text information containing specific instructions and guidelines used when generating content using AI.

[0644] "Emotion analysis" refers to a technological means of analyzing a customer's facial expressions in real time and identifying their emotional state from the results.

[0645] "Product recommendation" refers to algorithms and systems that present optimal products to customers based on analyzed emotional data.

[0646] "Customer service prompts" refer to text information containing instructions for providing appropriate response methods and conversation content depending on the customer's emotional state.

[0647] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following provides a detailed description of the embodiments of the present invention.

[0648] Hardware and software used

[0649] The system uses the following hardware and software:

[0650] Server: Uses Django (Python Web Framework) and is responsible for back-end data processing.

[0651] Database: MySQL is used to manage illustrations, AI models, generative prompts, customer data, etc.

[0652] Face Recognition and Emotion Analysis: Using OpenCV and DeepFace libraries.

[0653] Front-end: Uses React Native to provide a user interface for smartphones and tablets.

[0654] Recommendation system: Uses TensorFlow to recommend products based on sentiment analysis results.

[0655] Specific system operations and processing

[0656] 1. Upload and sell illustrations:

[0657] Illustration providers log in to the platform, upload their own illustrations, and set up sales. The terminal sends the entered data to the server, which records it in a database.

[0658] 2. Building and selling AI models:

[0659] Model builders purchase illustrations for sale on the platform, download them, and then build an AI model. They then upload the AI ​​model to the platform and set it up for sale.

[0660] 3. Emotion analysis:

[0661] The front-end device uses a camera to capture the customer's facial expressions in real time and sends the data to the server, which then uses DeepFace to perform emotion analysis and sends the analysis results back to the front-end.

[0662] 4. Generate product recommendations and customer prompts:

[0663] Based on the sentiment analysis results, an algorithm using TensorFlow is run to recommend appropriate products, and customer service prompts are generated based on the analysis results and sent to the store clerk's device.

[0664] Specific Operation Examples

[0665] Operation example 1: Illustration provider operation

[0666] Illustration provider A uploads the illustration he or she has drawn to the platform. The server stores it in the database and adds it to the sales list.

[0667] Operation example 2: Model builder operation

[0668] Model Builder B purchases an illustration from the platform, builds an AI model based on that illustration, uploads the built AI model to the server, and sets up sales.

[0669] Operation example 3: Sentiment analysis and product recommendation

[0670] When customer C enters the store, facial recognition is performed using the device's camera. If emotion analysis determines that C is happy, the server recommends positive products (e.g., colorful miscellaneous goods).

[0671] Specific prompt examples

[0672] A customer comes into the store with a smile. Please recommend cheerful and uplifting items and accessories and serve them in a bright and cheerful atmosphere.

[0673] This provides an environment that can improve the user experience for all: illustrators, model builders, and customers. By combining emotion analysis technology with an AI model generation and sales platform, this system achieves more personalized product recommendations and customer service support.

[0674] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0675] Step 1:

[0676] Uploading illustrations and setting up sales

[0677] The user (illustrator) logs in to the device and accesses the illustration upload page. They select the illustration file and metadata (title, description, price, etc.) and click the upload button. The device sends this data to the server, which saves the illustration in storage and records the metadata in the database. The illustration is then added to the sales list with a success message.

[0678] Input: illustration file, metadata (title, description, price, etc.)

[0679] Processing / calculation: illustration file storage, metadata database recording

[0680] Output: Success message, added to sales list

[0681] Step 2:

[0682] Purchase illustrations currently on sale

[0683] The model builder logs in to the terminal and accesses the page of illustrations for sale. They select the illustration they want to purchase and click the purchase button. The terminal provides a form for entering payment information, which is then sent to the server after it is filled out. The server sends the information to the payment system, and once the payment is confirmed, a download link is generated and sent back to the terminal.

[0684] Input: Login information, illustration selection information, payment information

[0685] Processing / Calculation: Payment processing, transaction recording, download link generation

[0686] Output: Download link

[0687] Step 3:

[0688] Building and uploading an AI model

[0689] The model builder uses the purchased illustration in a local environment to build an AI model. After construction, the constructed AI model and its metadata (title, description, price, etc.) are sent to the server via the upload page. The server saves the AI ​​model in storage and records it in a database.

[0690] Input: Built AI model file, metadata (title, description, price, etc.)

[0691] Processing / calculation: AI model file storage, metadata database recording

[0692] Output: Success message, added to sales list

[0693] Step 4:

[0694] Setting up non-fungible tokens (NFTs)

[0695] The server then sets up the uploaded AI model as an NFT, using blockchain technology to prove ownership of the digital asset and add it to the sales list.

[0696] Input: AI model file, metadata

[0697] Processing / calculation: NFT setting, ownership verification by blockchain

[0698] Output: Add to sales list

[0699] Step 5:

[0700] Sales Generated Prompts

[0701] To set up sales of the generated prompts on the platform, prompt engineers log in, enter the prompt content and price, and send it to the server, which records the prompt information in the database and adds it to the sales list.

[0702] Input: Generate prompt content, price

[0703] Processing / calculation: database recording of prompt information

[0704] Output: Add to sales list

[0705] Step 6:

[0706] Customer Sentiment Analysis

[0707] The device uses a camera to capture customer facial expression data in real time and transmits it to the server, which then uses the DeepFace library to perform emotion analysis and sends the results back to the device.

[0708] Input: Customer's facial expression data

[0709] Processing / Calculation: Emotion Analysis (using DeepFace)

[0710] Output: Emotion analysis results

[0711] Step 7:

[0712] Generate product recommendations and customer service prompts

[0713] The server uses TensorFlow to run an algorithm that recommends appropriate products based on the results of the sentiment analysis, and also generates customer service prompts based on the analysis results and notifies the store clerk's device.

[0714] Input: Sentiment analysis results

[0715] Processing / calculation: Executing product recommendation algorithms, generating customer prompts (using TensorFlow)

[0716] Output: Product recommendations, customer service prompts

[0717] Step 8:

[0718] Sales List Updates

[0719] All illustrations, AI models, and generated prompts uploaded by users are added to the sales list by the server and made available to customers.

[0720] Input: Uploaded illustrations, AI models, generated prompts

[0721] Processing / calculation: Updating the database and publishing the sales list

[0722] Output: Published sales list

[0723] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0724] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0725] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0726] [Second embodiment]

[0727] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0728] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0729] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0730] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0731] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0732] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0733] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0734] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0735] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0736] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0737] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0738] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0739] This invention is a system in which illustrators sell their illustrations on a platform, model builders purchase them, build AI models, and then sell the AI ​​models. This system solves copyright issues while realizing legal and advantageous transactions for both parties.

[0740] Program processing

[0741] This system is composed of a server, a terminal, and a user. The flow of each process will be explained in detail below.

[0742] Upload and sell illustrations

[0743] 1. The user (illustrator) logs in to the platform.

[0744] The device prompts the user to enter their email address and password. After the user enters the information, the device sends it to the server.

[0745] The server authenticates the user by checking the user information in the database. If authentication is successful, the server generates a token and returns it to the terminal.

[0746] 2. The user accesses their profile page and opens the upload page for their work.

[0747] The terminal displays a form for uploading artwork, allowing the user to select an illustration file and enter metadata such as title, description, and price.

[0748] 3. The user clicks the upload button.

[0749] The terminal transmits the selected illustration file and metadata to the server.

[0750] The server saves the illustration file to storage, records the corresponding metadata in a database, and returns a success message to the device once the save is confirmed.

[0751] 4. The server adds the newly uploaded illustration to the for sale list.

[0752] The server will update the public page, making the new illustration available for viewing.

[0753] Building and selling AI models

[0754] 5. The user (model builder) logs in to the platform and browses the illustration page for sale.

[0755] The terminal displays details of illustrations for sale. The user selects the illustration they want and clicks the purchase button.

[0756] 6. Complete the purchase process.

[0757] The terminal prompts for payment information and transmits that information to the server.

[0758] The server processes the payment and, if successful, provides a purchase confirmation message and download link to the device.

[0759] 7. Users download the purchased illustrations and use them to build AI models.

[0760] The device allows users to use downloaded illustrations in a local environment.

[0761] 8. Upload the AI ​​model you built to the platform.

[0762] The terminal displays an upload page for the AI ​​model file, where the user selects the file and enters sales information (price, quantity, etc.).

[0763] The device sends this to the server, which saves the AI ​​model file and records the sales information in a database.

[0764] 9. The server sets the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[0765] The server processes the NFT and adds it to the sales list.

[0766] Prompt Sales

[0767] 10. Users (prompt engineers) sell the generated prompts on the platform.

[0768] The terminal displays the generated prompt sales page, and the user inputs the prompt content and price.

[0769] The terminal transmits the input prompt information to the server.

[0770] The server records the prompt information in a database and adds it to the sales list.

[0771] Specific examples

[0772] Illustration provider's scenario

[0773] Illustrator A accesses the platform to sell a landscape painting he or she has created. After logging in, A goes to the profile page and opens the work upload page. A selects a file, enters the title "Beautiful Evening Scenery," the description "A landscape with a tranquil sunset," and the price of 5,000 yen, and clicks the upload button. The data is saved by the server, and A's work is published in the sales list.

[0774] Model Builder Scenarios

[0775] Model builder B wants to build a new AI model using a landscape painting, so he logs into the platform. He browses the illustration page for sale, selects A's "Beautiful Sunset Scene," and clicks the purchase button. B enters his payment information and receives a download link once the process is complete. B uses the downloaded image to build an AI model, and then applies for and sells the model as an NFT for limited time only.

[0776] The present invention provides an appropriate environment for both illustration providers and model builders to conduct transactions safely and fairly, thereby realizing a system that allows both parties to enjoy mutual benefits while resolving copyright issues.

[0777] The processing flow will be explained below.

[0778] Upload and sell illustrations

[0779] Step 1:

[0780] The user (illustrator) accesses the platform's login page.

[0781] The device will display a login page and prompt you to enter your email address and password.

[0782] The user enters an email address and password.

[0783] Step 2:

[0784] The information entered by the user is sent to the server.

[0785] The device sends the entered email address and password to the server.

[0786] Step 3:

[0787] The server authenticates the user by checking the user information in the database.

[0788] The server compares the entered information with the user information stored in a database and performs authentication.

[0789] If the authentication is successful, the server generates a token and returns it to the terminal.

[0790] Step 4:

[0791] Users access their profile page and open the upload page for their work.

[0792] The device provides an interface with a profile page and an upload page.

[0793] Step 5:

[0794] The user selects an illustration file and enters metadata such as title, description, and price.

[0795] The terminal displays a file selection button and an input form.

[0796] The user inputs the necessary information.

[0797] Step 6:

[0798] The user clicks the upload button.

[0799] The terminal transmits the selected illustration file and metadata to the server.

[0800] Step 7:

[0801] The server stores the illustration files and records the corresponding metadata in a database.

[0802] The server stores the illustration files in storage.

[0803] Saves the metadata (title, description, price, etc.) to the database, confirms the save, and returns a success message to the terminal.

[0804] Step 8:

[0805] The server adds the newly uploaded illustration to the for sale list.

[0806] The server updates the public page and makes the new illustration available for viewing.

[0807] Building and selling AI models

[0808] Step 1:

[0809] Users (model builders) log in to the platform and access the illustration page for sale.

[0810] The terminal displays a login page and the user enters authentication information.

[0811] After authentication, the page of illustrations currently for sale will be displayed.

[0812] Step 2:

[0813] The server provides the terminal with data on illustrations currently on sale.

[0814] The server retrieves illustration information for sale from the database and returns it to the terminal.

[0815] Step 3:

[0816] The user selects the illustration they want to purchase and clicks the purchase button.

[0817] The device displays detailed information about the selected illustration and provides a purchase button.

[0818] Step 4:

[0819] The user enters payment information.

[0820] The terminal provides a form for inputting payment information, and the user enters the information.

[0821] Step 5:

[0822] The terminal transmits the entered payment information to the server.

[0823] The terminal transmits the payment information to the server.

[0824] Step 6:

[0825] The server processes the payment and records the transaction.

[0826] The server sends the information to a payment system to process the payment.

[0827] Once you have confirmed the payment was successful, record the transaction in your database.

[0828] If the payment is successful, the server will return a download link to the device along with a purchase completion message.

[0829] Step 7:

[0830] Users can download the illustrations they purchase and use them to build AI models.

[0831] The terminal displays a download link to the user.

[0832] Users click on the link to download the illustration.

[0833] Step 8:

[0834] Users build AI models in a local environment using the illustrations they purchase.

[0835] Step 9:

[0836] Users upload the AI ​​model they have built to the platform and set up sales.

[0837] The device will display the AI ​​model upload page.

[0838] The user selects an AI model file and enters the title, description, price, quantity, etc.

[0839] Step 10:

[0840] The device sends the AI ​​model file and metadata to the server.

[0841] The terminal transmits the input data to the server.

[0842] Step 11:

[0843] The server stores the AI ​​model and records sales information in a database.

[0844] The server stores the AI ​​model file in storage.

[0845] The metadata is saved in the database, and after confirming the save, a success message is returned to the terminal.

[0846] Step 12:

[0847] The server sets up the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[0848] The server processes the NFT and adds it to the sales list.

[0849] Prompt Sales

[0850] Step 1:

[0851] Users (prompt engineers) sell the generated prompts on the platform.

[0852] The terminal displays the generated prompt sales page.

[0853] The user enters the prompt and the price.

[0854] Step 2:

[0855] The terminal transmits the input prompt information to the server.

[0856] The terminal transmits the entered prompt and price information to the server.

[0857] Step 3:

[0858] The server records the prompt information in a database and adds it to the sales list.

[0859] The server stores the prompt information in a database.

[0860] Update the prompt sales page and add the new prompt to the sales list.

[0861] Example 1

[0862] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0863] Previously, selling illustrations and building AI models had issues with copyright and the reliability of transactions. Furthermore, the process of model builders purchasing illustrations and then building and selling AI models based on them was complicated, and there was a lack of proper data management and processing. Therefore, there is a need for a safe and efficient means of transaction for both illustration providers and model builders.

[0864] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0865] In this invention, the server includes an authentication means for users to log in to the platform, a means for inputting illustration metadata and uploading illustration files, a means for saving the uploaded illustrations in storage and recording the metadata in a database, a means for adding newly uploaded illustrations to a list of items for sale, a payment processing means for completing the purchase process, a means for downloading purchased illustration files, a means for uploading constructed AI models for sale on the platform, and a means for setting the AI ​​models for sale as non-fungible tokens (NFTs). This enables both illustration providers and model builders to conduct transactions safely and efficiently.

[0866] "Illustration provider" refers to a user who sells their own illustrations on the platform.

[0867] "Model builders" refer to users who purchase illustrations sold on the platform and build AI models.

[0868] "Authentication means" refers to the means for verifying an email address and password and generating a token for a user to log in to the platform.

[0869] "Metadata" refers to additional information such as the title, description, and price of an illustration file.

[0870] "Storage" refers to the storage device that stores uploaded illustration files in digital format.

[0871] "Database" refers to a system for systematically storing and managing information about illustration providers and illustration metadata.

[0872] "For Sale List" refers to a list that displays illustrations currently for sale on a public page.

[0873] "Payment processing means" refers to the means for receiving and processing payment information from the user during the purchase procedure.

[0874] "Download link" refers to the link on the Internet that allows a user to download the illustration file they have purchased.

[0875] "AI model" refers to an artificial intelligence model built by the user based on the purchased illustration.

[0876] A "non-fungible token (NFT)" refers to a token that represents a unique digital asset issued based on blockchain technology.

[0877] "Generation prompt" refers to the textual input instructions used to generate an AI model.

[0878] This system allows illustration providers to sell their illustrations on a platform, and model builders can purchase those illustrations to build AI models, which can then be sold. The system consists of a server, terminals, and users.

[0879] Hardware and software used

[0880] Server: Includes database, storage, authentication, payment processing, and NFT issuance functions. As a specific example, AWS (Amazon Web Services) can be used.

[0881] Terminal: A device that uses a web browser to provide a user interface and input, send, and receive data. For example, Google Chrome can be used.

[0882] Database: Manages user information, illustration metadata, AI model metadata, and sales information. As a concrete example, MySQL can be used.

[0883] Storage: Stores uploaded illustration files and AI model files. For example, Amazon S3 can be used.

[0884] Specific actions of the illustration provider

[0885] 1. The illustrator accesses the platform using a web browser. They enter their email address and password on the login screen and send the authentication information to the server. The server compares the information with the information in the database and authenticates the user.

[0886] 2. After successful authentication, the illustrator can access their profile page and open the upload page for their artwork. The user selects an illustration file, adds metadata such as title, description, and price, and clicks the upload button.

[0887] 3. The device sends this data to the server, which then stores the received illustration file in storage. At the same time, it records the metadata in a database and updates the for-sale listing on the public page.

[0888] Specific actions of the model builder

[0889] 1. The model builder logs in to the platform using a web browser, browses the illustrations for sale page, selects the desired illustration, and clicks the purchase button.

[0890] 2. The terminal displays a payment information input screen and prompts the model builder to enter the payment information. The payment information is sent to the server, which processes the payment through a payment provider.

[0891] 3. If the payment is successful, the server generates a purchase confirmation message and a download link and returns them to the device, allowing the model builder to download the purchased illustration.

[0892] 4. The model builder builds an AI model based on the downloaded illustration and uploads it to the platform. The device sends this information to the server, which then stores the AI ​​model file in storage and records the metadata in a database.

[0893] Issuance and sale of NFTs

[0894] 1. Once the AI ​​model is uploaded, the server processes the AI ​​model to issue it as a non-fungible token (NFT), which registers the AI ​​model as a unique digital asset.

[0895] 2. The server adds the issued NFT to the for sale list and updates the public page.

[0896] Prompt Sales

[0897] 1. After logging in to the platform, the prompt engineer accesses the page for selling generated prompts, enters the content and price of the generated prompt, and clicks the Save button.

[0898] 2. The terminal sends this information to the server, which records the prompt information in the database, adding a new prompt to the sales list.

[0899] Specific examples

[0900] Prompt Sentence Examples

[0901] "Simulate a mountain landscape with a sunset in the background."

[0902] This invention provides an environment where users can safely and efficiently sell and purchase illustrations, and build and sell AI models based on them, thereby maximizing the profits of both parties while resolving copyright issues.

[0903] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0904] Step 1:

[0905] A user logs into the platform.

[0906] Input: The user enters their email address and password on the device.

[0907] Specific behavior: The device displays a login screen and prompts the user to enter their email address and password.

[0908] Data processing: Convert the entered email address and password into JSON format and send it to the server.

[0909] Output: The server checks the user information against the database, and if authentication is successful, generates an authentication token and returns it to the terminal.

[0910] Description: The terminal receives the authentication token and displays a successful login to the user.

[0911] Step 2:

[0912] A user accesses their profile page and opens the upload page for their work.

[0913] Input: User clicks on the "Profile Page" link on their device.

[0914] Specific operation: The device will display the profile page and also display a link to the "work upload page."

[0915] Output: When the user clicks on the link, the device will display a form for uploading the work.

[0916] Description: The user selects an illustration file and enters metadata such as title, description, and price.

[0917] Step 3:

[0918] The user uploads the illustration file and metadata.

[0919] Input: User clicks the upload button.

[0920] Specific operation: The device sends the selected illustration file and the entered metadata to the server.

[0921] Data processing: The illustration file is sent as binary data, and the metadata is sent as JSON format to the server.

[0922] Output: The server saves the illustration files to storage and records the metadata in a database.

[0923] Description: If the save is successful, the server generates a success message and returns it to the terminal, which displays the success message to the user.

[0924] Step 4:

[0925] The server adds the newly uploaded illustration to the for sale list.

[0926] Input: Illustration files and metadata stored on the server.

[0927] Specific action: The server updates the data on the public page and adds the new illustration to the sales list.

[0928] Output: The for sale listing on the public page is updated to show the new illustration.

[0929] Description: When a user visits a public page, a new illustration appears.

[0930] Step 5:

[0931] Model builders browse the illustrations for sale page and purchase illustrations.

[0932] Input: A model builder browses an illustration page for sale on their device.

[0933] Specific operation: The device displays details of illustrations for sale. The user selects the desired illustration and clicks the purchase button.

[0934] Output: The checkout screen is displayed.

[0935] Description: Model builder enters payment information.

[0936] Step 6:

[0937] Complete the purchase process.

[0938] Input: The model builder enters payment information and clicks the confirm button.

[0939] Specific operation: The terminal sends the entered payment information to the server.

[0940] Data processing: Payment information is encrypted and sent to our servers.

[0941] Output: If the payment is successful, the server generates a purchase confirmation message and a download link and returns them to the device.

[0942] Description: Model builder receives a purchase confirmation message and download link on their device.

[0943] Step 7:

[0944] The illustrations purchased by users are downloaded and used to build AI models.

[0945] Input: Model builder clicks on download link.

[0946] Specific operation: The device downloads the illustration file and saves it locally.

[0947] Output: The illustration file is saved locally.

[0948] Description: The model builder builds an AI model based on the downloaded illustration file.

[0949] Step 8:

[0950] Users upload their built AI models to the platform.

[0951] Input: The model builder selects the AI ​​model file and enters sales information.

[0952] Specific operation: The device sends the AI ​​model file and sales information to the server.

[0953] Data processing: The AI ​​model file is sent as binary data, and sales information is sent in JSON format to the server.

[0954] Output: The server saves the AI ​​model file to storage and records the metadata in a database.

[0955] Description: A new AI model is added to the for sale list.

[0956] Step 9:

[0957] The server sets the AI ​​model as an NFT and updates the sales page.

[0958] Input: Uploaded AI model data.

[0959] Specific operation: The server processes the NFT and adds it to the sales list.

[0960] Output: The sales page is updated and the AI ​​model is sold as an NFT.

[0961] Description: When users visit the sales page, they can see that the new AI model is being sold as an NFT.

[0962] Step 10:

[0963] Users (prompt engineers) sell generated prompts.

[0964] Input: The prompt engineer enters the content and price of the generated prompt.

[0965] Specific operation: The terminal displays the generated prompt sales page and provides a form for the user to enter the prompt content and price.

[0966] Data processing: The entered prompt information is converted into JSON format and sent to the server.

[0967] Output: The server records the prompt information in a database and adds it to the sales list.

[0968] Description: The generated prompt is added to the sales list and becomes visible to the user.

[0969] (Application example 1)

[0970] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0971] In the past, copyright management and fair distribution of rewards have been issues in the trading of illustrations and digital content. Furthermore, in the trading of AI models generated from illustrations and the content that utilizes them, there has been a lack of rights protection and transparency, which has led to a decline in the reliability of the transactions. Furthermore, there has been little progress in developing a platform for utilizing this content across a wide range of devices. It is necessary to solve these issues and provide a fair and transparent trading system.

[0972] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0973] In this invention, the server includes a means for an illustration provider to sell their illustrations on an e-commerce platform, a means for a model builder to purchase sold illustrations and build an AI model, a means for selling the built AI model on the e-commerce platform, a means for generating content using the AI ​​model based on the purchased illustrations, and a means for displaying the generated content on a smart device. This solves issues of copyright management and fair remuneration distribution, enabling fair and transparent transactions. Furthermore, the generated content can be used on a variety of devices such as smartphones and smart glasses, making it possible to provide high-quality digital content to a wide range of users.

[0974] An "illustration provider" is a person who sells illustrations that he or she has created on an e-commerce platform.

[0975] An "e-commerce platform" is an online system for buying and selling goods and services over the Internet.

[0976] A "model builder" is someone who purchases illustrations for sale and builds an AI model based on those illustrations.

[0977] An "AI model" is a digital model built using artificial intelligence technology to perform a specific task.

[0978] A "non-fungible token (NFT)" is a unique tokenized digital asset that proves ownership of a digital asset.

[0979] "Generated prompts" are sentences containing instructions or hints that the AI ​​model uses to improve the quality of the generated content.

[0980] A "smart device" is an electronic device that has internet connectivity and can run various applications. Examples include smartphones, smart glasses, and head-mounted displays.

[0981] "Content" refers to information or data that is electronically generated or distributed, and specifically includes artwork, animated characters, etc.

[0982] A "server" is a computer system that provides information or services in response to requests from clients over a network.

[0983] An embodiment of the present invention will be described. This invention is a system in which an illustration provider sells their own illustrations on an e-commerce platform, and a model builder builds an AI model based on the purchased illustrations. This allows the built AI model to be sold again on the e-commerce platform, and the generated content to be displayed on a smart device.

[0984] The server provides a function that allows illustrators to sell their illustrations on an e-commerce platform. Specifically, illustrators can access the platform, upload their works, and assign metadata such as title, description, price, etc. The server stores this information in a database and instantly updates the sales list.

[0985] Model builders use a means to purchase illustrations for sale. Based on the purchased illustrations, they can build AI models in a local environment. The built AI models can then be used by users to generate any content they want. For example, they can use the AI ​​models to generate digital content such as animated characters and background images.

[0986] The constructed AI models will then be sold on the e-commerce platform. Furthermore, purchased AI models will be set up as non-fungible tokens (NFTs) to prove digital ownership, facilitating copyright management and ensuring fair reward distribution.

[0987] The system also includes a function to display the generated content on smart devices, allowing users to view and use the generated content in real time on devices such as smartphones, smart glasses, and head-mounted displays.

[0988] Specific examples are given below.

[0989] For example, a user can upload an illustration of a riverside landscape, and another user who purchases that illustration can build an AI model. Using that AI model, a user can input a prompt such as, "Draw a new animated character based on the riverside landscape. Add colorful flowers and a blue sky as the background." This generated content can then be easily displayed and used on smartphones or smart glasses.

[0990] By having each stakeholder, server, terminal, and user, fulfill their respective roles, fair and transparent content transactions and use across a variety of devices will be realized.

[0991] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0992] Step 1:

[0993] The user (illustrator) logs in to the platform.

[0994] Enter your email address and password.

[0995] The server receives this information and compares it with the user information in its database for authentication. If authentication is successful, the server generates a token and returns it to the terminal.

[0996] Output: The authenticated token.

[0997] Step 2:

[0998] Users access their profile page and open the upload page for their work.

[0999] Input: User-selected illustration file, metadata such as title, description, and price.

[1000] The terminal provides a form to display this information, receives input from the user, and then transmits the selected illustration file and metadata to the server.

[1001] Output: Illustration file and metadata.

[1002] Step 3:

[1003] The server stores the received illustration files in storage and records the metadata in a database.

[1004] Input: Uploaded illustration file and metadata.

[1005] The server saves this data in the storage and database, respectively. Once the saving is confirmed, the server returns a success message to the terminal.

[1006] Output: Save confirmation success message.

[1007] Step 4:

[1008] The server adds the newly uploaded illustration to the for sale list.

[1009] Input: Saved illustrations and metadata.

[1010] The server will update the public page, making the new illustration available for viewing.

[1011] Output: The updated public list.

[1012] Step 5:

[1013] Users (model builders) log in to the platform and view pages of illustrations available for sale.

[1014] Input: The user's access request.

[1015] The terminal displays details of illustrations for sale. The user selects the illustration they want and clicks the purchase button.

[1016] Output: Displayed illustration details.

[1017] Step 6:

[1018] Complete the purchase process.

[1019] Input: Payment information.

[1020] The server receives and processes the payment information, and upon successful payment, provides the user with a purchase confirmation message and a download link.

[1021] Output: Purchase confirmation message and download link.

[1022] Step 7:

[1023] Users can download the illustrations they purchase and use them to build AI models.

[1024] Input: Download link.

[1025] The device uses the download link to obtain the illustration file and saves it locally, allowing the user to build an AI model based on the illustration.

[1026] Output: Downloaded illustration file.

[1027] Step 8:

[1028] Users upload their built AI models to the platform.

[1029] Input: AI model file and sales information (price, quantity, etc.).

[1030] The device sends the AI ​​model file and sales information to the server, which stores it and adds it to the sales list.

[1031] Output: Saved AI model file and sales information.

[1032] Step 9:

[1033] The server sets up the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[1034] Input: A saved AI model file.

[1035] The server processes the NFT and adds it to the sales list.

[1036] Output: Added NFT to the for sale list.

[1037] Step 10:

[1038] Users (prompt engineers) sell the generated prompts on the platform.

[1039] Input: Generate prompt and price.

[1040] The terminal displays the generated prompt sales page, and the user inputs the prompt content and price, which are then sent to the server, recorded in the database, and added to the sales list.

[1041] Output: Recorded prompt information and updated sales list.

[1042] These steps will enable illustrators and model builders to sell their work and the AI ​​models they generate, enabling a fair and transparent trade of content.

[1043] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1044] This invention combines an emotion engine with a system in which illustrators sell their illustrations on a platform, model builders purchase them to build AI models, and then sell the AI ​​models. This system can recognize users' emotions and adjust content recommendations and generation prompts based on those emotions.

[1045] Program processing

[1046] This system is composed of a server, a terminal, a user, and an emotion engine. The flow of each process will be explained in detail below.

[1047] Upload and sell illustrations

[1048] 1. The user (illustrator) logs in to the platform.

[1049] The device displays a login page and prompts the user to enter their email address and password. After the user enters the information, the device sends it to the server.

[1050] The server authenticates the user by checking the user information in the database. If authentication is successful, the server generates a token and returns it to the terminal.

[1051] 2. The user accesses their profile page and opens the upload page for their work.

[1052] The terminal displays a form for uploading artwork, allowing the user to select an illustration file and enter metadata such as title, description, and price.

[1053] 3. The user clicks the upload button.

[1054] The terminal transmits the selected illustration file and metadata to the server.

[1055] The server saves the illustration file to storage, records the corresponding metadata in a database, and returns a success message to the device once the save is confirmed.

[1056] 4. The server adds the newly uploaded illustration to the for sale list.

[1057] The server updates the public page and makes the new illustration available for viewing.

[1058] Building and selling AI models

[1059] 5. The user (model builder) logs in to the platform and accesses the illustration page for sale.

[1060] The terminal displays a login page, where the user enters their authentication information. After authentication, the terminal displays a page of illustrations for sale.

[1061] 6. The server provides the terminal with data on illustrations currently on sale.

[1062] The server retrieves illustration information for sale from the database and returns it to the terminal.

[1063] 7. The user selects the illustration they want to purchase and clicks the purchase button.

[1064] The device displays detailed information about the selected illustration and provides a purchase button.

[1065] 8. The user enters payment information.

[1066] The terminal provides a form for inputting payment information, and the user enters the information.

[1067] 9. The terminal sends the entered payment information to the server.

[1068] The terminal transmits the payment information to the server.

[1069] 10. The server processes the payment and records the transaction.

[1070] The server sends the information to a payment system to process the payment.

[1071] Once you have confirmed the payment was successful, record the transaction in your database.

[1072] If the payment is successful, the server will return a download link to the device along with a purchase completion message.

[1073] 11. Users download the purchased illustrations and use them to build AI models.

[1074] The terminal displays a download link to the user.

[1075] Users click on the link to download the illustration.

[1076] 12. Users build AI models in their local environment using the illustrations they purchased.

[1077] 13. Users upload the AI ​​model they have built to the platform and set up sales.

[1078] The device will display the AI ​​model upload page.

[1079] The user selects an AI model file and enters the title, description, price, quantity, etc.

[1080] 14. The device sends the AI ​​model file and metadata to the server.

[1081] The terminal transmits the input data to the server.

[1082] 15. The server stores the AI ​​model and records sales information in a database.

[1083] The server stores the AI ​​model file in storage.

[1084] The metadata is saved in the database, and after confirming the save, a success message is returned to the terminal.

[1085] 16. The server sets up the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[1086] The server processes the NFT and adds it to the sales list.

[1087] Prompt Sales

[1088] 17. Users (prompt engineers) sell the generated prompts on the platform.

[1089] The terminal displays the generated prompt sales page, and the user inputs the prompt content and price.

[1090] The terminal transmits the input prompt information to the server.

[1091] The server records the prompt information in a database and adds it to the sales list.

[1092] Utilizing the Emotion Engine

[1093] 18. The emotion engine receives the user's facial expression data as input and analyzes emotions in real time.

[1094] The device captures facial expression data through the camera and sends it to the emotion engine.

[1095] The emotion engine analyzes the received facial expression data and identifies the emotional state.

[1096] 19. The emotion engine sends the analysis results to the server to optimize the user experience.

[1097] The server recommends content to improve the user experience based on the emotion analysis results received from the emotion engine.

[1098] 20. The emotion engine adjusts the prompts generated by the AI ​​model based on the user's emotional state.

[1099] The server selects the most appropriate generated prompt depending on the emotional state and provides it to the user.

[1100] Specific examples

[1101] Illustration provider's scenario

[1102] Illustrator A accesses the platform to sell a landscape painting he or she has created. After logging in, A goes to the profile page and opens the work upload page. A selects a file, enters the title "Beautiful Evening Scenery," the description "A landscape with a tranquil sunset," and the price of 5,000 yen, and clicks the upload button. The data is saved by the server, and A's work is published in the sales list.

[1103] Model Builder Scenarios

[1104] Model builder B wants to build a new AI model using a landscape painting, so he logs into the platform. He browses the illustration page for sale, selects A's "Beautiful Sunset Scene," and clicks the purchase button. B enters his payment information and receives a download link once the process is complete. B uses the downloaded image to build an AI model, and then applies for and sells the model as an NFT for limited time only.

[1105] Emotion Engine Scenario

[1106] When user C logs in to the platform and browses illustrations, facial expression data is captured via the camera. The emotion engine recognizes C's happy facial expression and sends the emotion analysis results to the server. The server then recommends illustrations with a cheerful tone to enhance C's joy. In addition, when C builds an AI model, the generated prompts are automatically adjusted to match C's emotional state.

[1107] This invention provides a comprehensive system for safe and fair transactions that considers the emotional state of illustration providers, model builders, and general users, thereby resolving copyright issues and realizing a mutually beneficial environment.

[1108] The processing flow will be explained below.

[1109] Upload and sell illustrations

[1110] Step 1:

[1111] The user (illustrator) accesses the platform's login page.

[1112] The device will display a login page and prompt you to enter your email address and password.

[1113] Step 2:

[1114] The user enters an email address and password.

[1115] The terminal transmits the authentication information entered by the user to the server.

[1116] Step 3:

[1117] The server authenticates the user by checking the user information in the database.

[1118] The server compares the entered information with the information in the database, and if authentication is successful, generates a session token and returns it to the terminal.

[1119] Step 4:

[1120] Users access their profile page and open the upload page for their work.

[1121] The device provides an interface with a profile page and an upload page.

[1122] Step 5:

[1123] The user selects an illustration file and enters metadata such as title, description, and price.

[1124] The terminal displays a file selection button and an information input form.

[1125] Step 6:

[1126] The user clicks the upload button.

[1127] The terminal transmits the selected illustration file and metadata to the server.

[1128] Step 7:

[1129] The server stores the illustration files and records the corresponding metadata in a database.

[1130] The server saves the illustration file to storage and saves the metadata to a database. Once the saving is complete, the server returns a success message to the device.

[1131] Step 8:

[1132] The server adds the newly uploaded illustration to the for sale list.

[1133] The server updates the public page and displays the new illustration in the for sale listing.

[1134] Building and selling AI models

[1135] Step 1:

[1136] Users (model builders) log in to the platform and access the illustration page for sale.

[1137] The terminal displays a login page where the user can enter their authentication information. After authentication, the terminal displays a page listing illustrations currently for sale.

[1138] Step 2:

[1139] The server retrieves data on illustrations currently on sale and provides it to the terminal.

[1140] The server retrieves information about illustrations currently on sale from the database and transmits it to the terminal.

[1141] Step 3:

[1142] The user selects the illustration they want to purchase and clicks the purchase button.

[1143] The device will display detailed information about the selected illustration and a purchase button.

[1144] Step 4:

[1145] The user enters payment information.

[1146] The terminal provides a form for inputting payment information, and the user enters the information.

[1147] Step 5:

[1148] The terminal transmits the entered payment information to the server.

[1149] The terminal transmits the payment information to the server.

[1150] Step 6:

[1151] The server processes the payment and records the transaction.

[1152] The server processes the payment by sending the information to the payment system, records the transaction in a database after confirming the payment was successful, and returns a download link to the device along with a purchase completion message.

[1153] Step 7:

[1154] Users can download the illustrations they purchase and use them to build AI models.

[1155] The terminal displays a download link, allowing the user to click on the link to download the illustration.

[1156] Step 8:

[1157] Users build AI models in a local environment using the illustrations they purchase.

[1158] Step 9:

[1159] Users upload the AI ​​model they have built to the platform and set up sales.

[1160] The terminal displays an AI model upload page, where the user selects an AI model file and enters metadata such as title, description, price, and quantity.

[1161] Step 10:

[1162] The device sends the AI ​​model file and metadata to the server.

[1163] The terminal transmits the input data to the server.

[1164] Step 11:

[1165] The server stores the AI ​​model and records sales information in a database.

[1166] The server saves the AI ​​model file to storage, saves the metadata to a database, and returns a success message to the device once the save is complete.

[1167] Step 12:

[1168] The server sets up the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[1169] The server will process the NFT and add it to the sales list.

[1170] Prompt Sales

[1171] Step 1:

[1172] Users (prompt engineers) sell the generated prompts on the platform.

[1173] The terminal displays the generated prompt sales page and allows the prompt content and price to be entered.

[1174] Step 2:

[1175] The terminal transmits the input prompt information to the server.

[1176] The terminal transmits the entered prompt and price information to the server.

[1177] Step 3:

[1178] The server records the prompt information in a database and adds it to the sales list.

[1179] The server saves the prompt information in a database and updates the sales page.

[1180] Utilizing the Emotion Engine

[1181] Step 1:

[1182] The device captures the user's facial expression data with a camera and sends it to the emotion engine.

[1183] The device captures the user's facial expressions in real time and sends the data to the emotion engine.

[1184] Step 2:

[1185] The emotion engine analyzes the facial expression data to identify the user's emotional state.

[1186] The emotion engine analyzes the input facial expression data and identifies the user's emotional state.

[1187] Step 3:

[1188] The emotion engine sends the analysis results to the server.

[1189] The emotion engine transmits the analysis results of the identified emotional state to the server.

[1190] Step 4:

[1191] The server recommends appropriate content to the user based on the results of the sentiment analysis.

[1192] Based on the results of the sentiment analysis, the server recommends appropriate illustrations and prompts to the user.

[1193] Step 5:

[1194] The server adjusts the generated prompts based on the user's emotional state.

[1195] The server selects the most appropriate prompt to generate based on the emotion analysis results and presents it to the user.

[1196] Specific examples

[1197] Illustration provider's scenario

[1198] Illustrator A accesses the platform to sell a landscape painting he or she has created. After logging in, A goes to the profile page and opens the work upload page. A selects a file, enters the title "Beautiful Evening Scenery," the description "A landscape with a tranquil sunset," and the price of 5,000 yen, and clicks the upload button. The data is saved by the server, and A's work is published in the sales list.

[1199] Model Builder Scenarios

[1200] Model builder B wants to build a new AI model using a landscape painting, so he logs into the platform. He browses the illustration page for sale, selects A's "Beautiful Sunset Scene," and clicks the purchase button. B enters his payment information and receives a download link once the process is complete. B uses the downloaded image to build an AI model, and then applies for and sells the model as an NFT for limited time only.

[1201] Emotion Engine Scenario

[1202] When user C logs in to the platform and views an illustration, facial expression data is captured via the camera. The emotion engine recognizes C's happy expression and sends the emotion analysis results to the server. The server then recommends illustrations with a cheerful tone to enhance C's joy. Furthermore, when C builds an AI model, the generated prompts are automatically adjusted to match C's emotional state. The present invention realizes safe and fair transactions by taking into account the emotional states of the illustration provider, model builder, and general users.

[1203] Example 2

[1204] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1205] In conventional systems, the process for illustrators to sell their illustrations and the process for model builders to use those illustrations to build and sell AI models are complicated, and the user experience is not sufficiently improved. Furthermore, the system lacks the ability to recognize the user's emotional state in real time and recommend optimal content or adjust generated prompts based on that emotion. This makes it difficult for users to achieve emotionally satisfying transactions.

[1206] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for an illustration provider to sell their own illustrations on the platform; a means for a terminal to authenticate a user; a means for saving illustration files and metadata and adding them to a sales list; a means for a model builder to purchase sold illustrations; a means for processing payments and recording transactions; a means for providing users with links to download the illustrations; a means for a user to build an AI model and sell it on the platform; a means for recording the metadata of the AI ​​model and adding it to a sales list; a means for an emotion engine to analyze the user's emotions; a means for recommending content based on the emotion analysis results; and a means for adjusting generation prompts according to the user's emotional state. This enables users to achieve emotionally satisfying transactions through a simple and efficient process.

[1207] "Illustration provider" refers to a user who sells illustrations they have drawn on the platform.

[1208] "Model builders" refer to users who purchase illustrations for sale and build AI models.

[1209] "Terminal" refers to a computer or information processing device operated by a user, and is responsible for user authentication, data entry, display, etc.

[1210] "Server" refers to a central computer that stores and processes data, authenticates users, records transactions, etc.

[1211] "Platform" refers to an online service infrastructure for selling illustrations, building AI models, and selling generation prompts.

[1212] "Metadata" refers to accompanying information about an illustration or AI model (e.g., title, description, price, etc.).

[1213] "Storage" refers to a digital storage medium for long-term data preservation.

[1214] A "token" refers to identification information generated by a server when a user is successfully authenticated.

[1215] "Transaction" refers to data that records a series of processes related to the purchase and sale of illustrations and AI models.

[1216] A "non-fungible token (NFT)" is a token that uses blockchain technology to prove the uniqueness and ownership of a digital asset.

[1217] "Emotion engine" refers to a program for analyzing a user's emotional state.

[1218] A "generation prompt" refers to an input sentence that provides specific generation instructions to an AI model.

[1219] "Content" refers to information and data provided to users (e.g., illustrations, recommended images, text, etc.).

[1220] The present invention is a system in which illustrators sell their illustrations on a platform, model builders purchase them, build AI models, and sell the AI ​​models. Furthermore, by combining this system with an emotion engine, it can recognize the user's emotional state and adjust content recommendations and generated prompts based on that state. Specific embodiments of the invention are described below.

[1221] Configuration and Usage

[1222] This system mainly consists of a server, a terminal, a user, and an emotion engine.

[1223] Upload and sell illustrations

[1224] The user (illustrator) enters their email address and password on their device and sends the authentication information to the server. The server compares the user information with that in the database, and if authentication is successful, generates a token and returns it to the device. The user then accesses their profile page and opens the work upload page. The device prompts them to select an illustration file and enter metadata such as title, description, and price, which are then sent to the server. The server saves the illustration file in storage and records the metadata in the database. Once saved, the server adds the newly uploaded illustration to the for sale list and updates the public page.

[1225] Building and selling AI models

[1226] The model builder accesses the page of illustrations for sale and selects the illustration they wish to purchase. The terminal prompts them to enter payment information and sends it to the server. The server sends the information to the payment system and processes the payment. If the payment is successful, it records the transaction and returns a download link to the terminal along with a purchase completion message. The model builder uses the downloaded illustration to build an AI model in a local environment, uploads it to the platform, and sets it up for sale. The server saves the AI ​​model file in storage and records the metadata in a database. Once saved, the server sets the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[1227] Prompt Sales

[1228] The prompt engineer sells the generated prompts on the platform. The terminal allows the user to input the prompt content and price, and sends it to the server. The server records the prompt information in the database and adds it to the sales list.

[1229] Utilizing the Emotion Engine

[1230] The emotion engine receives the user's facial expression data as input and analyzes emotions in real time. The device captures the facial expression data through the camera and sends it to the emotion engine. The emotion engine then sends the analysis results to the server, which then recommends content to improve the user experience. The emotion engine also adjusts the generated prompts based on the user's emotional state. For example, if the user shows a happy expression, the server will recommend an illustration with a cheerful tone, and the generated prompts will also be adjusted to match that emotion.

[1231] Specific examples

[1232] Illustration provider's scenario

[1233] Illustrator A accesses the platform to sell a landscape painting he or she has created. After logging in, A goes to the profile page and opens the work upload page. A selects the file, enters the title "Beautiful Evening Scenery," the description "A landscape with a tranquil sunset," and the price of 5,000 yen, and clicks the upload button. The data is saved by the server, and A's work is published in the sales list.

[1234] Model Builder Scenarios

[1235] Model builder B logs into the platform, browses the list of illustrations for sale, and purchases A's "Beautiful Sunset." After entering payment information and completing the purchase, B obtains a download link from the server. B uses this illustration to build a new AI model, which he then uploads back to the platform and sells as an NFT.

[1236] Emotion Engine Scenario

[1237] User C logs in to the platform and browses various illustrations. C's facial expression data is captured through the camera, and the emotion engine detects the emotion of joy. Based on this analysis, the server recommends cheerful illustrations that enhance C's joy. In addition, when C builds an AI model, the generated prompts are automatically adjusted to provide instructions that best suit C's emotions.

[1238] In this way, the system smoothly carries out the entire process from providing illustrations to building AI models and sales, and further optimizes the experience based on the user's emotions, providing an overall excellent user experience.

[1239] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1240] Step 1:

[1241] The user (illustrator) logs in to the platform

[1242] Input: Email address, Password

[1243] Specific behavior:

[1244] 1. The device displays the login page.

[1245] 2. The user enters their email address and password and clicks the login button.

[1246] 3. The terminal sends the entered information to the server.

[1247] Data processing / calculation and output:

[1248] The server compares the user information with that in the database, and if authentication is successful, generates a token and returns it to the terminal.

[1249] Step 2:

[1250] A user accesses their profile page and opens the upload page for their work.

[1251] Input: Token

[1252] Specific behavior:

[1253] 1. The device receives the authenticated token and displays the profile page.

[1254] 2. The user selects the upload page for the work.

[1255] Data processing / calculation and output:

[1256] The server verifies the authentication token and sends the upload form to the device.

[1257] Step 3:

[1258] Upload your work

[1259] Input: Illustration file, metadata (title, description, price, etc.)

[1260] Specific behavior:

[1261] 1. The device displays the illustration file and a metadata input form.

[1262] 2. The user fills out the input form and clicks the upload button.

[1263] 3. The device sends the illustration file and metadata to the server.

[1264] Data processing / calculation and output:

[1265] The server saves the illustration file to storage, records the metadata in the database, and sends a success message to the device after saving is complete.

[1266] Step 4:

[1267] Add to for sale list

[1268] Input: Saved illustration file and metadata

[1269] Specific behavior:

[1270] The server adds the newly uploaded illustration to the for sale list.

[1271] Data processing / calculation and output:

[1272] The server will update the public page and make the new illustrations available for viewing.

[1273] Step 5:

[1274] The user (model builder) accesses the illustration page for sale.

[1275] Input: User authentication

[1276] Specific behavior:

[1277] 1. The terminal displays a user authentication page and the user logs in.

[1278] 2. The user enters their login information and accesses the illustrations for sale page.

[1279] Data processing / calculation and output:

[1280] The server retrieves information about illustrations for sale from the database and returns it to the terminal, which then displays it.

[1281] Step 6:

[1282] Selecting and purchasing illustrations

[1283] Input: Selected illustration and payment information

[1284] Specific behavior:

[1285] 1. The user selects the illustration they want to purchase and clicks the purchase button.

[1286] 2. The terminal provides a form for entering payment information, and the user enters the information.

[1287] 3. The terminal sends the entered information to the server.

[1288] Data processing / calculation and output:

[1289] The server sends the information to the payment system, processes the payment, and if the payment is successful, records the transaction in a database and returns a purchase completion message and a download link to the device.

[1290] Step 7:

[1291] Download illustrations

[1292] Input: Purchase completion message and download link

[1293] Specific behavior:

[1294] 1. The device will display a purchase completion message and a download link.

[1295] 2. The user clicks on the download link to download the illustration.

[1296] Data processing / calculation and output:

[1297] The user obtains the downloaded illustration file and saves it in their local environment.

[1298] Step 8:

[1299] Building and uploading an AI model

[1300] Input: Downloaded illustration file, AI model file, metadata

[1301] Specific behavior:

[1302] 1. The user builds an AI model in a local environment using the illustrations they purchased.

[1303] 2. Upload the AI ​​model you have built to the platform and set it up for sales.

[1304] Data processing / calculation and output:

[1305] The server saves the AI ​​model file to storage, records the metadata in the database, and sends a success message to the device when the save is complete.

[1306] Step 9:

[1307] NFT issuance and sales page updates

[1308] Input: AI model file and metadata

[1309] Specific behavior:

[1310] The server sets the AI ​​model as an NFT and updates the sales page.

[1311] Data processing / calculation and output:

[1312] The server processes the NFT and adds it to the sales list.

[1313] Step 10:

[1314] Sales Generated Prompts

[1315] Input: Generate prompt content, price

[1316] Specific behavior:

[1317] 1. The user (prompt engineer) accesses a page that sells generated prompts.

[1318] 2. Enter the prompt content and price and send it from the terminal to the server.

[1319] Data processing / calculation and output:

[1320] The server records the prompt information in a database and adds it to the sales list.

[1321] Step 11:

[1322] Emotion analysis using an emotion engine

[1323] Input: User's facial expression data

[1324] Specific behavior:

[1325] 1. The device acquires facial expression data through the camera and sends it to the emotion engine.

[1326] 2. The emotion engine analyzes facial expression data and identifies emotional states.

[1327] Data processing / calculation and output:

[1328] The sentiment analysis results are sent to the server, which then recommends content to improve the user experience.

[1329] Step 12:

[1330] Adjusting the generated prompt

[1331] Input: Sentiment analysis results

[1332] Specific behavior:

[1333] The server selects the most appropriate generated prompt according to the emotional state and provides it to the user.

[1334] Data processing / calculation and output:

[1335] The emotional engine adjusts the generated prompts based on the emotional state to provide the user with the most appropriate generated content.

[1336] (Application example 2)

[1337] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1338] While existing platforms allow transactions between illustration providers and model builders, they lack the ability to customize or recommend products based on customer sentiment. Furthermore, they lack real-time customer support and prompt generation for appropriate sales promotion, making it difficult to provide an optimal customer experience. Therefore, there is a need for a system that can maximize the profits of illustration providers and model builders while improving customer satisfaction.

[1339] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1340] In this invention, the server includes a means for an illustrator to sell his / her own illustrations on the platform, a means for a model builder to purchase sold illustrations and build an AI model, a means for recognizing a customer's facial expression in real time and analyzing their emotions, a means for recommending appropriate products based on the analyzed emotions, and a means for generating customer service prompts for sales promotion based on the customer's emotions. This enables personalized product recommendations and customer service support that take customer emotions into consideration.

[1341] "Platform" refers to a series of online systems that multiple users can access via the Internet and use to trade illustrations and AI models.

[1342] "Illustration Provider" refers to an individual or organization that uploads and sells illustrations they have created on the Platform.

[1343] "Model Builder" refers to an individual or organization that purchases illustrations for sale on the Platform, creates AI models based on those illustrations, and then sells them on the Platform.

[1344] An "AI model" refers to a program or system built using machine learning algorithms to perform a specific task.

[1345] A "non-fungible token (NFT)" is a token that uses blockchain technology to prove ownership of a digital asset and guarantee its uniqueness.

[1346] "Generation prompts" refer to text information containing specific instructions and guidelines used when generating content using AI.

[1347] "Emotion analysis" refers to a technological means of analyzing a customer's facial expressions in real time and identifying their emotional state from the results.

[1348] "Product recommendation" refers to algorithms and systems that present optimal products to customers based on analyzed emotional data.

[1349] "Customer service prompts" refer to text information containing instructions for providing appropriate response methods and conversation content depending on the customer's emotional state.

[1350] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following provides a detailed description of the embodiments of the present invention.

[1351] Hardware and software used

[1352] The system uses the following hardware and software:

[1353] Server: Uses Django (Python Web Framework) and is responsible for back-end data processing.

[1354] Database: MySQL is used to manage illustrations, AI models, generative prompts, customer data, etc.

[1355] Face Recognition and Emotion Analysis: Using OpenCV and DeepFace libraries.

[1356] Front-end: Uses React Native to provide a user interface for smartphones and tablets.

[1357] Recommendation system: Uses TensorFlow to recommend products based on sentiment analysis results.

[1358] Specific system operations and processing

[1359] 1. Upload and sell illustrations:

[1360] Illustration providers log in to the platform, upload their own illustrations, and set up sales. The terminal sends the entered data to the server, which records it in a database.

[1361] 2. Building and selling AI models:

[1362] Model builders purchase illustrations for sale on the platform, download them, and then build an AI model. They then upload the AI ​​model to the platform and set it up for sale.

[1363] 3. Emotion analysis:

[1364] The front-end device uses a camera to capture the customer's facial expressions in real time and sends the data to the server, which then uses DeepFace to perform emotion analysis and sends the analysis results back to the front-end.

[1365] 4. Generate product recommendations and customer prompts:

[1366] Based on the sentiment analysis results, an algorithm using TensorFlow is run to recommend appropriate products, and customer service prompts are generated based on the analysis results and sent to the store clerk's device.

[1367] Specific Operation Examples

[1368] Operation example 1: Illustration provider operation

[1369] Illustration provider A uploads the illustration he or she has drawn to the platform. The server stores it in the database and adds it to the sales list.

[1370] Operation example 2: Model builder operation

[1371] Model Builder B purchases an illustration from the platform, builds an AI model based on that illustration, uploads the built AI model to the server, and sets up sales.

[1372] Operation example 3: Sentiment analysis and product recommendation

[1373] When customer C enters the store, facial recognition is performed using the device's camera. If emotion analysis determines that C is happy, the server recommends positive products (e.g., colorful miscellaneous goods).

[1374] Specific prompt examples

[1375] A customer comes into the store with a smile. Please recommend cheerful and uplifting items and accessories and serve them in a bright and cheerful atmosphere.

[1376] This provides an environment that can improve the user experience for all: illustrators, model builders, and customers. By combining emotion analysis technology with an AI model generation and sales platform, this system achieves more personalized product recommendations and customer service support.

[1377] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1378] Step 1:

[1379] Uploading illustrations and setting up sales

[1380] The user (illustrator) logs in to the device and accesses the illustration upload page. They select the illustration file and metadata (title, description, price, etc.) and click the upload button. The device sends this data to the server, which saves the illustration in storage and records the metadata in the database. The illustration is then added to the sales list with a success message.

[1381] Input: illustration file, metadata (title, description, price, etc.)

[1382] Processing / calculation: illustration file storage, metadata database recording

[1383] Output: Success message, added to sales list

[1384] Step 2:

[1385] Purchase illustrations currently on sale

[1386] The model builder logs in to the terminal and accesses the page of illustrations for sale. They select the illustration they want to purchase and click the purchase button. The terminal provides a form for entering payment information, which is then sent to the server after it is filled out. The server sends the information to the payment system, and once the payment is confirmed, a download link is generated and sent back to the terminal.

[1387] Input: Login information, illustration selection information, payment information

[1388] Processing / Calculation: Payment processing, transaction recording, download link generation

[1389] Output: Download link

[1390] Step 3:

[1391] Building and uploading an AI model

[1392] The model builder uses the purchased illustration in a local environment to build an AI model. After construction, the constructed AI model and its metadata (title, description, price, etc.) are sent to the server via the upload page. The server saves the AI ​​model in storage and records it in a database.

[1393] Input: Built AI model file, metadata (title, description, price, etc.)

[1394] Processing / calculation: AI model file storage, metadata database recording

[1395] Output: Success message, added to sales list

[1396] Step 4:

[1397] Setting up non-fungible tokens (NFTs)

[1398] The server then sets up the uploaded AI model as an NFT, using blockchain technology to prove ownership of the digital asset and add it to the sales list.

[1399] Input: AI model file, metadata

[1400] Processing / calculation: NFT setting, ownership verification by blockchain

[1401] Output: Add to sales list

[1402] Step 5:

[1403] Sales Generated Prompts

[1404] To set up sales of the generated prompts on the platform, prompt engineers log in, enter the prompt content and price, and send it to the server, which records the prompt information in the database and adds it to the sales list.

[1405] Input: Generate prompt content, price

[1406] Processing / calculation: database recording of prompt information

[1407] Output: Add to sales list

[1408] Step 6:

[1409] Customer Sentiment Analysis

[1410] The device uses a camera to capture customer facial expression data in real time and transmits it to the server, which then uses the DeepFace library to perform emotion analysis and sends the results back to the device.

[1411] Input: Customer's facial expression data

[1412] Processing / Calculation: Emotion Analysis (using DeepFace)

[1413] Output: Emotion analysis results

[1414] Step 7:

[1415] Generate product recommendations and customer service prompts

[1416] The server uses TensorFlow to run an algorithm that recommends appropriate products based on the results of the sentiment analysis, and also generates customer service prompts based on the analysis results and notifies the store clerk's device.

[1417] Input: Sentiment analysis results

[1418] Processing / calculation: Executing product recommendation algorithms, generating customer prompts (using TensorFlow)

[1419] Output: Product recommendations, customer service prompts

[1420] Step 8:

[1421] Sales List Updates

[1422] All illustrations, AI models, and generated prompts uploaded by users are added to the sales list by the server and made available to customers.

[1423] Input: Uploaded illustrations, AI models, generated prompts

[1424] Processing / calculation: Updating the database and publishing the sales list

[1425] Output: Published sales list

[1426] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1427] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1428] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1429] [Third embodiment]

[1430] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1431] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1432] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1433] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1434] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1435] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1436] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1437] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1438] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1439] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1440] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1441] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1442] This invention is a system in which illustrators sell their illustrations on a platform, model builders purchase them, build AI models, and then sell the AI ​​models. This system solves copyright issues while realizing legal and advantageous transactions for both parties.

[1443] Program processing

[1444] This system is composed of a server, a terminal, and a user. The flow of each process will be explained in detail below.

[1445] Upload and sell illustrations

[1446] 1. The user (illustrator) logs in to the platform.

[1447] The device prompts the user to enter their email address and password. After the user enters the information, the device sends it to the server.

[1448] The server authenticates the user by checking the user information in the database. If authentication is successful, the server generates a token and returns it to the terminal.

[1449] 2. The user accesses their profile page and opens the upload page for their work.

[1450] The terminal displays a form for uploading artwork, allowing the user to select an illustration file and enter metadata such as title, description, and price.

[1451] 3. The user clicks the upload button.

[1452] The terminal transmits the selected illustration file and metadata to the server.

[1453] The server saves the illustration file to storage, records the corresponding metadata in a database, and returns a success message to the device once the save is confirmed.

[1454] 4. The server adds the newly uploaded illustration to the for sale list.

[1455] The server will update the public page, making the new illustration available for viewing.

[1456] Building and selling AI models

[1457] 5. The user (model builder) logs in to the platform and browses the illustration page for sale.

[1458] The terminal displays details of illustrations for sale. The user selects the illustration they want and clicks the purchase button.

[1459] 6. Complete the purchase process.

[1460] The terminal prompts for payment information and transmits that information to the server.

[1461] The server processes the payment and, if successful, provides a purchase confirmation message and download link to the device.

[1462] 7. Users download the purchased illustrations and use them to build AI models.

[1463] The device allows users to use downloaded illustrations in a local environment.

[1464] 8. Upload the AI ​​model you built to the platform.

[1465] The terminal displays an upload page for the AI ​​model file, where the user selects the file and enters sales information (price, quantity, etc.).

[1466] The device sends this to the server, which saves the AI ​​model file and records the sales information in a database.

[1467] 9. The server sets the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[1468] The server processes the NFT and adds it to the sales list.

[1469] Prompt Sales

[1470] 10. Users (prompt engineers) sell the generated prompts on the platform.

[1471] The terminal displays the generated prompt sales page, and the user inputs the prompt content and price.

[1472] The terminal transmits the input prompt information to the server.

[1473] The server records the prompt information in a database and adds it to the sales list.

[1474] Specific examples

[1475] Illustration provider's scenario

[1476] Illustrator A accesses the platform to sell a landscape painting he or she has created. After logging in, A goes to the profile page and opens the work upload page. A selects a file, enters the title "Beautiful Evening Scenery," the description "A landscape with a tranquil sunset," and the price of 5,000 yen, and clicks the upload button. The data is saved by the server, and A's work is published in the sales list.

[1477] Model Builder Scenarios

[1478] Model builder B wants to build a new AI model using a landscape painting, so he logs into the platform. He browses the illustration page for sale, selects A's "Beautiful Sunset Scene," and clicks the purchase button. B enters his payment information and receives a download link once the process is complete. B uses the downloaded image to build an AI model, and then applies for and sells the model as an NFT for limited time only.

[1479] The present invention provides an appropriate environment for both illustration providers and model builders to conduct transactions safely and fairly, thereby realizing a system that allows both parties to enjoy mutual benefits while resolving copyright issues.

[1480] The processing flow will be explained below.

[1481] Upload and sell illustrations

[1482] Step 1:

[1483] The user (illustrator) accesses the platform's login page.

[1484] The device will display a login page and prompt you to enter your email address and password.

[1485] The user enters an email address and password.

[1486] Step 2:

[1487] The information entered by the user is sent to the server.

[1488] The device sends the entered email address and password to the server.

[1489] Step 3:

[1490] The server authenticates the user by checking the user information in the database.

[1491] The server compares the entered information with the user information stored in a database and performs authentication.

[1492] If the authentication is successful, the server generates a token and returns it to the terminal.

[1493] Step 4:

[1494] Users access their profile page and open the upload page for their work.

[1495] The device provides an interface with a profile page and an upload page.

[1496] Step 5:

[1497] The user selects an illustration file and enters metadata such as title, description, and price.

[1498] The terminal displays a file selection button and an input form.

[1499] The user inputs the necessary information.

[1500] Step 6:

[1501] The user clicks the upload button.

[1502] The terminal transmits the selected illustration file and metadata to the server.

[1503] Step 7:

[1504] The server stores the illustration files and records the corresponding metadata in a database.

[1505] The server stores the illustration files in storage.

[1506] Saves the metadata (title, description, price, etc.) to the database, confirms the save, and returns a success message to the terminal.

[1507] Step 8:

[1508] The server adds the newly uploaded illustration to the for sale list.

[1509] The server updates the public page and makes the new illustration available for viewing.

[1510] Building and selling AI models

[1511] Step 1:

[1512] Users (model builders) log in to the platform and access the illustration page for sale.

[1513] The terminal displays a login page and the user enters authentication information.

[1514] After authentication, the page of illustrations currently for sale will be displayed.

[1515] Step 2:

[1516] The server provides the terminal with data on illustrations currently on sale.

[1517] The server retrieves illustration information for sale from the database and returns it to the terminal.

[1518] Step 3:

[1519] The user selects the illustration they want to purchase and clicks the purchase button.

[1520] The device displays detailed information about the selected illustration and provides a purchase button.

[1521] Step 4:

[1522] The user enters payment information.

[1523] The terminal provides a form for inputting payment information, and the user enters the information.

[1524] Step 5:

[1525] The terminal transmits the entered payment information to the server.

[1526] The terminal transmits the payment information to the server.

[1527] Step 6:

[1528] The server processes the payment and records the transaction.

[1529] The server sends the information to a payment system to process the payment.

[1530] Once you have confirmed the payment was successful, record the transaction in your database.

[1531] If the payment is successful, the server will return a download link to the device along with a purchase completion message.

[1532] Step 7:

[1533] Users can download the illustrations they purchase and use them to build AI models.

[1534] The terminal displays a download link to the user.

[1535] Users click on the link to download the illustration.

[1536] Step 8:

[1537] Users build AI models in a local environment using the illustrations they purchase.

[1538] Step 9:

[1539] Users upload the AI ​​model they have built to the platform and set up sales.

[1540] The device will display the AI ​​model upload page.

[1541] The user selects an AI model file and enters the title, description, price, quantity, etc.

[1542] Step 10:

[1543] The device sends the AI ​​model file and metadata to the server.

[1544] The terminal transmits the input data to the server.

[1545] Step 11:

[1546] The server stores the AI ​​model and records sales information in a database.

[1547] The server stores the AI ​​model file in storage.

[1548] The metadata is saved in the database, and after confirming the save, a success message is returned to the terminal.

[1549] Step 12:

[1550] The server sets up the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[1551] The server processes the NFT and adds it to the sales list.

[1552] Prompt Sales

[1553] Step 1:

[1554] Users (prompt engineers) sell the generated prompts on the platform.

[1555] The terminal displays the generated prompt sales page.

[1556] The user enters the prompt and the price.

[1557] Step 2:

[1558] The terminal transmits the input prompt information to the server.

[1559] The terminal transmits the entered prompt and price information to the server.

[1560] Step 3:

[1561] The server records the prompt information in a database and adds it to the sales list.

[1562] The server stores the prompt information in a database.

[1563] Update the prompt sales page and add the new prompt to the sales list.

[1564] Example 1

[1565] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1566] Previously, selling illustrations and building AI models had issues with copyright and the reliability of transactions. Furthermore, the process of model builders purchasing illustrations and then building and selling AI models based on them was complicated, and there was a lack of proper data management and processing. Therefore, there is a need for a safe and efficient means of transaction for both illustration providers and model builders.

[1567] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1568] In this invention, the server includes an authentication means for users to log in to the platform, a means for inputting illustration metadata and uploading illustration files, a means for saving the uploaded illustrations in storage and recording the metadata in a database, a means for adding newly uploaded illustrations to a list of items for sale, a payment processing means for completing the purchase process, a means for downloading purchased illustration files, a means for uploading constructed AI models for sale on the platform, and a means for setting the AI ​​models for sale as non-fungible tokens (NFTs). This enables both illustration providers and model builders to conduct transactions safely and efficiently.

[1569] "Illustration provider" refers to a user who sells their own illustrations on the platform.

[1570] "Model builders" refer to users who purchase illustrations sold on the platform and build AI models.

[1571] "Authentication means" refers to the means for verifying an email address and password and generating a token for a user to log in to the platform.

[1572] "Metadata" refers to additional information such as the title, description, and price of an illustration file.

[1573] "Storage" refers to the storage device that stores uploaded illustration files in digital format.

[1574] "Database" refers to a system for systematically storing and managing information about illustration providers and illustration metadata.

[1575] "For Sale List" refers to a list that displays illustrations currently for sale on a public page.

[1576] "Payment processing means" refers to the means for receiving and processing payment information from the user during the purchase procedure.

[1577] "Download link" refers to the link on the Internet that allows a user to download the illustration file they have purchased.

[1578] "AI model" refers to an artificial intelligence model built by the user based on the purchased illustration.

[1579] A "non-fungible token (NFT)" refers to a token that represents a unique digital asset issued based on blockchain technology.

[1580] "Generation prompt" refers to the textual input instructions used to generate an AI model.

[1581] This system allows illustration providers to sell their illustrations on a platform, and model builders can purchase those illustrations to build AI models, which can then be sold. The system consists of a server, terminals, and users.

[1582] Hardware and software used

[1583] Server: Includes database, storage, authentication, payment processing, and NFT issuance functions. As a specific example, AWS (Amazon Web Services) can be used.

[1584] Terminal: A device that uses a web browser to provide a user interface and input, send, and receive data. For example, Google Chrome can be used.

[1585] Database: Manages user information, illustration metadata, AI model metadata, and sales information. As a concrete example, MySQL can be used.

[1586] Storage: Stores uploaded illustration files and AI model files. For example, Amazon S3 can be used.

[1587] Specific actions of the illustration provider

[1588] 1. The illustrator accesses the platform using a web browser. They enter their email address and password on the login screen and send the authentication information to the server. The server compares the information with the information in the database and authenticates the user.

[1589] 2. After successful authentication, the illustrator can access their profile page and open the upload page for their artwork. The user selects an illustration file, adds metadata such as title, description, and price, and clicks the upload button.

[1590] 3. The device sends this data to the server, which then stores the received illustration file in storage. At the same time, it records the metadata in a database and updates the for-sale listing on the public page.

[1591] Specific actions of the model builder

[1592] 1. The model builder logs in to the platform using a web browser, browses the illustrations for sale page, selects the desired illustration, and clicks the purchase button.

[1593] 2. The terminal displays a payment information input screen and prompts the model builder to enter the payment information. The payment information is sent to the server, which processes the payment through a payment provider.

[1594] 3. If the payment is successful, the server generates a purchase confirmation message and a download link and returns them to the device, allowing the model builder to download the purchased illustration.

[1595] 4. The model builder builds an AI model based on the downloaded illustration and uploads it to the platform. The device sends this information to the server, which then stores the AI ​​model file in storage and records the metadata in a database.

[1596] Issuance and sale of NFTs

[1597] 1. Once the AI ​​model is uploaded, the server processes the AI ​​model to issue it as a non-fungible token (NFT), which registers the AI ​​model as a unique digital asset.

[1598] 2. The server adds the issued NFT to the for sale list and updates the public page.

[1599] Prompt Sales

[1600] 1. After logging in to the platform, the prompt engineer accesses the page for selling generated prompts, enters the content and price of the generated prompt, and clicks the Save button.

[1601] 2. The terminal sends this information to the server, which records the prompt information in the database, adding a new prompt to the sales list.

[1602] Specific examples

[1603] Prompt Sentence Examples

[1604] "Simulate a mountain landscape with a sunset in the background."

[1605] This invention provides an environment where users can safely and efficiently sell and purchase illustrations, and build and sell AI models based on them, thereby maximizing the profits of both parties while resolving copyright issues.

[1606] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1607] Step 1:

[1608] A user logs into the platform.

[1609] Input: The user enters their email address and password on the device.

[1610] Specific behavior: The device displays a login screen and prompts the user to enter their email address and password.

[1611] Data processing: Convert the entered email address and password into JSON format and send it to the server.

[1612] Output: The server checks the user information against the database, and if authentication is successful, generates an authentication token and returns it to the terminal.

[1613] Description: The terminal receives the authentication token and displays a successful login to the user.

[1614] Step 2:

[1615] A user accesses their profile page and opens the upload page for their work.

[1616] Input: User clicks on the "Profile Page" link on their device.

[1617] Specific operation: The device will display the profile page and also display a link to the "work upload page."

[1618] Output: When the user clicks on the link, the device will display a form for uploading the work.

[1619] Description: The user selects an illustration file and enters metadata such as title, description, and price.

[1620] Step 3:

[1621] The user uploads the illustration file and metadata.

[1622] Input: User clicks the upload button.

[1623] Specific operation: The device sends the selected illustration file and the entered metadata to the server.

[1624] Data processing: The illustration file is sent as binary data, and the metadata is sent as JSON format to the server.

[1625] Output: The server saves the illustration files to storage and records the metadata in a database.

[1626] Description: If the save is successful, the server generates a success message and returns it to the terminal, which displays the success message to the user.

[1627] Step 4:

[1628] The server adds the newly uploaded illustration to the for sale list.

[1629] Input: Illustration files and metadata stored on the server.

[1630] Specific action: The server updates the data on the public page and adds the new illustration to the sales list.

[1631] Output: The for sale listing on the public page is updated to show the new illustration.

[1632] Description: When a user visits a public page, a new illustration appears.

[1633] Step 5:

[1634] Model builders browse the illustrations for sale page and purchase illustrations.

[1635] Input: A model builder browses an illustration page for sale on their device.

[1636] Specific operation: The device displays details of illustrations for sale. The user selects the desired illustration and clicks the purchase button.

[1637] Output: The checkout screen is displayed.

[1638] Description: Model builder enters payment information.

[1639] Step 6:

[1640] Complete the purchase process.

[1641] Input: The model builder enters payment information and clicks the confirm button.

[1642] Specific operation: The terminal sends the entered payment information to the server.

[1643] Data processing: Payment information is encrypted and sent to our servers.

[1644] Output: If the payment is successful, the server generates a purchase confirmation message and a download link and returns them to the device.

[1645] Description: Model builder receives a purchase confirmation message and download link on their device.

[1646] Step 7:

[1647] The illustrations purchased by users are downloaded and used to build AI models.

[1648] Input: Model builder clicks on download link.

[1649] Specific operation: The device downloads the illustration file and saves it locally.

[1650] Output: The illustration file is saved locally.

[1651] Description: The model builder builds an AI model based on the downloaded illustration file.

[1652] Step 8:

[1653] Users upload their built AI models to the platform.

[1654] Input: The model builder selects the AI ​​model file and enters sales information.

[1655] Specific operation: The device sends the AI ​​model file and sales information to the server.

[1656] Data processing: The AI ​​model file is sent as binary data, and sales information is sent in JSON format to the server.

[1657] Output: The server saves the AI ​​model file to storage and records the metadata in a database.

[1658] Description: A new AI model is added to the for sale list.

[1659] Step 9:

[1660] The server sets the AI ​​model as an NFT and updates the sales page.

[1661] Input: Uploaded AI model data.

[1662] Specific operation: The server processes the NFT and adds it to the sales list.

[1663] Output: The sales page is updated and the AI ​​model is sold as an NFT.

[1664] Description: When users visit the sales page, they can see that the new AI model is being sold as an NFT.

[1665] Step 10:

[1666] Users (prompt engineers) sell generated prompts.

[1667] Input: The prompt engineer enters the content and price of the generated prompt.

[1668] Specific operation: The terminal displays the generated prompt sales page and provides a form for the user to enter the prompt content and price.

[1669] Data processing: The entered prompt information is converted into JSON format and sent to the server.

[1670] Output: The server records the prompt information in a database and adds it to the sales list.

[1671] Description: The generated prompt is added to the sales list and becomes visible to the user.

[1672] (Application example 1)

[1673] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1674] In the past, copyright management and fair distribution of rewards have been issues in the trading of illustrations and digital content. Furthermore, in the trading of AI models generated from illustrations and the content that utilizes them, there has been a lack of rights protection and transparency, which has led to a decline in the reliability of the transactions. Furthermore, there has been little progress in developing a platform for utilizing this content across a wide range of devices. It is necessary to solve these issues and provide a fair and transparent trading system.

[1675] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1676] In this invention, the server includes a means for an illustration provider to sell their illustrations on an e-commerce platform, a means for a model builder to purchase sold illustrations and build an AI model, a means for selling the built AI model on the e-commerce platform, a means for generating content using the AI ​​model based on the purchased illustrations, and a means for displaying the generated content on a smart device. This solves issues of copyright management and fair remuneration distribution, enabling fair and transparent transactions. Furthermore, the generated content can be used on a variety of devices such as smartphones and smart glasses, making it possible to provide high-quality digital content to a wide range of users.

[1677] An "illustration provider" is a person who sells illustrations that he or she has created on an e-commerce platform.

[1678] An "e-commerce platform" is an online system for buying and selling goods and services over the Internet.

[1679] A "model builder" is someone who purchases illustrations for sale and builds an AI model based on those illustrations.

[1680] An "AI model" is a digital model built using artificial intelligence technology to perform a specific task.

[1681] A "non-fungible token (NFT)" is a unique tokenized digital asset that proves ownership of a digital asset.

[1682] "Generated prompts" are sentences containing instructions or hints that the AI ​​model uses to improve the quality of the generated content.

[1683] A "smart device" is an electronic device that has internet connectivity and can run various applications. Examples include smartphones, smart glasses, and head-mounted displays.

[1684] "Content" refers to information or data that is electronically generated or distributed, and specifically includes artwork, animated characters, etc.

[1685] A "server" is a computer system that provides information or services in response to requests from clients over a network.

[1686] An embodiment of the present invention will be described. This invention is a system in which an illustration provider sells their own illustrations on an e-commerce platform, and a model builder builds an AI model based on the purchased illustrations. This allows the built AI model to be sold again on the e-commerce platform, and the generated content to be displayed on a smart device.

[1687] The server provides a function that allows illustrators to sell their illustrations on an e-commerce platform. Specifically, illustrators can access the platform, upload their works, and assign metadata such as title, description, price, etc. The server stores this information in a database and instantly updates the sales list.

[1688] Model builders use a means to purchase illustrations for sale. Based on the purchased illustrations, they can build AI models in a local environment. The built AI models can then be used by users to generate any content they want. For example, they can use the AI ​​models to generate digital content such as animated characters and background images.

[1689] The constructed AI models will then be sold on the e-commerce platform. Furthermore, purchased AI models will be set up as non-fungible tokens (NFTs) to prove digital ownership, facilitating copyright management and ensuring fair reward distribution.

[1690] The system also includes a function to display the generated content on smart devices, allowing users to view and use the generated content in real time on devices such as smartphones, smart glasses, and head-mounted displays.

[1691] Specific examples are given below.

[1692] For example, a user can upload an illustration of a riverside landscape, and another user who purchases that illustration can build an AI model. Using that AI model, a user can input a prompt such as, "Draw a new animated character based on the riverside landscape. Add colorful flowers and a blue sky as the background." This generated content can then be easily displayed and used on smartphones or smart glasses.

[1693] By having each stakeholder, server, terminal, and user, fulfill their respective roles, fair and transparent content transactions and use across a variety of devices will be realized.

[1694] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1695] Step 1:

[1696] The user (illustrator) logs in to the platform.

[1697] Enter your email address and password.

[1698] The server receives this information and compares it with the user information in its database for authentication. If authentication is successful, the server generates a token and returns it to the terminal.

[1699] Output: The authenticated token.

[1700] Step 2:

[1701] Users access their profile page and open the upload page for their work.

[1702] Input: User-selected illustration file, metadata such as title, description, and price.

[1703] The terminal provides a form to display this information, receives input from the user, and then transmits the selected illustration file and metadata to the server.

[1704] Output: Illustration file and metadata.

[1705] Step 3:

[1706] The server stores the received illustration files in storage and records the metadata in a database.

[1707] Input: Uploaded illustration file and metadata.

[1708] The server saves this data in the storage and database, respectively. Once the saving is confirmed, the server returns a success message to the terminal.

[1709] Output: Save confirmation success message.

[1710] Step 4:

[1711] The server adds the newly uploaded illustration to the for sale list.

[1712] Input: Saved illustrations and metadata.

[1713] The server will update the public page, making the new illustration available for viewing.

[1714] Output: The updated public list.

[1715] Step 5:

[1716] Users (model builders) log in to the platform and view pages of illustrations available for sale.

[1717] Input: The user's access request.

[1718] The terminal displays details of illustrations for sale. The user selects the illustration they want and clicks the purchase button.

[1719] Output: Displayed illustration details.

[1720] Step 6:

[1721] Complete the purchase process.

[1722] Input: Payment information.

[1723] The server receives and processes the payment information, and upon successful payment, provides the user with a purchase confirmation message and a download link.

[1724] Output: Purchase confirmation message and download link.

[1725] Step 7:

[1726] Users can download the illustrations they purchase and use them to build AI models.

[1727] Input: Download link.

[1728] The device uses the download link to obtain the illustration file and saves it locally, allowing the user to build an AI model based on the illustration.

[1729] Output: Downloaded illustration file.

[1730] Step 8:

[1731] Users upload their built AI models to the platform.

[1732] Input: AI model file and sales information (price, quantity, etc.).

[1733] The device sends the AI ​​model file and sales information to the server, which stores it and adds it to the sales list.

[1734] Output: Saved AI model file and sales information.

[1735] Step 9:

[1736] The server sets up the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[1737] Input: A saved AI model file.

[1738] The server processes the NFT and adds it to the sales list.

[1739] Output: Added NFT to the for sale list.

[1740] Step 10:

[1741] Users (prompt engineers) sell the generated prompts on the platform.

[1742] Input: Generate prompt and price.

[1743] The terminal displays the generated prompt sales page, and the user inputs the prompt content and price, which are then sent to the server, recorded in the database, and added to the sales list.

[1744] Output: Recorded prompt information and updated sales list.

[1745] These steps will enable illustrators and model builders to sell their work and the AI ​​models they generate, enabling a fair and transparent trade of content.

[1746] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1747] This invention combines an emotion engine with a system in which illustrators sell their illustrations on a platform, model builders purchase them to build AI models, and then sell the AI ​​models. This system can recognize users' emotions and adjust content recommendations and generation prompts based on those emotions.

[1748] Program processing

[1749] This system is composed of a server, a terminal, a user, and an emotion engine. The flow of each process will be explained in detail below.

[1750] Upload and sell illustrations

[1751] 1. The user (illustrator) logs in to the platform.

[1752] The device displays a login page and prompts the user to enter their email address and password. After the user enters the information, the device sends it to the server.

[1753] The server authenticates the user by checking the user information in the database. If authentication is successful, the server generates a token and returns it to the terminal.

[1754] 2. The user accesses their profile page and opens the upload page for their work.

[1755] The terminal displays a form for uploading artwork, allowing the user to select an illustration file and enter metadata such as title, description, and price.

[1756] 3. The user clicks the upload button.

[1757] The terminal transmits the selected illustration file and metadata to the server.

[1758] The server saves the illustration file to storage, records the corresponding metadata in a database, and returns a success message to the device once the save is confirmed.

[1759] 4. The server adds the newly uploaded illustration to the for sale list.

[1760] The server updates the public page and makes the new illustration available for viewing.

[1761] Building and selling AI models

[1762] 5. The user (model builder) logs in to the platform and accesses the illustration page for sale.

[1763] The terminal displays a login page, where the user enters their authentication information. After authentication, the terminal displays a page of illustrations for sale.

[1764] 6. The server provides the terminal with data on illustrations currently on sale.

[1765] The server retrieves illustration information for sale from the database and returns it to the terminal.

[1766] 7. The user selects the illustration they want to purchase and clicks the purchase button.

[1767] The device displays detailed information about the selected illustration and provides a purchase button.

[1768] 8. The user enters payment information.

[1769] The terminal provides a form for inputting payment information, and the user enters the information.

[1770] 9. The terminal sends the entered payment information to the server.

[1771] The terminal transmits the payment information to the server.

[1772] 10. The server processes the payment and records the transaction.

[1773] The server sends the information to a payment system to process the payment.

[1774] Once you have confirmed the payment was successful, record the transaction in your database.

[1775] If the payment is successful, the server will return a download link to the device along with a purchase completion message.

[1776] 11. Users download the purchased illustrations and use them to build AI models.

[1777] The terminal displays a download link to the user.

[1778] Users click on the link to download the illustration.

[1779] 12. Users build AI models in their local environment using the illustrations they purchased.

[1780] 13. Users upload the AI ​​model they have built to the platform and set up sales.

[1781] The device will display the AI ​​model upload page.

[1782] The user selects an AI model file and enters the title, description, price, quantity, etc.

[1783] 14. The device sends the AI ​​model file and metadata to the server.

[1784] The terminal transmits the input data to the server.

[1785] 15. The server stores the AI ​​model and records sales information in a database.

[1786] The server stores the AI ​​model file in storage.

[1787] The metadata is saved in the database, and after confirming the save, a success message is returned to the terminal.

[1788] 16. The server sets up the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[1789] The server processes the NFT and adds it to the sales list.

[1790] Prompt Sales

[1791] 17. Users (prompt engineers) sell the generated prompts on the platform.

[1792] The terminal displays the generated prompt sales page, and the user inputs the prompt content and price.

[1793] The terminal transmits the input prompt information to the server.

[1794] The server records the prompt information in a database and adds it to the sales list.

[1795] Utilizing the Emotion Engine

[1796] 18. The emotion engine receives the user's facial expression data as input and analyzes emotions in real time.

[1797] The device captures facial expression data through the camera and sends it to the emotion engine.

[1798] The emotion engine analyzes the received facial expression data and identifies the emotional state.

[1799] 19. The emotion engine sends the analysis results to the server to optimize the user experience.

[1800] The server recommends content to improve the user experience based on the emotion analysis results received from the emotion engine.

[1801] 20. The emotion engine adjusts the prompts generated by the AI ​​model based on the user's emotional state.

[1802] The server selects the most appropriate generated prompt depending on the emotional state and provides it to the user.

[1803] Specific examples

[1804] Illustration provider's scenario

[1805] Illustrator A accesses the platform to sell a landscape painting he or she has created. After logging in, A goes to the profile page and opens the work upload page. A selects a file, enters the title "Beautiful Evening Scenery," the description "A landscape with a tranquil sunset," and the price of 5,000 yen, and clicks the upload button. The data is saved by the server, and A's work is published in the sales list.

[1806] Model Builder Scenarios

[1807] Model builder B wants to build a new AI model using a landscape painting, so he logs into the platform. He browses the illustration page for sale, selects A's "Beautiful Sunset Scene," and clicks the purchase button. B enters his payment information and receives a download link once the process is complete. B uses the downloaded image to build an AI model, and then applies for and sells the model as an NFT for limited time only.

[1808] Emotion Engine Scenario

[1809] When user C logs in to the platform and browses illustrations, facial expression data is captured via the camera. The emotion engine recognizes C's happy facial expression and sends the emotion analysis results to the server. The server then recommends illustrations with a cheerful tone to enhance C's joy. In addition, when C builds an AI model, the generated prompts are automatically adjusted to match C's emotional state.

[1810] This invention provides a comprehensive system for safe and fair transactions that considers the emotional state of illustration providers, model builders, and general users, thereby resolving copyright issues and realizing a mutually beneficial environment.

[1811] The processing flow will be explained below.

[1812] Upload and sell illustrations

[1813] Step 1:

[1814] The user (illustrator) accesses the platform's login page.

[1815] The device will display a login page and prompt you to enter your email address and password.

[1816] Step 2:

[1817] The user enters an email address and password.

[1818] The terminal transmits the authentication information entered by the user to the server.

[1819] Step 3:

[1820] The server authenticates the user by checking the user information in the database.

[1821] The server compares the entered information with the information in the database, and if authentication is successful, generates a session token and returns it to the terminal.

[1822] Step 4:

[1823] Users access their profile page and open the upload page for their work.

[1824] The device provides an interface with a profile page and an upload page.

[1825] Step 5:

[1826] The user selects an illustration file and enters metadata such as title, description, and price.

[1827] The terminal displays a file selection button and an information input form.

[1828] Step 6:

[1829] The user clicks the upload button.

[1830] The terminal transmits the selected illustration file and metadata to the server.

[1831] Step 7:

[1832] The server stores the illustration files and records the corresponding metadata in a database.

[1833] The server saves the illustration file to storage and saves the metadata to a database. Once the saving is complete, the server returns a success message to the device.

[1834] Step 8:

[1835] The server adds the newly uploaded illustration to the for sale list.

[1836] The server updates the public page and displays the new illustration in the for sale listing.

[1837] Building and selling AI models

[1838] Step 1:

[1839] Users (model builders) log in to the platform and access the illustration page for sale.

[1840] The terminal displays a login page where the user can enter their authentication information. After authentication, the terminal displays a page listing illustrations currently for sale.

[1841] Step 2:

[1842] The server retrieves data on illustrations currently on sale and provides it to the terminal.

[1843] The server retrieves information about illustrations currently on sale from the database and transmits it to the terminal.

[1844] Step 3:

[1845] The user selects the illustration they want to purchase and clicks the purchase button.

[1846] The device will display detailed information about the selected illustration and a purchase button.

[1847] Step 4:

[1848] The user enters payment information.

[1849] The terminal provides a form for inputting payment information, and the user enters the information.

[1850] Step 5:

[1851] The terminal transmits the entered payment information to the server.

[1852] The terminal transmits the payment information to the server.

[1853] Step 6:

[1854] The server processes the payment and records the transaction.

[1855] The server processes the payment by sending the information to the payment system, records the transaction in a database after confirming the payment was successful, and returns a download link to the device along with a purchase completion message.

[1856] Step 7:

[1857] Users can download the illustrations they purchase and use them to build AI models.

[1858] The terminal displays a download link, allowing the user to click on the link to download the illustration.

[1859] Step 8:

[1860] Users build AI models in a local environment using the illustrations they purchase.

[1861] Step 9:

[1862] Users upload the AI ​​model they have built to the platform and set up sales.

[1863] The terminal displays an AI model upload page, where the user selects an AI model file and enters metadata such as title, description, price, and quantity.

[1864] Step 10:

[1865] The device sends the AI ​​model file and metadata to the server.

[1866] The terminal transmits the input data to the server.

[1867] Step 11:

[1868] The server stores the AI ​​model and records sales information in a database.

[1869] The server saves the AI ​​model file to storage, saves the metadata to a database, and returns a success message to the device once the save is complete.

[1870] Step 12:

[1871] The server sets up the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[1872] The server will process the NFT and add it to the sales list.

[1873] Prompt Sales

[1874] Step 1:

[1875] Users (prompt engineers) sell the generated prompts on the platform.

[1876] The terminal displays the generated prompt sales page and allows the prompt content and price to be entered.

[1877] Step 2:

[1878] The terminal transmits the input prompt information to the server.

[1879] The terminal transmits the entered prompt and price information to the server.

[1880] Step 3:

[1881] The server records the prompt information in a database and adds it to the sales list.

[1882] The server saves the prompt information in a database and updates the sales page.

[1883] Utilizing the Emotion Engine

[1884] Step 1:

[1885] The device captures the user's facial expression data with a camera and sends it to the emotion engine.

[1886] The device captures the user's facial expressions in real time and sends the data to the emotion engine.

[1887] Step 2:

[1888] The emotion engine analyzes the facial expression data to identify the user's emotional state.

[1889] The emotion engine analyzes the input facial expression data and identifies the user's emotional state.

[1890] Step 3:

[1891] The emotion engine sends the analysis results to the server.

[1892] The emotion engine transmits the analysis results of the identified emotional state to the server.

[1893] Step 4:

[1894] The server recommends appropriate content to the user based on the results of the sentiment analysis.

[1895] Based on the results of the sentiment analysis, the server recommends appropriate illustrations and prompts to the user.

[1896] Step 5:

[1897] The server adjusts the generated prompts based on the user's emotional state.

[1898] The server selects the most appropriate prompt to generate based on the emotion analysis results and presents it to the user.

[1899] Specific examples

[1900] Illustration provider's scenario

[1901] Illustrator A accesses the platform to sell a landscape painting he or she has created. After logging in, A goes to the profile page and opens the work upload page. A selects a file, enters the title "Beautiful Evening Scenery," the description "A landscape with a tranquil sunset," and the price of 5,000 yen, and clicks the upload button. The data is saved by the server, and A's work is published in the sales list.

[1902] Model Builder Scenarios

[1903] Model builder B wants to build a new AI model using a landscape painting, so he logs into the platform. He browses the illustration page for sale, selects A's "Beautiful Sunset Scene," and clicks the purchase button. B enters his payment information and receives a download link once the process is complete. B uses the downloaded image to build an AI model, and then applies for and sells the model as an NFT for limited time only.

[1904] Emotion Engine Scenario

[1905] When user C logs in to the platform and views an illustration, facial expression data is captured via the camera. The emotion engine recognizes C's happy expression and sends the emotion analysis results to the server. The server then recommends illustrations with a cheerful tone to enhance C's joy. Furthermore, when C builds an AI model, the generated prompts are automatically adjusted to match C's emotional state. The present invention realizes safe and fair transactions by taking into account the emotional states of the illustration provider, model builder, and general users.

[1906] Example 2

[1907] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1908] In conventional systems, the process for illustrators to sell their illustrations and the process for model builders to use those illustrations to build and sell AI models are complicated, and the user experience is not sufficiently improved. Furthermore, the system lacks the ability to recognize the user's emotional state in real time and recommend optimal content or adjust generated prompts based on that emotion. This makes it difficult for users to achieve emotionally satisfying transactions.

[1909] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for an illustration provider to sell their own illustrations on the platform; a means for a terminal to authenticate a user; a means for saving illustration files and metadata and adding them to a sales list; a means for a model builder to purchase sold illustrations; a means for processing payments and recording transactions; a means for providing users with links to download the illustrations; a means for a user to build an AI model and sell it on the platform; a means for recording the metadata of the AI ​​model and adding it to a sales list; a means for an emotion engine to analyze the user's emotions; a means for recommending content based on the emotion analysis results; and a means for adjusting generation prompts according to the user's emotional state. This enables users to achieve emotionally satisfying transactions through a simple and efficient process.

[1910] "Illustration provider" refers to a user who sells illustrations they have drawn on the platform.

[1911] "Model builders" refer to users who purchase illustrations for sale and build AI models.

[1912] "Terminal" refers to a computer or information processing device operated by a user, and is responsible for user authentication, data entry, display, etc.

[1913] "Server" refers to a central computer that stores and processes data, authenticates users, records transactions, etc.

[1914] "Platform" refers to an online service infrastructure for selling illustrations, building AI models, and selling generation prompts.

[1915] "Metadata" refers to accompanying information about an illustration or AI model (e.g., title, description, price, etc.).

[1916] "Storage" refers to a digital storage medium for long-term data preservation.

[1917] A "token" refers to identification information generated by a server when a user is successfully authenticated.

[1918] "Transaction" refers to data that records a series of processes related to the purchase and sale of illustrations and AI models.

[1919] A "non-fungible token (NFT)" is a token that uses blockchain technology to prove the uniqueness and ownership of a digital asset.

[1920] "Emotion engine" refers to a program for analyzing a user's emotional state.

[1921] A "generation prompt" refers to an input sentence that provides specific generation instructions to an AI model.

[1922] "Content" refers to information and data provided to users (e.g., illustrations, recommended images, text, etc.).

[1923] The present invention is a system in which illustrators sell their illustrations on a platform, model builders purchase them, build AI models, and sell the AI ​​models. Furthermore, by combining this system with an emotion engine, it can recognize the user's emotional state and adjust content recommendations and generated prompts based on that state. Specific embodiments of the invention are described below.

[1924] Configuration and Usage

[1925] This system mainly consists of a server, a terminal, a user, and an emotion engine.

[1926] Upload and sell illustrations

[1927] The user (illustrator) enters their email address and password on their device and sends the authentication information to the server. The server compares the user information with that in the database, and if authentication is successful, generates a token and returns it to the device. The user then accesses their profile page and opens the work upload page. The device prompts them to select an illustration file and enter metadata such as title, description, and price, which are then sent to the server. The server saves the illustration file in storage and records the metadata in the database. Once saved, the server adds the newly uploaded illustration to the for sale list and updates the public page.

[1928] Building and selling AI models

[1929] The model builder accesses the page of illustrations for sale and selects the illustration they wish to purchase. The terminal prompts them to enter payment information and sends it to the server. The server sends the information to the payment system and processes the payment. If the payment is successful, it records the transaction and returns a download link to the terminal along with a purchase completion message. The model builder uses the downloaded illustration to build an AI model in a local environment, uploads it to the platform, and sets it up for sale. The server saves the AI ​​model file in storage and records the metadata in a database. Once saved, the server sets the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[1930] Prompt Sales

[1931] The prompt engineer sells the generated prompts on the platform. The terminal allows the user to input the prompt content and price, and sends it to the server. The server records the prompt information in the database and adds it to the sales list.

[1932] Utilizing the Emotion Engine

[1933] The emotion engine receives the user's facial expression data as input and analyzes emotions in real time. The device captures the facial expression data through the camera and sends it to the emotion engine. The emotion engine then sends the analysis results to the server, which then recommends content to improve the user experience. The emotion engine also adjusts the generated prompts based on the user's emotional state. For example, if the user shows a happy expression, the server will recommend an illustration with a cheerful tone, and the generated prompts will also be adjusted to match that emotion.

[1934] Specific examples

[1935] Illustration provider's scenario

[1936] Illustrator A accesses the platform to sell a landscape painting he or she has created. After logging in, A goes to the profile page and opens the work upload page. A selects the file, enters the title "Beautiful Evening Scenery," the description "A landscape with a tranquil sunset," and the price of 5,000 yen, and clicks the upload button. The data is saved by the server, and A's work is published in the sales list.

[1937] Model Builder Scenarios

[1938] Model builder B logs into the platform, browses the list of illustrations for sale, and purchases A's "Beautiful Sunset." After entering payment information and completing the purchase, B obtains a download link from the server. B uses this illustration to build a new AI model, which he then uploads back to the platform and sells as an NFT.

[1939] Emotion Engine Scenario

[1940] User C logs in to the platform and browses various illustrations. C's facial expression data is captured through the camera, and the emotion engine detects the emotion of joy. Based on this analysis, the server recommends cheerful illustrations that enhance C's joy. In addition, when C builds an AI model, the generated prompts are automatically adjusted to provide instructions that best suit C's emotions.

[1941] In this way, the system smoothly carries out the entire process from providing illustrations to building AI models and sales, and further optimizes the experience based on the user's emotions, providing an overall excellent user experience.

[1942] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1943] Step 1:

[1944] The user (illustrator) logs in to the platform

[1945] Input: Email address, Password

[1946] Specific behavior:

[1947] 1. The device displays the login page.

[1948] 2. The user enters their email address and password and clicks the login button.

[1949] 3. The terminal sends the entered information to the server.

[1950] Data processing / calculation and output:

[1951] The server compares the user information with that in the database, and if authentication is successful, generates a token and returns it to the terminal.

[1952] Step 2:

[1953] A user accesses their profile page and opens the upload page for their work.

[1954] Input: Token

[1955] Specific behavior:

[1956] 1. The device receives the authenticated token and displays the profile page.

[1957] 2. The user selects the upload page for the work.

[1958] Data processing / calculation and output:

[1959] The server verifies the authentication token and sends the upload form to the device.

[1960] Step 3:

[1961] Upload your work

[1962] Input: Illustration file, metadata (title, description, price, etc.)

[1963] Specific behavior:

[1964] 1. The device displays the illustration file and a metadata input form.

[1965] 2. The user fills out the input form and clicks the upload button.

[1966] 3. The device sends the illustration file and metadata to the server.

[1967] Data processing / calculation and output:

[1968] The server saves the illustration file to storage, records the metadata in the database, and sends a success message to the device after saving is complete.

[1969] Step 4:

[1970] Add to for sale list

[1971] Input: Saved illustration file and metadata

[1972] Specific behavior:

[1973] The server adds the newly uploaded illustration to the for sale list.

[1974] Data processing / calculation and output:

[1975] The server will update the public page and make the new illustrations available for viewing.

[1976] Step 5:

[1977] The user (model builder) accesses the illustration page for sale.

[1978] Input: User authentication

[1979] Specific behavior:

[1980] 1. The terminal displays a user authentication page and the user logs in.

[1981] 2. The user enters their login information and accesses the illustrations for sale page.

[1982] Data processing / calculation and output:

[1983] The server retrieves information about illustrations for sale from the database and returns it to the terminal, which then displays it.

[1984] Step 6:

[1985] Selecting and purchasing illustrations

[1986] Input: Selected illustration and payment information

[1987] Specific behavior:

[1988] 1. The user selects the illustration they want to purchase and clicks the purchase button.

[1989] 2. The terminal provides a form for entering payment information, and the user enters the information.

[1990] 3. The terminal sends the entered information to the server.

[1991] Data processing / calculation and output:

[1992] The server sends the information to the payment system, processes the payment, and if the payment is successful, records the transaction in a database and returns a purchase completion message and a download link to the device.

[1993] Step 7:

[1994] Download illustrations

[1995] Input: Purchase completion message and download link

[1996] Specific behavior:

[1997] 1. The device will display a purchase completion message and a download link.

[1998] 2. The user clicks on the download link to download the illustration.

[1999] Data processing / calculation and output:

[2000] The user obtains the downloaded illustration file and saves it in their local environment.

[2001] Step 8:

[2002] Building and uploading an AI model

[2003] Input: Downloaded illustration file, AI model file, metadata

[2004] Specific behavior:

[2005] 1. The user builds an AI model in a local environment using the illustrations they purchased.

[2006] 2. Upload the AI ​​model you have built to the platform and set it up for sales.

[2007] Data processing / calculation and output:

[2008] The server saves the AI ​​model file to storage, records the metadata in the database, and sends a success message to the device when the save is complete.

[2009] Step 9:

[2010] NFT issuance and sales page updates

[2011] Input: AI model file and metadata

[2012] Specific behavior:

[2013] The server sets the AI ​​model as an NFT and updates the sales page.

[2014] Data processing / calculation and output:

[2015] The server processes the NFT and adds it to the sales list.

[2016] Step 10:

[2017] Sales Generated Prompts

[2018] Input: Generate prompt content, price

[2019] Specific behavior:

[2020] 1. The user (prompt engineer) accesses a page that sells generated prompts.

[2021] 2. Enter the prompt content and price and send it from the terminal to the server.

[2022] Data processing / calculation and output:

[2023] The server records the prompt information in a database and adds it to the sales list.

[2024] Step 11:

[2025] Emotion analysis using an emotion engine

[2026] Input: User's facial expression data

[2027] Specific behavior:

[2028] 1. The device acquires facial expression data through the camera and sends it to the emotion engine.

[2029] 2. The emotion engine analyzes facial expression data and identifies emotional states.

[2030] Data processing / calculation and output:

[2031] The sentiment analysis results are sent to the server, which then recommends content to improve the user experience.

[2032] Step 12:

[2033] Adjusting the generated prompt

[2034] Input: Sentiment analysis results

[2035] Specific behavior:

[2036] The server selects the most appropriate generated prompt according to the emotional state and provides it to the user.

[2037] Data processing / calculation and output:

[2038] The emotional engine adjusts the generated prompts based on the emotional state to provide the user with the most appropriate generated content.

[2039] (Application example 2)

[2040] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2041] While existing platforms allow transactions between illustration providers and model builders, they lack the ability to customize or recommend products based on customer sentiment. Furthermore, they lack real-time customer support and prompt generation for appropriate sales promotion, making it difficult to provide an optimal customer experience. Therefore, there is a need for a system that can maximize the profits of illustration providers and model builders while improving customer satisfaction.

[2042] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2043] In this invention, the server includes a means for an illustrator to sell his / her own illustrations on the platform, a means for a model builder to purchase sold illustrations and build an AI model, a means for recognizing a customer's facial expression in real time and analyzing their emotions, a means for recommending appropriate products based on the analyzed emotions, and a means for generating customer service prompts for sales promotion based on the customer's emotions. This enables personalized product recommendations and customer service support that take customer emotions into consideration.

[2044] "Platform" refers to a series of online systems that multiple users can access via the Internet and use to trade illustrations and AI models.

[2045] "Illustration Provider" refers to an individual or organization that uploads and sells illustrations they have created on the Platform.

[2046] "Model Builder" refers to an individual or organization that purchases illustrations for sale on the Platform, creates AI models based on those illustrations, and then sells them on the Platform.

[2047] An "AI model" refers to a program or system built using machine learning algorithms to perform a specific task.

[2048] A "non-fungible token (NFT)" is a token that uses blockchain technology to prove ownership of a digital asset and guarantee its uniqueness.

[2049] "Generation prompts" refer to text information containing specific instructions and guidelines used when generating content using AI.

[2050] "Emotion analysis" refers to a technological means of analyzing a customer's facial expressions in real time and identifying their emotional state from the results.

[2051] "Product recommendation" refers to algorithms and systems that present optimal products to customers based on analyzed emotional data.

[2052] "Customer service prompts" refer to text information containing instructions for providing appropriate response methods and conversation content depending on the customer's emotional state.

[2053] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following provides a detailed description of the embodiments of the present invention.

[2054] Hardware and software used

[2055] The system uses the following hardware and software:

[2056] Server: Uses Django (Python Web Framework) and is responsible for back-end data processing.

[2057] Database: MySQL is used to manage illustrations, AI models, generative prompts, customer data, etc.

[2058] Face Recognition and Emotion Analysis: Using OpenCV and DeepFace libraries.

[2059] Front-end: Uses React Native to provide a user interface for smartphones and tablets.

[2060] Recommendation system: Uses TensorFlow to recommend products based on sentiment analysis results.

[2061] Specific system operations and processing

[2062] 1. Upload and sell illustrations:

[2063] Illustration providers log in to the platform, upload their own illustrations, and set up sales. The terminal sends the entered data to the server, which records it in a database.

[2064] 2. Building and selling AI models:

[2065] Model builders purchase illustrations for sale on the platform, download them, and then build an AI model. They then upload the AI ​​model to the platform and set it up for sale.

[2066] 3. Emotion analysis:

[2067] The front-end device uses a camera to capture the customer's facial expressions in real time and sends the data to the server, which then uses DeepFace to perform emotion analysis and sends the analysis results back to the front-end.

[2068] 4. Generate product recommendations and customer prompts:

[2069] Based on the sentiment analysis results, an algorithm using TensorFlow is run to recommend appropriate products, and customer service prompts are generated based on the analysis results and sent to the store clerk's device.

[2070] Specific Operation Examples

[2071] Operation example 1: Illustration provider operation

[2072] Illustration provider A uploads the illustration he or she has drawn to the platform. The server stores it in the database and adds it to the sales list.

[2073] Operation example 2: Model builder operation

[2074] Model Builder B purchases an illustration from the platform, builds an AI model based on that illustration, uploads the built AI model to the server, and sets up sales.

[2075] Operation example 3: Sentiment analysis and product recommendation

[2076] When customer C enters the store, facial recognition is performed using the device's camera. If emotion analysis determines that C is happy, the server recommends positive products (e.g., colorful miscellaneous goods).

[2077] Specific prompt examples

[2078] A customer comes into the store with a smile. Please recommend cheerful and uplifting items and accessories and serve them in a bright and cheerful atmosphere.

[2079] This provides an environment that can improve the user experience for all: illustrators, model builders, and customers. By combining emotion analysis technology with an AI model generation and sales platform, this system achieves more personalized product recommendations and customer service support.

[2080] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2081] Step 1:

[2082] Uploading illustrations and setting up sales

[2083] The user (illustrator) logs in to the device and accesses the illustration upload page. They select the illustration file and metadata (title, description, price, etc.) and click the upload button. The device sends this data to the server, which saves the illustration in storage and records the metadata in the database. The illustration is then added to the sales list with a success message.

[2084] Input: illustration file, metadata (title, description, price, etc.)

[2085] Processing / calculation: illustration file storage, metadata database recording

[2086] Output: Success message, added to sales list

[2087] Step 2:

[2088] Purchase illustrations currently on sale

[2089] The model builder logs in to the terminal and accesses the page of illustrations for sale. They select the illustration they want to purchase and click the purchase button. The terminal provides a form for entering payment information, which is then sent to the server after it is filled out. The server sends the information to the payment system, and once the payment is confirmed, a download link is generated and sent back to the terminal.

[2090] Input: Login information, illustration selection information, payment information

[2091] Processing / Calculation: Payment processing, transaction recording, download link generation

[2092] Output: Download link

[2093] Step 3:

[2094] Building and uploading an AI model

[2095] The model builder uses the purchased illustration in a local environment to build an AI model. After construction, the constructed AI model and its metadata (title, description, price, etc.) are sent to the server via the upload page. The server saves the AI ​​model in storage and records it in a database.

[2096] Input: Built AI model file, metadata (title, description, price, etc.)

[2097] Processing / calculation: AI model file storage, metadata database recording

[2098] Output: Success message, added to sales list

[2099] Step 4:

[2100] Setting up non-fungible tokens (NFTs)

[2101] The server then sets up the uploaded AI model as an NFT, using blockchain technology to prove ownership of the digital asset and add it to the sales list.

[2102] Input: AI model file, metadata

[2103] Processing / calculation: NFT setting, ownership verification by blockchain

[2104] Output: Add to sales list

[2105] Step 5:

[2106] Sales Generated Prompts

[2107] To set up sales of the generated prompts on the platform, prompt engineers log in, enter the prompt content and price, and send it to the server, which records the prompt information in the database and adds it to the sales list.

[2108] Input: Generate prompt content, price

[2109] Processing / calculation: database recording of prompt information

[2110] Output: Add to sales list

[2111] Step 6:

[2112] Customer Sentiment Analysis

[2113] The device uses a camera to capture customer facial expression data in real time and transmits it to the server, which then uses the DeepFace library to perform emotion analysis and sends the results back to the device.

[2114] Input: Customer's facial expression data

[2115] Processing / Calculation: Emotion Analysis (using DeepFace)

[2116] Output: Emotion analysis results

[2117] Step 7:

[2118] Generate product recommendations and customer service prompts

[2119] The server uses TensorFlow to run an algorithm that recommends appropriate products based on the results of the sentiment analysis, and also generates customer service prompts based on the analysis results and notifies the store clerk's device.

[2120] Input: Sentiment analysis results

[2121] Processing / calculation: Executing product recommendation algorithms, generating customer prompts (using TensorFlow)

[2122] Output: Product recommendations, customer service prompts

[2123] Step 8:

[2124] Sales List Updates

[2125] All illustrations, AI models, and generated prompts uploaded by users are added to the sales list by the server and made available to customers.

[2126] Input: Uploaded illustrations, AI models, generated prompts

[2127] Processing / calculation: Updating the database and publishing the sales list

[2128] Output: Published sales list

[2129] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2130] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2131] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2132] [Fourth embodiment]

[2133] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2134] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2135] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2136] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2137] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2138] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2139] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2140] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2141] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2142] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2143] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2144] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2145] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2146] This invention is a system in which illustrators sell their illustrations on a platform, model builders purchase them, build AI models, and then sell the AI ​​models. This system solves copyright issues while realizing legal and advantageous transactions for both parties.

[2147] Program processing

[2148] This system is composed of a server, a terminal, and a user. The flow of each process will be explained in detail below.

[2149] Upload and sell illustrations

[2150] 1. The user (illustrator) logs in to the platform.

[2151] The device prompts the user to enter their email address and password. After the user enters the information, the device sends it to the server.

[2152] The server authenticates the user by checking the user information in the database. If authentication is successful, the server generates a token and returns it to the terminal.

[2153] 2. The user accesses their profile page and opens the upload page for their work.

[2154] The terminal displays a form for uploading artwork, allowing the user to select an illustration file and enter metadata such as title, description, and price.

[2155] 3. The user clicks the upload button.

[2156] The terminal transmits the selected illustration file and metadata to the server.

[2157] The server saves the illustration file to storage, records the corresponding metadata in a database, and returns a success message to the device once the save is confirmed.

[2158] 4. The server adds the newly uploaded illustration to the for sale list.

[2159] The server will update the public page, making the new illustration available for viewing.

[2160] Building and selling AI models

[2161] 5. The user (model builder) logs in to the platform and browses the illustration page for sale.

[2162] The terminal displays details of illustrations for sale. The user selects the illustration they want and clicks the purchase button.

[2163] 6. Complete the purchase process.

[2164] The terminal prompts for payment information and transmits that information to the server.

[2165] The server processes the payment and, if successful, provides a purchase confirmation message and download link to the device.

[2166] 7. Users download the purchased illustrations and use them to build AI models.

[2167] The device allows users to use downloaded illustrations in a local environment.

[2168] 8. Upload the AI ​​model you built to the platform.

[2169] The terminal displays an upload page for the AI ​​model file, where the user selects the file and enters sales information (price, quantity, etc.).

[2170] The device sends this to the server, which saves the AI ​​model file and records the sales information in a database.

[2171] 9. The server sets the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[2172] The server processes the NFT and adds it to the sales list.

[2173] Prompt Sales

[2174] 10. Users (prompt engineers) sell the generated prompts on the platform.

[2175] The terminal displays the generated prompt sales page, and the user inputs the prompt content and price.

[2176] The terminal transmits the input prompt information to the server.

[2177] The server records the prompt information in a database and adds it to the sales list.

[2178] Specific examples

[2179] Illustration provider's scenario

[2180] Illustrator A accesses the platform to sell a landscape painting he or she has created. After logging in, A goes to the profile page and opens the work upload page. A selects a file, enters the title "Beautiful Evening Scenery," the description "A landscape with a tranquil sunset," and the price of 5,000 yen, and clicks the upload button. The data is saved by the server, and A's work is published in the sales list.

[2181] Model Builder Scenarios

[2182] Model builder B wants to build a new AI model using a landscape painting, so he logs into the platform. He browses the illustration page for sale, selects A's "Beautiful Sunset Scene," and clicks the purchase button. B enters his payment information and receives a download link once the process is complete. B uses the downloaded image to build an AI model, and then applies for and sells the model as an NFT for limited time only.

[2183] The present invention provides an appropriate environment for both illustration providers and model builders to conduct transactions safely and fairly, thereby realizing a system that allows both parties to enjoy mutual benefits while resolving copyright issues.

[2184] The processing flow will be explained below.

[2185] Upload and sell illustrations

[2186] Step 1:

[2187] The user (illustrator) accesses the platform's login page.

[2188] The device will display a login page and prompt you to enter your email address and password.

[2189] The user enters an email address and password.

[2190] Step 2:

[2191] The information entered by the user is sent to the server.

[2192] The device sends the entered email address and password to the server.

[2193] Step 3:

[2194] The server authenticates the user by checking the user information in the database.

[2195] The server compares the entered information with the user information stored in a database and performs authentication.

[2196] If the authentication is successful, the server generates a token and returns it to the terminal.

[2197] Step 4:

[2198] Users access their profile page and open the upload page for their work.

[2199] The device provides an interface with a profile page and an upload page.

[2200] Step 5:

[2201] The user selects an illustration file and enters metadata such as title, description, and price.

[2202] The terminal displays a file selection button and an input form.

[2203] The user inputs the necessary information.

[2204] Step 6:

[2205] The user clicks the upload button.

[2206] The terminal transmits the selected illustration file and metadata to the server.

[2207] Step 7:

[2208] The server stores the illustration files and records the corresponding metadata in a database.

[2209] The server stores the illustration files in storage.

[2210] Saves the metadata (title, description, price, etc.) to the database, confirms the save, and returns a success message to the terminal.

[2211] Step 8:

[2212] The server adds the newly uploaded illustration to the for sale list.

[2213] The server updates the public page and makes the new illustration available for viewing.

[2214] Building and selling AI models

[2215] Step 1:

[2216] Users (model builders) log in to the platform and access the illustration page for sale.

[2217] The terminal displays a login page and the user enters authentication information.

[2218] After authentication, the page of illustrations currently for sale will be displayed.

[2219] Step 2:

[2220] The server provides the terminal with data on illustrations currently on sale.

[2221] The server retrieves illustration information for sale from the database and returns it to the terminal.

[2222] Step 3:

[2223] The user selects the illustration they want to purchase and clicks the purchase button.

[2224] The device displays detailed information about the selected illustration and provides a purchase button.

[2225] Step 4:

[2226] The user enters payment information.

[2227] The terminal provides a form for inputting payment information, and the user enters the information.

[2228] Step 5:

[2229] The terminal transmits the entered payment information to the server.

[2230] The terminal transmits the payment information to the server.

[2231] Step 6:

[2232] The server processes the payment and records the transaction.

[2233] The server sends the information to a payment system to process the payment.

[2234] Once you have confirmed the payment was successful, record the transaction in your database.

[2235] If the payment is successful, the server will return a download link to the device along with a purchase completion message.

[2236] Step 7:

[2237] Users can download the illustrations they purchase and use them to build AI models.

[2238] The terminal displays a download link to the user.

[2239] Users click on the link to download the illustration.

[2240] Step 8:

[2241] Users build AI models in a local environment using the illustrations they purchase.

[2242] Step 9:

[2243] Users upload the AI ​​model they have built to the platform and set up sales.

[2244] The device will display the AI ​​model upload page.

[2245] The user selects an AI model file and enters the title, description, price, quantity, etc.

[2246] Step 10:

[2247] The device sends the AI ​​model file and metadata to the server.

[2248] The terminal transmits the input data to the server.

[2249] Step 11:

[2250] The server stores the AI ​​model and records sales information in a database.

[2251] The server stores the AI ​​model file in storage.

[2252] The metadata is saved in the database, and after confirming the save, a success message is returned to the terminal.

[2253] Step 12:

[2254] The server sets up the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[2255] The server processes the NFT and adds it to the sales list.

[2256] Prompt Sales

[2257] Step 1:

[2258] Users (prompt engineers) sell the generated prompts on the platform.

[2259] The terminal displays the generated prompt sales page.

[2260] The user enters the prompt and the price.

[2261] Step 2:

[2262] The terminal transmits the input prompt information to the server.

[2263] The terminal transmits the entered prompt and price information to the server.

[2264] Step 3:

[2265] The server records the prompt information in a database and adds it to the sales list.

[2266] The server stores the prompt information in a database.

[2267] Update the prompt sales page and add the new prompt to the sales list.

[2268] Example 1

[2269] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2270] Previously, selling illustrations and building AI models had issues with copyright and the reliability of transactions. Furthermore, the process of model builders purchasing illustrations and then building and selling AI models based on them was complicated, and there was a lack of proper data management and processing. Therefore, there is a need for a safe and efficient means of transaction for both illustration providers and model builders.

[2271] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2272] In this invention, the server includes an authentication means for users to log in to the platform, a means for inputting illustration metadata and uploading illustration files, a means for saving the uploaded illustrations in storage and recording the metadata in a database, a means for adding newly uploaded illustrations to a list of items for sale, a payment processing means for completing the purchase process, a means for downloading purchased illustration files, a means for uploading constructed AI models for sale on the platform, and a means for setting the AI ​​models for sale as non-fungible tokens (NFTs). This enables both illustration providers and model builders to conduct transactions safely and efficiently.

[2273] "Illustration provider" refers to a user who sells their own illustrations on the platform.

[2274] "Model builders" refer to users who purchase illustrations sold on the platform and build AI models.

[2275] "Authentication means" refers to the means for verifying an email address and password and generating a token for a user to log in to the platform.

[2276] "Metadata" refers to additional information such as the title, description, and price of an illustration file.

[2277] "Storage" refers to the storage device that stores uploaded illustration files in digital format.

[2278] "Database" refers to a system for systematically storing and managing information about illustration providers and illustration metadata.

[2279] "For Sale List" refers to a list that displays illustrations currently for sale on a public page.

[2280] "Payment processing means" refers to the means for receiving and processing payment information from the user during the purchase procedure.

[2281] "Download link" refers to the link on the Internet that allows a user to download the illustration file they have purchased.

[2282] "AI model" refers to an artificial intelligence model built by the user based on the purchased illustration.

[2283] A "non-fungible token (NFT)" refers to a token that represents a unique digital asset issued based on blockchain technology.

[2284] "Generation prompt" refers to the textual input instructions used to generate an AI model.

[2285] This system allows illustration providers to sell their illustrations on a platform, and model builders can purchase those illustrations to build AI models, which can then be sold. The system consists of a server, terminals, and users.

[2286] Hardware and software used

[2287] Server: Includes database, storage, authentication, payment processing, and NFT issuance functions. As a specific example, AWS (Amazon Web Services) can be used.

[2288] Terminal: A device that uses a web browser to provide a user interface and input, send, and receive data. For example, Google Chrome can be used.

[2289] Database: Manages user information, illustration metadata, AI model metadata, and sales information. As a concrete example, MySQL can be used.

[2290] Storage: Stores uploaded illustration files and AI model files. For example, Amazon S3 can be used.

[2291] Specific actions of the illustration provider

[2292] 1. The illustrator accesses the platform using a web browser. They enter their email address and password on the login screen and send the authentication information to the server. The server compares the information with the information in the database and authenticates the user.

[2293] 2. After successful authentication, the illustrator can access their profile page and open the upload page for their artwork. The user selects an illustration file, adds metadata such as title, description, and price, and clicks the upload button.

[2294] 3. The device sends this data to the server, which then stores the received illustration file in storage. At the same time, it records the metadata in a database and updates the for-sale listing on the public page.

[2295] Specific actions of the model builder

[2296] 1. The model builder logs in to the platform using a web browser, browses the illustrations for sale page, selects the desired illustration, and clicks the purchase button.

[2297] 2. The terminal displays a payment information input screen and prompts the model builder to enter the payment information. The payment information is sent to the server, which processes the payment through a payment provider.

[2298] 3. If the payment is successful, the server generates a purchase confirmation message and a download link and returns them to the device, allowing the model builder to download the purchased illustration.

[2299] 4. The model builder builds an AI model based on the downloaded illustration and uploads it to the platform. The device sends this information to the server, which then stores the AI ​​model file in storage and records the metadata in a database.

[2300] Issuance and sale of NFTs

[2301] 1. Once the AI ​​model is uploaded, the server processes the AI ​​model to issue it as a non-fungible token (NFT), which registers the AI ​​model as a unique digital asset.

[2302] 2. The server adds the issued NFT to the for sale list and updates the public page.

[2303] Prompt Sales

[2304] 1. After logging in to the platform, the prompt engineer accesses the page for selling generated prompts, enters the content and price of the generated prompt, and clicks the Save button.

[2305] 2. The terminal sends this information to the server, which records the prompt information in the database, adding a new prompt to the sales list.

[2306] Specific examples

[2307] Prompt Sentence Examples

[2308] "Simulate a mountain landscape with a sunset in the background."

[2309] This invention provides an environment where users can safely and efficiently sell and purchase illustrations, and build and sell AI models based on them, thereby maximizing the profits of both parties while resolving copyright issues.

[2310] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2311] Step 1:

[2312] A user logs into the platform.

[2313] Input: The user enters their email address and password on the device.

[2314] Specific behavior: The device displays a login screen and prompts the user to enter their email address and password.

[2315] Data processing: Convert the entered email address and password into JSON format and send it to the server.

[2316] Output: The server checks the user information against the database, and if authentication is successful, generates an authentication token and returns it to the terminal.

[2317] Description: The terminal receives the authentication token and displays a successful login to the user.

[2318] Step 2:

[2319] A user accesses their profile page and opens the upload page for their work.

[2320] Input: User clicks on the "Profile Page" link on their device.

[2321] Specific operation: The device will display the profile page and also display a link to the "work upload page."

[2322] Output: When the user clicks on the link, the device will display a form for uploading the work.

[2323] Description: The user selects an illustration file and enters metadata such as title, description, and price.

[2324] Step 3:

[2325] The user uploads the illustration file and metadata.

[2326] Input: User clicks the upload button.

[2327] Specific operation: The device sends the selected illustration file and the entered metadata to the server.

[2328] Data processing: The illustration file is sent as binary data, and the metadata is sent as JSON format to the server.

[2329] Output: The server saves the illustration files to storage and records the metadata in a database.

[2330] Description: If the save is successful, the server generates a success message and returns it to the terminal, which displays the success message to the user.

[2331] Step 4:

[2332] The server adds the newly uploaded illustration to the for sale list.

[2333] Input: Illustration files and metadata stored on the server.

[2334] Specific action: The server updates the data on the public page and adds the new illustration to the sales list.

[2335] Output: The for sale listing on the public page is updated to show the new illustration.

[2336] Description: When a user visits a public page, a new illustration appears.

[2337] Step 5:

[2338] Model builders browse the illustrations for sale page and purchase illustrations.

[2339] Input: A model builder browses an illustration page for sale on their device.

[2340] Specific operation: The device displays details of illustrations for sale. The user selects the desired illustration and clicks the purchase button.

[2341] Output: The checkout screen is displayed.

[2342] Description: Model builder enters payment information.

[2343] Step 6:

[2344] Complete the purchase process.

[2345] Input: The model builder enters payment information and clicks the confirm button.

[2346] Specific operation: The terminal sends the entered payment information to the server.

[2347] Data processing: Payment information is encrypted and sent to our servers.

[2348] Output: If the payment is successful, the server generates a purchase confirmation message and a download link and returns them to the device.

[2349] Description: Model builder receives a purchase confirmation message and download link on their device.

[2350] Step 7:

[2351] The illustrations purchased by users are downloaded and used to build AI models.

[2352] Input: Model builder clicks on download link.

[2353] Specific operation: The device downloads the illustration file and saves it locally.

[2354] Output: The illustration file is saved locally.

[2355] Description: The model builder builds an AI model based on the downloaded illustration file.

[2356] Step 8:

[2357] Users upload their built AI models to the platform.

[2358] Input: The model builder selects the AI ​​model file and enters sales information.

[2359] Specific operation: The device sends the AI ​​model file and sales information to the server.

[2360] Data processing: The AI ​​model file is sent as binary data, and sales information is sent in JSON format to the server.

[2361] Output: The server saves the AI ​​model file to storage and records the metadata in a database.

[2362] Description: A new AI model is added to the for sale list.

[2363] Step 9:

[2364] The server sets the AI ​​model as an NFT and updates the sales page.

[2365] Input: Uploaded AI model data.

[2366] Specific operation: The server processes the NFT and adds it to the sales list.

[2367] Output: The sales page is updated and the AI ​​model is sold as an NFT.

[2368] Description: When users visit the sales page, they can see that the new AI model is being sold as an NFT.

[2369] Step 10:

[2370] Users (prompt engineers) sell generated prompts.

[2371] Input: The prompt engineer enters the content and price of the generated prompt.

[2372] Specific operation: The terminal displays the generated prompt sales page and provides a form for the user to enter the prompt content and price.

[2373] Data processing: The entered prompt information is converted into JSON format and sent to the server.

[2374] Output: The server records the prompt information in a database and adds it to the sales list.

[2375] Description: The generated prompt is added to the sales list and becomes visible to the user.

[2376] (Application example 1)

[2377] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2378] In the past, copyright management and fair distribution of rewards have been issues in the trading of illustrations and digital content. Furthermore, in the trading of AI models generated from illustrations and the content that utilizes them, there has been a lack of rights protection and transparency, which has led to a decline in the reliability of the transactions. Furthermore, there has been little progress in developing a platform for utilizing this content across a wide range of devices. It is necessary to solve these issues and provide a fair and transparent trading system.

[2379] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2380] In this invention, the server includes a means for an illustration provider to sell their illustrations on an e-commerce platform, a means for a model builder to purchase sold illustrations and build an AI model, a means for selling the built AI model on the e-commerce platform, a means for generating content using the AI ​​model based on the purchased illustrations, and a means for displaying the generated content on a smart device. This solves issues of copyright management and fair remuneration distribution, enabling fair and transparent transactions. Furthermore, the generated content can be used on a variety of devices such as smartphones and smart glasses, making it possible to provide high-quality digital content to a wide range of users.

[2381] An "illustration provider" is a person who sells illustrations that he or she has created on an e-commerce platform.

[2382] An "e-commerce platform" is an online system for buying and selling goods and services over the Internet.

[2383] A "model builder" is someone who purchases illustrations for sale and builds an AI model based on those illustrations.

[2384] An "AI model" is a digital model built using artificial intelligence technology to perform a specific task.

[2385] A "non-fungible token (NFT)" is a unique tokenized digital asset that proves ownership of a digital asset.

[2386] "Generated prompts" are sentences containing instructions or hints that the AI ​​model uses to improve the quality of the generated content.

[2387] A "smart device" is an electronic device that has internet connectivity and can run various applications. Examples include smartphones, smart glasses, and head-mounted displays.

[2388] "Content" refers to information or data that is electronically generated or distributed, and specifically includes artwork, animated characters, etc.

[2389] A "server" is a computer system that provides information or services in response to requests from clients over a network.

[2390] An embodiment of the present invention will be described. This invention is a system in which an illustration provider sells their own illustrations on an e-commerce platform, and a model builder builds an AI model based on the purchased illustrations. This allows the built AI model to be sold again on the e-commerce platform, and the generated content to be displayed on a smart device.

[2391] The server provides a function that allows illustrators to sell their illustrations on an e-commerce platform. Specifically, illustrators can access the platform, upload their works, and assign metadata such as title, description, price, etc. The server stores this information in a database and instantly updates the sales list.

[2392] Model builders use a means to purchase illustrations for sale. Based on the purchased illustrations, they can build AI models in a local environment. The built AI models can then be used by users to generate any content they want. For example, they can use the AI ​​models to generate digital content such as animated characters and background images.

[2393] The constructed AI models will then be sold on the e-commerce platform. Furthermore, purchased AI models will be set up as non-fungible tokens (NFTs) to prove digital ownership, facilitating copyright management and ensuring fair reward distribution.

[2394] The system also includes a function to display the generated content on smart devices, allowing users to view and use the generated content in real time on devices such as smartphones, smart glasses, and head-mounted displays.

[2395] Specific examples are given below.

[2396] For example, a user can upload an illustration of a riverside landscape, and another user who purchases that illustration can build an AI model. Using that AI model, a user can input a prompt such as, "Draw a new animated character based on the riverside landscape. Add colorful flowers and a blue sky as the background." This generated content can then be easily displayed and used on smartphones or smart glasses.

[2397] By having each stakeholder, server, terminal, and user, fulfill their respective roles, fair and transparent content transactions and use across a variety of devices will be realized.

[2398] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2399] Step 1:

[2400] The user (illustrator) logs in to the platform.

[2401] Enter your email address and password.

[2402] The server receives this information and compares it with the user information in its database for authentication. If authentication is successful, the server generates a token and returns it to the terminal.

[2403] Output: The authenticated token.

[2404] Step 2:

[2405] Users access their profile page and open the upload page for their work.

[2406] Input: User-selected illustration file, metadata such as title, description, and price.

[2407] The terminal provides a form to display this information, receives input from the user, and then transmits the selected illustration file and metadata to the server.

[2408] Output: Illustration file and metadata.

[2409] Step 3:

[2410] The server stores the received illustration files in storage and records the metadata in a database.

[2411] Input: Uploaded illustration file and metadata.

[2412] The server saves this data in the storage and database, respectively. Once the saving is confirmed, the server returns a success message to the terminal.

[2413] Output: Save confirmation success message.

[2414] Step 4:

[2415] The server adds the newly uploaded illustration to the for sale list.

[2416] Input: Saved illustrations and metadata.

[2417] The server will update the public page, making the new illustration available for viewing.

[2418] Output: The updated public list.

[2419] Step 5:

[2420] Users (model builders) log in to the platform and view pages of illustrations available for sale.

[2421] Input: The user's access request.

[2422] The terminal displays details of illustrations for sale. The user selects the illustration they want and clicks the purchase button.

[2423] Output: Displayed illustration details.

[2424] Step 6:

[2425] Complete the purchase process.

[2426] Input: Payment information.

[2427] The server receives and processes the payment information, and upon successful payment, provides the user with a purchase confirmation message and a download link.

[2428] Output: Purchase confirmation message and download link.

[2429] Step 7:

[2430] Users can download the illustrations they purchase and use them to build AI models.

[2431] Input: Download link.

[2432] The device uses the download link to obtain the illustration file and saves it locally, allowing the user to build an AI model based on the illustration.

[2433] Output: Downloaded illustration file.

[2434] Step 8:

[2435] Users upload their built AI models to the platform.

[2436] Input: AI model file and sales information (price, quantity, etc.).

[2437] The device sends the AI ​​model file and sales information to the server, which stores it and adds it to the sales list.

[2438] Output: Saved AI model file and sales information.

[2439] Step 9:

[2440] The server sets up the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[2441] Input: A saved AI model file.

[2442] The server processes the NFT and adds it to the sales list.

[2443] Output: Added NFT to the for sale list.

[2444] Step 10:

[2445] Users (prompt engineers) sell the generated prompts on the platform.

[2446] Input: Generate prompt and price.

[2447] The terminal displays the generated prompt sales page, and the user inputs the prompt content and price, which are then sent to the server, recorded in the database, and added to the sales list.

[2448] Output: Recorded prompt information and updated sales list.

[2449] These steps will enable illustrators and model builders to sell their work and the AI ​​models they generate, enabling a fair and transparent trade of content.

[2450] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2451] This invention combines an emotion engine with a system in which illustrators sell their illustrations on a platform, model builders purchase them to build AI models, and then sell the AI ​​models. This system can recognize users' emotions and adjust content recommendations and generation prompts based on those emotions.

[2452] Program processing

[2453] This system is composed of a server, a terminal, a user, and an emotion engine. The flow of each process will be explained in detail below.

[2454] Upload and sell illustrations

[2455] 1. The user (illustrator) logs in to the platform.

[2456] The device displays a login page and prompts the user to enter their email address and password. After the user enters the information, the device sends it to the server.

[2457] The server authenticates the user by checking the user information in the database. If authentication is successful, the server generates a token and returns it to the terminal.

[2458] 2. The user accesses their profile page and opens the upload page for their work.

[2459] The terminal displays a form for uploading artwork, allowing the user to select an illustration file and enter metadata such as title, description, and price.

[2460] 3. The user clicks the upload button.

[2461] The terminal transmits the selected illustration file and metadata to the server.

[2462] The server saves the illustration file to storage, records the corresponding metadata in a database, and returns a success message to the device once the save is confirmed.

[2463] 4. The server adds the newly uploaded illustration to the for sale list.

[2464] The server updates the public page and makes the new illustration available for viewing.

[2465] Building and selling AI models

[2466] 5. The user (model builder) logs in to the platform and accesses the illustration page for sale.

[2467] The terminal displays a login page, where the user enters their authentication information. After authentication, the terminal displays a page of illustrations for sale.

[2468] 6. The server provides the terminal with data on illustrations currently on sale.

[2469] The server retrieves illustration information for sale from the database and returns it to the terminal.

[2470] 7. The user selects the illustration they want to purchase and clicks the purchase button.

[2471] The device displays detailed information about the selected illustration and provides a purchase button.

[2472] 8. The user enters payment information.

[2473] The terminal provides a form for inputting payment information, and the user enters the information.

[2474] 9. The terminal sends the entered payment information to the server.

[2475] The terminal transmits the payment information to the server.

[2476] 10. The server processes the payment and records the transaction.

[2477] The server sends the information to a payment system to process the payment.

[2478] Once you have confirmed the payment was successful, record the transaction in your database.

[2479] If the payment is successful, the server will return a download link to the device along with a purchase completion message.

[2480] 11. Users download the purchased illustrations and use them to build AI models.

[2481] The terminal displays a download link to the user.

[2482] Users click on the link to download the illustration.

[2483] 12. Users build AI models in their local environment using the illustrations they purchased.

[2484] 13. Users upload the AI ​​model they have built to the platform and set up sales.

[2485] The device will display the AI ​​model upload page.

[2486] The user selects an AI model file and enters the title, description, price, quantity, etc.

[2487] 14. The device sends the AI ​​model file and metadata to the server.

[2488] The terminal transmits the input data to the server.

[2489] 15. The server stores the AI ​​model and records sales information in a database.

[2490] The server stores the AI ​​model file in storage.

[2491] The metadata is saved in the database, and after confirming the save, a success message is returned to the terminal.

[2492] 16. The server sets up the AI ​​model as a non-fungible token (NFT) and updates the sales page.

[2493] The server processes the NFT and adds it to the sales list.

[2494] Prompt Sales

[2495] 17. Users (prompt engineers) sell the generated prompts on the platform.

[2496] The terminal displays the generated prompt sales page, and the user inputs the prompt content and price.

[2497] The terminal transmits the input prompt information to the server.

[2498] The server records the prompt information in a database and adds it to the sales list.

[2499] Utilizing the Emotion Engine

[2500] 18. The emotion engine receives the user's facial expression data as input and analyzes emotions in real time.

[2501] The device captures facial expression data through the camera and sends it to the emotion engine.

[2502] The emotion engine analyzes the received facial expression data and identifies the emotional state.

[2503] 19. The emotion engine sends the analysis results to the server to optimize the user experience.

[2504] The server recommends content to improve the user experience based on the emotion analysis results received from the emotion engine.

[2505] 20. The emotion engine adjusts the prompts generated by the AI ​​model based on the user's emotional state.

[2506] The server selects the most appropriate generated prompt depending on the emotional state and provides it to the user.

[2507] Specific examples

[2508] Illustration provider's scenario

[2509] Illustrator A accesses the platform to sell a landscape painting he or she has created. After logging in, A goes to the profile page and opens the work upload page. A selects a file, enters the title "Beautiful Evening Scenery," the description "A landscape with a tranquil sunset," and the price of 5,000 yen, and clicks the upload button. The data is saved by the server, and A's work is published in the sales list.

[2510] Model Builder Scenarios

[2511] Model builder B wants to build a new AI model using a landscape painting, so he logs into the platform. He browses the illustration page for sale, selects A's "Beautiful Sunset Scene," and clicks the purchase button. B enters his payment information and receives a download link once the process is complete. B uses the downloaded image to build an AI model, and then applies for and sells the model as an NFT for limited time only.

[2512] Emotion Engine Scenario

[2513] When user C logs in to the platform and browses illustrations, facial expression data is captured via the camera. The emotion engine recognizes C's happy facial expression and sends the emotion analysis results to the server. The server then recommends illustrations with a cheerful tone to enhance C's joy. In addition, when C builds an AI model, the generated prompts are automatically adjusted to match C's emotional state.

[2514] This invention provides a comprehensive system for safe and fair transactions that considers the emotional state of illustration providers, model builders, and general users, thereby resolving copyright issues and realizing a mutually beneficial environment.

[2515] The processing flow will be explained below.

[2516] Upload and sell illustrations

[2517] Step 1:

[2518] The user (illustrator) accesses the platform's login page.

[2519] The device will display a login page and prompt you to enter your email address and password.

[2520] Step 2:

[2521] The user enters an email address and password.

[2522] The terminal transmits the authentication information entered by the user to the server.

[2523] Step 3:

[2524] The server authenticates the user by checking the user information in the database.

[2525] The server compares the entered information with the information in the database, and if authentication is successful, generates a session token and returns it to the terminal.

[2526] Step 4:

[2527] Users access their profile page and open the upload page for their work.

[2528] The device provides an interface with a profile page and an upload page.

[2529] Step 5:

[2530] The user selects an illustration file and enters metadata such as title, description, and price.

[2531] The terminal displays a file selection button and an information input form.

[2532] Step 6:

[2533] The user clicks the upload button.

[2534] The terminal transmits the selected illustration file and metadata to the server.

[2535] Step 7:

[2536] The server stores the illustration files and records the corresponding metadata in a database.

[2537] The server saves the illustration file to storage and saves the metadata to a database. Once the saving is complete, the server returns a success message to the device.

[2538] Step 8:

[2539] The server adds the newly uploaded illustration to the for sale list.

[2540] The server updates the public page and displays the new illustration in the for sale listing.

[2541] Building and selling AI models

[2542] Step 1:

[2543] Users (model builders) log in to the platform and access the illustration page for sale.

[2544] The terminal displays a login page where the user can enter their authentication information. After authentication, the terminal displays a page listing illustrations currently for sale.

[2545] Step 2:

[2546] The server retrieves data on illustrations currently on sale and provides it to the terminal.

[2547] The server retrieves information about illustrations currently on sale from the database and transmits it to the terminal.

[2548] Step 3:

[2549] The user selects the illustration they want to purchase and clicks the purchase button.

[2550] The device will display detailed information about the selected illustration and a purchase button.

[2551] Step 4:

[2552] The user enters payment information.

[2553] The terminal provides a form for inputting payment information, and the user enters the information.

[2554] Step 5:

[2555] The terminal transmits the entered payment information to the server.

[2556] The terminal transmits the payment information to the server.

[2557] Step 6:

[2558] The server processes the paymen...

Claims

1. A means for illustration providers to sell their illustrations on the platform, A means for model builders to purchase illustrations for sale and build AI models, A system that includes a means to sell the AI ​​models that have been built on the platform.

2. The system of claim 1, further comprising means for making the AI ​​model available for sale as a non-fungible token (NFT).

3. 10. The system of claim 1, further comprising means for selling the generated prompts on the platform.

Images