system

Abstract

A system is provided.SOLUTION: A system comprising: means for a user to enter a prompt; means for sending the entered prompt to a server; means for generating a digital image using an image generation AI based on the prompt on the server; means for sending and displaying the generated digital image to the user's device; means for uploading the generated digital image to a marketplace for sale as a NFT; and means for managing the revenue sold and donating a portion to a welfare or charity.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Currently, creating digital art and selling it as an NFT requires high technical skills and expertise, posing a significant hurdle for many people, especially those with physical disabilities and those with limited knowledge of digital art. This limits their opportunities to generate digital art, sell it as an NFT, and earn revenue. Furthermore, there is a lack of efficient and easy ways to donate the revenue to welfare or charitable causes. The objective of this invention is to solve these problems. [Means for solving the problem]

[0005] To solve this problem, the present invention provides a system that includes: a means for a user to input a prompt; a means for transmitting the input prompt to a server; a means for generating a digital image on the server using an image generation AI based on the prompt; a means for transmitting and displaying the generated digital image to the user's device; a means for uploading the generated digital image to a marketplace and selling it as an NFT; and a means for managing sales revenue and donating a portion of the revenue to welfare or charity organizations. The system also includes a means for managing revenue in virtual currency and handling the cashing process. Furthermore, the prompt input means can assist the generation process by providing the user with suggested prompts and samples. This allows anyone to easily create digital art, sell it as an NFT, and use the revenue to contribute to society.

[0006] "User" means an individual or organization that utilizes the system to input prompts, generate images, and sell NFTs.

[0007] A "prompt" is text information entered by a user that the image generation AI uses to generate a digital image.

[0008] The "server" is a computer system that receives prompts sent by users, generates digital images using image generation AI, and performs subsequent processing.

[0009] "Image generation AI" is an artificial intelligence program that analyzes input prompts and automatically generates digital images based on them.

[0010] A "digital image" is image data in digital format generated by image generation AI.

[0011] A "terminal" is a device, such as a computer or smartphone, that a user uses to enter prompts and review the generated digital images.

[0012] The "marketplace" is an online platform for uploading and selling generated digital images as NFTs.

[0013] "NFT" stands for Non-Fungible Token, a token that uses blockchain technology to prove that a particular piece of digital art or digital asset is unique.

[0014] "Revenue" refers to the financial gain from selling the generated digital image as an NFT.

[0015] A "welfare or charity organization" is an organization that contributes to society or provides support to the community, to which a portion of its profits are donated.

[0016] "Virtual currency" means a currency that exists in digital form and is used to manage and convert earnings.

[0017] A "liquidation process agent" is a third-party institution or service that processes the conversion of virtual currency revenues into fiat currency or other forms of cash.

[0018] "Means for providing prompt suggestions and examples" refers to a function that provides ideas and examples to assist the generation process when the user enters a prompt. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0020] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0021] First, the terms used in the following description will be explained.

[0022] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0023] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0024] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0025] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0026] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0027] [First embodiment]

[0028] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0029] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0030] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0031] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0032] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0033] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0034] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0035] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0036] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0037] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0038] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0039] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0040] The present invention relates to a system that allows users to easily create digital art by entering prompts and earn revenue by selling it as an NFT. This system is designed to be easily usable by users who do not have specialized knowledge of digital art, and even by users with physical disabilities.

[0041] Program processing details

[0042] 1. Prompt Input

[0043] Device: The user launches a dedicated application and enters text prompts about the digital art they want to create. For example, they can enter specific images such as "a beautiful sunset" or "a city of the near future."

[0044] 2. Sending prompts and generating images

[0045] Terminal: When the user presses the "Generate" button, the entered prompt is sent to the server. The server receives the prompt and generates digital art using image generation AI based on the prompt. In this process, the image generation AI internally analyzes the prompt and automatically creates the appropriate artwork.

[0046] 3. Displaying the generated image

[0047] Server: The generated digital image is temporarily stored on the server, and its URL and metadata are sent back to the user's device.

[0048] On the device: The user can check the generated image based on the URL sent to them. The image becomes viewable and the user can rate the generated art.

[0049] 4. Upload as an NFT

[0050] User: If the user is happy with the image, they press the "Upload as NFT" button.

[0051] Terminal: This operation sends an upload request to the server.

[0052] Server: The server receives the upload request and uploads the image file and any necessary metadata (e.g., title, description, category, etc.) to the NFT marketplace.

[0053] 5. Sales Procedures

[0054] Server: Uploaded NFTs are published on the marketplace and begin to be sold. The sales process is tracked in real time, and when a purchase is made, the information is recorded.

[0055] 6. Sales Tracking and Revenue Sharing

[0056] Server: When a sale is made, the revenue is managed and recorded in virtual currency. A portion of the revenue is automatically donated to welfare or charity organizations designated within the system.

[0057] Agent: Manages the cryptocurrency conversion process and converts it into fiat currency, ensuring that revenue is distributed appropriately to users and charities.

[0058] Specific examples

[0059] For example, if the user types the prompt "Beautiful sunset", the following happens:

[0060] 1. Prompt input:

[0061] User: Enters "Beautiful sunset" into the application.

[0062] 2. Sending prompts and generating images:

[0063] Terminal: Sends a prompt to the server.

[0064] Server: Receives prompts and the image generation AI generates digital art depicting a beautiful sunset.

[0065] 3. View the generated image:

[0066] Server: Sends the generated image URL and metadata to the device.

[0067] Terminal: Access the sent URL and display the generated image.

[0068] 4. Upload as an NFT:

[0069] User: Satisfied with the image, presses the "Upload as NFT" button.

[0070] Device: Sends an upload request to the server.

[0071] Server: Uploads images and metadata to the NFT marketplace.

[0072] 5. Sales Procedure:

[0073] Server: NFTs will be available for sale on the marketplace.

[0074] 6. Sales Tracking and Revenue Sharing:

[0075] Server: The sale is completed and revenue is recorded in virtual currency.

[0076] Agency: Virtual currency is converted into cash and a portion of the proceeds is donated to welfare or charity organizations.

[0077] This system allows users to easily create beautiful digital art, sell it as NFTs, and contribute to society at the same time.

[0078] The processing flow will be explained below.

[0079] Step 1:

[0080] User: Launches the dedicated application and enters a prompt text about the content of the digital art they want to generate. For example, the user enters the prompt "Beautiful sunset."

[0081] Step 2:

[0082] Terminal: After the user has finished entering the prompt, the terminal accepts the operation of pressing the "Generate" button, and then sends the entered prompt data to the server.

[0083] Step 3:

[0084] Server: Receives input prompts and provides them to the image generation AI, which analyzes the prompts and generates the appropriate digital images.

[0085] Step 4:

[0086] Server: Temporarily stores the generated digital image. Then, it generates a URL and metadata (title, description, creation date, etc.) for the image and sends them to the device.

[0087] Step 5:

[0088] Terminal: Based on the URL of the generated image received, the image is displayed to the user. The user checks the displayed image and, if satisfied, presses the "Upload as NFT" button.

[0089] Step 6:

[0090] Terminal: Detects when the "Upload as NFT" button is pressed and sends the user's operation to the server as an upload request.

[0091] Step 7:

[0092] Server: Receives upload requests, collects image files and necessary metadata, and uploads them to the NFT marketplace. If the upload is successful, the server confirms the start of sales on the marketplace.

[0093] Step 8:

[0094] Server: Records sales start information within the system and notifies users that their NFTs are available for sale.

[0095] Step 9:

[0096] Server: Tracks sales in real time and records purchase information and revenue when an NFT is purchased.

[0097] Step 10:

[0098] Server: Manages revenue as virtual currency and transfers the revenue information to a means that handles the cash-out process on your behalf.

[0099] Step 11:

[0100] Agents: These companies handle the process of converting virtual currency into fiat currency and donating a portion of the proceeds to designated welfare or charitable organizations.

[0101] Step 12:

[0102] Server: Records the completed donation information within the system and the user, and stores all transactions as a log.

[0103] The above steps establish a complete process from when a user enters the prompt, to when digital art is created and sold, and the proceeds are used for social contribution.

[0104] Example 1

[0105] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0106] Conventional digital art creation and sales systems require specialized knowledge, making them difficult for general users and users with physical disabilities to use. Furthermore, the procedures for selling digital art as NFTs are often complicated, and the revenue management and donation processes often require advanced knowledge. The present invention aims to solve these problems.

[0107] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0108] In this invention, the server includes: a means for a user to input a prompt; a means for transmitting the input prompt to the server; a means for generating a digital image on the server using a generative AI model based on the prompt; a means for transmitting and displaying the generated digital image to the user's terminal; a means for uploading the digital image generated by the user's operation to a marketplace and selling it as an NFT; a means for managing sales revenue in virtual currency and donating a portion of the revenue to welfare or charity organizations; a means for automatically performing the process of converting the revenue into cash; and a means for the prompt input means to provide the user with suggested prompts and samples. This enables users without specialized knowledge to easily create digital art and sell it as an NFT, and donate a portion of the revenue to welfare or charity organizations.

[0109] A "User" is someone who uses the system to enter prompts and generate digital art and sell it as an NFT.

[0110] A "prompt" is text information that a user inputs into a generative AI model, instructing it on the image and content of the digital art to be generated.

[0111] The "server" is a computer system that receives prompts, generates digital art using a generative AI model, and transmits the digital image to the user's device.

[0112] A "generative AI model" is an artificial intelligence program that contains algorithms that generate digital images based on input prompts, such as models like DALL-E and Midjourney.

[0113] "Digital Imagery" means computer graphics generated from prompts by a generative AI model.

[0114] A "terminal" is a device used by a user, such as a computer or smartphone, that has the functionality to communicate with a server.

[0115] "NFT" stands for "Non-Fungible Token" and is a token that manages digital assets such as digital art as unique items on the blockchain.

[0116] A "marketplace" is an online platform for buying and selling NFTs, such as OpenSea or Rarible.

[0117] "Virtual currency" refers to digital currencies that use blockchain technology to manage the trading and ownership of digital assets, including Bitcoin and Ethereum.

[0118] "Revenue" refers to the profits earned by users from the sale of NFTs.

[0119] The "conversion process" refers to the series of steps to convert virtual currency into legal tender.

[0120] "Welfare and charity organizations" is a general term for organizations that provide social assistance or charitable activities.

[0121] The present invention relates to a system that allows users to easily create digital art by entering prompts and earn revenue by selling it as an NFT. This system is designed to be easily usable by users who do not have specialized knowledge of digital art, and by users with physical disabilities.

[0122] Hardware and software used

[0123] Hardware:

[0124] User device: A device such as a computer or smartphone where the user enters the prompts and sees the results.

[0125] Server: A computer system that receives prompts, uses a generative AI model to generate digital art, and uploads it to the NFT marketplace.

[0126] software:

[0127] Generative AI model: An artificial intelligence program that contains algorithms for generating digital images based on input prompts. Examples include models such as DALL-E and Midjourney.

[0128] NFT marketplace: an online platform for selling generated digital art as NFTs. Examples include OpenSea and Rarible.

[0129] Program processing overview

[0130] Entering and submitting prompts

[0131] User:

[0132] The user launches a dedicated application and enters a prompt in text format about the digital art they want to create. Examples of prompts include images such as "a beautiful sunset" or "a city of the near future."

[0133] Device:

[0134] Validates the prompts entered by the user and sends them to the server in the appropriate format.

[0135] Image generation and transmission

[0136] server:

[0137] Receives prompts sent from the device and inputs them into a generative AI model (e.g., DALL-E or Midjourney).

[0138] An image generation AI model analyzes the prompts and automatically generates a digital image.

[0139] The generated digital image is saved as a temporary file and its URL and metadata are generated.

[0140] The image URL and metadata are sent to the user's device.

[0141] Displaying and evaluating the generated images

[0142] Device:

[0143] Receive the URL sent from the server, access the URL and display the generated image.

[0144] The user can review the displayed image and request regeneration or correction as needed.

[0145] Upload and sell as NFTs

[0146] User:

[0147] If you're happy with the generated image, press the "Upload as NFT" button.

[0148] Device:

[0149] Send an upload request to the server, including the image file and any necessary metadata (e.g. title, description, category, etc.).

[0150] server:

[0151] Receives upload requests and uploads image files and metadata to NFT marketplaces (e.g., OpenSea or Rarible).

[0152] Sales will begin as NFTs, and the progress of the buying and selling process will be tracked in real time, with purchase information recorded.

[0153] Once an NFT is sold, the proceeds are recorded in a cryptocurrency wallet, and a portion of the proceeds is automatically donated to designated welfare or charity organizations.

[0154] Agency:

[0155] It manages the cryptocurrency conversion process and converts it into fiat currency, ensuring that revenue is appropriately distributed to users and designated welfare and charity organizations.

[0156] As described above, this invention allows users to easily create digital art and sell it as NFTs without requiring specialized knowledge. It also provides a mechanism for donating a portion of the profits to welfare and charitable organizations, thereby contributing to society at the same time.

[0157] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0158] Step 1:

[0159] Entering Prompts

[0160] User: Launches a dedicated application and enters a prompt in text format about the digital art they want to create. For example, they can enter an image such as "a beautiful sunset" or "a city of the near future."

[0161] Input: The prompt text entered by the user.

[0162] Output: The prompt is displayed on the terminal.

[0163] Specific operation: The user enters a prompt sentence in the text box and presses the confirmation button.

[0164] Step 2:

[0165] Sending a prompt

[0166] Terminal: When the user presses the "Generate" button, the terminal validates the entered prompt and sends it in the appropriate format to the server, generating a data packet containing the prompt text and the user's identification information (e.g., user ID).

[0167] Input: The prompt text that the user entered and instructed to send.

[0168] Output: A data packet containing the prompt and the user ID is sent to the server.

[0169] Specific operation: Pressing a button sends a prompt, and a data packet is generated and sent.

[0170] Step 3:

[0171] Receiving prompts and generating images

[0172] Server: Receives prompts sent from the device and inputs them into a generative AI model (e.g., DALL-E or Midjourney). The image-generating AI model analyzes the prompts and automatically generates digital images.

[0173] Input: The prompt text and user ID sent.

[0174] Output: The digital image data and its metadata that are generated.

[0175] Specific operations: Prompt sentences are analyzed, images are generated, the generated image data is saved, and metadata is generated.

[0176] Step 4:

[0177] Sending the generated image

[0178] Server: Sends the URL and metadata of the generated digital image to the user's device. This data packet includes the URL of the temporary storage location for the image and the image metadata (e.g., creation time, image quality information, etc.).

[0179] Input: Generated digital image data and metadata.

[0180] Output: The data packets are sent to the user's terminal.

[0181] Specific operations: Temporarily save image data, generate a URL, and construct and send a data packet.

[0182] Step 5:

[0183] Displaying and evaluating the generated images

[0184] Terminal: Receives the URL sent from the server, accesses the URL, and displays the generated image. The user can check the displayed image and request regeneration or correction as necessary.

[0185] Input: URL and metadata received from the server.

[0186] Output: The generated image is displayed on the user's device.

[0187] Specific operation: Image data is acquired and displayed by accessing the URL.

[0188] Step 6:

[0189] Upload as an NFT

[0190] User: If satisfied with the generated image, press the "Upload as NFT" button.

[0191] Device: Sends an upload request to the server, which includes the image file and any necessary metadata (e.g., title, description, category, etc.).

[0192] Input: The image to be uploaded and its metadata.

[0193] Output: The upload request is sent to the server.

[0194] Specific operations: Image file and metadata are verified, and an upload data packet is created and sent.

[0195] Step 7:

[0196] Upload and sell images to the marketplace

[0197] Server: Receives the upload request, uploads the image file and metadata to an NFT marketplace (e.g., OpenSea or Rarible), obtains a public URL for the NFT, and returns it to the user.

[0198] Input: Uploaded image file and metadata.

[0199] Output: Public URL as NFT.

[0200] Specific operations: Data is sent to the marketplace, a public URL is obtained, and the URL is returned to the user.

[0201] Step 8:

[0202] Revenue Management and Distribution

[0203] Server: When an NFT sale is completed, the proceeds are recorded in a cryptocurrency wallet. Based on specific settings, a portion of the proceeds is donated to welfare or charity organizations.

[0204] Input: NFT sales completion information and revenue data.

[0205] Output: Recording of earnings and donations to cryptocurrency wallet.

[0206] Specific operations: Records sales data, manages virtual currency, and processes automatic donations.

[0207] Step 9:

[0208] Proxy handling of the cash conversion process

[0209] Agent: Manages the cash-out process, converts cryptocurrency into fiat currency, and distributes the cashed-out revenue appropriately to users and charities.

[0210] Input: User and charity revenue data.

[0211] Output: Distribution of redeemed fiat currency.

[0212] Specific operations: Virtual currency is converted into cash, converted into legal tender, and distributed.

[0213] By following these steps, users can easily create digital art and sell it as an NFT. This system also contributes to society by automatically donating a portion of the profits to welfare and charitable organizations.

[0214] (Application example 1)

[0215] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0216] Conventional systems for creating and selling digital art required specialized knowledge, limiting the user base. Furthermore, the ways in which the created digital art could be utilized were limited, particularly in content distribution services. Furthermore, the procedures for managing and allocating revenue from the created digital art were complicated, making them difficult for many users to use.

[0217] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0218] In this invention, the server includes a means for a user to input a prompt, a means for transmitting the input prompt to the server, a means for generating a digital image on the server using an image generation AI based on the prompt, a means for transmitting the generated digital image to the user's device and displaying it, a means for uploading the generated digital image to a distribution platform and distributing it as an album cover or background image, and a means for managing revenue from the distribution and donating a portion of the revenue to welfare or charitable organizations. This allows users without specialized knowledge to easily generate digital art and makes the art widely available in content distribution services. Furthermore, revenue management and distribution are automated, making the system easily accessible to many users.

[0219] A "prompt" is text that indicates instructions or requests that a user sends to a generative AI model.

[0220] The "server" is a central processing unit that receives prompts, runs the image generation AI, stores the generated images, and uploads them to the distribution platform.

[0221] "Image generation AI" is an artificial intelligence algorithm that automatically generates digital images based on user prompts.

[0222] A "digital image" is electronic visual data generated based on a user prompt.

[0223] A "terminal" is an electronic device that a user uses to enter prompts and view generated digital images.

[0224] A "distribution platform" is an online service that publishes and makes available to viewers the digital images generated.

[0225] An "album cover" is a digital image that visually represents a music album.

[0226] A "background visual" is a digital image used as a background on a distribution platform.

[0227] "Revenue" means the financial benefits derived from the distribution and sale of generated digital images and content.

[0228] A "welfare or charity organization" is a non-profit organization whose purpose is to donate a portion of its profits.

[0229] "Virtual currency" means electronic currency that exists in digital or virtual form and is used for transactions.

[0230] "Prompt suggestions and samples" are concrete examples and hints provided as reference to help users enter appropriate prompts.

[0231] The present invention relates to a system that allows users to easily create digital art by entering prompts and use it as album covers or background visuals on a distribution platform. This system is designed to be easy to use even for users who do not have specialized knowledge of digital art.

[0232] The server provides an interface for the user to enter a prompt. When the user enters a prompt, such as "an inspiring night sky, stars, or a dreamy theme," the prompt is sent to the server. The server processes the received prompt and generates a digital image using a generative AI model (e.g., DALL-E or MidJourney). The generated digital image is temporarily stored on the server, and a URL for the image is sent back to the user's device. The user can use this URL to view the generated image and make any necessary edits.

[0233] Once the user is satisfied with the generated digital image, they can press the "Distribute as content" button, which will upload the image to the distribution platform via the server. On the distribution platform, the generated digital image will be made public as an album cover or background visual.

[0234] Regarding revenue management, the server will track the usage of the distributed content in real time, and the revenue earned will be managed in virtual currency. The virtual currency conversion process will be handled by an agency, and a portion of the revenue will be donated to designated welfare and charitable organizations.

[0235] The specific system configuration and process are explained below. The user's device is an electronic device such as a smartphone, smart glasses, or head-mounted display (HMD), and prompt input is performed through a dedicated application installed on the device. This application is developed using programming languages ​​such as React Native, Swift, and Kotlin.

[0236] On the server side, server frameworks such as Node.js and Flask are used. DALL-E and MidJourney are used as image generation AI, and the generated digital images are temporarily stored in databases such as MongoDB and PostgreSQL. Music streaming services and video distribution services are used as distribution platforms.

[0237] For example, if a user inputs the prompt "Inspirational night sky, stars, dreamy theme," the image generation AI will generate digital art depicting a fantastic night sky based on this prompt. This generated digital art will be sent to the user's device, where the user can review and edit it, and then it will be uploaded to the distribution platform.

[0238] The above is a specific embodiment for carrying out the present invention, which makes it possible to easily create beautiful digital art without specialized knowledge and utilize it in a variety of content distribution services.

[0239] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0240] Step 1:

[0241] The user launches a dedicated application on their device and inputs a prompt in text form for the digital art they wish to create. This prompt might describe a specific image, such as "an inspiring night sky, stars, or a dreamlike theme." The user enters the prompt and presses the send button to generate the input data.

[0242] Step 2:

[0243] The terminal sends the entered prompt text to the server. In this sending process, an API request including the prompt text is generated and an HTTP request is made to the server. The input data is mainly the prompt text.

[0244] Step 3:

[0245] The server analyzes the received prompt and generates a digital image based on the prompt using image generation AI (e.g., DALL-E, MidJourney). The generative AI model understands the content of the prompt and performs data calculations to generate digital art in accordance with it. The input here is the prompt, and the output is a digital image.

[0246] Step 4:

[0247] The server temporarily stores the generated digital image and generates a URL and metadata for the image. The URL and metadata for the stored digital image are generated on the server side. The metadata includes the image title and description. The output is the URL and metadata for the digital image.

[0248] Step 5:

[0249] The server returns the URL and metadata of the generated image to the user's device, which receives this information and accesses it to display the image. The input is the URL and metadata from the server, and the output is the display of the image.

[0250] Step 6:

[0251] The user checks the generated digital image and edits it as necessary. When the image is satisfactory, the user presses the "Distribute as content" button. This operation confirms the edited image data. The input is the edited content of the image, and the output is the confirmed image data.

[0252] Step 7:

[0253] The terminal sends the confirmed image data to the server again. At this stage, an image data upload request is generated and sent to the server. The input is the confirmed image data, and the output is the upload request.

[0254] Step 8:

[0255] The server uploads the received image data to the distribution platform. Specifically, it uploads the image data using the distribution platform's API and publishes it as an album cover or background visual. The input is the confirmed image data, and the output is the upload result to the distribution platform.

[0256] Step 9:

[0257] The server tracks the usage of digital images on the distribution platform in real time and records and manages the revenue generated. In this process, revenue data is managed in virtual currency. The input is usage data, and the output is revenue record data.

[0258] Step 10:

[0259] When revenue is generated, the server requests an agent to process the virtual currency to be converted into cash. The agent converts the virtual currency and donates a portion of the revenue to a designated welfare or charity organization. The input is the virtual currency data of the revenue, and the output is the converted revenue and the fulfillment of the donation.

[0260] The above steps enable users to easily create digital art and use it widely in content distribution services. In addition, revenue management and distribution are automated, making the system easy to use for many users.

[0261] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0262] This invention relates to a system that allows users to easily create digital art by entering prompts, then sell it as NFTs and earn revenue. In particular, by combining it with an emotion engine that recognizes the user's emotions, more personalized prompt generation and suggestions can be generated, improving the user experience. This system is designed to be easily usable by users without specialized knowledge of digital art or users with physical disabilities.

[0263] Program processing details

[0264] 1. Prompt Input and Emotion Recognition

[0265] User: Launches a dedicated application and uses facial expressions, voice, or text input. For example, the user might smile in front of the smartphone camera, say "I'm feeling happy today," or type "Today is a wonderful day."

[0266] Terminal: Collects the user's facial expression, voice, and text data using input devices such as a camera, microphone, and keyboard.

[0267] Emotion engine: Analyzes collected data and recognizes the user's emotions. For example, it can recognize "happiness" as an emotion from the user's smile or voice.

[0268] 2. Prompt generation and suggestions

[0269] Terminal: Based on the emotion data obtained from the emotion engine, the prompt input means provides suggestions and samples. For example, if the emotion "happiness" is recognized, prompts such as "beautiful sunset" and "fun festival scenery" will be suggested.

[0270] 3. Sending prompts and generating images

[0271] User: Choose from suggested prompts or enter the text of their own prompt, then press the "Generate" button.

[0272] Terminal: Sends selected or entered prompts to the server.

[0273] Server: Receives prompts and the image generation AI generates digital images based on them.

[0274] 4. Display and check the generated image

[0275] Server: Temporarily stores the generated digital image and sends its URL and metadata to the user's device.

[0276] Terminal: The generated image is displayed based on the sent URL. The user checks the displayed image and, if satisfied, presses the "Upload as NFT" button.

[0277] 5. Upload as an NFT

[0278] Terminal: Detects when the "Upload as NFT" button is pressed and sends an upload request to the server.

[0279] Server: Receives the upload request and uploads the image file and necessary metadata to the NFT marketplace. If the upload is successful, the server confirms the start of sales on the marketplace.

[0280] 6. Sales procedures and revenue management

[0281] Server: Records sales start information in the system and notifies users that NFTs are available for sale. Tracks sales in real time and records purchase information and revenue when NFTs are purchased.

[0282] Server: Manages revenue as virtual currency and transfers the revenue information to a means that handles the cash-out process on your behalf.

[0283] 7. Revenue Sharing and Donations

[0284] Agents: These companies handle the process of converting virtual currency into fiat currency and donating a portion of the proceeds to designated welfare or charitable organizations.

[0285] Server: Records the completed donation information within the system and the user, and stores all transactions as a log.

[0286] Specific examples

[0287] For example, if a user launches an application and smiles into the smartphone camera, the following steps are performed:

[0288] 1. Prompt Input and Emotion Recognition

[0289] Device: The smartphone camera captures the user's smile.

[0290] Emotion engine: Analyzes collected facial image data and recognizes the user's emotion as "happiness."

[0291] 2. Prompt generation and suggestions

[0292] Terminal: Based on the emotion "happiness," the system suggests prompts to the user, such as "beautiful sunset" or "fun festival scenery."

[0293] 3. Sending prompts and generating images

[0294] User: Selects the prompt "Beautiful Sunset" and presses the "Generate" button.

[0295] Terminal: Sends the selected prompt to the server.

[0296] Server: Receives the prompt and the image generation AI generates a digital image depicting a "beautiful sunset."

[0297] 4. Display and check the generated image

[0298] Server: Sends the generated images and their metadata to the device.

[0299] Terminal: Display the image to the user and ask them to confirm.

[0300] 5. Upload as an NFT

[0301] User: Satisfied with the image, presses the "Upload as NFT" button.

[0302] Device: Sends an upload request to the server.

[0303] Server: Upload images to the NFT marketplace and start selling.

[0304] 6. Sales procedures and revenue management

[0305] Server: Track sales status in real time and manage revenue as virtual currency.

[0306] 7. Revenue Sharing and Donations

[0307] Agency: Converts revenue into fiat currency and donates a portion to welfare or charity organizations.

[0308] This allows users to create digital art in an easy and personalized way, sell it as an NFT, and use the proceeds to contribute to society.

[0309] The processing flow will be explained below.

[0310] Program processing details

[0311] Step 1:

[0312] User: Launch the dedicated application, smile in front of the smartphone camera, and capture your facial expression. You can also choose to input using voice or text. For example, you can say, "I'm feeling happy today," or input using text, "Today is a wonderful day."

[0313] Step 2:

[0314] Terminal: Collects the user's facial expressions, voice, and text data using input devices such as a camera, microphone, and keyboard. Prepares to send this data to the emotion engine.

[0315] Step 3:

[0316] Emotion engine: Analyzes collected data and recognizes the user's emotions. For example, it can recognize "happiness" as an emotion from the user's smile or voice.

[0317] Step 4:

[0318] Terminal: Based on the emotion data obtained from the emotion engine, the prompt input means provides suggestions and samples. For example, if the emotion "happiness" is recognized, prompts such as "beautiful sunset" and "fun festival scenery" will be suggested.

[0319] Step 5:

[0320] User: Choose from suggested prompts or enter the text of their own prompt, then press the "Generate" button.

[0321] Step 6:

[0322] Terminal: Sends the selected or entered prompt to the server, formatting the prompt data appropriately before sending it.

[0323] Step 7:

[0324] Server: Receives the prompt and provides it to the image generation AI, which analyzes the prompt and generates the appropriate digital image.

[0325] Step 8:

[0326] Server: Temporarily stores the generated digital image. Then, it generates a URL and metadata (title, description, creation date, etc.) for the image and sends them to the device.

[0327] Step 9:

[0328] Terminal: Based on the URL of the generated image received, the image is displayed to the user. The user checks the displayed image and, if satisfied, presses the "Upload as NFT" button.

[0329] Step 10:

[0330] Device: Detects when the "Upload as NFT" button is pressed and sends an upload request to the server, including the image file and any necessary metadata.

[0331] Step 11:

[0332] Server: Receives the upload request and uploads the image file and necessary metadata to the NFT marketplace. If the upload is successful, the server confirms the start of sales on the marketplace.

[0333] Step 12:

[0334] Server: Records sales start information within the system and notifies users that their NFTs are available for sale.

[0335] Step 13:

[0336] Server: Tracks sales in real time, records the purchase information and revenue when an NFT is purchased, and records cryptocurrency revenue in the system.

[0337] Step 14:

[0338] Server: Manages revenue as virtual currency and transfers the revenue information to a means that handles the cash-out process on your behalf.

[0339] Step 15:

[0340] Agents: These companies handle the process of converting virtual currency into fiat currency and donating a portion of the proceeds to designated welfare or charitable organizations.

[0341] Step 16:

[0342] Server: Records the completed donation information within the system and the user, and stores all transactions as a log.

[0343] Specific examples

[0344] For example, if a user launches an application and smiles into the smartphone camera, the following steps are performed:

[0345] Step 1:

[0346] User: Speaks to the application, "I'm feeling happy today."

[0347] Step 2:

[0348] Device: The smartphone's microphone captures the user's voice.

[0349] Step 3:

[0350] Emotion engine: Analyzes collected voice data and recognizes the user's emotion as "happiness."

[0351] Step 4:

[0352] Terminal: Based on the emotion "happiness," the system suggests prompts to the user, such as "beautiful sunset" or "fun festival scenery."

[0353] Step 5:

[0354] User: Selects the prompt "Beautiful Sunset" and presses the "Generate" button.

[0355] Step 6:

[0356] Terminal: Sends the selected prompt to the server.

[0357] Step 7:

[0358] Server: Receives the prompt and the image generation AI generates a digital image depicting a "beautiful sunset."

[0359] Step 8:

[0360] Server: Sends the generated images and their metadata to the device.

[0361] Step 9:

[0362] Terminal: Display the image to the user and ask them to confirm.

[0363] Step 10:

[0364] User: Satisfied with the image, presses the "Upload as NFT" button.

[0365] Step 11:

[0366] Device: Sends an upload request to the server.

[0367] Step 12:

[0368] Server: Upload images to the NFT marketplace and start selling.

[0369] Step 13:

[0370] Server: Track sales status in real time and manage revenue as virtual currency.

[0371] Step 14:

[0372] Server: Carries out the procedures to process the cash-out process.

[0373] Step 15:

[0374] Agency: Converts revenue into fiat currency and donates a portion to welfare or charity organizations.

[0375] Step 16:

[0376] Server: Records donation information and keeps a log of all transactions.

[0377] In this way, users can easily create digital art and use the proceeds from selling it as an NFT to contribute to society.

[0378] Example 2

[0379] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0380] Conventional digital art generation systems require users to input prompts, generate digital images based on those prompts, and sell them as NFTs, resulting in a complicated process. Furthermore, they lack the ability to generate personalized prompts using emotion recognition, which hinders the user experience. Furthermore, the process of managing revenue and donating to welfare or charitable organizations is also complicated.

[0381] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0382] In this invention, the server includes means for a user to input a prompt, means for transmitting the input prompt, means for generating digital media using an image generation algorithm, means for transmitting the generated digital media to a user terminal and displaying it, means for uploading the digital media to an e-commerce platform and selling it as a digital asset, means for managing revenue and donating it to welfare or charity organizations, means for analyzing facial expressions, voice, and text data to recognize emotions, and means for generating and suggesting prompts based on the recognized emotions, thereby improving the user experience and simplifying the revenue management and donation process.

[0383] A "prompt" is a sentence or word entered by a user that represents an instruction or request.

[0384] A "server" is a computer system that provides services to other computers on a network.

[0385] A "terminal" is a computer device or apparatus that is operated by a user.

[0386] An "image generation algorithm" is a method or procedure for automatically generating a digital image based on specified prompts.

[0387] "Digital media" refers to content such as images and video that is electronically generated and stored.

[0388] An "e-commerce platform" is a web service or application for buying and selling goods over the Internet.

[0389] A "digital asset" is any property stored in digital form that is data of value that can be owned or sold.

[0390] An "emotion engine" is a technology or system that analyzes a user's facial expressions, voice, and text data to identify emotions.

[0391] "Revenue" means the profit earned when a Digital Asset is sold.

[0392] "Virtual currency" means a digital or virtual currency whose transactions are governed by cryptography.

[0393] "Welfare and charity organizations" are organizations and groups that contribute to society and provide humanitarian aid.

[0394] A "suggestion" is a prompt or idea presented to the user.

[0395] The present invention relates to a system that allows users to easily create digital art by entering prompts, sell the resulting digital art as digital assets, and earn revenue. In particular, by combining it with an emotion engine that recognizes the user's emotions, more personalized prompt generation and suggestions can be generated, improving the user experience. This system is designed to be easily usable by users who do not have specialized knowledge of digital art or who have physical disabilities. Specifically, the system is implemented as follows.

[0396] First, a user launches a dedicated application and smiles at the smartphone camera, speaks into the microphone saying "I'm feeling happy today," or types "It's a nice day today" into a text field. The hardware used here is the smartphone's input devices, such as the camera, microphone, and keyboard.

[0397] The device uses input devices such as a camera, microphone, and keyboard to collect the user's facial expression, voice, and text data. The collected data is temporarily stored locally and then sent to a server. The server uses an emotion engine (e.g., an emotion recognition algorithm) to analyze the collected data and recognize the user's emotions. Specifically, the emotion engine can use existing emotion recognition technologies such as Microsoft® Azure® Face API and IBM Watson® Tone Analyzer.

[0398] The server generates multiple prompts based on the recognized emotion data and sends them to the device. For example, if the emotion "happiness" is recognized, prompts such as a beautiful sunset or a fun festival scene may be generated. The device then presents the generated prompts to the user, who can then select from the suggested prompts or enter their own prompt by text.

[0399] When the user selects or enters a prompt and presses the "Generate" button, the device sends the prompt to the server. The server generates digital media using an image generation algorithm (e.g., DALL-E by OpenAI®) based on the received prompt. The generated digital media is temporarily stored, and its URL and metadata are sent to the user's device.

[0400] The device displays the digital media generated based on the URL and prompts the user for confirmation. If the user is satisfied with the generated digital media, they press the "Upload as NFT" button. This causes the device to send an upload request to the server, which then uploads the image and metadata to an NFT marketplace (e.g., OpenSea) and begins selling it.

[0401] The server records the sales status within the system and notifies the user that the NFT is available for sale. It also monitors the sales situation in real time and records purchase information and revenue. The revenue is managed as virtual currency and sent to the user's wallet address. The agency converts the revenue into fiat currency and donates it to a welfare or charity organization designated by the user. This process is managed by the server, which notifies the user when the donation is complete and stores all transaction logs.

[0402] For example, if a user launches the application and smiles into the smartphone camera, the emotion engine will recognize the expression as "happiness" and suggest a prompt such as "beautiful sunset." The user can then select the prompt and press the "Generate" button, which will generate a digital image using the image generation algorithm.

[0403] Example prompt sentence:

[0404] "Prompt: Please walk me through the steps to capture a photo of a smiling face, generate digital art that expresses happiness, and upload it to an NFT marketplace."

[0405] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0406] Step 1: Prompt Input and Emotion Recognition

[0407] User: Launches the dedicated application and smiles in front of the smartphone camera. In the case of voice input, the user speaks, "I'm feeling happy today," and in the case of text input, the user types, "Today is a wonderful day."

[0408] Input: User's facial expressions, voice, and text data

[0409] Terminal: The user's facial expression data captured by the camera, voice data collected by the microphone, and text data entered on the keyboard are temporarily stored in local storage.

[0410] Output: Collected facial expressions, voice, and text data

[0411] Terminal: Sends collected data to the server.

[0412] Input: Collected facial expressions, voice, and text data

[0413] Server: Analyzes the collected data using an emotion engine (e.g., emotion recognition algorithm) to identify the user's emotion.

[0414] Output: User's emotion (e.g., "Happy")

[0415] ---

[0416] Step 2: Generate and suggest prompts

[0417] Server: Generates appropriate prompts based on recognized emotion data (e.g., "happy").

[0418] Input: User emotion data

[0419] Server: For example, based on the emotion "happiness," generate prompts such as "a beautiful sunset" or "a fun festival scene."

[0420] Output: Generated prompt

[0421] Terminal: Presents the generated prompt to the user.

[0422] Input: Generated prompt

[0423] Output: The prompt displayed to the user

[0424] ---

[0425] Step 3: Sending prompts and generating images

[0426] User: Select from the provided prompts or enter their own prompt and press the "Generate" button.

[0427] Input: The prompt selected or entered by the user

[0428] Terminal: Sends selected or entered prompts to the server.

[0429] Output: Prompt sent

[0430] Server: Based on the received prompts, generates digital media using an image generation algorithm (e.g., OpenAI's DALL-E).

[0431] Input: prompt

[0432] Output: The digital medium produced

[0433] ---

[0434] Step 4: View and check the generated image

[0435] Server: Temporarily stores the generated digital media and metadata, and sends the URL to the user's device.

[0436] Input: Generated digital media and metadata

[0437] Output: URL and metadata of the digital media

[0438] Terminal: Using the received URL, the generated digital media is displayed to the user.

[0439] Input: URL of digital media

[0440] Output: The digital media displayed to the user

[0441] User: Check the generated digital media and if satisfied, press the "Upload as NFT" button.

[0442] ---

[0443] Step 5: Upload as an NFT

[0444] Terminal: Detects when the "Upload as NFT" button is pressed and sends the image data and metadata to the server.

[0445] Input: Image data and metadata

[0446] Output: Request sent to the server

[0447] Server: Based on the received request, uploads the digital media and metadata to an e-commerce platform (e.g., OpenSea) and initiates sales.

[0448] Input: Request, Digital Media, Metadata

[0449] Output: Upload status to e-commerce platform

[0450] ---

[0451] Step 6: Sales Process and Revenue Management

[0452] Server: Records sales start information in the system and notifies users that their NFTs are available for sale.

[0453] Input: Sales start information from e-commerce platform

[0454] Output:Available for sale notification

[0455] Server: Monitors sales in real time and records purchase information and revenue when an NFT is purchased.

[0456] Input: Sales Status

[0457] Output: Purchase information, revenue records

[0458] Server: Manages revenue as virtual currency and sends it to the user's wallet address.

[0459] Input: Revenue Data

[0460] Output: Send cryptocurrency to user wallet

[0461] ---

[0462] Step 7: Revenue sharing and donations

[0463] Agency: Converts virtual currency into fiat currency and donates it to welfare or charity organizations designated by the user.

[0464] Input: Cryptocurrency

[0465] Output: Fiat currency, donation process

[0466] Server: Notifies the user that the donation has been completed and stores all transaction logs within the system.

[0467] Input: Donation completion information

[0468] Output: Notifications, transaction log storage

[0469] (Application example 2)

[0470] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0471] Conventional digital art generation systems allow users to input prompts and generate images based on those prompts, but the system does not generate or suggest personalized prompts that take the user's emotions into account, resulting in a limited user experience. Furthermore, the process of selling the generated digital art as an NFT requires specialized knowledge, limiting the number of users.

[0472] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0473] In this invention, the server includes: a means for a user to input a prompt; a means for transmitting the input prompt to the server; a means for generating a digital image on the server using an image generation AI based on the prompt; a means for transmitting and displaying the generated digital image to the user's device; a means for uploading the generated digital image to a marketplace and selling it as an NFT; a means for managing sales revenue and donating a portion of the revenue to welfare or charity organizations; and a means for generating or suggesting personalized prompts using an emotion engine that recognizes the user's emotions. This enables users to easily create personalized digital art based on their own emotions, sell it as an NFT, and earn revenue.

[0474] "User" means an individual or entity that utilizes the system to enter prompts to create and sell digital art.

[0475] A "prompt" is an instruction, such as text, audio, or an image, that is entered by the user.

[0476] A "server" is a computer system that receives prompts and manages the generation, display, and sale of digital images.

[0477] "Image generation AI" is an artificial intelligence technology that automatically generates digital images based on input prompts.

[0478] "Digital Image" means image data of the created artwork in digital format.

[0479] A "terminal" is a device (e.g., smartphone, tablet) that a user uses to enter prompts and view generated digital images.

[0480] The "marketplace" is an online platform that sells the generated digital images as NFTs.

[0481] "NFT" stands for "Non-Fungible Token" and is a blockchain-based token that proves ownership of digital art or other digital content.

[0482] An "emotion engine" is a technology for recognizing and analyzing a user's emotions from facial expressions, voice, or text.

[0483] A "personalized prompt" is a specific prompt that is suggested based on the perceived sentiment of the user.

[0484] "Revenue" is the monetary gain from the sold NFT.

[0485] "Welfare and charity organizations" are organizations or groups that provide social assistance and relief activities.

[0486] "Virtual currency" is a digital currency traded online and is a different form of traditional physical currency.

[0487] This invention is a system that allows users to create digital art by entering prompts and sell it as NFTs. At the heart of the system is an emotion engine that recognizes the user's emotions, allowing it to generate or suggest personalized prompts.

[0488] The system uses the following major hardware and software components:

[0489] 1. Hardware

[0490] Terminal: A device (e.g., smartphone, tablet, smart glasses) on which a user enters prompts and displays the generated digital images.

[0491] Server: A computer system that receives prompts and manages the generation, display, and sale of digital images.

[0492] 2. Software

[0493] Emotion engine: A technology for recognizing emotions from a user's facial expressions, voice, or text. Examples include AWS® Rekognition and Google® Cloud Speech-to-Text.

[0494] Image generation AI: Artificial intelligence technology that automatically generates digital images based on input prompts, such as OpenAI's DALL-E.

[0495] NFT Marketplace: An online platform that sells generated digital images as NFTs. It can use OpenSea APIs and other APIs.

[0496] Virtual currency management system: A system for managing sales revenue as virtual currency and handling the cash conversion process.

[0497] 3. Examples of prompt sentences

[0498] "happiness"

[0499] "Beautiful sunset"

[0500] "A fun festival scene"

[0501] The system processing is described in detail below.

[0502] Prompt Input and Emotion Recognition

[0503] The user uses the device to make facial expressions, input voice, or input text in front of the camera. The device uses input devices such as a camera, microphone, and keyboard to collect the user's facial, voice, and text data and send it to the emotion engine. The emotion engine analyzes the collected data and recognizes the user's emotion. For example, if the user smiles, the emotion engine recognizes "happiness."

[0504] Prompt generation and suggestions

[0505] The device generates or suggests relevant prompts based on the emotion data obtained from the emotion engine. For example, if the emotion "happiness" is recognized, prompts such as "beautiful sunset" or "fun festival scenery" are suggested to the user.

[0506] Digital image generation and display

[0507] The user selects from suggested prompts or enters their own prompt. Then, by pressing the "Generate" button, the device sends the selected or entered prompt to the server. The server then sends the received prompt to an image generation AI, which generates a digital image. The generated digital image is temporarily stored by the server, and its URL and metadata are sent to the user's device. The device then displays the generated image based on the URL.

[0508] Converting images into NFTs and selling them

[0509] If the user is satisfied with the generated image, they press the "Upload as NFT" button. The device sends an upload request to the server, which uploads the image file and necessary metadata to the NFT marketplace. If the upload is successful, the image will be available for sale on the marketplace.

[0510] Revenue Management and Donations

[0511] The server tracks sales status in real time and manages the revenue as virtual currency, which is converted into fiat currency through a cash-out process, a portion of which is donated to welfare and charitable organizations.

[0512] In this way, the system allows users to easily create personalized, emotion-based digital art, sell it as an NFT, and earn revenue.

[0513] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0514] Step 1:

[0515] The user uses the device to make facial expressions, input voice, or input text in front of the camera. The device collects the user's facial expression, voice, and text data using input devices such as a camera, microphone, and keyboard.

[0516] Input: facial expression images, audio data, text data

[0517] Output: Collected user data

[0518] Step 2:

[0519] The device sends the collected user data to the emotion engine, which analyzes facial images using AWS Rekognition and converts the audio into text using Google Cloud Speech-to-Text. The analyzed data is used to recognize the user's emotions.

[0520] Input: Collected user data

[0521] Data processing: facial expression image analysis, voice data text conversion

[0522] Output: Recognized emotion data (e.g., happiness)

[0523] Step 3:

[0524] The device generates or suggests relevant prompts based on the recognized emotion data. For example, if the recognized emotion is "happiness," the device may suggest prompts such as "beautiful sunset" or "fun festival scenery" to the user.

[0525] Input: Recognized emotion data

[0526] Data generation: generating prompts that correspond to emotions

[0527] Output: A suggested prompt (e.g., "Beautiful sunset")

[0528] Step 4:

[0529] The user selects from the suggested prompts or enters their own prompt and presses the "Generate" button. The terminal sends the selected or entered prompt to the server.

[0530] Input: Suggested prompt or your own prompt

[0531] Output: Prompt data sent

[0532] Step 5:

[0533] The server sends the received prompt data to the image generation AI, which generates a digital image based on the prompt. The generated digital image is temporarily stored.

[0534] Input: Submitted prompt data

[0535] Data calculation: Digital image generation using image generation AI

[0536] Output: The generated digital image

[0537] Step 6:

[0538] The server sends the URL and metadata of the generated digital image to the terminal, which then displays the generated image to the user based on the URL.

[0539] Input: Generated digital image

[0540] Data processing: Image URL and metadata generation

[0541] Output: Image URL and metadata

[0542] Step 7:

[0543] If the user is satisfied with the generated image, they press the "Upload as NFT" button, and the device sends an upload request to the server.

[0544] Input: User upload request

[0545] Output: Upload request sent

[0546] Step 8:

[0547] The server uploads the image file and necessary metadata to the NFT marketplace, where, if the upload is successful, the image will be available for sale.

[0548] Input: Upload request sent

[0549] Data Calculation: Uploading image files and metadata

[0550] Output: Marketplace sales status

[0551] Step 9:

[0552] The server tracks sales status in real time and manages the revenue as virtual currency, which is converted into fiat currency through a cash-out process, a portion of which is donated to welfare and charitable organizations.

[0553] Input: Marketplace sales data

[0554] Data Computing: Revenue Management and Monetization Process

[0555] Output: Managed revenue and donation information

[0556] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0557] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0558] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0559] [Second embodiment]

[0560] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0561] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0562] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0563] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0564] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0565] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0566] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0567] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0568] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0569] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0570] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0571] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0572] The present invention relates to a system that allows users to easily create digital art by entering prompts and earn revenue by selling it as an NFT. This system is designed to be easily usable by users who do not have specialized knowledge of digital art, and even by users with physical disabilities.

[0573] Program processing details

[0574] 1. Prompt Input

[0575] Device: The user launches a dedicated application and enters text prompts about the digital art they want to create. For example, they can enter specific images such as "a beautiful sunset" or "a city of the near future."

[0576] 2. Sending prompts and generating images

[0577] Terminal: When the user presses the "Generate" button, the entered prompt is sent to the server. The server receives the prompt and generates digital art using image generation AI based on the prompt. In this process, the image generation AI internally analyzes the prompt and automatically creates the appropriate artwork.

[0578] 3. Displaying the generated image

[0579] Server: The generated digital image is temporarily stored on the server, and its URL and metadata are sent back to the user's device.

[0580] On the device: The user can check the generated image based on the URL sent to them. The image becomes viewable and the user can rate the generated art.

[0581] 4. Upload as an NFT

[0582] User: If the user is happy with the image, they press the "Upload as NFT" button.

[0583] Terminal: This operation sends an upload request to the server.

[0584] Server: The server receives the upload request and uploads the image file and any necessary metadata (e.g., title, description, category, etc.) to the NFT marketplace.

[0585] 5. Sales Procedures

[0586] Server: Uploaded NFTs are published on the marketplace and begin to be sold. The sales process is tracked in real time, and when a purchase is made, the information is recorded.

[0587] 6. Sales Tracking and Revenue Sharing

[0588] Server: When a sale is made, the revenue is managed and recorded in virtual currency. A portion of the revenue is automatically donated to welfare or charity organizations designated within the system.

[0589] Agent: Manages the cryptocurrency conversion process and converts it into fiat currency, ensuring that revenue is distributed appropriately to users and charities.

[0590] Specific examples

[0591] For example, if the user types the prompt "Beautiful sunset", the following happens:

[0592] 1. Prompt input:

[0593] User: Enters "Beautiful sunset" into the application.

[0594] 2. Sending prompts and generating images:

[0595] Terminal: Sends a prompt to the server.

[0596] Server: Receives prompts and the image generation AI generates digital art depicting a beautiful sunset.

[0597] 3. View the generated image:

[0598] Server: Sends the generated image URL and metadata to the device.

[0599] Terminal: Access the sent URL and display the generated image.

[0600] 4. Upload as an NFT:

[0601] User: Satisfied with the image, presses the "Upload as NFT" button.

[0602] Device: Sends an upload request to the server.

[0603] Server: Uploads images and metadata to the NFT marketplace.

[0604] 5. Sales Procedure:

[0605] Server: NFTs will be available for sale on the marketplace.

[0606] 6. Sales Tracking and Revenue Sharing:

[0607] Server: The sale is completed and revenue is recorded in virtual currency.

[0608] Agency: Virtual currency is converted into cash and a portion of the proceeds is donated to welfare or charity organizations.

[0609] This system allows users to easily create beautiful digital art, sell it as NFTs, and contribute to society at the same time.

[0610] The processing flow will be explained below.

[0611] Step 1:

[0612] User: Launches the dedicated application and enters a prompt text about the content of the digital art they want to generate. For example, the user enters the prompt "Beautiful sunset."

[0613] Step 2:

[0614] Terminal: After the user has finished entering the prompt, the terminal accepts the operation of pressing the "Generate" button, and then sends the entered prompt data to the server.

[0615] Step 3:

[0616] Server: Receives input prompts and provides them to the image generation AI, which analyzes the prompts and generates the appropriate digital images.

[0617] Step 4:

[0618] Server: Temporarily stores the generated digital image. Then, it generates a URL and metadata (title, description, creation date, etc.) for the image and sends them to the device.

[0619] Step 5:

[0620] Terminal: Based on the URL of the generated image received, the image is displayed to the user. The user checks the displayed image and, if satisfied, presses the "Upload as NFT" button.

[0621] Step 6:

[0622] Terminal: Detects when the "Upload as NFT" button is pressed and sends the user's operation to the server as an upload request.

[0623] Step 7:

[0624] Server: Receives upload requests, collects image files and necessary metadata, and uploads them to the NFT marketplace. If the upload is successful, the server confirms the start of sales on the marketplace.

[0625] Step 8:

[0626] Server: Records sales start information within the system and notifies users that their NFTs are available for sale.

[0627] Step 9:

[0628] Server: Tracks sales in real time and records purchase information and revenue when an NFT is purchased.

[0629] Step 10:

[0630] Server: Manages revenue as virtual currency and transfers the revenue information to a means that handles the cash-out process on your behalf.

[0631] Step 11:

[0632] Agents: These companies handle the process of converting virtual currency into fiat currency and donating a portion of the proceeds to designated welfare or charitable organizations.

[0633] Step 12:

[0634] Server: Records the completed donation information within the system and the user, and stores all transactions as a log.

[0635] The above steps establish a complete process from when a user enters the prompt, to when digital art is created and sold, and the proceeds are used for social contribution.

[0636] Example 1

[0637] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0638] Conventional digital art creation and sales systems require specialized knowledge, making them difficult for general users and users with physical disabilities to use. Furthermore, the procedures for selling digital art as NFTs are often complicated, and the revenue management and donation processes often require advanced knowledge. The present invention aims to solve these problems.

[0639] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0640] In this invention, the server includes: a means for a user to input a prompt; a means for transmitting the input prompt to the server; a means for generating a digital image on the server using a generative AI model based on the prompt; a means for transmitting and displaying the generated digital image to the user's terminal; a means for uploading the digital image generated by the user's operation to a marketplace and selling it as an NFT; a means for managing sales revenue in virtual currency and donating a portion of the revenue to welfare or charity organizations; a means for automatically performing the process of converting the revenue into cash; and a means for the prompt input means to provide the user with suggested prompts and samples. This enables users without specialized knowledge to easily create digital art and sell it as an NFT, and donate a portion of the revenue to welfare or charity organizations.

[0641] A "User" is someone who uses the system to enter prompts and generate digital art and sell it as an NFT.

[0642] A "prompt" is text information that a user inputs into a generative AI model, instructing it on the image and content of the digital art to be generated.

[0643] The "server" is a computer system that receives prompts, generates digital art using a generative AI model, and transmits the digital image to the user's device.

[0644] A "generative AI model" is an artificial intelligence program that contains algorithms that generate digital images based on input prompts, such as models like DALL-E and Midjourney.

[0645] "Digital Imagery" means computer graphics generated from prompts by a generative AI model.

[0646] A "terminal" is a device used by a user, such as a computer or smartphone, that has the functionality to communicate with a server.

[0647] "NFT" stands for "Non-Fungible Token" and is a token that manages digital assets such as digital art as unique items on the blockchain.

[0648] A "marketplace" is an online platform for buying and selling NFTs, such as OpenSea or Rarible.

[0649] "Virtual currency" refers to digital currencies that use blockchain technology to manage the trading and ownership of digital assets, including Bitcoin and Ethereum.

[0650] "Revenue" refers to the profits earned by users from the sale of NFTs.

[0651] The "conversion process" refers to the series of steps to convert virtual currency into legal tender.

[0652] "Welfare and charity organizations" is a general term for organizations that provide social assistance or charitable activities.

[0653] The present invention relates to a system that allows users to easily create digital art by entering prompts and earn revenue by selling it as an NFT. This system is designed to be easily usable by users who do not have specialized knowledge of digital art, and by users with physical disabilities.

[0654] Hardware and software used

[0655] Hardware:

[0656] User device: A device such as a computer or smartphone where the user enters the prompts and sees the results.

[0657] Server: A computer system that receives prompts, uses a generative AI model to generate digital art, and uploads it to the NFT marketplace.

[0658] software:

[0659] Generative AI model: An artificial intelligence program that contains algorithms for generating digital images based on input prompts. Examples include models such as DALL-E and Midjourney.

[0660] NFT marketplace: an online platform for selling generated digital art as NFTs. Examples include OpenSea and Rarible.

[0661] Program processing overview

[0662] Entering and submitting prompts

[0663] User:

[0664] The user launches a dedicated application and enters a prompt in text format about the digital art they want to create. Examples of prompts include images such as "a beautiful sunset" or "a city of the near future."

[0665] Device:

[0666] Validates the prompts entered by the user and sends them to the server in the appropriate format.

[0667] Image generation and transmission

[0668] server:

[0669] Receives prompts sent from the device and inputs them into a generative AI model (e.g., DALL-E or Midjourney).

[0670] An image generation AI model analyzes the prompts and automatically generates a digital image.

[0671] The generated digital image is saved as a temporary file and its URL and metadata are generated.

[0672] The image URL and metadata are sent to the user's device.

[0673] Displaying and evaluating the generated images

[0674] Device:

[0675] Receive the URL sent from the server, access the URL and display the generated image.

[0676] The user can review the displayed image and request regeneration or correction as needed.

[0677] Upload and sell as NFTs

[0678] User:

[0679] If you're happy with the generated image, press the "Upload as NFT" button.

[0680] Device:

[0681] Send an upload request to the server, including the image file and any necessary metadata (e.g. title, description, category, etc.).

[0682] server:

[0683] Receives upload requests and uploads image files and metadata to NFT marketplaces (e.g., OpenSea or Rarible).

[0684] Sales will begin as NFTs, and the progress of the buying and selling process will be tracked in real time, with purchase information recorded.

[0685] Once an NFT is sold, the proceeds are recorded in a cryptocurrency wallet, and a portion of the proceeds is automatically donated to designated welfare or charity organizations.

[0686] Agency:

[0687] It manages the cryptocurrency conversion process and converts it into fiat currency, ensuring that revenue is appropriately distributed to users and designated welfare and charity organizations.

[0688] As described above, this invention allows users to easily create digital art and sell it as NFTs without requiring specialized knowledge. It also provides a mechanism for donating a portion of the profits to welfare and charitable organizations, thereby contributing to society at the same time.

[0689] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0690] Step 1:

[0691] Entering Prompts

[0692] User: Launches a dedicated application and enters a prompt in text format about the digital art they want to create. For example, they can enter an image such as "a beautiful sunset" or "a city of the near future."

[0693] Input: The prompt text entered by the user.

[0694] Output: The prompt is displayed on the terminal.

[0695] Specific operation: The user enters a prompt sentence in the text box and presses the confirmation button.

[0696] Step 2:

[0697] Sending a prompt

[0698] Terminal: When the user presses the "Generate" button, the terminal validates the entered prompt and sends it in the appropriate format to the server, generating a data packet containing the prompt text and the user's identification information (e.g., user ID).

[0699] Input: The prompt text that the user entered and instructed to send.

[0700] Output: A data packet containing the prompt and the user ID is sent to the server.

[0701] Specific operation: Pressing a button sends a prompt, and a data packet is generated and sent.

[0702] Step 3:

[0703] Receiving prompts and generating images

[0704] Server: Receives prompts sent from the device and inputs them into a generative AI model (e.g., DALL-E or Midjourney). The image-generating AI model analyzes the prompts and automatically generates digital images.

[0705] Input: The prompt text and user ID sent.

[0706] Output: The digital image data and its metadata that are generated.

[0707] Specific operations: Prompt sentences are analyzed, images are generated, the generated image data is saved, and metadata is generated.

[0708] Step 4:

[0709] Sending the generated image

[0710] Server: Sends the URL and metadata of the generated digital image to the user's device. This data packet includes the URL of the temporary storage location for the image and the image metadata (e.g., creation time, image quality information, etc.).

[0711] Input: Generated digital image data and metadata.

[0712] Output: The data packets are sent to the user's terminal.

[0713] Specific operations: Temporarily save image data, generate a URL, and construct and send a data packet.

[0714] Step 5:

[0715] Displaying and evaluating the generated images

[0716] Terminal: Receives the URL sent from the server, accesses the URL, and displays the generated image. The user can check the displayed image and request regeneration or correction as necessary.

[0717] Input: URL and metadata received from the server.

[0718] Output: The generated image is displayed on the user's device.

[0719] Specific operation: Image data is acquired and displayed by accessing the URL.

[0720] Step 6:

[0721] Upload as an NFT

[0722] User: If satisfied with the generated image, press the "Upload as NFT" button.

[0723] Device: Sends an upload request to the server, which includes the image file and any necessary metadata (e.g., title, description, category, etc.).

[0724] Input: The image to be uploaded and its metadata.

[0725] Output: The upload request is sent to the server.

[0726] Specific operations: Image file and metadata are verified, and an upload data packet is created and sent.

[0727] Step 7:

[0728] Upload and sell images to the marketplace

[0729] Server: Receives the upload request, uploads the image file and metadata to an NFT marketplace (e.g., OpenSea or Rarible), obtains a public URL for the NFT, and returns it to the user.

[0730] Input: Uploaded image file and metadata.

[0731] Output: Public URL as NFT.

[0732] Specific operations: Data is sent to the marketplace, a public URL is obtained, and the URL is returned to the user.

[0733] Step 8:

[0734] Revenue Management and Distribution

[0735] Server: When an NFT sale is completed, the proceeds are recorded in a cryptocurrency wallet. Based on specific settings, a portion of the proceeds is donated to welfare or charity organizations.

[0736] Input: NFT sales completion information and revenue data.

[0737] Output: Recording of earnings and donations to cryptocurrency wallet.

[0738] Specific operations: Records sales data, manages virtual currency, and processes automatic donations.

[0739] Step 9:

[0740] Proxy handling of the cash conversion process

[0741] Agent: Manages the cash-out process, converts cryptocurrency into fiat currency, and distributes the cashed-out revenue appropriately to users and charities.

[0742] Input: User and charity revenue data.

[0743] Output: Distribution of redeemed fiat currency.

[0744] Specific operations: Virtual currency is converted into cash, converted into legal tender, and distributed.

[0745] By following these steps, users can easily create digital art and sell it as an NFT. This system also contributes to society by automatically donating a portion of the profits to welfare and charitable organizations.

[0746] (Application example 1)

[0747] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0748] Conventional systems for creating and selling digital art required specialized knowledge, limiting the user base. Furthermore, the ways in which the created digital art could be utilized were limited, particularly in content distribution services. Furthermore, the procedures for managing and allocating revenue from the created digital art were complicated, making them difficult for many users to use.

[0749] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0750] In this invention, the server includes a means for a user to input a prompt, a means for transmitting the input prompt to the server, a means for generating a digital image on the server using an image generation AI based on the prompt, a means for transmitting the generated digital image to the user's device and displaying it, a means for uploading the generated digital image to a distribution platform and distributing it as an album cover or background image, and a means for managing revenue from the distribution and donating a portion of the revenue to welfare or charitable organizations. This allows users without specialized knowledge to easily generate digital art and makes the art widely available in content distribution services. Furthermore, revenue management and distribution are automated, making the system easily accessible to many users.

[0751] A "prompt" is text that indicates instructions or requests that a user sends to a generative AI model.

[0752] The "server" is a central processing unit that receives prompts, runs the image generation AI, stores the generated images, and uploads them to the distribution platform.

[0753] "Image generation AI" is an artificial intelligence algorithm that automatically generates digital images based on user prompts.

[0754] A "digital image" is electronic visual data generated based on a user prompt.

[0755] A "terminal" is an electronic device that a user uses to enter prompts and view generated digital images.

[0756] A "distribution platform" is an online service that publishes and makes available to viewers the digital images generated.

[0757] An "album cover" is a digital image that visually represents a music album.

[0758] A "background visual" is a digital image used as a background on a distribution platform.

[0759] "Revenue" means the financial benefits derived from the distribution and sale of generated digital images and content.

[0760] A "welfare or charity organization" is a non-profit organization whose purpose is to donate a portion of its profits.

[0761] "Virtual currency" means electronic currency that exists in digital or virtual form and is used for transactions.

[0762] "Prompt suggestions and samples" are concrete examples and hints provided as reference to help users enter appropriate prompts.

[0763] The present invention relates to a system that allows users to easily create digital art by entering prompts and use it as album covers or background visuals on a distribution platform. This system is designed to be easy to use even for users who do not have specialized knowledge of digital art.

[0764] The server provides an interface for the user to enter a prompt. When the user enters a prompt, such as "an inspiring night sky, stars, or a dreamy theme," the prompt is sent to the server. The server processes the received prompt and generates a digital image using a generative AI model (e.g., DALL-E or MidJourney). The generated digital image is temporarily stored on the server, and a URL for the image is sent back to the user's device. The user can use this URL to view the generated image and make any necessary edits.

[0765] Once the user is satisfied with the generated digital image, they can press the "Distribute as content" button, which will upload the image to the distribution platform via the server. On the distribution platform, the generated digital image will be made public as an album cover or background visual.

[0766] Regarding revenue management, the server will track the usage of the distributed content in real time, and the revenue earned will be managed in virtual currency. The virtual currency conversion process will be handled by an agency, and a portion of the revenue will be donated to designated welfare and charitable organizations.

[0767] The specific system configuration and process are explained below. The user's device is an electronic device such as a smartphone, smart glasses, or head-mounted display (HMD), and prompt input is performed through a dedicated application installed on the device. This application is developed using programming languages ​​such as React Native, Swift, and Kotlin.

[0768] On the server side, server frameworks such as Node.js and Flask are used. DALL-E and MidJourney are used as image generation AI, and the generated digital images are temporarily stored in databases such as MongoDB and PostgreSQL. Music streaming services and video distribution services are used as distribution platforms.

[0769] For example, if a user inputs the prompt "Inspirational night sky, stars, dreamy theme," the image generation AI will generate digital art depicting a fantastic night sky based on this prompt. This generated digital art will be sent to the user's device, where the user can review and edit it, and then it will be uploaded to the distribution platform.

[0770] The above is a specific embodiment for carrying out the present invention, which makes it possible to easily create beautiful digital art without specialized knowledge and utilize it in a variety of content distribution services.

[0771] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0772] Step 1:

[0773] The user launches a dedicated application on their device and inputs a prompt in text form for the digital art they wish to create. This prompt might describe a specific image, such as "an inspiring night sky, stars, or a dreamlike theme." The user enters the prompt and presses the send button to generate the input data.

[0774] Step 2:

[0775] The terminal sends the entered prompt text to the server. In this sending process, an API request including the prompt text is generated and an HTTP request is made to the server. The input data is mainly the prompt text.

[0776] Step 3:

[0777] The server analyzes the received prompt and generates a digital image based on the prompt using image generation AI (e.g., DALL-E, MidJourney). The generative AI model understands the content of the prompt and performs data calculations to generate digital art in accordance with it. The input here is the prompt, and the output is a digital image.

[0778] Step 4:

[0779] The server temporarily stores the generated digital image and generates a URL and metadata for the image. The URL and metadata for the stored digital image are generated on the server side. The metadata includes the image title and description. The output is the URL and metadata for the digital image.

[0780] Step 5:

[0781] The server returns the URL and metadata of the generated image to the user's device, which receives this information and accesses it to display the image. The input is the URL and metadata from the server, and the output is the display of the image.

[0782] Step 6:

[0783] The user checks the generated digital image and edits it as necessary. When the image is satisfactory, the user presses the "Distribute as content" button. This operation confirms the edited image data. The input is the edited content of the image, and the output is the confirmed image data.

[0784] Step 7:

[0785] The terminal sends the confirmed image data to the server again. At this stage, an image data upload request is generated and sent to the server. The input is the confirmed image data, and the output is the upload request.

[0786] Step 8:

[0787] The server uploads the received image data to the distribution platform. Specifically, it uploads the image data using the distribution platform's API and publishes it as an album cover or background visual. The input is the confirmed image data, and the output is the upload result to the distribution platform.

[0788] Step 9:

[0789] The server tracks the usage of digital images on the distribution platform in real time and records and manages the revenue generated. In this process, revenue data is managed in virtual currency. The input is usage data, and the output is revenue record data.

[0790] Step 10:

[0791] When revenue is generated, the server requests an agent to process the virtual currency to be converted into cash. The agent converts the virtual currency and donates a portion of the revenue to a designated welfare or charity organization. The input is the virtual currency data of the revenue, and the output is the converted revenue and the fulfillment of the donation.

[0792] The above steps enable users to easily create digital art and use it widely in content distribution services. In addition, revenue management and distribution are automated, making the system easy to use for many users.

[0793] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0794] This invention relates to a system that allows users to easily create digital art by entering prompts, then sell it as NFTs and earn revenue. In particular, by combining it with an emotion engine that recognizes the user's emotions, more personalized prompt generation and suggestions can be generated, improving the user experience. This system is designed to be easily usable by users without specialized knowledge of digital art or users with physical disabilities.

[0795] Program processing details

[0796] 1. Prompt Input and Emotion Recognition

[0797] User: Launches a dedicated application and uses facial expressions, voice, or text input. For example, the user might smile in front of the smartphone camera, say "I'm feeling happy today," or type "Today is a wonderful day."

[0798] Terminal: Collects the user's facial expression, voice, and text data using input devices such as a camera, microphone, and keyboard.

[0799] Emotion engine: Analyzes collected data and recognizes the user's emotions. For example, it can recognize "happiness" as an emotion from the user's smile or voice.

[0800] 2. Prompt generation and suggestions

[0801] Terminal: Based on the emotion data obtained from the emotion engine, the prompt input means provides suggestions and samples. For example, if the emotion "happiness" is recognized, prompts such as "beautiful sunset" and "fun festival scenery" will be suggested.

[0802] 3. Sending prompts and generating images

[0803] User: Choose from suggested prompts or enter the text of their own prompt, then press the "Generate" button.

[0804] Terminal: Sends selected or entered prompts to the server.

[0805] Server: Receives prompts and the image generation AI generates digital images based on them.

[0806] 4. Display and check the generated image

[0807] Server: Temporarily stores the generated digital image and sends its URL and metadata to the user's device.

[0808] Terminal: The generated image is displayed based on the sent URL. The user checks the displayed image and, if satisfied, presses the "Upload as NFT" button.

[0809] 5. Upload as an NFT

[0810] Terminal: Detects when the "Upload as NFT" button is pressed and sends an upload request to the server.

[0811] Server: Receives the upload request and uploads the image file and necessary metadata to the NFT marketplace. If the upload is successful, the server confirms the start of sales on the marketplace.

[0812] 6. Sales procedures and revenue management

[0813] Server: Records sales start information in the system and notifies users that NFTs are available for sale. Tracks sales in real time and records purchase information and revenue when NFTs are purchased.

[0814] Server: Manages revenue as virtual currency and transfers the revenue information to a means that handles the cash-out process on your behalf.

[0815] 7. Revenue Sharing and Donations

[0816] Agents: These companies handle the process of converting virtual currency into fiat currency and donating a portion of the proceeds to designated welfare or charitable organizations.

[0817] Server: Records the completed donation information within the system and the user, and stores all transactions as a log.

[0818] Specific examples

[0819] For example, if a user launches an application and smiles into the smartphone camera, the following steps are performed:

[0820] 1. Prompt Input and Emotion Recognition

[0821] Device: The smartphone camera captures the user's smile.

[0822] Emotion engine: Analyzes collected facial image data and recognizes the user's emotion as "happiness."

[0823] 2. Prompt generation and suggestions

[0824] Terminal: Based on the emotion "happiness," the system suggests prompts to the user, such as "beautiful sunset" or "fun festival scenery."

[0825] 3. Sending prompts and generating images

[0826] User: Selects the prompt "Beautiful Sunset" and presses the "Generate" button.

[0827] Terminal: Sends the selected prompt to the server.

[0828] Server: Receives the prompt and the image generation AI generates a digital image depicting a "beautiful sunset."

[0829] 4. Display and check the generated image

[0830] Server: Sends the generated images and their metadata to the device.

[0831] Terminal: Display the image to the user and ask them to confirm.

[0832] 5. Upload as an NFT

[0833] User: Satisfied with the image, presses the "Upload as NFT" button.

[0834] Device: Sends an upload request to the server.

[0835] Server: Upload images to the NFT marketplace and start selling.

[0836] 6. Sales procedures and revenue management

[0837] Server: Track sales status in real time and manage revenue as virtual currency.

[0838] 7. Revenue Sharing and Donations

[0839] Agency: Converts revenue into fiat currency and donates a portion to welfare or charity organizations.

[0840] This allows users to create digital art in an easy and personalized way, sell it as an NFT, and use the proceeds to contribute to society.

[0841] The processing flow will be explained below.

[0842] Program processing details

[0843] Step 1:

[0844] User: Launch the dedicated application, smile in front of the smartphone camera, and capture your facial expression. You can also choose to input using voice or text. For example, you can say, "I'm feeling happy today," or input using text, "Today is a wonderful day."

[0845] Step 2:

[0846] Terminal: Collects the user's facial expressions, voice, and text data using input devices such as a camera, microphone, and keyboard. Prepares to send this data to the emotion engine.

[0847] Step 3:

[0848] Emotion engine: Analyzes collected data and recognizes the user's emotions. For example, it can recognize "happiness" as an emotion from the user's smile or voice.

[0849] Step 4:

[0850] Terminal: Based on the emotion data obtained from the emotion engine, the prompt input means provides suggestions and samples. For example, if the emotion "happiness" is recognized, prompts such as "beautiful sunset" and "fun festival scenery" will be suggested.

[0851] Step 5:

[0852] User: Choose from suggested prompts or enter the text of their own prompt, then press the "Generate" button.

[0853] Step 6:

[0854] Terminal: Sends the selected or entered prompt to the server, formatting the prompt data appropriately before sending it.

[0855] Step 7:

[0856] Server: Receives the prompt and provides it to the image generation AI, which analyzes the prompt and generates the appropriate digital image.

[0857] Step 8:

[0858] Server: Temporarily stores the generated digital image. Then, it generates a URL and metadata (title, description, creation date, etc.) for the image and sends them to the device.

[0859] Step 9:

[0860] Terminal: Based on the URL of the generated image received, the image is displayed to the user. The user checks the displayed image and, if satisfied, presses the "Upload as NFT" button.

[0861] Step 10:

[0862] Device: Detects when the "Upload as NFT" button is pressed and sends an upload request to the server, including the image file and any necessary metadata.

[0863] Step 11:

[0864] Server: Receives the upload request and uploads the image file and necessary metadata to the NFT marketplace. If the upload is successful, the server confirms the start of sales on the marketplace.

[0865] Step 12:

[0866] Server: Records sales start information within the system and notifies users that their NFTs are available for sale.

[0867] Step 13:

[0868] Server: Tracks sales in real time, records the purchase information and revenue when an NFT is purchased, and records cryptocurrency revenue in the system.

[0869] Step 14:

[0870] Server: Manages revenue as virtual currency and transfers the revenue information to a means that handles the cash-out process on your behalf.

[0871] Step 15:

[0872] Agents: These companies handle the process of converting virtual currency into fiat currency and donating a portion of the proceeds to designated welfare or charitable organizations.

[0873] Step 16:

[0874] Server: Records the completed donation information within the system and the user, and stores all transactions as a log.

[0875] Specific examples

[0876] For example, if a user launches an application and smiles into the smartphone camera, the following steps are performed:

[0877] Step 1:

[0878] User: Speaks to the application, "I'm feeling happy today."

[0879] Step 2:

[0880] Device: The smartphone's microphone captures the user's voice.

[0881] Step 3:

[0882] Emotion engine: Analyzes collected voice data and recognizes the user's emotion as "happiness."

[0883] Step 4:

[0884] Terminal: Based on the emotion "happiness," the system suggests prompts to the user, such as "beautiful sunset" or "fun festival scenery."

[0885] Step 5:

[0886] User: Selects the prompt "Beautiful Sunset" and presses the "Generate" button.

[0887] Step 6:

[0888] Terminal: Sends the selected prompt to the server.

[0889] Step 7:

[0890] Server: Receives the prompt and the image generation AI generates a digital image depicting a "beautiful sunset."

[0891] Step 8:

[0892] Server: Sends the generated images and their metadata to the device.

[0893] Step 9:

[0894] Terminal: Display the image to the user and ask them to confirm.

[0895] Step 10:

[0896] User: Satisfied with the image, presses the "Upload as NFT" button.

[0897] Step 11:

[0898] Device: Sends an upload request to the server.

[0899] Step 12:

[0900] Server: Upload images to the NFT marketplace and start selling.

[0901] Step 13:

[0902] Server: Track sales status in real time and manage revenue as virtual currency.

[0903] Step 14:

[0904] Server: Carries out the procedures to process the cash-out process.

[0905] Step 15:

[0906] Agency: Converts revenue into fiat currency and donates a portion to welfare or charity organizations.

[0907] Step 16:

[0908] Server: Records donation information and keeps a log of all transactions.

[0909] In this way, users can easily create digital art and use the proceeds from selling it as an NFT to contribute to society.

[0910] Example 2

[0911] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0912] Conventional digital art generation systems require users to input prompts, generate digital images based on those prompts, and sell them as NFTs, resulting in a complicated process. Furthermore, they lack the ability to generate personalized prompts using emotion recognition, which hinders the user experience. Furthermore, the process of managing revenue and donating to welfare or charitable organizations is also complicated.

[0913] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0914] In this invention, the server includes means for a user to input a prompt, means for transmitting the input prompt, means for generating digital media using an image generation algorithm, means for transmitting the generated digital media to a user terminal and displaying it, means for uploading the digital media to an e-commerce platform and selling it as a digital asset, means for managing revenue and donating it to welfare or charity organizations, means for analyzing facial expressions, voice, and text data to recognize emotions, and means for generating and suggesting prompts based on the recognized emotions, thereby improving the user experience and simplifying the revenue management and donation process.

[0915] A "prompt" is a sentence or word entered by a user that represents an instruction or request.

[0916] A "server" is a computer system that provides services to other computers on a network.

[0917] A "terminal" is a computer device or apparatus that is operated by a user.

[0918] An "image generation algorithm" is a method or procedure for automatically generating a digital image based on specified prompts.

[0919] "Digital media" refers to content such as images and video that is electronically generated and stored.

[0920] An "e-commerce platform" is a web service or application for buying and selling goods over the Internet.

[0921] A "digital asset" is any property stored in digital form that is data of value that can be owned or sold.

[0922] An "emotion engine" is a technology or system that analyzes a user's facial expressions, voice, and text data to identify emotions.

[0923] "Revenue" means the profit earned when a Digital Asset is sold.

[0924] "Virtual currency" means a digital or virtual currency whose transactions are governed by cryptography.

[0925] "Welfare and charity organizations" are organizations and groups that contribute to society and provide humanitarian aid.

[0926] A "suggestion" is a prompt or idea presented to the user.

[0927] The present invention relates to a system that allows users to easily create digital art by entering prompts, sell the resulting digital art as digital assets, and earn revenue. In particular, by combining it with an emotion engine that recognizes the user's emotions, more personalized prompt generation and suggestions can be generated, improving the user experience. This system is designed to be easily usable by users who do not have specialized knowledge of digital art or who have physical disabilities. Specifically, the system is implemented as follows.

[0928] First, a user launches a dedicated application and smiles at the smartphone camera, speaks into the microphone saying "I'm feeling happy today," or types "It's a nice day today" into a text field. The hardware used here is the smartphone's input devices, such as the camera, microphone, and keyboard.

[0929] The device uses input devices such as a camera, microphone, and keyboard to collect the user's facial expressions, voice, and text data. The collected data is temporarily stored locally and then sent to a server. The server uses an emotion engine (e.g., an emotion recognition algorithm) to analyze the collected data and recognize the user's emotions. Specifically, the emotion engine can use existing emotion recognition technologies such as Microsoft Azure's Face API and IBM Watson's Tone Analyzer.

[0930] The server generates multiple prompts based on the recognized emotion data and sends them to the device. For example, if the emotion "happiness" is recognized, prompts such as a beautiful sunset or a fun festival scene may be generated. The device then presents the generated prompts to the user, who can then select from the suggested prompts or enter their own prompt by text.

[0931] When the user selects or enters a prompt and presses the "Generate" button, the device sends the prompt to the server. The server uses an image generation algorithm (e.g., OpenAI's DALL-E) based on the received prompt to generate a digital media. The generated digital media is temporarily stored, and its URL and metadata are sent to the user's device.

[0932] The device displays the digital media generated based on the URL and prompts the user for confirmation. If the user is satisfied with the generated digital media, they press the "Upload as NFT" button. This causes the device to send an upload request to the server, which then uploads the image and metadata to an NFT marketplace (e.g., OpenSea) and begins selling it.

[0933] The server records the sales status within the system and notifies the user that the NFT is available for sale. It also monitors the sales situation in real time and records purchase information and revenue. The revenue is managed as virtual currency and sent to the user's wallet address. The agency converts the revenue into fiat currency and donates it to a welfare or charity organization designated by the user. This process is managed by the server, which notifies the user when the donation is complete and stores all transaction logs.

[0934] For example, if a user launches the application and smiles into the smartphone camera, the emotion engine will recognize the expression as "happiness" and suggest a prompt such as "beautiful sunset." The user can then select the prompt and press the "Generate" button, which will generate a digital image using the image generation algorithm.

[0935] Example prompt sentence:

[0936] "Prompt: Please walk me through the steps to capture a photo of a smiling face, generate digital art that expresses happiness, and upload it to an NFT marketplace."

[0937] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0938] Step 1: Prompt Input and Emotion Recognition

[0939] User: Launches the dedicated application and smiles in front of the smartphone camera. In the case of voice input, the user speaks, "I'm feeling happy today," and in the case of text input, the user types, "Today is a wonderful day."

[0940] Input: User's facial expressions, voice, and text data

[0941] Terminal: The user's facial expression data captured by the camera, voice data collected by the microphone, and text data entered on the keyboard are temporarily stored in local storage.

[0942] Output: Collected facial expressions, voice, and text data

[0943] Terminal: Sends collected data to the server.

[0944] Input: Collected facial expressions, voice, and text data

[0945] Server: Analyzes the collected data using an emotion engine (e.g., emotion recognition algorithm) to identify the user's emotion.

[0946] Output: User's emotion (e.g., "Happy")

[0947] ---

[0948] Step 2: Generate and suggest prompts

[0949] Server: Generates appropriate prompts based on recognized emotion data (e.g., "happy").

[0950] Input: User emotion data

[0951] Server: For example, based on the emotion "happiness," generate prompts such as "a beautiful sunset" or "a fun festival scene."

[0952] Output: Generated prompt

[0953] Terminal: Presents the generated prompt to the user.

[0954] Input: Generated prompt

[0955] Output: The prompt displayed to the user

[0956] ---

[0957] Step 3: Sending prompts and generating images

[0958] User: Select from the provided prompts or enter their own prompt and press the "Generate" button.

[0959] Input: The prompt selected or entered by the user

[0960] Terminal: Sends selected or entered prompts to the server.

[0961] Output: Prompt sent

[0962] Server: Based on the received prompts, generates digital media using an image generation algorithm (e.g., OpenAI's DALL-E).

[0963] Input: prompt

[0964] Output: The digital medium produced

[0965] ---

[0966] Step 4: View and check the generated image

[0967] Server: Temporarily stores the generated digital media and metadata, and sends the URL to the user's device.

[0968] Input: Generated digital media and metadata

[0969] Output: URL and metadata of the digital media

[0970] Terminal: Using the received URL, the generated digital media is displayed to the user.

[0971] Input: URL of digital media

[0972] Output: The digital media displayed to the user

[0973] User: Check the generated digital media and if satisfied, press the "Upload as NFT" button.

[0974] ---

[0975] Step 5: Upload as an NFT

[0976] Terminal: Detects when the "Upload as NFT" button is pressed and sends the image data and metadata to the server.

[0977] Input: Image data and metadata

[0978] Output: Request sent to the server

[0979] Server: Based on the received request, uploads the digital media and metadata to an e-commerce platform (e.g., OpenSea) and initiates sales.

[0980] Input: Request, Digital Media, Metadata

[0981] Output: Upload status to e-commerce platform

[0982] ---

[0983] Step 6: Sales Process and Revenue Management

[0984] Server: Records sales start information in the system and notifies users that their NFTs are available for sale.

[0985] Input: Sales start information from e-commerce platform

[0986] Output:Available for sale notification

[0987] Server: Monitors sales in real time and records purchase information and revenue when an NFT is purchased.

[0988] Input: Sales Status

[0989] Output: Purchase information, revenue records

[0990] Server: Manages revenue as virtual currency and sends it to the user's wallet address.

[0991] Input: Revenue Data

[0992] Output: Send cryptocurrency to user wallet

[0993] ---

[0994] Step 7: Revenue sharing and donations

[0995] Agency: Converts virtual currency into fiat currency and donates it to welfare or charity organizations designated by the user.

[0996] Input: Cryptocurrency

[0997] Output: Fiat currency, donation process

[0998] Server: Notifies the user that the donation has been completed and stores all transaction logs within the system.

[0999] Input: Donation completion information

[1000] Output: Notifications, transaction log storage

[1001] (Application example 2)

[1002] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1003] Conventional digital art generation systems allow users to input prompts and generate images based on those prompts, but the system does not generate or suggest personalized prompts that take the user's emotions into account, resulting in a limited user experience. Furthermore, the process of selling the generated digital art as an NFT requires specialized knowledge, limiting the number of users.

[1004] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1005] In this invention, the server includes: a means for a user to input a prompt; a means for transmitting the input prompt to the server; a means for generating a digital image on the server using an image generation AI based on the prompt; a means for transmitting and displaying the generated digital image to the user's device; a means for uploading the generated digital image to a marketplace and selling it as an NFT; a means for managing sales revenue and donating a portion of the revenue to welfare or charity organizations; and a means for generating or suggesting personalized prompts using an emotion engine that recognizes the user's emotions. This enables users to easily create personalized digital art based on their own emotions, sell it as an NFT, and earn revenue.

[1006] "User" means an individual or entity that utilizes the system to enter prompts to create and sell digital art.

[1007] A "prompt" is an instruction, such as text, audio, or an image, that is entered by the user.

[1008] A "server" is a computer system that receives prompts and manages the generation, display, and sale of digital images.

[1009] "Image generation AI" is an artificial intelligence technology that automatically generates digital images based on input prompts.

[1010] "Digital Image" means image data of the created artwork in digital format.

[1011] A "terminal" is a device (e.g., smartphone, tablet) that a user uses to enter prompts and view generated digital images.

[1012] The "marketplace" is an online platform that sells the generated digital images as NFTs.

[1013] "NFT" stands for "Non-Fungible Token" and is a blockchain-based token that proves ownership of digital art or other digital content.

[1014] An "emotion engine" is a technology for recognizing and analyzing a user's emotions from facial expressions, voice, or text.

[1015] A "personalized prompt" is a specific prompt that is suggested based on the perceived sentiment of the user.

[1016] "Revenue" is the monetary gain from the sold NFT.

[1017] "Welfare and charity organizations" are organizations or groups that provide social assistance and relief activities.

[1018] "Virtual currency" is a digital currency traded online and is a different form of traditional physical currency.

[1019] This invention is a system that allows users to create digital art by entering prompts and sell it as NFTs. At the heart of the system is an emotion engine that recognizes the user's emotions, allowing it to generate or suggest personalized prompts.

[1020] The system uses the following major hardware and software components:

[1021] 1. Hardware

[1022] Terminal: A device (e.g., smartphone, tablet, smart glasses) on which a user enters prompts and displays the generated digital images.

[1023] Server: A computer system that receives prompts and manages the generation, display, and sale of digital images.

[1024] 2. Software

[1025] Emotion engine: A technology for recognizing emotions from a user's facial expressions, voice, or text. Examples include AWS Rekognition and Google Cloud Speech-to-Text.

[1026] Image generation AI: Artificial intelligence technology that automatically generates digital images based on input prompts, such as OpenAI's DALL-E.

[1027] NFT Marketplace: An online platform that sells generated digital images as NFTs. It can use OpenSea APIs and other APIs.

[1028] Virtual currency management system: A system for managing sales revenue as virtual currency and handling the cash conversion process.

[1029] 3. Examples of prompt sentences

[1030] "happiness"

[1031] "Beautiful sunset"

[1032] "A fun festival scene"

[1033] The system processing is described in detail below.

[1034] Prompt Input and Emotion Recognition

[1035] The user uses the device to make facial expressions, input voice, or input text in front of the camera. The device uses input devices such as a camera, microphone, and keyboard to collect the user's facial, voice, and text data and send it to the emotion engine. The emotion engine analyzes the collected data and recognizes the user's emotion. For example, if the user smiles, the emotion engine recognizes "happiness."

[1036] Prompt generation and suggestions

[1037] The device generates or suggests relevant prompts based on the emotion data obtained from the emotion engine. For example, if the emotion "happiness" is recognized, prompts such as "beautiful sunset" or "fun festival scenery" are suggested to the user.

[1038] Digital image generation and display

[1039] The user selects from suggested prompts or enters their own prompt. Then, by pressing the "Generate" button, the device sends the selected or entered prompt to the server. The server then sends the received prompt to an image generation AI, which generates a digital image. The generated digital image is temporarily stored by the server, and its URL and metadata are sent to the user's device. The device then displays the generated image based on the URL.

[1040] Converting images into NFTs and selling them

[1041] If the user is satisfied with the generated image, they press the "Upload as NFT" button. The device sends an upload request to the server, which uploads the image file and necessary metadata to the NFT marketplace. If the upload is successful, the image will be available for sale on the marketplace.

[1042] Revenue Management and Donations

[1043] The server tracks sales status in real time and manages the revenue as virtual currency, which is converted into fiat currency through a cash-out process, a portion of which is donated to welfare and charitable organizations.

[1044] In this way, the system allows users to easily create personalized, emotion-based digital art, sell it as an NFT, and earn revenue.

[1045] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1046] Step 1:

[1047] The user uses the device to make facial expressions, input voice, or input text in front of the camera. The device collects the user's facial expression, voice, and text data using input devices such as a camera, microphone, and keyboard.

[1048] Input: facial expression images, audio data, text data

[1049] Output: Collected user data

[1050] Step 2:

[1051] The device sends the collected user data to the emotion engine, which analyzes facial images using AWS Rekognition and converts the audio into text using Google Cloud Speech-to-Text. The analyzed data is used to recognize the user's emotions.

[1052] Input: Collected user data

[1053] Data processing: facial expression image analysis, voice data text conversion

[1054] Output: Recognized emotion data (e.g., happiness)

[1055] Step 3:

[1056] The device generates or suggests relevant prompts based on the recognized emotion data. For example, if the recognized emotion is "happiness," the device may suggest prompts such as "beautiful sunset" or "fun festival scenery" to the user.

[1057] Input: Recognized emotion data

[1058] Data generation: generating prompts that correspond to emotions

[1059] Output: A suggested prompt (e.g., "Beautiful sunset")

[1060] Step 4:

[1061] The user selects from the suggested prompts or enters their own prompt and presses the "Generate" button. The terminal sends the selected or entered prompt to the server.

[1062] Input: Suggested prompt or your own prompt

[1063] Output: Prompt data sent

[1064] Step 5:

[1065] The server sends the received prompt data to the image generation AI, which generates a digital image based on the prompt. The generated digital image is temporarily stored.

[1066] Input: Submitted prompt data

[1067] Data calculation: Digital image generation using image generation AI

[1068] Output: The generated digital image

[1069] Step 6:

[1070] The server sends the URL and metadata of the generated digital image to the terminal, which then displays the generated image to the user based on the URL.

[1071] Input: Generated digital image

[1072] Data processing: Image URL and metadata generation

[1073] Output: Image URL and metadata

[1074] Step 7:

[1075] If the user is satisfied with the generated image, they press the "Upload as NFT" button, and the device sends an upload request to the server.

[1076] Input: User upload request

[1077] Output: Upload request sent

[1078] Step 8:

[1079] The server uploads the image file and necessary metadata to the NFT marketplace, where, if the upload is successful, the image will be available for sale.

[1080] Input: Upload request sent

[1081] Data Calculation: Uploading image files and metadata

[1082] Output: Marketplace sales status

[1083] Step 9:

[1084] The server tracks sales status in real time and manages the revenue as virtual currency, which is converted into fiat currency through a cash-out process, a portion of which is donated to welfare and charitable organizations.

[1085] Input: Marketplace sales data

[1086] Data Computing: Revenue Management and Monetization Process

[1087] Output: Managed revenue and donation information

[1088] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1089] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1090] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1091] [Third embodiment]

[1092] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1093] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1094] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1095] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1096] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1097] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1098] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1099] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1100] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1101] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1102] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1103] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1104] The present invention relates to a system that allows users to easily create digital art by entering prompts and earn revenue by selling it as an NFT. This system is designed to be easily usable by users who do not have specialized knowledge of digital art, and even by users with physical disabilities.

[1105] Program processing details

[1106] 1. Prompt Input

[1107] Device: The user launches a dedicated application and enters text prompts about the digital art they want to create. For example, they can enter specific images such as "a beautiful sunset" or "a city of the near future."

[1108] 2. Sending prompts and generating images

[1109] Terminal: When the user presses the "Generate" button, the entered prompt is sent to the server. The server receives the prompt and generates digital art using image generation AI based on the prompt. In this process, the image generation AI internally analyzes the prompt and automatically creates the appropriate artwork.

[1110] 3. Displaying the generated image

[1111] Server: The generated digital image is temporarily stored on the server, and its URL and metadata are sent back to the user's device.

[1112] On the device: The user can check the generated image based on the URL sent to them. The image becomes viewable and the user can rate the generated art.

[1113] 4. Upload as an NFT

[1114] User: If the user is happy with the image, they press the "Upload as NFT" button.

[1115] Terminal: This operation sends an upload request to the server.

[1116] Server: The server receives the upload request and uploads the image file and any necessary metadata (e.g., title, description, category, etc.) to the NFT marketplace.

[1117] 5. Sales Procedures

[1118] Server: Uploaded NFTs are published on the marketplace and begin to be sold. The sales process is tracked in real time, and when a purchase is made, the information is recorded.

[1119] 6. Sales Tracking and Revenue Sharing

[1120] Server: When a sale is made, the revenue is managed and recorded in virtual currency. A portion of the revenue is automatically donated to welfare or charity organizations designated within the system.

[1121] Agent: Manages the cryptocurrency conversion process and converts it into fiat currency, ensuring that revenue is distributed appropriately to users and charities.

[1122] Specific examples

[1123] For example, if the user types the prompt "Beautiful sunset", the following happens:

[1124] 1. Prompt input:

[1125] User: Enters "Beautiful sunset" into the application.

[1126] 2. Sending prompts and generating images:

[1127] Terminal: Sends a prompt to the server.

[1128] Server: Receives prompts and the image generation AI generates digital art depicting a beautiful sunset.

[1129] 3. View the generated image:

[1130] Server: Sends the generated image URL and metadata to the device.

[1131] Terminal: Access the sent URL and display the generated image.

[1132] 4. Upload as an NFT:

[1133] User: Satisfied with the image, presses the "Upload as NFT" button.

[1134] Device: Sends an upload request to the server.

[1135] Server: Uploads images and metadata to the NFT marketplace.

[1136] 5. Sales Procedure:

[1137] Server: NFTs will be available for sale on the marketplace.

[1138] 6. Sales Tracking and Revenue Sharing:

[1139] Server: The sale is completed and revenue is recorded in virtual currency.

[1140] Agency: Virtual currency is converted into cash and a portion of the proceeds is donated to welfare or charity organizations.

[1141] This system allows users to easily create beautiful digital art, sell it as NFTs, and contribute to society at the same time.

[1142] The processing flow will be explained below.

[1143] Step 1:

[1144] User: Launches the dedicated application and enters a prompt text about the content of the digital art they want to generate. For example, the user enters the prompt "Beautiful sunset."

[1145] Step 2:

[1146] Terminal: After the user has finished entering the prompt, the terminal accepts the operation of pressing the "Generate" button, and then sends the entered prompt data to the server.

[1147] Step 3:

[1148] Server: Receives input prompts and provides them to the image generation AI, which analyzes the prompts and generates the appropriate digital images.

[1149] Step 4:

[1150] Server: Temporarily stores the generated digital image. Then, it generates a URL and metadata (title, description, creation date, etc.) for the image and sends them to the device.

[1151] Step 5:

[1152] Terminal: Based on the URL of the generated image received, the image is displayed to the user. The user checks the displayed image and, if satisfied, presses the "Upload as NFT" button.

[1153] Step 6:

[1154] Terminal: Detects when the "Upload as NFT" button is pressed and sends the user's operation to the server as an upload request.

[1155] Step 7:

[1156] Server: Receives upload requests, collects image files and necessary metadata, and uploads them to the NFT marketplace. If the upload is successful, the server confirms the start of sales on the marketplace.

[1157] Step 8:

[1158] Server: Records sales start information within the system and notifies users that their NFTs are available for sale.

[1159] Step 9:

[1160] Server: Tracks sales in real time and records purchase information and revenue when an NFT is purchased.

[1161] Step 10:

[1162] Server: Manages revenue as virtual currency and transfers the revenue information to a means that handles the cash-out process on your behalf.

[1163] Step 11:

[1164] Agents: These companies handle the process of converting virtual currency into fiat currency and donating a portion of the proceeds to designated welfare or charitable organizations.

[1165] Step 12:

[1166] Server: Records the completed donation information within the system and the user, and stores all transactions as a log.

[1167] The above steps establish a complete process from when a user enters the prompt, to when digital art is created and sold, and the proceeds are used for social contribution.

[1168] Example 1

[1169] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1170] Conventional digital art creation and sales systems require specialized knowledge, making them difficult for general users and users with physical disabilities to use. Furthermore, the procedures for selling digital art as NFTs are often complicated, and the revenue management and donation processes often require advanced knowledge. The present invention aims to solve these problems.

[1171] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1172] In this invention, the server includes: a means for a user to input a prompt; a means for transmitting the input prompt to the server; a means for generating a digital image on the server using a generative AI model based on the prompt; a means for transmitting and displaying the generated digital image to the user's terminal; a means for uploading the digital image generated by the user's operation to a marketplace and selling it as an NFT; a means for managing sales revenue in virtual currency and donating a portion of the revenue to welfare or charity organizations; a means for automatically performing the process of converting the revenue into cash; and a means for the prompt input means to provide the user with suggested prompts and samples. This enables users without specialized knowledge to easily create digital art and sell it as an NFT, and donate a portion of the revenue to welfare or charity organizations.

[1173] A "User" is someone who uses the system to enter prompts and generate digital art and sell it as an NFT.

[1174] A "prompt" is text information that a user inputs into a generative AI model, instructing it on the image and content of the digital art to be generated.

[1175] The "server" is a computer system that receives prompts, generates digital art using a generative AI model, and transmits the digital image to the user's device.

[1176] A "generative AI model" is an artificial intelligence program that contains algorithms that generate digital images based on input prompts, such as models like DALL-E and Midjourney.

[1177] "Digital Imagery" means computer graphics generated from prompts by a generative AI model.

[1178] A "terminal" is a device used by a user, such as a computer or smartphone, that has the functionality to communicate with a server.

[1179] "NFT" stands for "Non-Fungible Token" and is a token that manages digital assets such as digital art as unique items on the blockchain.

[1180] A "marketplace" is an online platform for buying and selling NFTs, such as OpenSea or Rarible.

[1181] "Virtual currency" refers to digital currencies that use blockchain technology to manage the trading and ownership of digital assets, including Bitcoin and Ethereum.

[1182] "Revenue" refers to the profits earned by users from the sale of NFTs.

[1183] The "conversion process" refers to the series of steps to convert virtual currency into legal tender.

[1184] "Welfare and charity organizations" is a general term for organizations that provide social assistance or charitable activities.

[1185] The present invention relates to a system that allows users to easily create digital art by entering prompts and earn revenue by selling it as an NFT. This system is designed to be easily usable by users who do not have specialized knowledge of digital art, and by users with physical disabilities.

[1186] Hardware and software used

[1187] Hardware:

[1188] User device: A device such as a computer or smartphone where the user enters the prompts and sees the results.

[1189] Server: A computer system that receives prompts, uses a generative AI model to generate digital art, and uploads it to the NFT marketplace.

[1190] software:

[1191] Generative AI model: An artificial intelligence program that contains algorithms for generating digital images based on input prompts. Examples include models such as DALL-E and Midjourney.

[1192] NFT marketplace: an online platform for selling generated digital art as NFTs. Examples include OpenSea and Rarible.

[1193] Program processing overview

[1194] Entering and submitting prompts

[1195] User:

[1196] The user launches a dedicated application and enters a prompt in text format about the digital art they want to create. Examples of prompts include images such as "a beautiful sunset" or "a city of the near future."

[1197] Device:

[1198] Validates the prompts entered by the user and sends them to the server in the appropriate format.

[1199] Image generation and transmission

[1200] server:

[1201] Receives prompts sent from the device and inputs them into a generative AI model (e.g., DALL-E or Midjourney).

[1202] An image generation AI model analyzes the prompts and automatically generates a digital image.

[1203] The generated digital image is saved as a temporary file and its URL and metadata are generated.

[1204] The image URL and metadata are sent to the user's device.

[1205] Displaying and evaluating the generated images

[1206] Device:

[1207] Receive the URL sent from the server, access the URL and display the generated image.

[1208] The user can review the displayed image and request regeneration or correction as needed.

[1209] Upload and sell as NFTs

[1210] User:

[1211] If you're happy with the generated image, press the "Upload as NFT" button.

[1212] Device:

[1213] Send an upload request to the server, including the image file and any necessary metadata (e.g. title, description, category, etc.).

[1214] server:

[1215] Receives upload requests and uploads image files and metadata to NFT marketplaces (e.g., OpenSea or Rarible).

[1216] Sales will begin as NFTs, and the progress of the buying and selling process will be tracked in real time, with purchase information recorded.

[1217] Once an NFT is sold, the proceeds are recorded in a cryptocurrency wallet, and a portion of the proceeds is automatically donated to designated welfare or charity organizations.

[1218] Agency:

[1219] It manages the cryptocurrency conversion process and converts it into fiat currency, ensuring that revenue is appropriately distributed to users and designated welfare and charity organizations.

[1220] As described above, this invention allows users to easily create digital art and sell it as NFTs without requiring specialized knowledge. It also provides a mechanism for donating a portion of the profits to welfare and charitable organizations, thereby contributing to society at the same time.

[1221] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1222] Step 1:

[1223] Entering Prompts

[1224] User: Launches a dedicated application and enters a prompt in text format about the digital art they want to create. For example, they can enter an image such as "a beautiful sunset" or "a city of the near future."

[1225] Input: The prompt text entered by the user.

[1226] Output: The prompt is displayed on the terminal.

[1227] Specific operation: The user enters a prompt sentence in the text box and presses the confirmation button.

[1228] Step 2:

[1229] Sending a prompt

[1230] Terminal: When the user presses the "Generate" button, the terminal validates the entered prompt and sends it in the appropriate format to the server, generating a data packet containing the prompt text and the user's identification information (e.g., user ID).

[1231] Input: The prompt text that the user entered and instructed to send.

[1232] Output: A data packet containing the prompt and the user ID is sent to the server.

[1233] Specific operation: Pressing a button sends a prompt, and a data packet is generated and sent.

[1234] Step 3:

[1235] Receiving prompts and generating images

[1236] Server: Receives prompts sent from the device and inputs them into a generative AI model (e.g., DALL-E or Midjourney). The image-generating AI model analyzes the prompts and automatically generates digital images.

[1237] Input: The prompt text and user ID sent.

[1238] Output: The digital image data and its metadata that are generated.

[1239] Specific operations: Prompt sentences are analyzed, images are generated, the generated image data is saved, and metadata is generated.

[1240] Step 4:

[1241] Sending the generated image

[1242] Server: Sends the URL and metadata of the generated digital image to the user's device. This data packet includes the URL of the temporary storage location for the image and the image metadata (e.g., creation time, image quality information, etc.).

[1243] Input: Generated digital image data and metadata.

[1244] Output: The data packets are sent to the user's terminal.

[1245] Specific operations: Temporarily save image data, generate a URL, and construct and send a data packet.

[1246] Step 5:

[1247] Displaying and evaluating the generated images

[1248] Terminal: Receives the URL sent from the server, accesses the URL, and displays the generated image. The user can check the displayed image and request regeneration or correction as necessary.

[1249] Input: URL and metadata received from the server.

[1250] Output: The generated image is displayed on the user's device.

[1251] Specific operation: Image data is acquired and displayed by accessing the URL.

[1252] Step 6:

[1253] Upload as an NFT

[1254] User: If satisfied with the generated image, press the "Upload as NFT" button.

[1255] Device: Sends an upload request to the server, which includes the image file and any necessary metadata (e.g., title, description, category, etc.).

[1256] Input: The image to be uploaded and its metadata.

[1257] Output: The upload request is sent to the server.

[1258] Specific operations: Image file and metadata are verified, and an upload data packet is created and sent.

[1259] Step 7:

[1260] Upload and sell images to the marketplace

[1261] Server: Receives the upload request, uploads the image file and metadata to an NFT marketplace (e.g., OpenSea or Rarible), obtains a public URL for the NFT, and returns it to the user.

[1262] Input: Uploaded image file and metadata.

[1263] Output: Public URL as NFT.

[1264] Specific operations: Data is sent to the marketplace, a public URL is obtained, and the URL is returned to the user.

[1265] Step 8:

[1266] Revenue Management and Distribution

[1267] Server: When an NFT sale is completed, the proceeds are recorded in a cryptocurrency wallet. Based on specific settings, a portion of the proceeds is donated to welfare or charity organizations.

[1268] Input: NFT sales completion information and revenue data.

[1269] Output: Recording of earnings and donations to cryptocurrency wallet.

[1270] Specific operations: Records sales data, manages virtual currency, and processes automatic donations.

[1271] Step 9:

[1272] Proxy handling of the cash conversion process

[1273] Agent: Manages the cash-out process, converts cryptocurrency into fiat currency, and distributes the cashed-out revenue appropriately to users and charities.

[1274] Input: User and charity revenue data.

[1275] Output: Distribution of redeemed fiat currency.

[1276] Specific operations: Virtual currency is converted into cash, converted into legal tender, and distributed.

[1277] By following these steps, users can easily create digital art and sell it as an NFT. This system also contributes to society by automatically donating a portion of the profits to welfare and charitable organizations.

[1278] (Application example 1)

[1279] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1280] Conventional systems for creating and selling digital art required specialized knowledge, limiting the user base. Furthermore, the ways in which the created digital art could be utilized were limited, particularly in content distribution services. Furthermore, the procedures for managing and allocating revenue from the created digital art were complicated, making them difficult for many users to use.

[1281] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1282] In this invention, the server includes a means for a user to input a prompt, a means for transmitting the input prompt to the server, a means for generating a digital image on the server using an image generation AI based on the prompt, a means for transmitting the generated digital image to the user's device and displaying it, a means for uploading the generated digital image to a distribution platform and distributing it as an album cover or background image, and a means for managing revenue from the distribution and donating a portion of the revenue to welfare or charitable organizations. This allows users without specialized knowledge to easily generate digital art and makes the art widely available in content distribution services. Furthermore, revenue management and distribution are automated, making the system easily accessible to many users.

[1283] A "prompt" is text that indicates instructions or requests that a user sends to a generative AI model.

[1284] The "server" is a central processing unit that receives prompts, runs the image generation AI, stores the generated images, and uploads them to the distribution platform.

[1285] "Image generation AI" is an artificial intelligence algorithm that automatically generates digital images based on user prompts.

[1286] A "digital image" is electronic visual data generated based on a user prompt.

[1287] A "terminal" is an electronic device that a user uses to enter prompts and view generated digital images.

[1288] A "distribution platform" is an online service that publishes and makes available to viewers the digital images generated.

[1289] An "album cover" is a digital image that visually represents a music album.

[1290] A "background visual" is a digital image used as a background on a distribution platform.

[1291] "Revenue" means the financial benefits derived from the distribution and sale of generated digital images and content.

[1292] A "welfare or charity organization" is a non-profit organization whose purpose is to donate a portion of its profits.

[1293] "Virtual currency" means electronic currency that exists in digital or virtual form and is used for transactions.

[1294] "Prompt suggestions and samples" are concrete examples and hints provided as reference to help users enter appropriate prompts.

[1295] The present invention relates to a system that allows users to easily create digital art by entering prompts and use it as album covers or background visuals on a distribution platform. This system is designed to be easy to use even for users who do not have specialized knowledge of digital art.

[1296] The server provides an interface for the user to enter a prompt. When the user enters a prompt, such as "an inspiring night sky, stars, or a dreamy theme," the prompt is sent to the server. The server processes the received prompt and generates a digital image using a generative AI model (e.g., DALL-E or MidJourney). The generated digital image is temporarily stored on the server, and a URL for the image is sent back to the user's device. The user can use this URL to view the generated image and make any necessary edits.

[1297] Once the user is satisfied with the generated digital image, they can press the "Distribute as content" button, which will upload the image to the distribution platform via the server. On the distribution platform, the generated digital image will be made public as an album cover or background visual.

[1298] Regarding revenue management, the server will track the usage of the distributed content in real time, and the revenue earned will be managed in virtual currency. The virtual currency conversion process will be handled by an agency, and a portion of the revenue will be donated to designated welfare and charitable organizations.

[1299] The specific system configuration and process are explained below. The user's device is an electronic device such as a smartphone, smart glasses, or head-mounted display (HMD), and prompt input is performed through a dedicated application installed on the device. This application is developed using programming languages ​​such as React Native, Swift, and Kotlin.

[1300] On the server side, server frameworks such as Node.js and Flask are used. DALL-E and MidJourney are used as image generation AI, and the generated digital images are temporarily stored in databases such as MongoDB and PostgreSQL. Music streaming services and video distribution services are used as distribution platforms.

[1301] For example, if a user inputs the prompt "Inspirational night sky, stars, dreamy theme," the image generation AI will generate digital art depicting a fantastic night sky based on this prompt. This generated digital art will be sent to the user's device, where the user can review and edit it, and then it will be uploaded to the distribution platform.

[1302] The above is a specific embodiment for carrying out the present invention, which makes it possible to easily create beautiful digital art without specialized knowledge and utilize it in a variety of content distribution services.

[1303] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1304] Step 1:

[1305] The user launches a dedicated application on their device and inputs a prompt in text form for the digital art they wish to create. This prompt might describe a specific image, such as "an inspiring night sky, stars, or a dreamlike theme." The user enters the prompt and presses the send button to generate the input data.

[1306] Step 2:

[1307] The terminal sends the entered prompt text to the server. In this sending process, an API request including the prompt text is generated and an HTTP request is made to the server. The input data is mainly the prompt text.

[1308] Step 3:

[1309] The server analyzes the received prompt and generates a digital image based on the prompt using image generation AI (e.g., DALL-E, MidJourney). The generative AI model understands the content of the prompt and performs data calculations to generate digital art in accordance with it. The input here is the prompt, and the output is a digital image.

[1310] Step 4:

[1311] The server temporarily stores the generated digital image and generates a URL and metadata for the image. The URL and metadata for the stored digital image are generated on the server side. The metadata includes the image title and description. The output is the URL and metadata for the digital image.

[1312] Step 5:

[1313] The server returns the URL and metadata of the generated image to the user's device, which receives this information and accesses it to display the image. The input is the URL and metadata from the server, and the output is the display of the image.

[1314] Step 6:

[1315] The user checks the generated digital image and edits it as necessary. When the image is satisfactory, the user presses the "Distribute as content" button. This operation confirms the edited image data. The input is the edited content of the image, and the output is the confirmed image data.

[1316] Step 7:

[1317] The terminal sends the confirmed image data to the server again. At this stage, an image data upload request is generated and sent to the server. The input is the confirmed image data, and the output is the upload request.

[1318] Step 8:

[1319] The server uploads the received image data to the distribution platform. Specifically, it uploads the image data using the distribution platform's API and publishes it as an album cover or background visual. The input is the confirmed image data, and the output is the upload result to the distribution platform.

[1320] Step 9:

[1321] The server tracks the usage of digital images on the distribution platform in real time and records and manages the revenue generated. In this process, revenue data is managed in virtual currency. The input is usage data, and the output is revenue record data.

[1322] Step 10:

[1323] When revenue is generated, the server requests an agent to process the virtual currency to be converted into cash. The agent converts the virtual currency and donates a portion of the revenue to a designated welfare or charity organization. The input is the virtual currency data of the revenue, and the output is the converted revenue and the fulfillment of the donation.

[1324] The above steps enable users to easily create digital art and use it widely in content distribution services. In addition, revenue management and distribution are automated, making the system easy to use for many users.

[1325] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1326] This invention relates to a system that allows users to easily create digital art by entering prompts, then sell it as NFTs and earn revenue. In particular, by combining it with an emotion engine that recognizes the user's emotions, more personalized prompt generation and suggestions can be generated, improving the user experience. This system is designed to be easily usable by users without specialized knowledge of digital art or users with physical disabilities.

[1327] Program processing details

[1328] 1. Prompt Input and Emotion Recognition

[1329] User: Launches a dedicated application and uses facial expressions, voice, or text input. For example, the user might smile in front of the smartphone camera, say "I'm feeling happy today," or type "Today is a wonderful day."

[1330] Terminal: Collects the user's facial expression, voice, and text data using input devices such as a camera, microphone, and keyboard.

[1331] Emotion engine: Analyzes collected data and recognizes the user's emotions. For example, it can recognize "happiness" as an emotion from the user's smile or voice.

[1332] 2. Prompt generation and suggestions

[1333] Terminal: Based on the emotion data obtained from the emotion engine, the prompt input means provides suggestions and samples. For example, if the emotion "happiness" is recognized, prompts such as "beautiful sunset" and "fun festival scenery" will be suggested.

[1334] 3. Sending prompts and generating images

[1335] User: Choose from suggested prompts or enter the text of their own prompt, then press the "Generate" button.

[1336] Terminal: Sends selected or entered prompts to the server.

[1337] Server: Receives prompts and the image generation AI generates digital images based on them.

[1338] 4. Display and check the generated image

[1339] Server: Temporarily stores the generated digital image and sends its URL and metadata to the user's device.

[1340] Terminal: The generated image is displayed based on the sent URL. The user checks the displayed image and, if satisfied, presses the "Upload as NFT" button.

[1341] 5. Upload as an NFT

[1342] Terminal: Detects when the "Upload as NFT" button is pressed and sends an upload request to the server.

[1343] Server: Receives the upload request and uploads the image file and necessary metadata to the NFT marketplace. If the upload is successful, the server confirms the start of sales on the marketplace.

[1344] 6. Sales procedures and revenue management

[1345] Server: Records sales start information in the system and notifies users that NFTs are available for sale. Tracks sales in real time and records purchase information and revenue when NFTs are purchased.

[1346] Server: Manages revenue as virtual currency and transfers the revenue information to a means that handles the cash-out process on your behalf.

[1347] 7. Revenue Sharing and Donations

[1348] Agents: These companies handle the process of converting virtual currency into fiat currency and donating a portion of the proceeds to designated welfare or charitable organizations.

[1349] Server: Records the completed donation information within the system and the user, and stores all transactions as a log.

[1350] Specific examples

[1351] For example, if a user launches an application and smiles into the smartphone camera, the following steps are performed:

[1352] 1. Prompt Input and Emotion Recognition

[1353] Device: The smartphone camera captures the user's smile.

[1354] Emotion engine: Analyzes collected facial image data and recognizes the user's emotion as "happiness."

[1355] 2. Prompt generation and suggestions

[1356] Terminal: Based on the emotion "happiness," the system suggests prompts to the user, such as "beautiful sunset" or "fun festival scenery."

[1357] 3. Sending prompts and generating images

[1358] User: Selects the prompt "Beautiful Sunset" and presses the "Generate" button.

[1359] Terminal: Sends the selected prompt to the server.

[1360] Server: Receives the prompt and the image generation AI generates a digital image depicting a "beautiful sunset."

[1361] 4. Display and check the generated image

[1362] Server: Sends the generated images and their metadata to the device.

[1363] Terminal: Display the image to the user and ask them to confirm.

[1364] 5. Upload as an NFT

[1365] User: Satisfied with the image, presses the "Upload as NFT" button.

[1366] Device: Sends an upload request to the server.

[1367] Server: Upload images to the NFT marketplace and start selling.

[1368] 6. Sales procedures and revenue management

[1369] Server: Track sales status in real time and manage revenue as virtual currency.

[1370] 7. Revenue Sharing and Donations

[1371] Agency: Converts revenue into fiat currency and donates a portion to welfare or charity organizations.

[1372] This allows users to create digital art in an easy and personalized way, sell it as an NFT, and use the proceeds to contribute to society.

[1373] The processing flow will be explained below.

[1374] Program processing details

[1375] Step 1:

[1376] User: Launch the dedicated application, smile in front of the smartphone camera, and capture your facial expression. You can also choose to input using voice or text. For example, you can say, "I'm feeling happy today," or input using text, "Today is a wonderful day."

[1377] Step 2:

[1378] Terminal: Collects the user's facial expressions, voice, and text data using input devices such as a camera, microphone, and keyboard. Prepares to send this data to the emotion engine.

[1379] Step 3:

[1380] Emotion engine: Analyzes collected data and recognizes the user's emotions. For example, it can recognize "happiness" as an emotion from the user's smile or voice.

[1381] Step 4:

[1382] Terminal: Based on the emotion data obtained from the emotion engine, the prompt input means provides suggestions and samples. For example, if the emotion "happiness" is recognized, prompts such as "beautiful sunset" and "fun festival scenery" will be suggested.

[1383] Step 5:

[1384] User: Choose from suggested prompts or enter the text of their own prompt, then press the "Generate" button.

[1385] Step 6:

[1386] Terminal: Sends the selected or entered prompt to the server, formatting the prompt data appropriately before sending it.

[1387] Step 7:

[1388] Server: Receives the prompt and provides it to the image generation AI, which analyzes the prompt and generates the appropriate digital image.

[1389] Step 8:

[1390] Server: Temporarily stores the generated digital image. Then, it generates a URL and metadata (title, description, creation date, etc.) for the image and sends them to the device.

[1391] Step 9:

[1392] Terminal: Based on the URL of the generated image received, the image is displayed to the user. The user checks the displayed image and, if satisfied, presses the "Upload as NFT" button.

[1393] Step 10:

[1394] Device: Detects when the "Upload as NFT" button is pressed and sends an upload request to the server, including the image file and any necessary metadata.

[1395] Step 11:

[1396] Server: Receives the upload request and uploads the image file and necessary metadata to the NFT marketplace. If the upload is successful, the server confirms the start of sales on the marketplace.

[1397] Step 12:

[1398] Server: Records sales start information within the system and notifies users that their NFTs are available for sale.

[1399] Step 13:

[1400] Server: Tracks sales in real time, records the purchase information and revenue when an NFT is purchased, and records cryptocurrency revenue in the system.

[1401] Step 14:

[1402] Server: Manages revenue as virtual currency and transfers the revenue information to a means that handles the cash-out process on your behalf.

[1403] Step 15:

[1404] Agents: These companies handle the process of converting virtual currency into fiat currency and donating a portion of the proceeds to designated welfare or charitable organizations.

[1405] Step 16:

[1406] Server: Records the completed donation information within the system and the user, and stores all transactions as a log.

[1407] Specific examples

[1408] For example, if a user launches an application and smiles into the smartphone camera, the following steps are performed:

[1409] Step 1:

[1410] User: Speaks to the application, "I'm feeling happy today."

[1411] Step 2:

[1412] Device: The smartphone's microphone captures the user's voice.

[1413] Step 3:

[1414] Emotion engine: Analyzes collected voice data and recognizes the user's emotion as "happiness."

[1415] Step 4:

[1416] Terminal: Based on the emotion "happiness," the system suggests prompts to the user, such as "beautiful sunset" or "fun festival scenery."

[1417] Step 5:

[1418] User: Selects the prompt "Beautiful Sunset" and presses the "Generate" button.

[1419] Step 6:

[1420] Terminal: Sends the selected prompt to the server.

[1421] Step 7:

[1422] Server: Receives the prompt and the image generation AI generates a digital image depicting a "beautiful sunset."

[1423] Step 8:

[1424] Server: Sends the generated images and their metadata to the device.

[1425] Step 9:

[1426] Terminal: Display the image to the user and ask them to confirm.

[1427] Step 10:

[1428] User: Satisfied with the image, presses the "Upload as NFT" button.

[1429] Step 11:

[1430] Device: Sends an upload request to the server.

[1431] Step 12:

[1432] Server: Upload images to the NFT marketplace and start selling.

[1433] Step 13:

[1434] Server: Track sales status in real time and manage revenue as virtual currency.

[1435] Step 14:

[1436] Server: Carries out the procedures to process the cash-out process.

[1437] Step 15:

[1438] Agency: Converts revenue into fiat currency and donates a portion to welfare or charity organizations.

[1439] Step 16:

[1440] Server: Records donation information and keeps a log of all transactions.

[1441] In this way, users can easily create digital art and use the proceeds from selling it as an NFT to contribute to society.

[1442] Example 2

[1443] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1444] Conventional digital art generation systems require users to input prompts, generate digital images based on those prompts, and sell them as NFTs, resulting in a complicated process. Furthermore, they lack the ability to generate personalized prompts using emotion recognition, which hinders the user experience. Furthermore, the process of managing revenue and donating to welfare or charitable organizations is also complicated.

[1445] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1446] In this invention, the server includes means for a user to input a prompt, means for transmitting the input prompt, means for generating digital media using an image generation algorithm, means for transmitting the generated digital media to a user terminal and displaying it, means for uploading the digital media to an e-commerce platform and selling it as a digital asset, means for managing revenue and donating it to welfare or charity organizations, means for analyzing facial expressions, voice, and text data to recognize emotions, and means for generating and suggesting prompts based on the recognized emotions, thereby improving the user experience and simplifying the revenue management and donation process.

[1447] A "prompt" is a sentence or word entered by a user that represents an instruction or request.

[1448] A "server" is a computer system that provides services to other computers on a network.

[1449] A "terminal" is a computer device or apparatus that is operated by a user.

[1450] An "image generation algorithm" is a method or procedure for automatically generating a digital image based on specified prompts.

[1451] "Digital media" refers to content such as images and video that is electronically generated and stored.

[1452] An "e-commerce platform" is a web service or application for buying and selling goods over the Internet.

[1453] A "digital asset" is any property stored in digital form that is data of value that can be owned or sold.

[1454] An "emotion engine" is a technology or system that analyzes a user's facial expressions, voice, and text data to identify emotions.

[1455] "Revenue" means the profit earned when a Digital Asset is sold.

[1456] "Virtual currency" means a digital or virtual currency whose transactions are governed by cryptography.

[1457] "Welfare and charity organizations" are organizations and groups that contribute to society and provide humanitarian aid.

[1458] A "suggestion" is a prompt or idea presented to the user.

[1459] The present invention relates to a system that allows users to easily create digital art by entering prompts, sell the resulting digital art as digital assets, and earn revenue. In particular, by combining it with an emotion engine that recognizes the user's emotions, more personalized prompt generation and suggestions can be generated, improving the user experience. This system is designed to be easily usable by users who do not have specialized knowledge of digital art or who have physical disabilities. Specifically, the system is implemented as follows.

[1460] First, a user launches a dedicated application and smiles at the smartphone camera, speaks into the microphone saying "I'm feeling happy today," or types "It's a nice day today" into a text field. The hardware used here is the smartphone's input devices, such as the camera, microphone, and keyboard.

[1461] The device uses input devices such as a camera, microphone, and keyboard to collect the user's facial expressions, voice, and text data. The collected data is temporarily stored locally and then sent to a server. The server uses an emotion engine (e.g., an emotion recognition algorithm) to analyze the collected data and recognize the user's emotions. Specifically, the emotion engine can use existing emotion recognition technologies such as Microsoft Azure's Face API and IBM Watson's Tone Analyzer.

[1462] The server generates multiple prompts based on the recognized emotion data and sends them to the device. For example, if the emotion "happiness" is recognized, prompts such as a beautiful sunset or a fun festival scene may be generated. The device then presents the generated prompts to the user, who can then select from the suggested prompts or enter their own prompt by text.

[1463] When the user selects or enters a prompt and presses the "Generate" button, the device sends the prompt to the server. The server uses an image generation algorithm (e.g., OpenAI's DALL-E) based on the received prompt to generate a digital media. The generated digital media is temporarily stored, and its URL and metadata are sent to the user's device.

[1464] The device displays the digital media generated based on the URL and prompts the user for confirmation. If the user is satisfied with the generated digital media, they press the "Upload as NFT" button. This causes the device to send an upload request to the server, which then uploads the image and metadata to an NFT marketplace (e.g., OpenSea) and begins selling it.

[1465] The server records the sales status within the system and notifies the user that the NFT is available for sale. It also monitors the sales situation in real time and records purchase information and revenue. The revenue is managed as virtual currency and sent to the user's wallet address. The agency converts the revenue into fiat currency and donates it to a welfare or charity organization designated by the user. This process is managed by the server, which notifies the user when the donation is complete and stores all transaction logs.

[1466] For example, if a user launches the application and smiles into the smartphone camera, the emotion engine will recognize the expression as "happiness" and suggest a prompt such as "beautiful sunset." The user can then select the prompt and press the "Generate" button, which will generate a digital image using the image generation algorithm.

[1467] Example prompt sentence:

[1468] "Prompt: Please walk me through the steps to capture a photo of a smiling face, generate digital art that expresses happiness, and upload it to an NFT marketplace."

[1469] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1470] Step 1: Prompt Input and Emotion Recognition

[1471] User: Launches the dedicated application and smiles in front of the smartphone camera. In the case of voice input, the user speaks, "I'm feeling happy today," and in the case of text input, the user types, "Today is a wonderful day."

[1472] Input: User's facial expressions, voice, and text data

[1473] Terminal: The user's facial expression data captured by the camera, voice data collected by the microphone, and text data entered on the keyboard are temporarily stored in local storage.

[1474] Output: Collected facial expressions, voice, and text data

[1475] Terminal: Sends collected data to the server.

[1476] Input: Collected facial expressions, voice, and text data

[1477] Server: Analyzes the collected data using an emotion engine (e.g., emotion recognition algorithm) to identify the user's emotion.

[1478] Output: User's emotion (e.g., "Happy")

[1479] ---

[1480] Step 2: Generate and suggest prompts

[1481] Server: Generates appropriate prompts based on recognized emotion data (e.g., "happy").

[1482] Input: User emotion data

[1483] Server: For example, based on the emotion "happiness," generate prompts such as "a beautiful sunset" or "a fun festival scene."

[1484] Output: Generated prompt

[1485] Terminal: Presents the generated prompt to the user.

[1486] Input: Generated prompt

[1487] Output: The prompt displayed to the user

[1488] ---

[1489] Step 3: Sending prompts and generating images

[1490] User: Select from the provided prompts or enter their own prompt and press the "Generate" button.

[1491] Input: The prompt selected or entered by the user

[1492] Terminal: Sends selected or entered prompts to the server.

[1493] Output: Prompt sent

[1494] Server: Based on the received prompts, generates digital media using an image generation algorithm (e.g., OpenAI's DALL-E).

[1495] Input: prompt

[1496] Output: The digital medium produced

[1497] ---

[1498] Step 4: View and check the generated image

[1499] Server: Temporarily stores the generated digital media and metadata, and sends the URL to the user's device.

[1500] Input: Generated digital media and metadata

[1501] Output: URL and metadata of the digital media

[1502] Terminal: Using the received URL, the generated digital media is displayed to the user.

[1503] Input: URL of digital media

[1504] Output: The digital media displayed to the user

[1505] User: Check the generated digital media and if satisfied, press the "Upload as NFT" button.

[1506] ---

[1507] Step 5: Upload as an NFT

[1508] Terminal: Detects when the "Upload as NFT" button is pressed and sends the image data and metadata to the server.

[1509] Input: Image data and metadata

[1510] Output: Request sent to the server

[1511] Server: Based on the received request, uploads the digital media and metadata to an e-commerce platform (e.g., OpenSea) and initiates sales.

[1512] Input: Request, Digital Media, Metadata

[1513] Output: Upload status to e-commerce platform

[1514] ---

[1515] Step 6: Sales Process and Revenue Management

[1516] Server: Records sales start information in the system and notifies users that their NFTs are available for sale.

[1517] Input: Sales start information from e-commerce platform

[1518] Output:Available for sale notification

[1519] Server: Monitors sales in real time and records purchase information and revenue when an NFT is purchased.

[1520] Input: Sales Status

[1521] Output: Purchase information, revenue records

[1522] Server: Manages revenue as virtual currency and sends it to the user's wallet address.

[1523] Input: Revenue Data

[1524] Output: Send cryptocurrency to user wallet

[1525] ---

[1526] Step 7: Revenue sharing and donations

[1527] Agency: Converts virtual currency into fiat currency and donates it to welfare or charity organizations designated by the user.

[1528] Input: Cryptocurrency

[1529] Output: Fiat currency, donation process

[1530] Server: Notifies the user that the donation has been completed and stores all transaction logs within the system.

[1531] Input: Donation completion information

[1532] Output: Notifications, transaction log storage

[1533] (Application example 2)

[1534] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1535] Conventional digital art generation systems allow users to input prompts and generate images based on those prompts, but the system does not generate or suggest personalized prompts that take the user's emotions into account, resulting in a limited user experience. Furthermore, the process of selling the generated digital art as an NFT requires specialized knowledge, limiting the number of users.

[1536] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1537] In this invention, the server includes: a means for a user to input a prompt; a means for transmitting the input prompt to the server; a means for generating a digital image on the server using an image generation AI based on the prompt; a means for transmitting and displaying the generated digital image to the user's device; a means for uploading the generated digital image to a marketplace and selling it as an NFT; a means for managing sales revenue and donating a portion of the revenue to welfare or charity organizations; and a means for generating or suggesting personalized prompts using an emotion engine that recognizes the user's emotions. This enables users to easily create personalized digital art based on their own emotions, sell it as an NFT, and earn revenue.

[1538] "User" means an individual or entity that utilizes the system to enter prompts to create and sell digital art.

[1539] A "prompt" is an instruction, such as text, audio, or an image, that is entered by the user.

[1540] A "server" is a computer system that receives prompts and manages the generation, display, and sale of digital images.

[1541] "Image generation AI" is an artificial intelligence technology that automatically generates digital images based on input prompts.

[1542] "Digital Image" means image data of the created artwork in digital format.

[1543] A "terminal" is a device (e.g., smartphone, tablet) that a user uses to enter prompts and view generated digital images.

[1544] The "marketplace" is an online platform that sells the generated digital images as NFTs.

[1545] "NFT" stands for "Non-Fungible Token" and is a blockchain-based token that proves ownership of digital art or other digital content.

[1546] An "emotion engine" is a technology for recognizing and analyzing a user's emotions from facial expressions, voice, or text.

[1547] A "personalized prompt" is a specific prompt that is suggested based on the perceived sentiment of the user.

[1548] "Revenue" is the monetary gain from the sold NFT.

[1549] "Welfare and charity organizations" are organizations or groups that provide social assistance and relief activities.

[1550] "Virtual currency" is a digital currency traded online and is a different form of traditional physical currency.

[1551] This invention is a system that allows users to create digital art by entering prompts and sell it as NFTs. At the heart of the system is an emotion engine that recognizes the user's emotions, allowing it to generate or suggest personalized prompts.

[1552] The system uses the following major hardware and software components:

[1553] 1. Hardware

[1554] Terminal: A device (e.g., smartphone, tablet, smart glasses) on which a user enters prompts and displays the generated digital images.

[1555] Server: A computer system that receives prompts and manages the generation, display, and sale of digital images.

[1556] 2. Software

[1557] Emotion engine: A technology for recognizing emotions from a user's facial expressions, voice, or text. Examples include AWS Rekognition and Google Cloud Speech-to-Text.

[1558] Image generation AI: Artificial intelligence technology that automatically generates digital images based on input prompts, such as OpenAI's DALL-E.

[1559] NFT Marketplace: An online platform that sells generated digital images as NFTs. It can use OpenSea APIs and other APIs.

[1560] Virtual currency management system: A system for managing sales revenue as virtual currency and handling the cash conversion process.

[1561] 3. Examples of prompt sentences

[1562] "happiness"

[1563] "Beautiful sunset"

[1564] "A fun festival scene"

[1565] The system processing is described in detail below.

[1566] Prompt Input and Emotion Recognition

[1567] The user uses the device to make facial expressions, input voice, or input text in front of the camera. The device uses input devices such as a camera, microphone, and keyboard to collect the user's facial, voice, and text data and send it to the emotion engine. The emotion engine analyzes the collected data and recognizes the user's emotion. For example, if the user smiles, the emotion engine recognizes "happiness."

[1568] Prompt generation and suggestions

[1569] The device generates or suggests relevant prompts based on the emotion data obtained from the emotion engine. For example, if the emotion "happiness" is recognized, prompts such as "beautiful sunset" or "fun festival scenery" are suggested to the user.

[1570] Digital image generation and display

[1571] The user selects from suggested prompts or enters their own prompt. Then, by pressing the "Generate" button, the device sends the selected or entered prompt to the server. The server then sends the received prompt to an image generation AI, which generates a digital image. The generated digital image is temporarily stored by the server, and its URL and metadata are sent to the user's device. The device then displays the generated image based on the URL.

[1572] Converting images into NFTs and selling them

[1573] If the user is satisfied with the generated image, they press the "Upload as NFT" button. The device sends an upload request to the server, which uploads the image file and necessary metadata to the NFT marketplace. If the upload is successful, the image will be available for sale on the marketplace.

[1574] Revenue Management and Donations

[1575] The server tracks sales status in real time and manages the revenue as virtual currency, which is converted into fiat currency through a cash-out process, a portion of which is donated to welfare and charitable organizations.

[1576] In this way, the system allows users to easily create personalized, emotion-based digital art, sell it as an NFT, and earn revenue.

[1577] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1578] Step 1:

[1579] The user uses the device to make facial expressions, input voice, or input text in front of the camera. The device collects the user's facial expression, voice, and text data using input devices such as a camera, microphone, and keyboard.

[1580] Input: facial expression images, audio data, text data

[1581] Output: Collected user data

[1582] Step 2:

[1583] The device sends the collected user data to the emotion engine, which analyzes facial images using AWS Rekognition and converts the audio into text using Google Cloud Speech-to-Text. The analyzed data is used to recognize the user's emotions.

[1584] Input: Collected user data

[1585] Data processing: facial expression image analysis, voice data text conversion

[1586] Output: Recognized emotion data (e.g., happiness)

[1587] Step 3:

[1588] The device generates or suggests relevant prompts based on the recognized emotion data. For example, if the recognized emotion is "happiness," the device may suggest prompts such as "beautiful sunset" or "fun festival scenery" to the user.

[1589] Input: Recognized emotion data

[1590] Data generation: generating prompts that correspond to emotions

[1591] Output: A suggested prompt (e.g., "Beautiful sunset")

[1592] Step 4:

[1593] The user selects from the suggested prompts or enters their own prompt and presses the "Generate" button. The terminal sends the selected or entered prompt to the server.

[1594] Input: Suggested prompt or your own prompt

[1595] Output: Prompt data sent

[1596] Step 5:

[1597] The server sends the received prompt data to the image generation AI, which generates a digital image based on the prompt. The generated digital image is temporarily stored.

[1598] Input: Submitted prompt data

[1599] Data calculation: Digital image generation using image generation AI

[1600] Output: The generated digital image

[1601] Step 6:

[1602] The server sends the URL and metadata of the generated digital image to the terminal, which then displays the generated image to the user based on the URL.

[1603] Input: Generated digital image

[1604] Data processing: Image URL and metadata generation

[1605] Output: Image URL and metadata

[1606] Step 7:

[1607] If the user is satisfied with the generated image, they press the "Upload as NFT" button, and the device sends an upload request to the server.

[1608] Input: User upload request

[1609] Output: Upload request sent

[1610] Step 8:

[1611] The server uploads the image file and necessary metadata to the NFT marketplace, where, if the upload is successful, the image will be available for sale.

[1612] Input: Upload request sent

[1613] Data Calculation: Uploading image files and metadata

[1614] Output: Marketplace sales status

[1615] Step 9:

[1616] The server tracks sales status in real time and manages the revenue as virtual currency, which is converted into fiat currency through a cash-out process, a portion of which is donated to welfare and charitable organizations.

[1617] Input: Marketplace sales data

[1618] Data Computing: Revenue Management and Monetization Process

[1619] Output: Managed revenue and donation information

[1620] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1621] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1622] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1623] [Fourth embodiment]

[1624] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1625] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1626] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1627] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1628] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1629] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1630] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1631] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1632] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1633] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1634] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1635] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1636] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1637] The present invention relates to a system that allows users to easily create digital art by entering prompts and earn revenue by selling it as an NFT. This system is designed to be easily usable by users who do not have specialized knowledge of digital art, and even by users with physical disabilities.

[1638] Program processing details

[1639] 1. Prompt Input

[1640] Device: The user launches a dedicated application and enters text prompts about the digital art they want to create. For example, they can enter specific images such as "a beautiful sunset" or "a city of the near future."

[1641] 2. Sending prompts and generating images

[1642] Terminal: When the user presses the "Generate" button, the entered prompt is sent to the server. The server receives the prompt and generates digital art using image generation AI based on the prompt. In this process, the image generation AI internally analyzes the prompt and automatically creates the appropriate artwork.

[1643] 3. Displaying the generated image

[1644] Server: The generated digital image is temporarily stored on the server, and its URL and metadata are sent back to the user's device.

[1645] On the device: The user can check the generated image based on the URL sent to them. The image becomes viewable and the user can rate the generated art.

[1646] 4. Upload as an NFT

[1647] User: If the user is happy with the image, they press the "Upload as NFT" button.

[1648] Terminal: This operation sends an upload request to the server.

[1649] Server: The server receives the upload request and uploads the image file and any necessary metadata (e.g., title, description, category, etc.) to the NFT marketplace.

[1650] 5. Sales Procedures

[1651] Server: Uploaded NFTs are published on the marketplace and begin to be sold. The sales process is tracked in real time, and when a purchase is made, the information is recorded.

[1652] 6. Sales Tracking and Revenue Sharing

[1653] Server: When a sale is made, the revenue is managed and recorded in virtual currency. A portion of the revenue is automatically donated to welfare or charity organizations designated within the system.

[1654] Agent: Manages the cryptocurrency conversion process and converts it into fiat currency, ensuring that revenue is distributed appropriately to users and charities.

[1655] Specific examples

[1656] For example, if the user types the prompt "Beautiful sunset", the following happens:

[1657] 1. Prompt input:

[1658] User: Enters "Beautiful sunset" into the application.

[1659] 2. Sending prompts and generating images:

[1660] Terminal: Sends a prompt to the server.

[1661] Server: Receives prompts and the image generation AI generates digital art depicting a beautiful sunset.

[1662] 3. View the generated image:

[1663] Server: Sends the generated image URL and metadata to the device.

[1664] Terminal: Access the sent URL and display the generated image.

[1665] 4. Upload as an NFT:

[1666] User: Satisfied with the image, presses the "Upload as NFT" button.

[1667] Device: Sends an upload request to the server.

[1668] Server: Uploads images and metadata to the NFT marketplace.

[1669] 5. Sales Procedure:

[1670] Server: NFTs will be available for sale on the marketplace.

[1671] 6. Sales Tracking and Revenue Sharing:

[1672] Server: The sale is completed and revenue is recorded in virtual currency.

[1673] Agency: Virtual currency is converted into cash and a portion of the proceeds is donated to welfare or charity organizations.

[1674] This system allows users to easily create beautiful digital art, sell it as NFTs, and contribute to society at the same time.

[1675] The processing flow will be explained below.

[1676] Step 1:

[1677] User: Launches the dedicated application and enters a prompt text about the content of the digital art they want to generate. For example, the user enters the prompt "Beautiful sunset."

[1678] Step 2:

[1679] Terminal: After the user has finished entering the prompt, the terminal accepts the operation of pressing the "Generate" button, and then sends the entered prompt data to the server.

[1680] Step 3:

[1681] Server: Receives input prompts and provides them to the image generation AI, which analyzes the prompts and generates the appropriate digital images.

[1682] Step 4:

[1683] Server: Temporarily stores the generated digital image. Then, it generates a URL and metadata (title, description, creation date, etc.) for the image and sends them to the device.

[1684] Step 5:

[1685] Terminal: Based on the URL of the generated image received, the image is displayed to the user. The user checks the displayed image and, if satisfied, presses the "Upload as NFT" button.

[1686] Step 6:

[1687] Terminal: Detects when the "Upload as NFT" button is pressed and sends the user's operation to the server as an upload request.

[1688] Step 7:

[1689] Server: Receives upload requests, collects image files and necessary metadata, and uploads them to the NFT marketplace. If the upload is successful, the server confirms the start of sales on the marketplace.

[1690] Step 8:

[1691] Server: Records sales start information within the system and notifies users that their NFTs are available for sale.

[1692] Step 9:

[1693] Server: Tracks sales in real time and records purchase information and revenue when an NFT is purchased.

[1694] Step 10:

[1695] Server: Manages revenue as virtual currency and transfers the revenue information to a means that handles the cash-out process on your behalf.

[1696] Step 11:

[1697] Agents: These companies handle the process of converting virtual currency into fiat currency and donating a portion of the proceeds to designated welfare or charitable organizations.

[1698] Step 12:

[1699] Server: Records the completed donation information within the system and the user, and stores all transactions as a log.

[1700] The above steps establish a complete process from when a user enters the prompt, to when digital art is created and sold, and the proceeds are used for social contribution.

[1701] Example 1

[1702] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1703] Conventional digital art creation and sales systems require specialized knowledge, making them difficult for general users and users with physical disabilities to use. Furthermore, the procedures for selling digital art as NFTs are often complicated, and the revenue management and donation processes often require advanced knowledge. The present invention aims to solve these problems.

[1704] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1705] In this invention, the server includes: a means for a user to input a prompt; a means for transmitting the input prompt to the server; a means for generating a digital image on the server using a generative AI model based on the prompt; a means for transmitting and displaying the generated digital image to the user's terminal; a means for uploading the digital image generated by the user's operation to a marketplace and selling it as an NFT; a means for managing sales revenue in virtual currency and donating a portion of the revenue to welfare or charity organizations; a means for automatically performing the process of converting the revenue into cash; and a means for the prompt input means to provide the user with suggested prompts and samples. This enables users without specialized knowledge to easily create digital art and sell it as an NFT, and donate a portion of the revenue to welfare or charity organizations.

[1706] A "User" is someone who uses the system to enter prompts and generate digital art and sell it as an NFT.

[1707] A "prompt" is text information that a user inputs into a generative AI model, instructing it on the image and content of the digital art to be generated.

[1708] The "server" is a computer system that receives prompts, generates digital art using a generative AI model, and transmits the digital image to the user's device.

[1709] A "generative AI model" is an artificial intelligence program that contains algorithms that generate digital images based on input prompts, such as models like DALL-E and Midjourney.

[1710] "Digital Imagery" means computer graphics generated from prompts by a generative AI model.

[1711] A "terminal" is a device used by a user, such as a computer or smartphone, that has the functionality to communicate with a server.

[1712] "NFT" stands for "Non-Fungible Token" and is a token that manages digital assets such as digital art as unique items on the blockchain.

[1713] A "marketplace" is an online platform for buying and selling NFTs, such as OpenSea or Rarible.

[1714] "Virtual currency" refers to digital currencies that use blockchain technology to manage the trading and ownership of digital assets, including Bitcoin and Ethereum.

[1715] "Revenue" refers to the profits earned by users from the sale of NFTs.

[1716] The "conversion process" refers to the series of steps to convert virtual currency into legal tender.

[1717] "Welfare and charity organizations" is a general term for organizations that provide social assistance or charitable activities.

[1718] The present invention relates to a system that allows users to easily create digital art by entering prompts and earn revenue by selling it as an NFT. This system is designed to be easily usable by users who do not have specialized knowledge of digital art, and by users with physical disabilities.

[1719] Hardware and software used

[1720] Hardware:

[1721] User device: A device such as a computer or smartphone where the user enters the prompts and sees the results.

[1722] Server: A computer system that receives prompts, uses a generative AI model to generate digital art, and uploads it to the NFT marketplace.

[1723] software:

[1724] Generative AI model: An artificial intelligence program that contains algorithms for generating digital images based on input prompts. Examples include models such as DALL-E and Midjourney.

[1725] NFT marketplace: an online platform for selling generated digital art as NFTs. Examples include OpenSea and Rarible.

[1726] Program processing overview

[1727] Entering and submitting prompts

[1728] User:

[1729] The user launches a dedicated application and enters a prompt in text format about the digital art they want to create. Examples of prompts include images such as "a beautiful sunset" or "a city of the near future."

[1730] Device:

[1731] Validates the prompts entered by the user and sends them to the server in the appropriate format.

[1732] Image generation and transmission

[1733] server:

[1734] Receives prompts sent from the device and inputs them into a generative AI model (e.g., DALL-E or Midjourney).

[1735] An image generation AI model analyzes the prompts and automatically generates a digital image.

[1736] The generated digital image is saved as a temporary file and its URL and metadata are generated.

[1737] The image URL and metadata are sent to the user's device.

[1738] Displaying and evaluating the generated images

[1739] Device:

[1740] Receive the URL sent from the server, access the URL and display the generated image.

[1741] The user can review the displayed image and request regeneration or correction as needed.

[1742] Upload and sell as NFTs

[1743] User:

[1744] If you're happy with the generated image, press the "Upload as NFT" button.

[1745] Device:

[1746] Send an upload request to the server, including the image file and any necessary metadata (e.g. title, description, category, etc.).

[1747] server:

[1748] Receives upload requests and uploads image files and metadata to NFT marketplaces (e.g., OpenSea or Rarible).

[1749] Sales will begin as NFTs, and the progress of the buying and selling process will be tracked in real time, with purchase information recorded.

[1750] Once an NFT is sold, the proceeds are recorded in a cryptocurrency wallet, and a portion of the proceeds is automatically donated to designated welfare or charity organizations.

[1751] Agency:

[1752] It manages the cryptocurrency conversion process and converts it into fiat currency, ensuring that revenue is appropriately distributed to users and designated welfare and charity organizations.

[1753] As described above, this invention allows users to easily create digital art and sell it as NFTs without requiring specialized knowledge. It also provides a mechanism for donating a portion of the profits to welfare and charitable organizations, thereby contributing to society at the same time.

[1754] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1755] Step 1:

[1756] Entering Prompts

[1757] User: Launches a dedicated application and enters a prompt in text format about the digital art they want to create. For example, they can enter an image such as "a beautiful sunset" or "a city of the near future."

[1758] Input: The prompt text entered by the user.

[1759] Output: The prompt is displayed on the terminal.

[1760] Specific operation: The user enters a prompt sentence in the text box and presses the confirmation button.

[1761] Step 2:

[1762] Sending a prompt

[1763] Terminal: When the user presses the "Generate" button, the terminal validates the entered prompt and sends it in the appropriate format to the server, generating a data packet containing the prompt text and the user's identification information (e.g., user ID).

[1764] Input: The prompt text that the user entered and instructed to send.

[1765] Output: A data packet containing the prompt and the user ID is sent to the server.

[1766] Specific operation: Pressing a button sends a prompt, and a data packet is generated and sent.

[1767] Step 3:

[1768] Receiving prompts and generating images

[1769] Server: Receives prompts sent from the device and inputs them into a generative AI model (e.g., DALL-E or Midjourney). The image-generating AI model analyzes the prompts and automatically generates digital images.

[1770] Input: The prompt text and user ID sent.

[1771] Output: The digital image data and its metadata that are generated.

[1772] Specific operations: Prompt sentences are analyzed, images are generated, the generated image data is saved, and metadata is generated.

[1773] Step 4:

[1774] Sending the generated image

[1775] Server: Sends the URL and metadata of the generated digital image to the user's device. This data packet includes the URL of the temporary storage location for the image and the image metadata (e.g., creation time, image quality information, etc.).

[1776] Input: Generated digital image data and metadata.

[1777] Output: The data packets are sent to the user's terminal.

[1778] Specific operations: Temporarily save image data, generate a URL, and construct and send a data packet.

[1779] Step 5:

[1780] Displaying and evaluating the generated images

[1781] Terminal: Receives the URL sent from the server, accesses the URL, and displays the generated image. The user can check the displayed image and request regeneration or correction as necessary.

[1782] Input: URL and metadata received from the server.

[1783] Output: The generated image is displayed on the user's device.

[1784] Specific operation: Image data is acquired and displayed by accessing the URL.

[1785] Step 6:

[1786] Upload as an NFT

[1787] User: If satisfied with the generated image, press the "Upload as NFT" button.

[1788] Device: Sends an upload request to the server, which includes the image file and any necessary metadata (e.g., title, description, category, etc.).

[1789] Input: The image to be uploaded and its metadata.

[1790] Output: The upload request is sent to the server.

[1791] Specific operations: Image file and metadata are verified, and an upload data packet is created and sent.

[1792] Step 7:

[1793] Upload and sell images to the marketplace

[1794] Server: Receives the upload request, uploads the image file and metadata to an NFT marketplace (e.g., OpenSea or Rarible), obtains a public URL for the NFT, and returns it to the user.

[1795] Input: Uploaded image file and metadata.

[1796] Output: Public URL as NFT.

[1797] Specific operations: Data is sent to the marketplace, a public URL is obtained, and the URL is returned to the user.

[1798] Step 8:

[1799] Revenue Management and Distribution

[1800] Server: When an NFT sale is completed, the proceeds are recorded in a cryptocurrency wallet. Based on specific settings, a portion of the proceeds is donated to welfare or charity organizations.

[1801] Input: NFT sales completion information and revenue data.

[1802] Output: Recording of earnings and donations to cryptocurrency wallet.

[1803] Specific operations: Records sales data, manages virtual currency, and processes automatic donations.

[1804] Step 9:

[1805] Proxy handling of the cash conversion process

[1806] Agent: Manages the cash-out process, converts cryptocurrency into fiat currency, and distributes the cashed-out revenue appropriately to users and charities.

[1807] Input: User and charity revenue data.

[1808] Output: Distribution of redeemed fiat currency.

[1809] Specific operations: Virtual currency is converted into cash, converted into legal tender, and distributed.

[1810] By following these steps, users can easily create digital art and sell it as an NFT. This system also contributes to society by automatically donating a portion of the profits to welfare and charitable organizations.

[1811] (Application example 1)

[1812] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1813] Conventional systems for creating and selling digital art required specialized knowledge, limiting the user base. Furthermore, the ways in which the created digital art could be utilized were limited, particularly in content distribution services. Furthermore, the procedures for managing and allocating revenue from the created digital art were complicated, making them difficult for many users to use.

[1814] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1815] In this invention, the server includes a means for a user to input a prompt, a means for transmitting the input prompt to the server, a means for generating a digital image on the server using an image generation AI based on the prompt, a means for transmitting the generated digital image to the user's device and displaying it, a means for uploading the generated digital image to a distribution platform and distributing it as an album cover or background image, and a means for managing revenue from the distribution and donating a portion of the revenue to welfare or charitable organizations. This allows users without specialized knowledge to easily generate digital art and makes the art widely available in content distribution services. Furthermore, revenue management and distribution are automated, making the system easily accessible to many users.

[1816] A "prompt" is text that indicates instructions or requests that a user sends to a generative AI model.

[1817] The "server" is a central processing unit that receives prompts, runs the image generation AI, stores the generated images, and uploads them to the distribution platform.

[1818] "Image generation AI" is an artificial intelligence algorithm that automatically generates digital images based on user prompts.

[1819] A "digital image" is electronic visual data generated based on a user prompt.

[1820] A "terminal" is an electronic device that a user uses to enter prompts and view generated digital images.

[1821] A "distribution platform" is an online service that publishes and makes available to viewers the digital images generated.

[1822] An "album cover" is a digital image that visually represents a music album.

[1823] A "background visual" is a digital image used as a background on a distribution platform.

[1824] "Revenue" means the financial benefits derived from the distribution and sale of generated digital images and content.

[1825] A "welfare or charity organization" is a non-profit organization whose purpose is to donate a portion of its profits.

[1826] "Virtual currency" means electronic currency that exists in digital or virtual form and is used for transactions.

[1827] "Prompt suggestions and samples" are concrete examples and hints provided as reference to help users enter appropriate prompts.

[1828] The present invention relates to a system that allows users to easily create digital art by entering prompts and use it as album covers or background visuals on a distribution platform. This system is designed to be easy to use even for users who do not have specialized knowledge of digital art.

[1829] The server provides an interface for the user to enter a prompt. When the user enters a prompt, such as "an inspiring night sky, stars, or a dreamy theme," the prompt is sent to the server. The server processes the received prompt and generates a digital image using a generative AI model (e.g., DALL-E or MidJourney). The generated digital image is temporarily stored on the server, and a URL for the image is sent back to the user's device. The user can use this URL to view the generated image and make any necessary edits.

[1830] Once the user is satisfied with the generated digital image, they can press the "Distribute as content" button, which will upload the image to the distribution platform via the server. On the distribution platform, the generated digital image will be made public as an album cover or background visual.

[1831] Regarding revenue management, the server will track the usage of the distributed content in real time, and the revenue earned will be managed in virtual currency. The virtual currency conversion process will be handled by an agency, and a portion of the revenue will be donated to designated welfare and charitable organizations.

[1832] The specific system configuration and process are explained below. The user's device is an electronic device such as a smartphone, smart glasses, or head-mounted display (HMD), and prompt input is performed through a dedicated application installed on the device. This application is developed using programming languages ​​such as React Native, Swift, and Kotlin.

[1833] On the server side, server frameworks such as Node.js and Flask are used. DALL-E and MidJourney are used as image generation AI, and the generated digital images are temporarily stored in databases such as MongoDB and PostgreSQL. Music streaming services and video distribution services are used as distribution platforms.

[1834] For example, if a user inputs the prompt "Inspirational night sky, stars, dreamy theme," the image generation AI will generate digital art depicting a fantastic night sky based on this prompt. This generated digital art will be sent to the user's device, where the user can review and edit it, and then it will be uploaded to the distribution platform.

[1835] The above is a specific embodiment for carrying out the present invention, which makes it possible to easily create beautiful digital art without specialized knowledge and utilize it in a variety of content distribution services.

[1836] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1837] Step 1:

[1838] The user launches a dedicated application on their device and inputs a prompt in text form for the digital art they wish to create. This prompt might describe a specific image, such as "an inspiring night sky, stars, or a dreamlike theme." The user enters the prompt and presses the send button to generate the input data.

[1839] Step 2:

[1840] The terminal sends the entered prompt text to the server. In this sending process, an API request including the prompt text is generated and an HTTP request is made to the server. The input data is mainly the prompt text.

[1841] Step 3:

[1842] The server analyzes the received prompt and generates a digital image based on the prompt using image generation AI (e.g., DALL-E, MidJourney). The generative AI model understands the content of the prompt and performs data calculations to generate digital art in accordance with it. The input here is the prompt, and the output is a digital image.

[1843] Step 4:

[1844] The server temporarily stores the generated digital image and generates a URL and metadata for the image. The URL and metadata for the stored digital image are generated on the server side. The metadata includes the image title and description. The output is the URL and metadata for the digital image.

[1845] Step 5:

[1846] The server returns the URL and metadata of the generated image to the user's device, which receives this information and accesses it to display the image. The input is the URL and metadata from the server, and the output is the display of the image.

[1847] Step 6:

[1848] The user checks the generated digital image and edits it as necessary. When the image is satisfactory, the user presses the "Distribute as content" button. This operation confirms the edited image data. The input is the edited content of the image, and the output is the confirmed image data.

[1849] Step 7:

[1850] The terminal sends the confirmed image data to the server again. At this stage, an image data upload request is generated and sent to the server. The input is the confirmed image data, and the output is the upload request.

[1851] Step 8:

[1852] The server uploads the received image data to the distribution platform. Specifically, it uploads the image data using the distribution platform's API and publishes it as an album cover or background visual. The input is the confirmed image data, and the output is the upload result to the distribution platform.

[1853] Step 9:

[1854] The server tracks the usage of digital images on the distribution platform in real time and records and manages the revenue generated. In this process, revenue data is managed in virtual currency. The input is usage data, and the output is revenue record data.

[1855] Step 10:

[1856] When revenue is generated, the server requests an agent to process the virtual currency to be converted into cash. The agent converts the virtual currency and donates a portion of the revenue to a designated welfare or charity organization. The input is the virtual currency data of the revenue, and the output is the converted revenue and the fulfillment of the donation.

[1857] The above steps enable users to easily create digital art and use it widely in content distribution services. In addition, revenue management and distribution are automated, making the system easy to use for many users.

[1858] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1859] This invention relates to a system that allows users to easily create digital art by entering prompts, then sell it as NFTs and earn revenue. In particular, by combining it with an emotion engine that recognizes the user's emotions, more personalized prompt generation and suggestions can be generated, improving the user experience. This system is designed to be easily usable by users without specialized knowledge of digital art or users with physical disabilities.

[1860] Program processing details

[1861] 1. Prompt Input and Emotion Recognition

[1862] User: Launches a dedicated application and uses facial expressions, voice, or text input. For example, the user might smile in front of the smartphone camera, say "I'm feeling happy today," or type "Today is a wonderful day."

[1863] Terminal: Collects the user's facial expression, voice, and text data using input devices such as a camera, microphone, and keyboard.

[1864] Emotion engine: Analyzes collected data and recognizes the user's emotions. For example, it can recognize "happiness" as an emotion from the user's smile or voice.

[1865] 2. Prompt generation and suggestions

[1866] Terminal: Based on the emotion data obtained from the emotion engine, the prompt input means provides suggestions and samples. For example, if the emotion "happiness" is recognized, prompts such as "beautiful sunset" and "fun festival scenery" will be suggested.

[1867] 3. Sending prompts and generating images

[1868] User: Choose from suggested prompts or enter the text of their own prompt, then press the "Generate" button.

[1869] Terminal: Sends selected or entered prompts to the server.

[1870] Server: Receives prompts and the image generation AI generates digital images based on them.

[1871] 4. Display and check the generated image

[1872] Server: Temporarily stores the generated digital image and sends its URL and metadata to the user's device.

[1873] Terminal: The generated image is displayed based on the sent URL. The user checks the displayed image and, if satisfied, presses the "Upload as NFT" button.

[1874] 5. Upload as an NFT

[1875] Terminal: Detects when the "Upload as NFT" button is pressed and sends an upload request to the server.

[1876] Server: Receives the upload request and uploads the image file and necessary metadata to the NFT marketplace. If the upload is successful, the server confirms the start of sales on the marketplace.

[1877] 6. Sales procedures and revenue management

[1878] Server: Records sales start information in the system and notifies users that NFTs are available for sale. Tracks sales in real time and records purchase information and revenue when NFTs are purchased.

[1879] Server: Manages revenue as virtual currency and transfers the revenue information to a means that handles the cash-out process on your behalf.

[1880] 7. Revenue Sharing and Donations

[1881] Agents: These companies handle the process of converting virtual currency into fiat currency and donating a portion of the proceeds to designated welfare or charitable organizations.

[1882] Server: Records the completed donation information within the system and the user, and stores all transactions as a log.

[1883] Specific examples

[1884] For example, if a user launches an application and smiles into the smartphone camera, the following steps are performed:

[1885] 1. Prompt Input and Emotion Recognition

[1886] Device: The smartphone camera captures the user's smile.

[1887] Emotion engine: Analyzes collected facial image data and recognizes the user's emotion as "happiness."

[1888] 2. Prompt generation and suggestions

[1889] Terminal: Based on the emotion "happiness," the system suggests prompts to the user, such as "beautiful sunset" or "fun festival scenery."

[1890] 3. Sending prompts and generating images

[1891] User: Selects the prompt "Beautiful Sunset" and presses the "Generate" button.

[1892] Terminal: Sends the selected prompt to the server.

[1893] Server: Receives the prompt and the image generation AI generates a digital image depicting a "beautiful sunset."

[1894] 4. Display and check the generated image

[1895] Server: Sends the generated images and their metadata to the device.

[1896] Terminal: Display the image to the user and ask them to confirm.

[1897] 5. Upload as an NFT

[1898] User: Satisfied with the image, presses the "Upload as NFT" button.

[1899] Device: Sends an upload request to the server.

[1900] Server: Upload images to the NFT marketplace and start selling.

[1901] 6. Sales procedures and revenue management

[1902] Server: Track sales status in real time and manage revenue as virtual currency.

[1903] 7. Revenue Sharing and Donations

[1904] Agency: Converts revenue into fiat currency and donates a portion to welfare or charity organizations.

[1905] This allows users to create digital art in an easy and personalized way, sell it as an NFT, and use the proceeds to contribute to society.

[1906] The processing flow will be explained below.

[1907] Program processing details

[1908] Step 1:

[1909] User: Launch the dedicated application, smile in front of the smartphone camera, and capture your facial expression. You can also choose to input using voice or text. For example, you can say, "I'm feeling happy today," or input using text, "Today is a wonderful day."

[1910] Step 2:

[1911] Terminal: Collects the user's facial expressions, voice, and text data using input devices such as a camera, microphone, and keyboard. Prepares to send this data to the emotion engine.

[1912] Step 3:

[1913] Emotion engine: Analyzes collected data and recognizes the user's emotions. For example, it can recognize "happiness" as an emotion from the user's smile or voice.

[1914] Step 4:

[1915] Terminal: Based on the emotion data obtained from the emotion engine, the prompt input means provides suggestions and samples. For example, if the emotion "happiness" is recognized, prompts such as "beautiful sunset" and "fun festival scenery" will be suggested.

[1916] Step 5:

[1917] User: Choose from suggested prompts or enter the text of their own prompt, then press the "Generate" button.

[1918] Step 6:

[1919] Terminal: Sends the selected or entered prompt to the server, formatting the prompt data appropriately before sending it.

[1920] Step 7:

[1921] Server: Receives the prompt and provides it to the image generation AI, which analyzes the prompt and generates the appropriate digital image.

[1922] Step 8:

[1923] Server: Temporarily stores the generated digital image. Then, it generates a URL and metadata (title, description, creation date, etc.) for the image and sends them to the device.

[1924] Step 9:

[1925] Terminal: Based on the URL of the generated image received, the image is displayed to the user. The user checks the displayed image and, if satisfied, presses the "Upload as NFT" button.

[1926] Step 10:

[1927] Device: Detects when the "Upload as NFT" button is pressed and sends an upload request to the server, including the image file and any necessary metadata.

[1928] Step 11:

[1929] Server: Receives the upload request and uploads the image file and necessary metadata to the NFT marketplace. If the upload is successful, the server confirms the start of sales on the marketplace.

[1930] Step 12:

[1931] Server: Records sales start information within the system and notifies users that their NFTs are available for sale.

[1932] Step 13:

[1933] Server: Tracks sales in real time, records the purchase information and revenue when an NFT is purchased, and records cryptocurrency revenue in the system.

[1934] Step 14:

[1935] Server: Manages revenue as virtual currency and transfers the revenue information to a means that handles the cash-out process on your behalf.

[1936] Step 15:

[1937] Agents: These companies handle the process of converting virtual currency into fiat currency and donating a portion of the proceeds to designated welfare or charitable organizations.

[1938] Step 16:

[1939] Server: Records the completed donation information within the system and the user, and stores all transactions as a log.

[1940] Specific examples

[1941] For example, if a user launches an application and smiles into the smartphone camera, the following steps are performed:

[1942] Step 1:

[1943] User: Speaks to the application, "I'm feeling happy today."

[1944] Step 2:

[1945] Device: The smartphone's microphone captures the user's voice.

[1946] Step 3:

[1947] Emotion engine: Analyzes collected voice data and recognizes the user's emotion as "happiness."

[1948] Step 4:

[1949] Terminal: Based on the emotion "happiness," the system suggests prompts to the user, such as "beautiful sunset" or "fun festival scenery."

[1950] Step 5:

[1951] User: Selects the prompt "Beautiful Sunset" and presses the "Generate" button.

[1952] Step 6:

[1953] Terminal: Sends the selected prompt to the server.

[1954] Step 7:

[1955] Server: Receives the prompt and the image generation AI generates a digital image depicting a "beautiful sunset."

[1956] Step 8:

[1957] Server: Sends the generated images and their metadata to the device.

[1958] Step 9:

[1959] Terminal: Display the image to the user and ask them to confirm.

[1960] Step 10:

[1961] User: Satisfied with the image, presses the "Upload as NFT" button.

[1962] Step 11:

[1963] Device: Sends an upload request to the server.

[1964] Step 12:

[1965] Server: Upload images to the NFT marketplace and start selling.

[1966] Step 13:

[1967] Server: Track sales status in real time and manage revenue as virtual currency.

[1968] Step 14:

[1969] Server: Carries out the procedures to process the cash-out process.

[1970] Step 15:

[1971] Agency: Converts revenue into fiat currency and donates a portion to welfare or charity organizations.

[1972] Step 16:

[1973] Server: Records donation information and keeps a log of all transactions.

[1974] In this way, users can easily create digital art and use the proceeds from selling it as an NFT to contribute to society.

[1975] Example 2

[1976] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1977] Conventional digital art generation systems require users to input prompts, generate digital images based on those prompts, and sell them as NFTs, resulting in a complicated process. Furthermore, they lack the ability to generate personalized prompts using emotion recognition, which hinders the user experience. Furthermore, the process of managing revenue and donating to welfare or charitable organizations is also complicated.

[1978] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1979] In this invention, the server includes means for a user to input a prompt, means for transmitting the input prompt, means for generating digital media using an image generation algorithm, means for transmitting the generated digital media to a user terminal and displaying it, means for uploading the digital media to an e-commerce platform and selling it as a digital asset, means for managing revenue and donating it to welfare or charity organizations, means for analyzing facial expressions, voice, and text data to recognize emotions, and means for generating and suggesting prompts based on the recognized emotions, thereby improving the user experience and simplifying the revenue management and donation process.

[1980] A "prompt" is a sentence or word entered by a user that represents an instruction or request.

[1981] A "server" is a computer system that provides services to other computers on a network.

[1982] A "terminal" is a computer device or apparatus that is operated by a user.

[1983] An "image generation algorithm" is a method or procedure for automatically generating a digital image based on specified prompts.

[1984] "Digital media" refers to content such as images and video that is electronically generated and stored.

[1985] An "e-commerce platform" is a web service or application for buying and selling goods over the Internet.

[1986] A "digital asset" is any property stored in digital form that is data of value that can be owned or sold.

[1987] An "emotion engine" is a technology or system that analyzes a user's facial expressions, voice, and text data to identify emotions.

[1988] "Revenue" means the profit earned when a Digital Asset is sold.

[1989] "Virtual currency" means a digital or virtual currency whose transactions are governed by cryptography.

[1990] "Welfare and charity organizations" are organizations and groups that contribute to society and provide humanitarian aid.

[1991] A "suggestion" is a prompt or idea presented to the user.

[1992] The present invention relates to a system that allows users to easily create digital art by entering prompts, sell the resulting digital art as digital assets, and earn revenue. In particular, by combining it with an emotion engine that recognizes the user's emotions, more personalized prompt generation and suggestions can be generated, improving the user experience. This system is designed to be easily usable by users who do not have specialized knowledge of digital art or who have physical disabilities. Specifically, the system is implemented as follows.

[1993] First, a user launches a dedicated application and smiles at the smartphone camera, speaks into the microphone saying "I'm feeling happy today," or types "It's a nice day today" into a text field. The hardware used here is the smartphone's input devices, such as the camera, microphone, and keyboard.

[1994] The device uses input devices such as a camera, microphone, and keyboard to collect the user's facial expressions, voice, and text data. The collected data is temporarily stored locally and then sent to a server. The server uses an emotion engine (e.g., an emotion recognition algorithm) to analyze the collected data and recognize the user's emotions. Specifically, the emotion engine can use existing emotion recognition technologies such as Microsoft Azure's Face API and IBM Watson's Tone Analyzer.

[1995] The server generates multiple prompts based on the recognized emotion data and sends them to the device. For example, if the emotion "happiness" is recognized, prompts such as a beautiful sunset or a fun festival scene may be generated. The device then presents the generated prompts to the user, who can then select from the suggested prompts or enter their own prompt by text.

[1996] When the user selects or enters a prompt and presses the "Generate" button, the device sends the prompt to the server. The server uses an image generation algorithm (e.g., OpenAI's DALL-E) based on the received prompt to generate a digital media. The generated digital media is temporarily stored, and its URL and metadata are sent to the user's device.

[1997] The device displays the digital media generated based on the URL and prompts the user for confirmation. If the user is satisfied with the generated digital media, they press the "Upload as NFT" button. This causes the device to send an upload request to the server, which then uploads the image and metadata to an NFT marketplace (e.g., OpenSea) and begins selling it.

[1998] The server records the sales status within the system and notifies the user that the NFT is available for sale. It also monitors the sales situation in real time and records purchase information and revenue. The revenue is managed as virtual currency and sent to the user's wallet address. The agency converts the revenue into fiat currency and donates it to a welfare or charity organization designated by the user. This process is managed by the server, which notifies the user when the donation is complete and stores all transaction logs.

[1999] For example, if a user launches the application and smiles into the smartphone camera, the emotion engine will recognize the expression as "happiness" and suggest a prompt such as "beautiful sunset." The user can then select the prompt and press the "Generate" button, which will generate a digital image using the image generation algorithm.

[2000] Example prompt sentence:

[2001] "Prompt: Please walk me through the steps to capture a photo of a smiling face, generate digital art that expresses happiness, and upload it to an NFT marketplace."

[2002] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2003] Step 1: Prompt Input and Emotion Recognition

[2004] User: Launches the dedicated application and smiles in front of the smartphone camera. In the case of voice input, the user speaks, "I'm feeling happy today," and in the case of text input, the user types, "Today is a wonderful day."

[2005] Input: User's facial expressions, voice, and text data

[2006] Terminal: The user's facial expression data captured by the camera, voice data collected by the microphone, and text data entered on the keyboard are temporarily stored in local storage.

[2007] Output: Collected facial expressions, voice, and text data

[2008] Terminal: Sends collected data to the server.

[2009] Input: Collected facial expressions, voice, and text data

[2010] Server: Analyzes the collected data using an emotion engine (e.g., emotion recognition algorithm) to identify the user's emotion.

[2011] Output: User's emotion (e.g., "Happy")

[2012] ---

[2013] Step 2: Generate and suggest prompts

[2014] Server: Generates appropriate prompts based on recognized emotion data (e.g., "happy").

[2015] Input: User emotion data

[2016] Server: For example, based on the emotion "happiness," generate prompts such as "a beautiful sunset" or "a fun festival scene."

[2017] Output: Generated prompt

[2018] Terminal: Presents the generated prompt to the user.

[2019] Input: Generated prompt

[2020] Output: The prompt displayed to the user

[2021] ---

[2022] Step 3: Sending prompts and generating images

[2023] User: Select from the provided prompts or enter their own prompt and press the "Generate" button.

[2024] Input: The prompt selected or entered by the user

[2025] Terminal: Sends selected or entered prompts to the server.

[2026] Output: Prompt sent

[2027] Server: Based on the received prompts, generates digital media using an image generation algorithm (e.g., OpenAI's DALL-E).

[2028] Input: prompt

[2029] Output: The digital medium produced

[2030] ---

[2031] Step 4: View and check the generated image

[2032] Server: Temporarily stores the generated digital media and metadata, and sends the URL to the user's device.

[2033] Input: Generated digital media and metadata

[2034] Output: URL and metadata of the digital media

[2035] Terminal: Using the received URL, the generated digital media is displayed to the user.

[2036] Input: URL of digital media

[2037] Output: The digital media displayed to the user

[2038] User: Check the generated digital media and if satisfied, press the "Upload as NFT" button.

[2039] ---

[2040] Step 5: Upload as an NFT

[2041] Terminal: Detects when the "Upload as NFT" button is pressed and sends the image data and metadata to the server.

[2042] Input: Image data and metadata

[2043] Output: Request sent to the server

[2044] Server: Based on the received request, uploads the digital media and metadata to an e-commerce platform (e.g., OpenSea) and initiates sales.

[2045] Input: Request, Digital Media, Metadata

[2046] Output: Upload status to e-commerce platform

[2047] ---

[2048] Step 6: Sales Process and Revenue Management

[2049] Server: Records sales start information in the system and notifies users that their NFTs are available for sale.

[2050] Input: Sales start information from e-commerce platform

[2051] Output:Available for sale notification

[2052] Server: Monitors sales in real time and records purchase information and revenue when an NFT is purchased.

[2053] Input: Sales Status

[2054] Output: Purchase information, revenue records

[2055] Server: Manages revenue as virtual currency and sends it to the user's wallet address.

[2056] Input: Revenue Data

[2057] Output: Send cryptocurrency to user wallet

[2058] ---

[2059] Step 7: Revenue sharing and donations

[2060] Agency: Converts virtual currency into fiat currency and donates it to welfare or charity organizations designated by the user.

[2061] Input: Cryptocurrency

[2062] Output: Fiat currency, donation process

[2063] Server: Notifies the user that the donation has been completed and stores all transaction logs within the system.

[2064] Input: Donation completion information

[2065] Output: Notifications, transaction log storage

[2066] (Application example 2)

[2067] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2068] Conventional digital art generation systems allow users to input prompts and generate images based on those prompts, but the system does not generate or suggest personalized prompts that take the user's emotions into account, resulting in a limited user experience. Furthermore, the process of selling the generated digital art as an NFT requires specialized knowledge, limiting the number of users.

[2069] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2070] In this invention, the server includes: a means for a user to input a prompt; a means for transmitting the input prompt to the server; a means for generating a digital image on the server using an image generation AI based on the prompt; a means for transmitting and displaying the generated digital image to the user's device; a means for uploading the generated digital image to a marketplace and selling it as an NFT; a means for managing sales revenue and donating a portion of the revenue to welfare or charity organizations; and a means for generating or suggesting personalized prompts using an emotion engine that recognizes the user's emotions. This enables users to easily create personalized digital art based on their own emotions, sell it as an NFT, and earn revenue.

[2071] "User" means an individual or entity that utilizes the system to enter prompts to create and sell digital art.

[2072] A "prompt" is an instruction, such as text, audio, or an image, that is entered by the user.

[2073] A "server" is a computer system that receives prompts and manages the generation, display, and sale of digital images.

[2074] "Image generation AI" is an artificial intelligence technology that automatically generates digital images based on input prompts.

[2075] "Digital Image" means image data of the created artwork in digital format.

[2076] A "terminal" is a device (e.g., smartphone, tablet) that a user uses to enter prompts and view generated digital images.

[2077] The "marketplace" is an online platform that sells the generated digital images as NFTs.

[2078] "NFT" stands for "Non-Fungible Token" and is a blockchain-based token that proves ownership of digital art or other digital content.

[2079] An "emotion engine" is a technology for recognizing and analyzing a user's emotions from facial expressions, voice, or text.

[2080] A "personalized prompt" is a specific prompt that is suggested based on the perceived sentiment of the user.

[2081] "Revenue" is the monetary gain from the sold NFT.

[2082] "Welfare and charity organizations" are organizations or groups that provide social assistance and relief activities.

[2083] "Virtual currency" is a digital currency traded online and is a different form of traditional physical currency.

[2084] This invention is a system that allows users to create digital art by entering prompts and sell it as NFTs. At the heart of the system is an emotion engine that recognizes the user's emotions, allowing it to generate or suggest personalized prompts.

[2085] The system uses the following major hardware and software components:

[2086] 1. Hardware

[2087] Terminal: A device (e.g., smartphone, tablet, smart glasses) on which a user enters prompts and displays the generated digital images.

[2088] Server: A computer system that receives prompts and manages the generation, display, and sale of digital images.

[2089] 2. Software

[2090] Emotion engine: A technology for recognizing emotions from a user's facial expressions, voice, or text. Examples include AWS Rekognition and Google Cloud Speech-to-Text.

[2091] Image generation AI: Artificial intelligence technology that automatically generates digital images based on input prompts, such as OpenAI's DALL-E.

[2092] NFT Marketplace: An online platform that sells generated digital images as NFTs. It can use OpenSea APIs and other APIs.

[2093] Virtual currency management system: A system for managing sales revenue as virtual currency and handling the cash conversion process.

[2094] 3. Examples of prompt sentences

[2095] "happiness"

[2096] "Beautiful sunset"

[2097] "A fun festival scene"

[2098] The system processing is described in detail below.

[2099] Prompt Input and Emotion Recognition

[2100] The user uses the device to make facial expressions, input voice, or input text in front of the camera. The device uses input devices such as a camera, microphone, and keyboard to collect the user's facial, voice, and text data and send it to the emotion engine. The emotion engine analyzes the collected data and recognizes the user's emotion. For example, if the user smiles, the emotion engine recognizes "happiness."

[2101] Prompt generation and suggestions

[2102] The device generates or suggests relevant prompts based on the emotion data obtained from the emotion engine. For example, if the emotion "happiness" is recognized, prompts such as "beautiful sunset" or "fun festival scenery" are suggested to the user.

[2103] Digital image generation and display

[2104] The user selects from suggested prompts or enters their own prompt. Then, by pressing the "Generate" button, the device sends the selected or entered prompt to the server. The server then sends the received prompt to an image generation AI, which generates a digital image. The generated digital image is temporarily stored by the server, and its URL and metadata are sent to the user's device. The device then displays the generated image based on the URL.

[2105] Converting images into NFTs and selling them

[2106] If the user is satisfied with the generated image, they press the "Upload as NFT" button. The device sends an upload request to the server, which uploads the image file and necessary metadata to the NFT marketplace. If the upload is successful, the image will be available for sale on the marketplace.

[2107] Revenue Management and Donations

[2108] The server tracks sales status in real time and manages the revenue as virtual currency, which is converted into fiat currency through a cash-out process, a portion of which is donated to welfare and charitable organizations.

[2109] In this way, the system allows users to easily create personalized, emotion-based digital art, sell it as an NFT, and earn revenue.

[2110] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2111] Step 1:

[2112] The user uses the device to make facial expressions, input voice, or input text in front of the camera. The device collects the user's facial expression, voice, and text data using input devices such as a camera, microphone, and keyboard.

[2113] Input: facial expression images, audio data, text data

[2114] Output: Collected user data

[2115] Step 2:

[2116] The device sends the collected user data to the emotion engine, which analyzes facial images using AWS Rekognition and converts the audio into text using Google Cloud Speech-to-Text. The analyzed data is used to recognize the user's emotions.

[2117] Input: Collected user data

[2118] Data processing: facial expression image analysis, voice data text conversion

[2119] Output: Recognized emotion data (e.g., happiness)

[2120] Step 3:

[2121] The device generates or suggests relevant prompts based on the recognized emotion data. For example, if the recognized emotion is "happiness," the device may suggest prompts such as "beautiful sunset" or "fun festival scenery" to the user.

[2122] Input: Recognized emotion data

[2123] Data generation: generating prompts that correspond to emotions

[2124] Output: A suggested prompt (e.g., "Beautiful sunset")

[2125] Step 4:

[2126] The user selects from the suggested prompts or enters their own prompt and presses the "Generate" button. The terminal sends the selected or entered prompt to the server.

[2127] Input: Suggested prompt or your own prompt

[2128] Output: Prompt data sent

[2129] Step 5:

[2130] The server sends the received prompt data to the image generation AI, which generates a digital image based on the prompt. The generated digital image is temporarily stored.

[2131] Input: Submitted prompt data

[2132] Data calculation: Digital image generation using image generation AI

[2133] Output: The generated digital image

[2134] Step 6:

[2135] The server sends the URL and metadata of the generated digital image to the terminal, which then displays the generated image to the user based on the URL.

[2136] Input: Generated digital image

[2137] Data processing: Image URL and metadata generation

[2138] Output: Image URL and metadata

[2139] Step 7:

[2140] If the user is satisfied with the generated image, they press the "Upload as NFT" button, and the device sends an upload request to the server.

[2141] Input: User upload request

[2142] Output: Upload request sent

[2143] Step 8:

[2144] The server uploads the image file and necessary metadata to the NFT marketplace, where, if the upload is successful, the image will be available for sale.

[2145] Input: Upload request sent

[2146] Data Calculation: Uploading image files and metadata

[2147] Output: Marketplace sales status

[2148] Step 9:

[2149] The server tracks sales status in real time and manages the revenue as virtual currency, which is converted into fiat currency through a cash-out process, a portion of which is donated to welfare and charitable organizations.

[2150] Input: Marketplace sales data

[2151] Data Computing: Revenue Management and Monetization Process

[2152] Output: Managed revenue and donation information

[2153] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2154] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2155] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2156] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2157] FIG. 9 illustrates an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and behaviors arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2158] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2159] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2160] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2161] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2162] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2163] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2164] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2165] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2166] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2167] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2168] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2169] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2170] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2171] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2172] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2173] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2174] The following is further disclosed regarding the above embodiment.

[2175] (Claim 1)

[2176] a means for the user to input a prompt;

[2177] means for sending the entered prompt to a server;

[2178] means for generating a digital image using an image generation AI on a server based on the prompt;

[2179] means for transmitting the generated digital image to a user's terminal and displaying it;

[2180] A means to upload the generated digital images to a marketplace and sell them as NFTs,

[2181] A means to manage the profits from sales and donate a portion to welfare and charitable organizations,

[2182] A system including:

[2183] (Claim 2)

[2184] A means for managing the revenue in virtual currency and carrying out the cashing process;

[2185] The system of claim 1 further comprising:

[2186] (Claim 3)

[2187] The prompt input means is characterized in that it provides the user with suggestions and samples of prompts.

[2188] 10. The system of claim 1.

[2189] "Example 1"

[2190] (Claim 1)

[2191] a means for the user to input a prompt;

[2192] means for sending the entered prompt to a server;

[2193] means for generating, on a server, a digital image using a generative AI model based on the prompts;

[2194] means for transmitting the generated digital image to a user's terminal and displaying it;

[2195] A means for uploading digital images generated by user operations to a marketplace and selling them as NFTs;

[2196] The revenue from the sale can be managed in virtual currency and a portion of it can be donated to welfare or charitable organizations.

[2197] A system including:

[2198] (Claim 2)

[2199] A means to automate the process of cashing out revenue,

[2200] The system of claim 1 further comprising:

[2201] (Claim 3)

[2202] The prompt input means provides the user with suggestions and samples of prompts.

[2203] 10. The system of claim 1.

[2204] "Application Example 1"

[2205] (Claim 1)

[2206] a means for the user to input a prompt;

[2207] means for sending the entered prompt to a server;

[2208] means for generating a digital image using an image generation AI on a server based on the prompt;

[2209] means for transmitting the generated digital image to a user's terminal and displaying it;

[2210] A means for uploading the generated digital images to a distribution platform and distributing them as album covers or background visuals;

[2211] A means to manage the revenue generated and donate a portion to welfare and charitable organizations,

[2212] A system including:

[2213] (Claim 2)

[2214] A means for managing the revenue in virtual currency and carrying out the cashing process;

[2215] The system of claim 1 further comprising:

[2216] (Claim 3)

[2217] The prompt input means is characterized in that it provides the user with suggestions and samples of prompts.

[2218] 10. The system of claim 1.

[2219] "Example 2: Combining Emotion Engines"

[2220] (Claim 1)

[2221] a means for the user to input a prompt;

[2222] means for sending the entered prompt to a server;

[2223] means for generating the digital media on the server using an image generation algorithm based on the prompts;

[2224] means for transmitting the generated digital medium to a user's terminal and displaying the medium;

[2225] means for uploading the generated digital media to an e-commerce platform and selling it as a digital asset;

[2226] A means to manage the profits from sales and donate a portion to welfare and charitable organizations,

[2227] A means for analyzing the collected facial expression, voice, and text data to recognize the user's emotions;

[2228] means for generating and suggesting prompts based on the recognized emotions;

[2229] A system including:

[2230] (Claim 2)

[2231] The system according to claim 1, further comprising means for managing the revenue in virtual currency and carrying out a cashing process on behalf of the revenue.

[2232] (Claim 3)

[2233] 10. The system of claim 1, wherein the prompt input means provides suggested or sample prompts to the user.

[2234] "Application example 2 when combining emotion engines"

[2235] (Claim 1)

[2236] a means for the user to input a prompt;

[2237] means for sending the entered prompt to a server;

[2238] means for generating a digital image using an image generation AI on a server based on the prompt;

[2239] means for transmitting the generated digital image to a user's terminal and displaying it;

[2240] A means to upload the generated digital images to a marketplace and sell them as NFTs,

[2241] A means to manage the profits from sales and donate a portion to welfare and charitable organizations,

[2242] means for generating or suggesting personalized prompts using an emotion engine that recognizes the user's emotions;

[2243] A system including:

[2244] (Claim 2)

[2245] A means for managing the revenue in virtual currency and carrying out the cashing process;

[2246] The system of claim 1 further comprising:

[2247] (Claim 3)

[2248] The prompt input means is characterized in that it provides the user with suggestions and samples of prompts.

[2249] 10. The system of claim 1. [Explanation of symbols]

[2250] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a means for the user to input a prompt; means for sending the entered prompt to a server; means for generating a digital image using an image generation AI on a server based on the prompt; means for transmitting the generated digital image to a user's terminal and displaying it; A means to upload the generated digital images to a marketplace and sell them as NFTs, A means to manage the profits from sales and donate a portion to welfare and charitable organizations, A system including:

2. A means for managing the revenue in virtual currency and carrying out the cashing process; The system of claim 1 further comprising:

3. The prompt input means is characterized in that it provides the user with suggestions and samples of prompts. The system of claim 1 .

Images