System

Abstract

To provide a system.SOLUTION: A system comprises: means for allowing a customer to input a desired item; means for inputting a prompt sentence to generative AI based on the desired item input to the input means, and generating a generation content; means for linking the content generated by the means for generating the generation content to various generative AI to generate a digital content; and means for providing the digital content generated by the means for generating the digital content to the customer and receiving compensation therefor.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In the creation of digital content, it is difficult to efficiently create and provide commercial materials that reflect the specific wishes of users. [Means for solving the problem]

[0005] The present invention provides a means for users to input their desired items, a means for querying a generative AI based on the desired items input and generating a generated code, a means for linking the generated code to various generative AIs (image generation AI / music generation AI / audio generation AI, etc.) to generate digital products, and a means for providing the generated digital products to users and receiving payment for them. This makes it possible to generate and provide digital content that reflects the specific wishes of users. [Brief explanation of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment Example 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0007] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0010] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0014] [First embodiment]

[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0019] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0022] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0023] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0027] "Example 1"

[0028] In one embodiment of the present invention, a portal is provided that allows users to input their desired items. This portal may be implemented in the form of a website or application, and users can specifically input their desired items by entering text or selecting from options. For example, if a user desires "an illustration of a cat with a sunset in the background," the user enters that information.

[0029] "Example 2"

[0030] Next, based on the user's inputted wishes, the generative AI asks questions and generates a generation code. This generative AI can use natural language processing AI such as cat generation AI. The cat generation AI generates detailed instructions for the digital content to be generated based on the user's input. For example, in response to a request for "an illustration of a cat with a sunset in the background," the cat generation AI generates specific generation instructions such as "draw a sunset in the background and a cat in the foreground." "Example 3"

[0031] The generated instructions are linked to various generation AIs (image generation AI, music generation AI, voice generation AI, etc.). These generation AIs generate specific digital products based on instructions from the cat generation AI. For example, the image generation AI generates a specific illustration based on the instruction to "draw a sunset in the background and a cat in the foreground."

[0032] "Example 4"

[0033] Finally, the generated digital product is provided to the user, and payment is received. This can be provided in various forms, such as providing a download link, sending by email, displaying within an application, etc. Payment can be received in various forms, such as a one-time fee, a monthly membership fee, or advertising revenue.

[0034] The processing flow of each embodiment will be described below.

[0035] "Example 1"

[0036] Step 1: A user enters details of the digital content they want through a portal such as a website or application. For example, if they want an "illustration of a cat with a sunset in the background," they can enter that information specifically by entering text or selecting from options.

[0037] "Example 2"

[0038] Step 1: After receiving input from the user, the generative AI (e.g., Cat generative AI) analyzes it.

[0039] Step 2: Based on the analysis results, the generative AI generates detailed instructions for the digital content to be generated. For example, it generates specific instructions such as "paint a sunset in the background and a cat in the foreground."

[0040] "Example 3"

[0041] Step 1: Various generative AIs (image generation AI / music generation AI / audio generation AI, etc.) receive instructions from the generative AI and generate digital content according to the instructions.

[0042] Step 2: For example, the image generation AI generates a specific illustration based on the instruction, "Draw a sunset in the background and a cat in the foreground."

[0043] "Example 4"

[0044] Step 1: The generated digital product is provided to the user. This can be provided in various forms, such as by providing a download link, sending it via email, or displaying it within an application.

[0045] Step 2: Users are compensated in various ways, such as a one-time generation fee, a monthly membership fee, or advertising revenue.

[0046] Example 1

[0047] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0048] With conventional systems, it was difficult to quickly and accurately provide digital content generated based on specific customer input of what they wanted. Furthermore, the quality and variety of the generated content was limited, making it impossible to meet the diverse needs of customers.

[0049] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0050] In this invention, the server includes a means for allowing customers to input their desired items, a means for inputting prompt sentences to a generative AI based on the input desired items to generate generated content, and a means for linking the generated content to various generative AIs (image generation AI, music generation AI, voice generation AI, etc.) to generate digital content. This enables the rapid generation and provision of a variety of high-quality digital content based on the specific wishes of customers.

[0051] "Customer" refers to a user who uses the system to input their desired content and receives the generated digital content.

[0052] "Desired Items" refers to the specific requests and demands that you enter through the system.

[0053] "Generative AI" refers to an artificial intelligence model that takes prompts based on customer preferences and generates generative content.

[0054] A "prompt sentence" is text data input to a generative AI, and contains information that forms the basis of the generated content.

[0055] "Generated content" refers to digital data generated by generative AI based on prompt text.

[0056] "Various generative AI" refers to artificial intelligence models that generate specific forms of digital content (images, music, audio, etc.) based on generated content.

[0057] "Digital content" refers to digital commercial materials such as music, images, and audio generated by generative AI.

[0058] "Consideration" means the fee or remuneration you pay to receive the generated Digital Content.

[0059] MODE FOR CARRYING OUT THE INVENTION

[0060] This invention is a system that allows a customer to input their desired items and provides digital content generated based on the input. A specific embodiment of this system will be described below.

[0061] User operations

[0062] Users access the portal through a web browser or application. The portal provides an interface for users to input their desires. Users use text boxes and options to specify their desires. For example, they might enter "an illustration of a cat with a sunset in the background." Once they've completed their request, they click a submit button.

[0063] Device operation

[0064] The terminal receives the request entered by the user and sends it to the server. Specifically, if the user enters "an illustration of a cat with a sunset in the background," the terminal converts the text data into JSON format and sends a POST request to the server's API endpoint using an HTTP request.

[0065] Server Operations

[0066] The server receives the HTTP request sent from the device and extracts the user's wishes from the request body. The extracted text data is input as a prompt to the generative AI model. For example, using OpenAI's (registered trademark) GPT-4 (registered trademark) API, the prompt "Illustration of a cat with a sunset in the background" is sent. The generative AI model generates an illustration based on the prompt and sends the result back to the server.

[0067] Server data return

[0068] The server returns the illustration data received from the generative AI model to the device. Specifically, the generated illustration is included in an HTTP response as binary data and sent to the device. The user can then view the generated illustration through their device. For example, in a web browser, the illustration is displayed as an image tag.

[0069] Specific examples

[0070] A user accesses the portal, enters "illustration of a cat with a sunset as a background," and clicks the submit button. The device converts this text data into JSON format and sends a POST request to the server's API endpoint. The server inputs the received text data as a prompt sentence into a generative AI model (for example, OpenAI's GPT-4). The generative AI model generates an illustration based on the prompt sentence and sends it back to the server. The server includes the generated illustration as binary data in an HTTP response and sends it to the device. The user can view the generated illustration through the device.

[0071] In this way, the user can specifically input what he or she wants and quickly obtain a variety of high-quality digital content based on that request.

[0072] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0073] Step 1:

[0074] Users access the portal through a web browser or application. They use the text boxes and options displayed in the portal's interface to enter their specific requests. For example, they might enter "an illustration of a cat with a sunset in the background." Once they've completed their request, they click a submit button.

[0075] Input: User's request (e.g., "An illustration of a cat with a sunset in the background")

[0076] Output: The user's request is sent to the terminal as text data.

[0077] Step 2:

[0078] The terminal receives the user's input and converts the text data into JSON format, which is then sent as a POST request to the server's API endpoint using an HTTP request.

[0079] Input: User's desired text data (e.g., "Illustration of a cat with a sunset in the background")

[0080] Output: Data converted to JSON format is sent to the server

[0081] Step 3:

[0082] The server receives the HTTP request sent from the device and extracts the user's request from the request body. The extracted text data is input as a prompt to the generative AI model. For example, using OpenAI's GPT-4 API, the prompt "Illustration of a cat with a sunset in the background" is sent. The generative AI model generates an illustration based on the prompt and sends the result back to the server.

[0083] Input: JSON format data (e.g., "Illustration of a cat with a sunset in the background")

[0084] Output: Illustration data generated from the generative AI model

[0085] Step 4:

[0086] The server returns the illustration data received from the generative AI model to the device. Specifically, the generated illustration is included in the HTTP response as binary data and sent to the device.

[0087] Input: Illustration data from a generative AI model

[0088] Output: The illustration as binary data is sent to the terminal.

[0089] Step 5:

[0090] The user can view the generated illustrations through their device. For example, in a web browser, the illustrations are displayed as image tags.

[0091] Input: An illustration of the binary data sent from the server

[0092] Output: Display of illustrations that users can check

[0093] In this way, the user can specifically input what he or she wants and quickly obtain a variety of high-quality digital content based on that request.

[0094] (Application example 1)

[0095] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0096] Conventional digital content generation systems have made it difficult for users to easily generate the specific illustrations and images they desire. Furthermore, they lacked the functionality to allow users to download or share the generated digital materials, limiting the user experience. This made it difficult to meet the diverse needs of users.

[0097] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0098] In this invention, the server includes a means for allowing customers to input their desired items, a means for querying a generation AI based on the input desired items and generating a generation code, a means for linking the generated code to various generation AIs (image generation AI / music generation AI / voice generation AI, etc.) to generate digital products, a means for providing the generated digital products to customers and receiving payment, and a means for downloading or sharing the generated digital products. This makes it possible for users to easily generate specific digital content they desire and download or share it.

[0099] "Means for customers to input their desired content" refers to an interface that allows users to input the specific illustrations, images, and other digital content they desire by entering text or selecting from a list of options.

[0100] The "means of asking a question to a generative AI and generating a generated code" is a process for sending a prompt to a generative AI based on a user's input preference, and obtaining a generated code as a result.

[0101] "Means of linking to various generative AIs to generate digital products" refers to a method of using the generated code to link to various generative AIs, such as image generation AI and music generation AI, to generate digital content that meets the user's wishes.

[0102] "Means for providing generated digital products to customers and receiving payment" refers to a system for providing generated digital content to users and receiving payment in return.

[0103] "Means for downloading or sharing generated digital products" refers to a function that allows users to download generated digital content to their own devices or share it on platforms such as social media.

[0104] "Generating digital products based on prompts using a specific generative AI model" refers to the process of using a specific generative artificial intelligence model to generate digital content based on prompts entered by a user.

[0105] "Digital content such as illustrations, images, music, and audio" refers to all content such as digital illustrations, images, music, and audio generated by generative artificial intelligence.

[0106] A system for implementing this invention includes means for allowing a user to input desired items, means for asking questions to a generation AI to generate a generated code, means for linking the generated code to various generation AIs to generate digital products, means for providing the generated digital products to customers and receiving payment, and means for downloading or sharing the generated digital products.

[0107] System configuration

[0108] The system uses the following hardware and software:

[0109] Hardware

[0110] Server (cloud server or local server)

[0111] User's smartphone

[0112] software

[0113] Flask (Python web framework)

[0114] OpenAI API (generative AI model)

[0115] Data processing and calculation

[0116] 1. User Input

[0117] Using a smartphone application, users can specify the illustration or image they want by entering text, for example, "an illustration of a cat with a sunset in the background."

[0118] 2. Questions for Generative AI

[0119] The server receives user input and sends a prompt to the generative AI, such as "Create an illustration of a cat with a sunset background."

[0120] 3. Generate generated code

[0121] The generative AI generates generative code based on the prompt text. This generative code is linked to various generative AIs (image generation AI, music generation AI, voice generation AI, etc.).

[0122] 4. Digital product creation

[0123] Various generation AIs receive the generated code and generate digital content according to the user's wishes. For example, the image generation AI generates an "illustration of a cat against a sunset background."

[0124] 5. Provision of digital products and receipt of payment

[0125] The generated digital content is provided to users through a server, who can then download it or share it on social media. Payment is made through an online payment system.

[0126] Specific examples

[0127] If the user wants "an illustration of a cat with a sunset in the background," they would enter the prompt text as follows:

[0128] Prompt Sentence Examples

[0129] Create an illustration of a cat with a sunset background

[0130] By sending this prompt to the generative AI, an illustration that matches the user's desire will be generated. The generated illustration can then be downloaded to the user's smartphone and shared on social media.

[0131] In this way, users can easily create the specific digital content they desire and download or share it.

[0132] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0133] Step 1:

[0134] The user uses a smartphone application to specify the desired illustration or image by entering text. For example, they might enter "an illustration of a cat with a sunset in the background." This input data is then sent to the server.

[0135] Step 2:

[0136] The server analyzes the input data received from the user and generates a prompt for the generative AI. Specifically, based on the input text "An illustration of a cat with a sunset background," it creates the prompt "Create an illustration of a cat with a sunset background." This prompt is then sent to the generative AI.

[0137] Step 3:

[0138] The generative AI generates a generative code based on the received prompt. The generative code contains instructions for generating digital content according to the user's wishes. This generative code is returned to the server.

[0139] Step 4:

[0140] The server receives the generation code and connects it to various generation AIs (image generation AI, music generation AI, voice generation AI, etc.). For example, it sends the generation code to an image generation AI, instructing it to generate an "illustration of a cat with a sunset in the background."

[0141] Step 5:

[0142] The image generation AI generates an illustration based on the user's request based on the generated code, and the generated illustration is returned to the server.

[0143] Step 6:

[0144] The server receives the generated illustrations and provides them to the user, who can then download them or share them on social media via a smartphone application.

[0145] Step 7:

[0146] When a user downloads or shares the generated illustration, the server receives payment through an online payment system, allowing the user to obtain the desired digital content and the server to receive payment.

[0147] Example 2

[0148] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0149] Conventional digital content generation systems have had difficulty efficiently generating content that specifically reflects user preferences. Furthermore, they lacked a means for automatically generating specific instructions to improve the quality of the generated content and user satisfaction. This has created a demand for a system that can quickly provide high-quality digital content that meets user preferences.

[0150] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0151] In this invention, the server includes a means for allowing a customer to input desired content, a means for asking a generative AI questions based on the input desired content and generating generation instructions, and a means for generating a generation code based on the generation instructions. This makes it possible to automatically generate specific generation instructions based on the user's wishes and quickly provide high-quality digital content based on them.

[0152] The "means by which customers can input desired content" refers to an interface that allows users to input the content of the digital content they desire.

[0153] The "means for asking questions to the generative AI and generating generation instructions" is an artificial intelligence system that analyzes the desired content entered by the user and generates specific generation instructions based on that.

[0154] The "means for generating generation code based on generation instructions" refers to a system that generates program code for generating actual digital content based on generation instructions received from the generative AI.

[0155] "Various generative AI" refers to artificial intelligence systems for generating specific types of digital content, such as image generation AI, music generation AI, and voice generation AI.

[0156] "Digital content" refers to media such as music, images, and audio that is expressed in digital form.

[0157] "Natural language processing AI" is an artificial intelligence system that analyzes natural language text entered by the user, understands its meaning, and generates appropriate generation instructions.

[0158] The present invention is a system for efficiently generating digital content desired by a user. A specific embodiment of this system will be described below.

[0159] The user uses the terminal to input the desired digital content. For example, the user might input "an illustration of a cat with a sunset in the background." This input is sent from the terminal to the server as text data.

[0160] The server analyzes the user's wishes and asks the generative AI a question. A natural language processing AI is used as this generative AI. The natural language processing AI analyzes the user's wishes and generates specific generation instructions. For example, it generates instructions such as "Draw a sunset in the background and a cat in the foreground."

[0161] Next, the server generates a generation code based on the generation instructions received from the generation AI. This generation code is a specific program for generating digital content. The generation code is linked to various generation AIs (e.g., image generation AI, music generation AI, voice generation AI, etc.) to generate digital content.

[0162] The generated digital content is sent from the server to the terminal and provided to the user, who can then check the generated digital content and modify or regenerate it as necessary.

[0163] As a concrete example, consider the case where a user requests "an illustration of dogs playing under a blue sky." In this case, the user inputs "an illustration of dogs playing under a blue sky" into their device. The server sends this input to a natural language processing AI, which then generates a generation instruction such as "draw a blue sky as the background and dogs playing in the foreground." Based on this generation instruction, the server generates specific generation code, which it then links to an image generation AI to generate an illustration. The generated illustration is then sent from the server to the device and provided to the user.

[0164] Example prompt sentence:

[0165] User Input: Illustration of dogs playing under a blue sky

[0166] Generative AI instructions: Draw a blue sky in the background with dogs playing in the foreground

[0167] In this way, it becomes possible to quickly provide high-quality digital content based on the user's wishes.

[0168] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0169] Step 1:

[0170] The user inputs their preference

[0171] The user uses the terminal to input the details of the digital content they want. For example, they input "an illustration of a cat with a sunset in the background." This input is saved as text data on the terminal.

[0172] Input: User's desired content (e.g., "An illustration of a cat with a sunset in the background")

[0173] Output: Desired content as text data

[0174] Step 2:

[0175] The device sends the user's wishes to the server

[0176] The terminal transmits the user's input preferences to the server. At this time, the input contents are transmitted as text data.

[0177] Input: Desired content as text data

[0178] Output: Request sent to server

[0179] Step 3:

[0180] The server asks the generative AI a question

[0181] The server then sends the user's request to a generative AI, which uses natural language processing AI. The server then sends the request to the generative AI and asks for specific instructions on how to create the product.

[0182] Input: Your request sent to the server

[0183] Output: The desired content sent to the generative AI

[0184] Step 4:

[0185] Generative AI generates specific generation instructions

[0186] The generative AI analyzes the user's wishes and generates specific instructions, such as "paint a sunset in the background and a cat in the foreground."

[0187] Input: Desired content sent to the generative AI

[0188] Output: Specific production instructions (e.g., "Draw a sunset in the background and a cat in the foreground")

[0189] Step 5:

[0190] The server generates the generated code based on the generation instructions.

[0191] The server generates the actual generation code based on the generation instructions received from the generative AI. This generation code is a specific program for generating digital content.

[0192] Input: Specific generation instructions

[0193] Output: Generated code

[0194] Step 6:

[0195] The server connects the generated code to various generation AIs

[0196] The server links the generated generation code to various generation AIs (e.g., image generation AI, music generation AI, voice generation AI, etc.) to generate digital content.

[0197] Input: Generated code

[0198] Output: Generated digital content

[0199] Step 7:

[0200] The server sends the generated digital content to the terminal.

[0201] The server transmits the generated digital content to the terminal, where the generated content is transmitted as digital data.

[0202] Input: Generated digital content

[0203] Output: Digital content sent to a device

[0204] Step 8:

[0205] The terminal displays the generated digital content to the user.

[0206] The terminal displays the received digital content to the user, who can then check the generated digital content and modify or regenerate it as necessary.

[0207] Input: Digital content sent to your device

[0208] Output: The digital content displayed to the user

[0209] (Application example 2)

[0210] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0211] With conventional digital content generation systems, it was difficult to create specific generation instructions based on the user's wishes, and the generated content often did not meet the user's expectations. Another issue was that the types of generated content were limited, and they were not particularly suited to generating artwork.

[0212] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0213] In this invention, the server includes a means for allowing customers to input their desired items, a means for querying a generative AI based on the input desired items and generating a generation code, a means for linking the generated code to various generative AIs (image generation AI, music generation AI, voice generation AI, etc.) to generate digital products, a means for providing the generated digital products to customers and receiving payment, and a means for generating artwork based on the generated instructions. This makes it possible to create specific generation instructions based on user wishes and generate a wide variety of digital content, especially artwork.

[0214] "Means for customer input" means an interface through which users can enter details of the digital content they wish to generate.

[0215] "Means for asking questions to a generative AI and generating generative code" refers to the process of asking questions to a generative AI based on user input and generating code containing specific generation instructions.

[0216] "Means of linking with various generation AIs to generate digital products" refers to the process of sending the generated code to different generation AIs, such as image generation AI, music generation AI, and voice generation AI, to generate digital content.

[0217] "Means of providing generated digital products to customers and receiving payment" refers to the process of providing generated digital content to users and receiving money or other compensation in return.

[0218] The "means for generating an artwork based on generated instructions" is a process for automatically generating an artwork based on specific generation instructions created by a generative artificial intelligence.

[0219] "Natural language processing AI" is artificial intelligence that has the ability to understand and generate human language.

[0220] "Digital Content" means content expressed in digital form, such as music, images, sounds, artwork, etc.

[0221] The system for implementing the present invention includes a series of processes for generating digital content desired by a user, which will be described in detail below.

[0222] System Configuration

[0223] The system consists of the following main components:

[0224] 1. User Interface: An interface for users to enter details of the digital content they want. This is implemented as a smartphone application.

[0225] 2. Generative AI: Natural language processing AI that asks questions based on user input and generates generative code containing specific generation instructions. In this example, we use OpenAI's GPT-3 (registered trademark).

[0226] 3. Various generative AI: AI that receives generated code and generates digital content. This includes image generation AI, music generation AI, and voice generation AI.

[0227] 4. Digital content provision system: A system for providing generated digital content to users and receiving payment for it.

[0228] Program processing

[0229] 1. User Interface: The user enters details of the digital content they want, for example, "an illustration of a cat with a sunset in the background."

[0230] 2. Generative AI: Receives user input and sends prompts to the generative AI. Examples of prompts include:

[0231] Generate detailed instructions for the artwork to be generated based on the user's request: Cat illustration with a sunset in the background

[0232] 3. Generate instructions: The generative AI creates specific instructions and responds. For example, it might generate an instruction such as "Draw a sunset in the background and a cat in the foreground."

[0233] 4. Various generative AI: The generated instructions are sent to various generative AI to generate digital content. In this case, the image-generating AI generates a concrete work of art.

[0234] 5. Digital Content Providing System: Generated digital content is provided to users and payment is received. Users can download the generated artwork.

[0235] Hardware and software used

[0236] Hardware: Smartphones, servers

[0237] Software: Python, OpenAI API, various generative AI (image generation AI, music generation AI, voice generation AI)

[0238] Specific examples

[0239] When a user requests "an illustration of a cat with a sunset in the background" using a smartphone application, the generative AI receives the following prompt:

[0240] Generate detailed instructions for the artwork to be generated based on the user's request: Cat illustration with a sunset in the background

[0241] The generative AI creates specific generation instructions, such as "paint a sunset in the background and a cat in the foreground," and sends them to the image generation AI, which then generates a work of art based on these instructions and provides it to the user.

[0242] In this way, specific creation instructions based on the user's wishes can be created, enabling the creation of a wide variety of digital content, particularly artwork.

[0243] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0244] Step 1:

[0245] A user uses a smartphone to input details of the digital content they want. For example, the desired content might be an illustration of a cat with a sunset in the background. The input data is sent to the server in text format.

[0246] Step 2:

[0247] The server sends a prompt to the generative AI based on the received user request. Specifically, it generates the following prompt:

[0248] Generate detailed instructions for the artwork to be generated based on the user's request: Cat illustration with a sunset in the background

[0249] This prompt sentence is sent to the generation AI to obtain generation instructions.

[0250] Step 3:

[0251] The generative AI creates specific instructions based on the received prompt, such as "Draw a sunset in the background and a cat in the foreground." These instructions are returned to the server in text format.

[0252] Step 4:

[0253] The server sends the generation instructions received from the generative AI to various generation AIs. Here, the generation instructions are sent to the image generation AI. Based on the generation instructions, the image generation AI generates a specific artwork.

[0254] Step 5:

[0255] The image generation AI generates an artwork based on the received generation instructions, and the generated artwork is returned to the server as image data.

[0256] Step 6:

[0257] The server provides the generated artwork to the user. The user can download the generated artwork using a smartphone terminal. The generated artwork is based on the user's wishes and meets the user's expectations.

[0258] In this way, specific creation instructions based on the user's wishes can be created, making it possible to create a wide variety of digital content, particularly artwork.

[0259] Example 3

[0260] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0261] Conventional digital content generation systems have had difficulty in quickly and accurately generating content that meets specific user requests. Furthermore, the methods for providing generated content and receiving payment are limited, resulting in low user convenience. This makes it difficult to respond to diverse user needs, resulting in a decline in user satisfaction.

[0262] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0263] In this invention, the server includes a means for allowing a customer to input desired digital content, a means for generating a prompt sentence in a generation AI model based on the input desired digital content, a means for linking the generated prompt sentence to various generation AIs (image generation AI / music generation AI / voice generation AI, etc.) to generate digital products, and a means for providing the generated digital products to customers and receiving payment. This makes it possible to quickly and accurately generate digital content that meets specific user requests, and to realize a variety of methods for providing the content and receiving payment.

[0264] "Customer" refers to a user who intends to use the system to generate digital content.

[0265] "Digital content" refers to commercial materials expressed in digital form, such as music, images, and audio.

[0266] A "generative AI model" refers to an artificial intelligence model that generates prompt sentences based on user requests and sends instructions to various generative AIs.

[0267] A "prompt sentence" refers to text containing specific instructions that is generated by a generative AI model by analyzing a user's request.

[0268] "Generative AI" refers to artificial intelligence (AI) that generates digital content based on prompts. Examples include image generation AI, music generation AI, and voice generation AI.

[0269] "Digital products" refers to digital content generated by generative AI.

[0270] "Means of provision" refers to the method by which the generated digital materials are provided to customers, including, for example, providing a download link, sending by email, or displaying within an application.

[0271] "Means of Receiving Compensation" refers to the method by which compensation is received from customers for the generated digital products, including, for example, a one-time fee, a monthly membership fee, or advertising revenue.

[0272] The present invention relates to a system for generating and providing digital content desired by a user. A specific embodiment of this system will be described below.

[0273] First, a user accesses the system using a terminal and inputs a request for the digital content they want to generate. For example, a user might input, "I want an illustration of a cat on a sunset background."

[0274] Next, the server receives the user's request and generates a prompt to be sent to the generative AI model. Specifically, the server analyzes the user's request using natural language processing technology and generates the prompt, "Draw a sunset in the background and a cat in the foreground." This prompt is then sent to the generative AI model.

[0275] The server sends the generated prompt to an appropriate generation AI, such as an image generation AI. For example, it sends the image generation AI an instruction to "draw a sunset in the background and a cat in the foreground." The image generation AI generates the specified illustration based on the received prompt. In this case, the image generation AI uses a deep learning framework such as TENSORFLOW (registered trademark) or PyTorch to generate the image.

[0276] The generated digital product is provided to the user by the server. It can be provided in the form of a download link, sent by email, or displayed within an application. For example, the server sends the user a download link for the generated illustration by email. The user clicks the link in the email to download the illustration.

[0277] Finally, the user pays for the provided digital product. The form of payment can be a fee per creation, a monthly membership fee, advertising revenue, etc. For example, the user pays the fee per creation using a credit card. Once the payment is confirmed, the server allows the user to download the illustration.

[0278] For example, if a user requests "I want an illustration of a cat on a sunset background," the server will send the following prompt to the generative AI model:

[0279] "Paint a sunset in the background and a cat in the foreground"

[0280] Upon receiving this prompt, the image generation AI will generate the specified illustration.

[0281] In this way, it is possible to quickly and accurately generate digital content that meets specific user requests, and realize a variety of methods for providing the content and receiving payment. The flow of the specification process in the third embodiment will be described with reference to FIG.

[0282] Step 1:

[0283] A user accesses the system using a terminal and inputs a request for the digital content they want to generate. For example, a user might input, "I want an illustration of a cat on a sunset background." The input request is sent to the server.

[0284] Input: User request (e.g., "I want an illustration of a cat on a sunset background.")

[0285] Output: The user's request sent to the server

[0286] Step 2:

[0287] The server receives requests sent by users and then uses a natural language processing engine to parse the requests and generate prompts to send to the generative AI model, such as "Draw a sunset in the background and a cat in the foreground."

[0288] Input: User request

[0289] Data processing: Analyzing requirements using a natural language processing engine

[0290] Output: The generated prompt (e.g., "Draw a sunset in the background and a cat in the foreground")

[0291] Step 3:

[0292] The server sends the generated prompt to an appropriate AI, such as an image generation AI. For example, it sends an instruction to the image generation AI to "draw a sunset in the background and a cat in the foreground."

[0293] Input: Generated prompt text

[0294] Output: The prompt sent to the generation AI

[0295] Step 4:

[0296] The image generation AI generates a specified illustration based on the received prompt sentence. In this case, the image generation AI generates the image using deep learning frameworks such as TensorFlow and PyTorch. For example, it generates an illustration with a sunset in the background and a cat in the foreground.

[0297] Input: prompt statement

[0298] Data Computing: Image Generation Using Deep Learning Frameworks

[0299] Output: Generated illustration

[0300] Step 5:

[0301] The server saves the generated illustration and generates a download link for the user, which the server then emails to the user.

[0302] Input: Generated illustration

[0303] Data processing: Generate download links

[0304] Output: Download link sent to user

[0305] Step 6:

[0306] The user clicks on the link in the email to download the illustration. The user enters their credit card information on the download page and pays for the one-time generation fee. Once the payment is confirmed, the server allows the user to download the illustration.

[0307] Input: Download link, credit card information

[0308] Data calculation: Payment confirmation

[0309] Output:Download allowed

[0310] (Application example 3)

[0311] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0312] In conventional digital product generation systems, when generating specific digital content desired by users, there were problems such as the generation AI's instructions being vague and the quality of the generated content being inconsistent. In addition, there were limited ways to provide the generated digital products to users and to receive payment, which made it difficult for users to use.

[0313] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes a means for allowing a customer to input a desired item; a means for querying a generation system AI based on the input desired item and generating a generation code; a means for linking the generated code to various generation AIs (image generation AI, music generation AI, audio generation AI, etc.) to generate digital products; a means for providing the generated digital products to customers and receiving payment; a means for the image generation AI to generate an original artwork based on a prompt entered by the customer and displaying it within the application; a means for sharing the generated artwork via a download link or on social media; and a means for the customer to pay a fee for one generation or to use the service unlimitedly as a monthly membership. This allows users to generate high-quality digital content by entering specific instructions, and to provide and receive payment in a convenient manner.

[0314] "Means for customers to input their wishes" refers to an interface that allows users to input specific details and instructions for the digital content they wish to generate.

[0315] "Means of asking questions to the generative AI and generating generated code" refers to the process of giving appropriate instructions to the generative AI based on the desired content entered by the user, and creating generated code based on those instructions.

[0316] "Means of linking with various generation AIs to generate digital products" refers to the process of passing the generated code to different generation AIs, such as image generation AI, music generation AI, and voice generation AI, and each AI then generates digital content.

[0317] "Means of providing generated digital products to customers and receiving payment" refers to a mechanism for providing generated digital content to users and receiving payment in return.

[0318] "The means by which an image generation AI generates an original work of art based on a prompt entered by a customer and displays it within the application" refers to the process by which an image generation AI generates an original work of art based on specific instructions (prompts) entered by a user and displays the work within the application.

[0319] "Means for sharing the generated artwork via download links or social media" refers to a function that allows users to download the generated artwork or share it on social media.

[0320] "Means where customers pay a fee for one-time generation or unlimited use as a monthly membership" means a fee structure whereby users can pay a fee for each content generated or can generate and use unlimited content as a monthly membership.

[0321] The system for implementing the present invention provides a series of processes for generating digital content desired by a user. Specific embodiments of the system will be described below.

[0322] First, a user accesses a dedicated application using a device such as a smartphone or computer. This application provides an interface where the user can input their desired content. For example, the user can input a prompt such as, "Please draw a landscape with a cat in front of a sunset."

[0323] Next, the server receives the prompt input from the user, asks the generative AI appropriate questions, and generates generative code. This generative code contains specific instructions based on the user's wishes. For example, the OpenAI API can be used as the generative AI.

[0324] The generated code is then linked to various generative AIs, such as image generation AI, music generation AI, and voice generation AI, which then generate digital content according to their respective fields of expertise. For example, an image generation AI can generate original artwork based on a user's prompt.

[0325] The generated digital products are displayed within the application. Users can view the generated artwork, download it via a download link, or share it on social media. Users can also pay a fee for a single creation or subscribe for unlimited use.

[0326] In implementing this system, the following hardware and software are used:

[0327] Hardware: Cloud servers (e.g., Amazon Web Services or Google® Cloud Platform)

[0328] Software: Flask (web framework), OpenAI API (generative AI)

[0329] For example, if a user inputs a prompt such as "Generate an illustration of dogs playing under a blue sky and white clouds," the image generation AI will generate an illustration based on that instruction and display it within the application. The user can then download the illustration or share it on social media.

[0330] In this way, users can generate high-quality digital content by inputting specific instructions, and provide and receive payment in a highly convenient manner.

[0331] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0332] Step 1:

[0333] The user accesses the application using a terminal and inputs the desired digital content as a prompt sentence, for example, "Please draw a landscape with a cat in front of a sunset." The input data is sent to the server.

[0334] Step 2:

[0335] The server analyzes the received prompt and generates a generated code to ask the generative AI an appropriate question. This generated code contains specific instructions based on the user's wishes. Natural language processing technology is used to generate the generated code. The input is the prompt and the output is the generated code.

[0336] Step 3:

[0337] The server connects the generated generation code to various generation AIs (image generation AI, music generation AI, voice generation AI, etc.). For example, an image generation AI is given the instruction to "generate a landscape painting of a cat in front of a sunset." The input is the generation code, and the output is the instruction to the generation AI.

[0338] Step 4:

[0339] Each generative AI generates digital content based on the instructions it receives. For example, an image-generating AI generates an image with specified content. The input is the instructions to the generative AI, and the output is the generated digital content (e.g., an image).

[0340] Step 5:

[0341] The server displays the generated digital content within the application, and the user can view the generated artwork. The input is the generated digital content, and the output is the display within the application.

[0342] Step 6:

[0343] Users can download the generated artwork via a download link or share it on social media. The input is the generated digital content, and the output is the download link or sharing on social media.

[0344] Step 7:

[0345] Users can pay a fee for a single generation or subscribe to unlimited monthly usage. The server manages user payment information and applies the appropriate fee structure. The input is the user payment information, and the output is the application of the fee.

[0346] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0347] "Example 1"

[0348] One embodiment of the present invention is a system that incorporates an emotion engine that recognizes user emotions. In this system, the emotion engine recognizes user emotions as a means for the user to input their desired items. Specifically, when a user inputs details of desired digital content through a portal such as a website or application, the emotion engine recognizes the user's emotion and asks a generative AI question based on that emotion. For example, if the user expresses joy, the emotion engine recognizes the emotion and instructs the generative AI to generate digital content related to joy.

[0349] "Example 2"

[0350] In addition, the code generated by the generative AI is linked to various generative AIs (image generation AI, music generation AI, audio generation AI, etc.), and the means of generating digital products also take into account the recognition results of the emotion engine. Specifically, the generative AI generates digital products based on the user's emotions recognized by the emotion engine. For example, if the user expresses joy, the generative AI will generate digital content related to joy, such as brightly colored images and cheerful music.

[0351] "Example 3"

[0352] Furthermore, the method of providing the generated digital product to the user and receiving payment also takes into account the results of the emotion engine's recognition. Specifically, the method of providing the digital product is adjusted based on the user's emotions recognized by the emotion engine. For example, if the user expresses joy, the digital product is immediately provided to the user, and their reaction is obtained as instant feedback. This makes it possible to provide the optimal digital product according to the user's emotions and optimize the payment for it.

[0353] The processing flow of each embodiment will be described below.

[0354] "Example 1"

[0355] Step 1: The user enters details of the digital content they want through a portal such as a website or app.

[0356] Step 2: The emotion engine recognizes the user's emotion.

[0357] Step 3: Based on the emotions recognized by the emotion engine, the generative AI is instructed to generate digital content.

[0358] "Example 2"

[0359] Step 1: The code generated by the generative AI is linked to various generative AIs (image generation AI, music generation AI, audio generation AI, etc.).

[0360] Step 2: Based on the user's emotions recognized by the emotion engine, the generative AI generates digital products.

[0361] "Example 3"

[0362] Step 1: Provide the generated digital product to the user.

[0363] Step 2: Adjust how digital products are presented based on the user's emotions recognized by the emotion engine.

[0364] Step 3: Get instant feedback from users.

[0365] Example 1

[0366] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0367] Conventional digital content generation systems provide a means for users to input their preferences, but do not generate content that takes the user's emotions into consideration. This makes it difficult to provide personalized content that reflects the user's emotions.

[0368] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0369] In this invention, the server includes a means for allowing a customer to input a desired item, a means for asking a generative AI questions based on the input desired item and generating a generated code, a means for linking the generated code to various generative AIs (image generation AI, music generation AI, voice generation AI, etc.) to generate digital products, a means for providing the generated digital products to the customer and receiving payment, a means for recognizing the customer's emotions, and a means for sending a prompt to the generative AI based on the recognized emotions. This enables the generation of more personalized digital content according to the user's emotions.

[0370] "Means for allowing customers to input their desired content" refers to means for providing an interface for users to specifically input the digital content they desire.

[0371] "Means for asking questions to a generative AI and generating generated code" refers to means for asking questions to a generative AI based on user input and creating generated code as a response.

[0372] "Means of linking to various generation AIs to generate digital products" refers to means of linking the generated code to different generation AIs such as image generation AI, music generation AI, and voice generation AI, and using them to generate digital content.

[0373] "Means for providing the generated digital materials to customers and receiving payment" refers to means for providing the generated digital content to users and receiving a fee in return.

[0374] "Means for recognizing customer emotions" refers to means that use technology to analyze and recognize emotions from user input and interactions.

[0375] "Means for sending prompt sentences to a generative AI based on recognized emotions" refers to means for generating appropriate prompt sentences based on the recognized emotions of a user and sending them to a generative AI.

[0376] The present invention is a system for generating digital content desired by a user, and aims to provide more personalized content by taking into consideration the user's emotions. Specific embodiments of this system will be described below.

[0377] System configuration

[0378] Hardware and Software

[0379] The server provides a portal in the form of a website or mobile application, with an interface where users can enter their preferences. Users can specify their preferences by entering text or selecting from a list of options.

[0380] An emotion engine is software for analyzing emotions from user input and interactions. Specifically, it uses Microsoft's Azure Cognitive Services or Google's Cloud Natural Language API.

[0381] Generative AI models such as OpenAI's GPT-4 and Google's BERT are used, which generate digital content based on prompts sent from the server.

[0382] Program processing

[0383] The server receives data when a user accesses the portal and inputs what they want. For example, if a user wants an illustration of a cat with a sunset in the background, they input that information into the portal.

[0384] The server then calls the emotion engine, which analyzes the user's input and interaction data to identify emotions. For example, if the user is feeling "happy," the emotion engine recognizes that emotion.

[0385] The server generates a prompt to send to the generative AI model based on the emotion information obtained from the emotion engine. For example, it creates a prompt such as, "Please generate an illustration of a cat with a sunset in the background. The user is very happy, so please create an illustration with a bright and cheerful atmosphere that reflects that emotion."

[0386] The generative AI model generates digital content based on the prompt it receives and according to the specified conditions. For example, GPT-4 generates a description of an illustration, and the image generation model creates the illustration based on that.

[0387] The server provides the digital content received from the generative AI model to users, who can then view and download the generated illustrations through a portal.

[0388] Specific examples

[0389] For example, if a user requests an "illustration of a cat with a sunset in the background" and expresses the emotion of joy, the emotion engine will recognize the user's emotion of joy and input the following prompt sentence into the generative AI model:

[0390] Example prompt sentence:

[0391] "Generate an illustration of a cat with a sunset in the background. The user is very happy, so please create a bright and cheerful illustration that reflects that emotion."

[0392] Based on this prompt, the generative AI model generates an illustration according to the specified conditions, and the server provides the illustration to the user, who can then view and download the generated illustration through a portal.

[0393] The above is a specific embodiment for carrying out the present invention. This system makes it possible to generate more personalized digital content according to the user's emotions.

[0394] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0395] Step 1:

[0396] A user accesses the portal

[0397] Users access the portal using a web browser or mobile application. The portal provides an interface where users can input their desires. The input includes text boxes and options, which the user uses to specify their desires. For example, they might enter "a picture of a cat with a sunset in the background." The output is the user's desire, sent to the portal.

[0398] Step 2:

[0399] The server receives the user's input

[0400] The server receives the preferences entered by the user into the portal. The input includes the text data entered by the user. The server receives this data and stores it in a database. The output is the saved user preference data.

[0401] Step 3:

[0402] The server invokes the emotion engine

[0403] The server invokes the emotion engine based on the user's input data. The input includes the user's desired data. The server sends an HTTP request and passes the data to the emotion engine. The emotion engine analyzes the user's input and interaction data to identify emotions. The analysis results are returned to the server in JSON format as output.

[0404] Step 4:

[0405] Emotion engine analyzes user emotions

[0406] The emotion engine analyzes the user's input data and identifies the user's emotion. The input includes the user's desired data. The emotion engine analyzes the emotion using natural language processing technology and identifies the emotion of "joy," for example. The emotion analysis result is obtained as the output.

[0407] Step 5:

[0408] The server sends a prompt to the generative AI model

[0409] The server generates a prompt to be sent to the generative AI model based on the analysis results obtained from the emotion engine. The input includes the emotion analysis results and the user's desired data. The server combines this data to create a prompt and sends it to the generative AI model via an HTTP request. The output is the prompt sent to the generative AI model.

[0410] Step 6:

[0411] Generative AI models generate digital content

[0412] The generative AI model generates digital content according to specified conditions based on the received prompt. The input includes the prompt sent from the server. The generative AI model generates, for example, an illustration using natural language processing and image generation techniques. The output is the generated digital content.

[0413] Step 7:

[0414] The server serves the generated content to the user

[0415] The server provides the user with digital content received from the generative AI model. The input includes the generated digital content. The server displays this content to the user through a portal and makes it available in a downloadable format. The output is digital content that the user can access.

[0416] (Application example 1)

[0417] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0418] Conventional digital content generation systems provide a means for users to input their desired content, but do not generate content that takes into account the user's emotions. This makes it difficult to provide more personalized content that reflects the user's emotions. Furthermore, if the generated content does not match the user's emotions, user satisfaction may decrease.

[0419] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0420] In this invention, the server includes a means for allowing a customer to input a desired item, a means for asking a generative AI questions based on the input desired item and generating a generated code, a means for linking the generated code to various generative AIs (image generation AI, music generation AI, voice generation AI, etc.) to generate digital products, a means for providing the generated digital products to customers and receiving payment, and a means for using an emotion engine that recognizes the customer's emotions to send prompts to the generative AI based on the emotions, thereby enabling the generation of personalized digital content according to the user's emotions.

[0421] "Customer" refers to a user who uses the system to input their desired items and receives the generated digital products.

[0422] "Desired Content" refers to the specific details of the digital content you wish to generate that you enter through the system.

[0423] "Generative AI" is an artificial intelligence that asks questions based on the desired item entered and generates a generative code.

[0424] "Generation code" refers to code that is generated by the generative AI based on the desired input, and is used to link with various generative AIs.

[0425] "Various generation AI" refers to artificial intelligence for generating digital products based on generated code, including image generation AI, music generation AI, and voice generation AI.

[0426] "Digital products" refer to digital content generated by various types of generative AI.

[0427] The "emotion engine" is an engine that recognizes the customer's emotions and sends prompts to the generative AI based on those emotions.

[0428] A "prompt" is an instruction sent to the generative AI based on the customer's emotions recognized by the emotion engine.

[0429] A system for implementing this invention is configured as follows: First, a user starts an application using a smartphone and inputs the desired digital content. Input methods include text input and selection from options.

[0430] Next, an emotion engine recognizes emotions from the user's input. This emotion engine analyzes the user's text and voice input to identify emotions such as joy, sadness, surprise, etc. Software such as EmotionRecognizer is used as the emotion engine.

[0431] Once the emotion is recognized, a prompt is generated for the generative AI. The prompt is generated based on the user's desired digital content and the recognized emotion. For example, if the user requests an "illustration of a cat with a sunset background" and the emotion engine recognizes the emotion "joy," the prompt will be "Create a joyful sunset background with a cat illustration."

[0432] The generated prompt is sent to a generative AI model such as the OpenAI API. The generative AI model generates digital content based on the prompt. The generated digital content is then generated through various generative AIs, such as image generation AI, music generation AI, and voice generation AI.

[0433] The generated digital content is provided to the user, who can view and download the generated content through a smartphone application. This makes it possible to generate personalized digital content according to the user's emotions.

[0434] For example, if a user requests an "illustration of a cat with a sunset as the background" and the emotion engine recognizes the emotion "joy," the prompt will be "Create a joyful sunset background with a cat illustration." This prompt will be sent to the generative AI model, and the generated illustration will be provided to the user.

[0435] The hardware used is primarily a smartphone, and the software used includes Python, Flask (web framework), OpenAI API (generative AI model), and EmotionRecognizer (emotion recognition engine).

[0436] Examples of prompts include:

[0437] "Create a joyful sunset background with a cat illustration"

[0438] "Create a sad melody for a rainy day"

[0439] "Create an exciting video about space exploration"

[0440] In this way, digital content can be generated according to the user's emotions.

[0441] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0442] Step 1:

[0443] The user starts the application on the smartphone and inputs the desired digital content.

[0444] Input: Text input of the digital content desired by the user (e.g., "Illustration of a cat with a sunset in the background")

[0445] Output: Text data of the digital content desired by the user

[0446] Step 2:

[0447] The terminal transmits the user's input contents to the emotion engine, and the emotion engine recognizes the user's emotion.

[0448] Input: Text data of the digital content desired by the user

[0449] Output: User's emotion data (e.g., "joy")

[0450] Specific operation: The emotion engine (EmotionRecognizer) analyzes text data and identifies emotions.

[0451] Step 3:

[0452] The server generates a prompt sentence to send to the generative AI based on the emotional data received from the emotion engine and the text data of the digital content desired by the user.

[0453] Input: Text data of the user's desired digital content, user's emotional data

[0454] Output: A prompt to send to the generative AI (e.g., "Create a joyful sunset background with a cat illustration")

[0455] Specific operation: The server generates a prompt sentence based on the emotion data.

[0456] Step 4:

[0457] The server sends a prompt to the generative AI, which then generates the digital content.

[0458] Input: Prompt to be sent to the generative AI

[0459] Output: Generated digital content (e.g. illustration data)

[0460] Specific operation: Generative AI (OpenAI API) generates digital content based on the prompt text.

[0461] Step 5:

[0462] The server provides the generated digital content to the user.

[0463] Input: Generated digital content

[0464] Output: The digital content that is delivered to the user

[0465] Specific operation: The server sends the generated digital content to the user's smartphone, allowing the user to view and download the content through the application.

[0466] Example 2

[0467] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0468] In conventional digital content generation systems, content generated based on user preferences often did not match the user's emotions or detailed preferences. Furthermore, if the generated content did not meet the user's expectations, user satisfaction decreased. Furthermore, it was difficult to generate content that took user emotions into account, making it difficult to meet individual needs.

[0469] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for allowing a customer to input a desired item, a means for querying a generative AI based on the input desired item and generating a generated code, a means for linking the generated code to various generative AIs (image generation AI, music generation AI, voice generation AI, etc.) to generate digital products, and a means for recognizing the customer's emotions using an emotion engine and adjusting the generated code based on the recognition results. This makes it possible to generate high-quality digital content based on the user's wishes and emotions.

[0470] "You" means a user who intends to use the system to generate digital content.

[0471] "Desired thing" refers to the specific content and characteristics of the digital content that the customer wishes to create.

[0472] "Generative AI" is AI that asks questions based on input desired items and generates generative code.

[0473] "Generated code" is code generated by generative artificial intelligence that contains detailed instructions for generating digital content.

[0474] "Various generative artificial intelligence" refers to artificial intelligence for generating specific digital content, such as image generation, music generation, and voice generation.

[0475] "Digital products" are generated digital content, including images, music, audio, etc.

[0476] The "emotion engine" is an engine that recognizes the customer's emotions and reflects the recognition results in the generated code.

[0477] The "recognition result" is information indicating the emotional state of the customer as recognized by the emotion engine.

[0478] This invention is a system for generating digital content based on user wishes. The system includes a means for allowing users to input their wishes, a generative AI, an emotion engine, and various generative AIs.

[0479] Hardware and software used

[0480] Server: Hardware that manages the entire system and executes various AI processes.

[0481] Device: The device on which the User enters their preferences and views the generated digital content, such as a computer or smartphone.

[0482] Generative AI: AI that processes natural language. For example, a natural language processing AI model.

[0483] Emotion engine: Software for recognizing user emotions.

[0484] Various generative artificial intelligence: Artificial intelligence that generates images, music, and voice. For example, image generation artificial intelligence models, music generation artificial intelligence models, and voice generation artificial intelligence models.

[0485] Program processing

[0486] 1. User preference input

[0487] The user enters details of the digital content they want through their device, for example, entering a specific request such as "an illustration of a cat with a sunset in the background."

[0488] 2. Question and instruction generation using generative AI

[0489] The server activates a generative artificial intelligence (AI) and asks additional questions based on the user's preferences. For example, the server might ask the user, "What color do you like your cat to be?"

[0490] The user answers questions through the device, for example, "I like black cats."

[0491] The server uses generative artificial intelligence to generate specific instructions based on the user's answers, such as "paint a sunset in the background and a black cat in the foreground."

[0492] 3. Generate generated code

[0493] The server generates a generation code based on the instructions of the generative AI. This generation code contains detailed instructions for generating digital content. For example, the server generates code containing specific instructions to the image-generating AI, such as "paint a sunset in the background and a black cat in the foreground."

[0494] 4. Use of Emotion Engine

[0495] The server activates the emotion engine to recognize the user's emotion. For example, if the user expresses joy through the device, the emotion engine will provide that information to the server.

[0496] The server provides the emotion engine's recognition results to the generative AI, which then adjusts the generated code, for example, adjusting instructions to generate brightly colored images and cheerful music based on the emotion of joy.

[0497] 5. Digital product creation

[0498] The server connects the generated code to various AI generators (such as image generators, music generators, and voice generators) to generate digital products. For example, an image generator generates an illustration of a black cat against a sunset.

[0499] The user can view and download the generated digital products through their device.

[0500] Examples and prompts

[0501] Examples:

[0502] If the user wants "an illustration of a cat with a sunset in the background," they would enter the following prompt:

[0503] Example prompt sentence:

[0504] User: I'd like an illustration of a cat with a sunset in the background.

[0505] Generative AI: What's the best color for a cat?

[0506] User: Black cats are good.

[0507] Generative AI: Generates instructions to paint a sunset in the background and a black cat in the foreground.

[0508] Based on this prompt, the generative artificial intelligence generates specific generation instructions and generates digital products taking into account the recognition results of the emotion engine.

[0509] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0510] Step 1: Enter user preferences

[0511] The user enters details of the digital content they want through their device, for example, entering a specific request such as "an illustration of a cat with a sunset in the background."

[0512] Input: Details of the digital content the user desires.

[0513] Output: The user's preference is sent to the server.

[0514] Step 2: Generative AI questions and instructions

[0515] The server activates a generative artificial intelligence (AI) and asks additional questions based on the user's preferences. For example, the server might ask the user, "What color do you like your cat to be?"

[0516] The user answers questions through the device, for example, "I like black cats."

[0517] Input: The user's preference and answers to any follow-up questions.

[0518] Data processing: Generative AI analyzes the user's wishes and responses and generates specific generation instructions.

[0519] Output: Specific production instructions, such as "paint a sunset in the background and a black cat in the foreground."

[0520] Step 3: Generate generated code

[0521] The server generates a generation code based on instructions from the generative artificial intelligence, the generation code including detailed instructions for generating the digital content.

[0522] Input: Specific generation instructions from the generative artificial intelligence.

[0523] Data processing: Based on the generation instructions, the server creates generation codes corresponding to various generation artificial intelligences.

[0524] Output: Specific generation code for the image generation AI: "Draw a sunset in the background and a black cat in the foreground."

[0525] Step 4: Use the Emotion Engine

[0526] The server activates the emotion engine to recognize the user's emotion. For example, if the user expresses joy through the device, the emotion engine will provide that information to the server.

[0527] Input: User emotion data.

[0528] Data calculation: The emotion engine analyzes the user's emotions and provides the results to the generative artificial intelligence.

[0529] Output: The recognition result of the emotion engine (e.g., emotion of joy).

[0530] Step 5: Adjust the generated code

[0531] The server provides the emotion engine's recognition results to the generative AI, which then adjusts the generated code, for example, adjusting instructions to generate brightly colored images and happy music based on the emotion of joy.

[0532] Input: Recognition results and generated code from the emotion engine.

[0533] Data processing: Generative AI adjusts the generated code based on the recognition results.

[0534] Output: Adjusted generated code.

[0535] Step 6: Generate digital products

[0536] The server connects the generated code to various AI generators (such as image generators, music generators, and voice generators) to generate digital products. For example, an image generator generates an illustration of a black cat against a sunset.

[0537] Input: The adjusted generated code.

[0538] Data calculation: Various generative artificial intelligences generate digital content based on generative code.

[0539] Output: The generated digital product (e.g., an illustration of a black cat against a sunset background).

[0540] Step 7: Offer digital products

[0541] The user can view and download the generated digital products through their device.

[0542] Input: The generated digital product.

[0543] Output: The digital product downloaded by the user.

[0544] (Application example 2)

[0545] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0546] Conventional digital content generation systems have the problem that content generated based on user preferences does not take into account the user's emotions, and therefore cannot sufficiently increase user satisfaction. Furthermore, if the generated content does not match the user's emotions, it may not meet the user's expectations, resulting in a decrease in frequency of use.

[0547] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0548] In this invention, the server includes means for allowing customers to input their desired items, means for asking a generative AI questions based on the input desired items and generating a generated code, means for linking the generated code to various generative AIs (image generation AI / music generation AI / voice generation AI, etc.) to generate digital products, means for recognizing the customer's emotions using an emotion engine, means for the generative AI to generate digital products based on the recognized emotions, and means for providing the generated digital products to customers and receiving payment. This makes it possible to generate digital content based on the user's wishes and emotions.

[0549] "Means for customers to input their wishes" refers to an interface that allows users to input their wishes and requests into the system.

[0550] "Means for asking questions to a generative AI and generating generated code" refers to the process of asking questions to a generative AI based on user input and creating generated code from the answers.

[0551] "Means of linking with various generation AIs to generate digital products" refers to the process of sending the generated code to different generation AIs, such as image generation AI, music generation AI, and voice generation AI, to create digital content.

[0552] "Means for recognizing customer emotions using an emotion engine" is a system that analyzes emotions from user input and behavior and recognizes those emotions.

[0553] "Means for generative AI to generate digital products based on recognized emotions" refers to the process by which generative AI creates appropriate digital content based on the user's emotions recognized by the emotion engine.

[0554] "Means for providing generated digital products to customers and receiving payment" refers to a system for providing generated digital content to users and receiving payment in return.

[0555] "Natural language processing AI" is artificial intelligence that has the ability to understand and generate human language.

[0556] "Digital content" refers to content such as images, music, and sound that is electronically generated.

[0557] The present invention is a system for generating and providing digital content based on the wishes and emotions of a user. A specific embodiment of this system is described below.

[0558] System Configuration

[0559] The system consists of the following main components:

[0560] 1. User Interface: The means by which the user inputs their desires. This can be implemented as a smartphone application or a web interface.

[0561] 2. Generative AI: This is artificial intelligence that asks questions based on user input and generates generative code. It uses natural language processing AI.

[0562] 3. Emotion Engine: A system for recognizing emotions from user input and behavior.

[0563] 4. Generative AI: Based on instructions from generative AI, digital content is generated using image generation AI, music generation AI, voice generation AI, etc.

[0564] 5. Provision system: A system for providing generated digital content to users and receiving payment.

[0565] Program processing

[0566] The server receives user requests through a user interface. The generative AI then asks questions based on the user's requests and generates a generative code. This generative code is then sent to various generative AIs to generate digital content.

[0567] The emotion engine recognizes emotions from user input and behavior. Based on the recognized emotion, the generative AI generates appropriate digital content. For example, if a user inputs "I want an illustration of a cat with a sunset background," and the emotion engine recognizes the user's emotion as "joy," the generative AI will generate an image with bright colors.

[0568] The generated digital content is provided to users through a provision system, and payment is received.

[0569] Hardware and software used

[0570] Hardware: Servers, smartphones, PCs

[0571] Software: Natural language processing AI (e.g., OpenAI API), emotion engine, image generation AI, music generation AI, speech generation AI

[0572] Specific examples

[0573] If the user types "I want an illustration of a cat with a sunset in the background," the following is an example of a prompt:

[0574] User's request: I want an illustration of a cat with a sunset in the background.

[0575] User Emotion: Delight

[0576] Generate the generation instructions.

[0577] By sending this prompt to the generative AI, specific generation instructions can be obtained, which the generative AI will then use to generate digital content and provide it to the user.

[0578] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0579] Step 1:

[0580] The user inputs what they want. The user inputs their specific request in text format through the interface of their smartphone or computer. For example, they might input, "I want an illustration of a cat with a sunset in the background." This input is sent to the system.

[0581] Step 2:

[0582] The server receives the user's input and asks the generative AI a question. The server generates a prompt based on the user's wishes and sends it to the generative AI. The generative AI analyzes this prompt and generates specific generation instructions. The input is the user's wishes, and the output is the generation instructions.

[0583] Step 3:

[0584] The server receives generation instructions from the generative AI and sends them to the emotion engine. The emotion engine recognizes emotions from the user's input and actions. For example, it recognizes that the user's input indicates the emotion of "joy." The input is the generation instructions and the user's wishes, and the output is the user's emotion.

[0585] Step 4:

[0586] The server receives the emotion recognition results from the emotion engine and sends them to the generation AI. The generation AI generates appropriate digital content based on the generation instructions and the emotion recognition results. For example, it generates an illustration of a cat with a bright sunset as the background. The input is the generation instructions and the emotion recognition results, and the output is the digital content.

[0587] Step 5:

[0588] The server receives the generated digital content and provides it to the user through the provision system. The user can download or view the generated digital content. The input is the digital content, and the output is the provision to the user.

[0589] Step 6:

[0590] The server receives payment from the user. The provision system handles the payment procedures when the user uses digital content. The input is the user's payment information, and the output is receipt of payment.

[0591] Example 3

[0592] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0593] Conventional digital product generation systems do not adjust the delivery method to take user emotions into account, making it difficult to maximize user satisfaction. Furthermore, the delivery method for generated digital products is uniform, making it difficult to respond to individual user needs.

[0594] The identification process by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means. In this invention, the server includes a means for allowing a customer to input a desired item, a means for querying a generative AI based on the input desired item and generating a generated code, a means for linking the generated code to various generative AIs (image generation AI, music generation AI, voice generation AI, etc.) and generating digital products, a means for providing the generated digital products to customers and receiving payment, and a means for recognizing customer emotions using an emotion engine and adjusting the method of providing the digital products based on the emotions. This makes it possible to provide optimal digital products according to the user's emotions and optimize the payment for them.

[0595] "Customer" refers to a user who uses the system to generate and receive digital products.

[0596] "Desired Item" means the information you enter to indicate the content and characteristics of the digital product you wish to create.

[0597] "Generative AI" is an AI that generates a generative code based on the desired input and sends instructions to various generative AIs.

[0598] "Generated code" refers to code generated by a generative artificial intelligence that contains specific instructions for various generative artificial intelligences.

[0599] "Various generative artificial intelligence" is a general term for artificial intelligence used to generate specific digital products, such as image generation, music generation, and voice generation.

[0600] "Digital products" refers to digital content generated by generative artificial intelligence and various types of generative artificial intelligence.

[0601] "Consideration" refers to the remuneration or fees received from customers for the provision of generated digital goods.

[0602] An "emotion engine" is an engine that recognizes customer emotions and adjusts how digital products are delivered based on the results.

[0603] "Delivery method" refers to the means or format by which the generated digital products are provided to customers.

[0604] The present invention relates to a system for generating and providing digital products desired by users. A specific embodiment of this system will be described below.

[0605] System configuration

[0606] This system mainly consists of a server, a terminal, generative AI, various generative AI, and an emotion engine.

[0607] server

[0608] The server receives and analyzes prompts from users. Based on the analysis results, the server sends instructions to the generative AI, receives the generated digital product, and provides it to the user. It also uses an emotion engine to recognize the user's emotions and adjusts the delivery method accordingly.

[0609] Terminal

[0610] The terminal provides an interface for users to input prompt sentences. The terminal is responsible for sending the input prompt sentences to the server. The terminal can be a PC, smartphone, tablet, or other device.

[0611] Generative Artificial Intelligence

[0612] The generative AI analyzes the prompts received from the server and generates specific instructions for various generative AIs. The generative AI analyzes the prompts using natural language processing (NLP) technology.

[0613] Various generative artificial intelligence

[0614] Various generative AIs generate specific digital products based on instructions received from generative AI. Examples include image generation AI, music generation AI, and voice generation AI. These AIs generate digital products using deep learning models (e.g., GAN and VQ-VAE).

[0615] Emotion Engine

[0616] The emotion engine recognizes user emotions and adjusts the way digital products are provided based on the results. The emotion engine analyzes user feedback (e.g., ratings and comments) to recognize emotions.

[0617] Specific examples

[0618] A specific example of operation is shown below.

[0619] 1. The user enters a prompt.

[0620] The user inputs a prompt through the terminal interface, for example, "Draw a sunset in the background and a cat in the foreground."

[0621] 2. The terminal sends a prompt to the server

[0622] The terminal sends the entered prompt sentence to the server as an HTTP POST request.

[0623] 3. The server parses the prompt

[0624] The server analyzes the received prompt using an NLP library (e.g., spaCy or NLTK) and breaks it down into specific instructions such as "Draw a sunset in the background" and "Draw a cat in the foreground."

[0625] 4. The server sends instructions to the generative AI

[0626] The server sends the analysis results in JSON format to the generative artificial intelligence API endpoint.

[0627] 5. The generative AI sends instructions to various generative AIs

[0628] Based on the analysis results, generative AI sends specific instructions to various generative AIs, such as image generation AI, music generation AI, and voice generation AI.

[0629] 6. Various generative AIs generate digital products

[0630] The image generation AI generates illustrations using deep learning models (e.g., GAN or VQ-VAE) based on the instructions it receives.

[0631] 7. The server receives the generated digital product

[0632] The server receives the illustration data returned from the generation AI and temporarily stores it.

[0633] 8. The server provides the digital product to the user.

[0634] The server generates a download link for the saved illustration data and sends the link to the user by email.

[0635] 9. The server receives payment

[0636] The server processes payments from users through a payment system (e.g., Stripe or PayPal).

[0637] 10. The server uses an emotion engine to recognize the user's emotions.

[0638] The server analyzes the user's feedback (for example, ratings and comments) using an emotion engine (for example, IBM Watson (registered trademark) Tone Analyzer) to recognize emotions.

[0639] 11. Servers adjust their serving style based on emotions

[0640] The server adjusts the next method of providing digital products based on the results of the emotion engine. For example, if the user expresses joy, the server sets the next delivery to be immediate.

[0641] In this way, a system is realized in which the server, the terminal, and the user cooperate to generate and provide digital products. The flow of the identification process in the third embodiment will be described with reference to FIG.

[0642] Step 1:

[0643] The user enters a prompt statement.

[0644] The user inputs a prompt through the terminal interface, for example, "Draw a sunset in the background and a cat in the foreground." The input prompt is temporarily stored in the terminal's memory.

[0645] Step 2:

[0646] The terminal sends the prompt to the server.

[0647] The terminal sends the entered prompt text to the server as an HTTP POST request. The input data is the prompt text, and the output data is the prompt text sent to the server. Specifically, the terminal converts the prompt text into JSON format and sends it to the server's API endpoint.

[0648] Step 3:

[0649] The server parses the prompt.

[0650] The server parses the received prompt using a natural language processing (NLP) library (e.g., spaCy or NLTK). The input data is the prompt, and the output data is the analysis result. Specifically, it breaks it down into specific instructions such as "Draw a sunset in the background" and "Draw a cat in the foreground."

[0651] Step 4:

[0652] The server sends instructions to the generative artificial intelligence.

[0653] The server sends specific instructions to the generative AI based on the analysis results. The input data is the analysis results, and the output data is the instructions sent to the generative AI. Specifically, the analysis results are sent in JSON format to the API endpoint of the generative AI.

[0654] Step 5:

[0655] The generative AI sends instructions to various generative AIs.

[0656] Based on the received analysis results, the generative AI sends specific instructions to various generative AIs (for example, image generation AI, music generation AI, and voice generation AI). The input data is the analysis results, and the output data is the instructions sent to the various generative AIs. Specifically, the analysis results are sent to the API endpoints of the various generative AIs.

[0657] Step 6:

[0658] Various generative artificial intelligences generate digital products.

[0659] Based on the instructions received, various generative AIs use deep learning models (such as GAN or VQ-VAE) to generate digital products. The input data are instructions from the generative AI, and the output data is the generated digital product. Specifically, image generation AI generates illustrations based on the specified content.

[0660] Step 7:

[0661] The server receives the generated digital product.

[0662] The server receives and temporarily stores digital products generated by various generation AIs. The input data is the generated digital product, and the output data is the digital product stored on the server. Specifically, the generated illustration data is stored in the server's storage.

[0663] Step 8:

[0664] The server provides the digital product to the user.

[0665] The server provides the saved digital product to the user. This can be provided in a variety of ways, such as by providing a download link, sending by email, or displaying within the application. The input data is the digital product saved on the server, and the output data is the digital product provided to the user. Specifically, the generated illustration data is generated as a download link, and the link is sent to the user by email.

[0666] Step 9:

[0667] The server obtains the payment.

[0668] The server receives payment for providing the digital product. Payment can take various forms, such as a fee for one generation, a monthly membership fee, or advertising revenue. The input data is payment information from the user, and the output data is the payment received. Specifically, the server processes payment from the user through a payment system (e.g., Stripe or PayPal).

[0669] Step 10:

[0670] The server uses an emotion engine to recognize the user's emotions.

[0671] The server analyzes user feedback (e.g., ratings and comments) using an emotion engine (e.g., IBM Watson Tone Analyzer) to recognize emotions. The input data is the user feedback, and the output data is the recognized emotion. Specifically, the server sends the user's comments to the emotion engine to detect emotions such as joy and satisfaction.

[0672] Step 11:

[0673] The server adjusts the serving method based on the emotion.

[0674] The server adjusts the method of providing digital products based on the recognition results of the emotion engine. The input data is the recognized emotion, and the output data is the adjusted method of providing the digital products. Specifically, if the user expresses the emotion of joy, the server sets the next delivery to be immediate.

[0675] (Application example 3)

[0676] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0677] Conventional digital product generation systems provide content in a uniform manner without considering the user's emotions, which can lead to a decrease in user satisfaction. Furthermore, if the generated content does not match the user's emotions, the user may miss an opportunity to earn compensation. For this reason, a system that realizes a method of providing optimal digital products according to the user's emotions is needed.

[0678] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes a means for allowing a customer to input a desired item, a means for querying a generation system AI based on the input desired item and generating a generated code, a means for linking the generated code to various generation AIs (image generation AI / music generation AI / audio generation AI, etc.) and generating digital products, a means for providing the generated digital products to customers and receiving payment, a means for recognizing the customer's emotions using an emotion engine, and a means for adjusting the method of providing the generated digital products based on the recognized emotions. This makes it possible to provide optimal digital products according to the user's emotions.

[0679] "Means for customers to input their wishes" refers to an interface that allows users to input their wishes and requests into the system.

[0680] "Means for asking questions to generative AI and generating generated code" refers to a function that queries generative AI based on user input and creates generated code as a result.

[0681] "Means of linking with various generation AIs to generate digital products" refers to a function that sends the generated code to various generation AIs such as image generation AI, music generation AI, and audio generation AI to generate digital content.

[0682] "Means of providing generated digital products to customers and receiving payment" refers to the function of providing generated digital content to users and receiving payment in return.

[0683] "Means for recognizing customer emotions using an emotion engine" is a function that uses an engine to analyze and recognize user emotions.

[0684] The "means for adjusting the method of providing generated digital merchandise based on the recognized emotions" is a function that optimizes the method of providing generated digital content according to the user's emotions recognized by the emotion engine.

[0685] A system for implementing this invention includes a means for allowing a user to input what they want, a means for asking a generation AI a question and generating a generated code, a means for linking the generated code to various generation AIs (image generation AI, music generation AI, audio generation AI, etc.) to generate digital products, a means for providing the generated digital products to users and receiving payment, a means for recognizing the user's emotions using an emotion engine, and a means for adjusting the method of providing the generated digital products based on the recognized emotions.

[0686] System configuration

[0687] 1. User Input Interface:

[0688] An interface through which a user inputs their desired input, such as a smartphone app or a web form.

[0689] 2. Generative AI:

[0690] Based on user input, questions are posed to the generative AI, which then generates generative code. For example, a natural language processing engine can be used to analyze the user's wishes and generate appropriate prompts.

[0691] 3. Various generation AI:

[0692] The generated code is then linked to image generation AI, music generation AI, and audio generation AI to generate digital products. For example, OpenAI's DALL-E is used for image generation, OpenAI's Jukedeck for music generation, and Google Cloud Text-to-Speech for audio generation.

[0693] 4. Digital product delivery methods:

[0694] The generated digital products are provided to users in exchange for payment. Methods of providing the products include download links, emails, and in-app displays.

[0695] 5. Emotion Engine:

[0696] It is an engine for recognizing user emotions, for example, using Microsoft Azure's Emotion API.

[0697] 6. Delivery method adjustment means:

[0698] The system adjusts the way the generated digital product is presented based on the recognized emotion. For example, if the user expresses joy, the system immediately presents the digital product and receives feedback on the user's reaction.

[0699] Processing flow

[0700] The server provides an interface for users to input their desired items and sends the inputted preferences to the generation AI. The generation AI generates a generation code based on the user's wishes and connects to various generation AIs. The various generation AIs generate digital products based on the generation code and send it back to the server. The server uses an emotion engine to recognize the user's emotions and selects the optimal delivery method based on those emotions. Finally, the server provides the generated digital products to the user and receives payment.

[0701] Specific examples

[0702] If a user requests an illustration of a sunset and a cat, the generative AI will generate a prompt that reads, "Draw a sunset in the background and a cat in the foreground."

[0703] If the user expresses sadness, the AI ​​will send a prompt to "generate calming and soothing music" and provide a download link for the generated music.

[0704] Prompt Sentence Examples

[0705] Prompt for image generation AI: "Draw a sunset in the background and a cat in the foreground."

[0706] Prompt for Music Generation AI: "Generate calm and soothing music."

[0707] Prompt for speech generation AI: "Generate a message to stay calm"

[0708] The above is an embodiment of the present invention.

[0709] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0710] Step 1:

[0711] The user inputs their desired items. The user inputs their wishes and requests in text format using a smartphone app or web form. The input data is sent to the server.

[0712] Step 2:

[0713] The server sends the desired item received from the user to the generative AI. The generative AI uses a natural language processing engine to analyze the user's request and generate an appropriate prompt. For example, if the user requests an "illustration of a sunset and a cat," the system generates the prompt "Draw a sunset in the background and a cat in the foreground."

[0714] Step 3:

[0715] The server sends the generated prompt to various generation AIs (image generation AI, music generation AI, voice generation AI, etc.). Each generation AI generates digital products based on the prompt. For example, an image generation AI receives the prompt "Draw a sunset in the background and a cat in the foreground" and generates a corresponding illustration.

[0716] Step 4:

[0717] The generated digital product is sent back to the server, which uses an emotion engine to recognize the user's emotions. The emotion engine analyzes the user's facial expressions and voice input to identify their emotions. For example, it uses Microsoft Azure's Emotion API to determine whether the user is expressing joy.

[0718] Step 5:

[0719] The server adjusts how the generated digital product is provided based on the recognized emotion. For example, if the user expresses joy, the generated illustration is instantly displayed in the app and the user's reaction is received as feedback. If the user expresses sadness, calm, soothing music is generated and a download link is provided.

[0720] Step 6:

[0721] The server provides the generated digital products to the user and receives payment. The methods of providing the products vary, including download links, emails, and in-app displays. Based on the user's reactions and feedback, the server optimizes the method of providing the products for future use.

[0722] The above are the specific processing steps for carrying out the present invention.

[0723] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0724] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 receives a prompt including an instruction, voice data indicating a voice, a text message, and a text message.

[0725] Inference data, such as text data representing text and image data representing images, is input to the data generation model 58. The data generation model 58 performs inference on the input inference data in accordance with instructions indicated by prompts, and outputs the inference results in the form of data such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0726] Another example of generative AI is Gemini (registered trademark) (Internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[0727] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0728] [Second embodiment]

[0729] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0730] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0731] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0732] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0733] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0734] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0735] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0736] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0737] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0738] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0739] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0740] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0741] "Example 1"

[0742] In one embodiment of the present invention, a portal is provided that allows users to input their desired items. This portal may be implemented in the form of a website or application, and users can specifically input their desired items by entering text or selecting from options. For example, if a user desires "an illustration of a cat with a sunset in the background," the user enters that information.

[0743] "Example 2"

[0744] Next, based on the user's inputted wishes, the generative AI asks questions and generates a generation code. This generative AI can use natural language processing AI such as cat generation AI. The cat generation AI generates detailed instructions for the digital content to be generated based on the user's input. For example, in response to a request for "an illustration of a cat with a sunset in the background," the cat generation AI generates specific generation instructions such as "draw a sunset in the background and a cat in the foreground."

[0745] "Example 3"

[0746] The generated instructions are linked to various generation AIs (image generation AI, music generation AI, voice generation AI, etc.). These generation AIs generate specific digital products based on instructions from the cat generation AI. For example, the image generation AI generates a specific illustration based on the instruction to "draw a sunset in the background and a cat in the foreground."

[0747] "Example 4"

[0748] Finally, the generated digital product is provided to the user, and payment is received. This can be provided in various forms, such as providing a download link, sending by email, displaying within an application, etc. Payment can be received in various forms, such as a one-time fee, a monthly membership fee, or advertising revenue.

[0749] The processing flow of each embodiment will be described below.

[0750] "Example 1"

[0751] Step 1: A user enters details of the digital content they want through a portal such as a website or application. For example, if they want an "illustration of a cat with a sunset in the background," they can enter that information specifically by entering text or selecting from options.

[0752] "Example 2"

[0753] Step 1: After receiving input from the user, the generative AI (e.g., Cat generative AI)

[0754] Analyze this.

[0755] Step 2: Based on the analysis results, the generative AI generates detailed instructions for the digital content to be generated. For example, it generates specific instructions such as "paint a sunset in the background and a cat in the foreground."

[0756] "Example 3"

[0757] Step 1: Various generative AIs (image generation AI / music generation AI / audio generation AI, etc.) receive instructions from the generative AI and generate digital content according to the instructions.

[0758] Step 2: For example, the image generation AI generates a specific illustration based on the instruction, "Draw a sunset in the background and a cat in the foreground."

[0759] "Example 4"

[0760] Step 1: The generated digital product is provided to the user. This can be provided in various forms, such as by providing a download link, sending it via email, or displaying it within an application.

[0761] Step 2: Users are compensated in various ways, such as a one-time generation fee, a monthly membership fee, or advertising revenue.

[0762] Example 1

[0763] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0764] With conventional systems, it was difficult to quickly and accurately provide digital content generated based on specific customer input of what they wanted. Furthermore, the quality and variety of the generated content was limited, making it impossible to meet the diverse needs of customers.

[0765] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0766] In this invention, the server includes a means for allowing customers to input their desired items, a means for inputting prompt sentences to a generative AI based on the input desired items to generate generated content, and a means for linking the generated content to various generative AIs (image generation AI, music generation AI, voice generation AI, etc.) to generate digital content. This enables the rapid generation and provision of a variety of high-quality digital content based on the specific wishes of customers.

[0767] "Customer" refers to a user who uses the system to input their desired content and receives the generated digital content.

[0768] "Desired Items" refers to the specific requests and demands that you enter through the system.

[0769] "Generative AI" refers to an artificial intelligence model that takes prompts based on customer preferences and generates generative content.

[0770] A "prompt sentence" is text data input to a generative AI, and contains information that forms the basis of the generated content.

[0771] "Generated content" refers to digital data generated by generative AI based on prompt text.

[0772] "Various generative AI" refers to artificial intelligence models that generate specific forms of digital content (images, music, audio, etc.) based on generated content.

[0773] "Digital content" refers to digital commercial materials such as music, images, and audio generated by generative AI.

[0774] "Consideration" means the fee or remuneration you pay to receive the generated Digital Content.

[0775] MODE FOR CARRYING OUT THE INVENTION

[0776] This invention is a system that allows a customer to input their desired items and provides digital content generated based on the input. A specific embodiment of this system will be described below.

[0777] User operations

[0778] Users access the portal through a web browser or application. The portal provides an interface for users to input their desires. Users use text boxes and options to specify their desires. For example, they might enter "an illustration of a cat with a sunset in the background." Once they've completed their request, they click a submit button.

[0779] Device operation

[0780] The terminal receives the request entered by the user and sends it to the server. Specifically, if the user enters "an illustration of a cat with a sunset in the background," the terminal converts the text data into JSON format and sends a POST request to the server's API endpoint using an HTTP request.

[0781] Server Operations

[0782] The server receives the HTTP request sent from the device and extracts the user's request from the request body. The extracted text data is input as a prompt to the generative AI model. For example, using OpenAI's GPT-4 API, the prompt "Illustration of a cat with a sunset in the background" is sent. The generative AI model generates an illustration based on the prompt and sends the result back to the server.

[0783] Server data return

[0784] The server returns the illustration data received from the generative AI model to the device. Specifically, the generated illustration is included in an HTTP response as binary data and sent to the device. The user can then view the generated illustration through their device. For example, in a web browser, the illustration is displayed as an image tag.

[0785] Specific examples

[0786] A user accesses the portal, enters "illustration of a cat with a sunset as a background," and clicks the submit button. The device converts this text data into JSON format and sends a POST request to the server's API endpoint. The server inputs the received text data as a prompt sentence into a generative AI model (for example, OpenAI's GPT-4). The generative AI model generates an illustration based on the prompt sentence and sends it back to the server. The server includes the generated illustration as binary data in an HTTP response and sends it to the device. The user can view the generated illustration through the device.

[0787] In this way, the user can specifically input what he or she wants and quickly obtain a variety of high-quality digital content based on that request.

[0788] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0789] Step 1:

[0790] Users access the portal through a web browser or application. They use the text boxes and options displayed in the portal's interface to enter their specific requests. For example, they might enter "an illustration of a cat with a sunset in the background." Once they've completed their request, they click a submit button.

[0791] Input: User's request (e.g., "An illustration of a cat with a sunset in the background")

[0792] Output: The user's request is sent to the terminal as text data.

[0793] Step 2:

[0794] The terminal receives the user's input and converts the text data into JSON format, which is then sent as a POST request to the server's API endpoint using an HTTP request.

[0795] Input: User's desired text data (e.g., "Illustration of a cat with a sunset in the background")

[0796] Output: Data converted to JSON format is sent to the server

[0797] Step 3:

[0798] The server receives the HTTP request sent from the device and extracts the user's request from the request body. The extracted text data is input as a prompt to the generative AI model. For example, using OpenAI's GPT-4 API, the prompt "Illustration of a cat with a sunset in the background" is sent. The generative AI model generates an illustration based on the prompt and sends the result back to the server.

[0799] Input: JSON format data (e.g., "Illustration of a cat with a sunset in the background")

[0800] Output: Illustration data generated from the generative AI model

[0801] Step 4:

[0802] The server returns the illustration data received from the generative AI model to the device. Specifically, the generated illustration is included in the HTTP response as binary data and sent to the device.

[0803] Input: Illustration data from a generative AI model

[0804] Output: The illustration as binary data is sent to the terminal.

[0805] Step 5:

[0806] The user can view the generated illustrations through their device. For example, in a web browser, the illustrations are displayed as image tags.

[0807] Input: An illustration of the binary data sent from the server

[0808] Output: Display of illustrations that users can check

[0809] In this way, the user can specifically input what he or she wants and quickly obtain a variety of high-quality digital content based on that request.

[0810] (Application example 1)

[0811] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0812] Conventional digital content generation systems have made it difficult for users to easily generate the specific illustrations and images they desire. Furthermore, they lacked the functionality to allow users to download or share the generated digital materials, limiting the user experience. This made it difficult to meet the diverse needs of users.

[0813] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0814] In this invention, the server includes a means for allowing customers to input their desired items, a means for querying a generation AI based on the input desired items and generating a generation code, a means for linking the generated code to various generation AIs (image generation AI / music generation AI / voice generation AI, etc.) to generate digital products, a means for providing the generated digital products to customers and receiving payment, and a means for downloading or sharing the generated digital products. This makes it possible for users to easily generate specific digital content they desire and download or share it.

[0815] "Means for customers to input their desired content" refers to an interface that allows users to input the specific illustrations, images, and other digital content they desire by entering text or selecting from a list of options.

[0816] The "means of asking a question to a generative AI and generating a generated code" is a process for sending a prompt to a generative AI based on a user's input preference, and obtaining a generated code as a result.

[0817] "Means of linking to various generative AIs to generate digital products" refers to a method of using the generated code to link to various generative AIs, such as image generation AI and music generation AI, to generate digital content that meets the user's wishes.

[0818] "Means for providing generated digital products to customers and receiving payment" refers to a system for providing generated digital content to users and receiving payment in return.

[0819] "Means for downloading or sharing generated digital products" refers to a function that allows users to download generated digital content to their own devices or share it on platforms such as social media.

[0820] "Generating digital products based on prompts using a specific generative AI model" refers to the process of using a specific generative artificial intelligence model to generate digital content based on prompts entered by a user.

[0821] "Digital content such as illustrations, images, music, and audio" refers to all content such as digital illustrations, images, music, and audio generated by generative artificial intelligence.

[0822] A system for implementing this invention includes means for allowing a user to input desired items, means for asking questions to a generation AI to generate a generated code, means for linking the generated code to various generation AIs to generate digital products, means for providing the generated digital products to customers and receiving payment, and means for downloading or sharing the generated digital products.

[0823] System configuration

[0824] The system uses the following hardware and software:

[0825] Hardware

[0826] Server (cloud server or local server)

[0827] User's smartphone

[0828] software

[0829] Flask (Python web framework)

[0830] OpenAI API (generative AI model)

[0831] Data processing and calculation

[0832] 1. User Input

[0833] Using a smartphone application, users can specify the illustration or image they want by entering text, for example, "an illustration of a cat with a sunset in the background."

[0834] 2. Questions for Generative AI

[0835] The server receives user input and sends a prompt to the generative AI, such as "Create an illustration of a cat with a sunset background."

[0836] 3. Generate generated code

[0837] The generative AI generates generative code based on the prompt text. This generative code is linked to various generative AIs (image generation AI, music generation AI, voice generation AI, etc.).

[0838] 4. Digital product creation

[0839] Various generation AIs receive the generated code and generate digital content according to the user's wishes. For example, the image generation AI generates an "illustration of a cat against a sunset background."

[0840] 5. Provision of digital products and receipt of payment

[0841] The generated digital content is provided to users through a server, who can then download it or share it on social media. Payment is made through an online payment system.

[0842] Specific examples

[0843] If the user wants "an illustration of a cat with a sunset in the background," they would enter the prompt text as follows:

[0844] Prompt Sentence Examples

[0845] Create an illustration of a cat with a sunset background

[0846] By sending this prompt to the generative AI, an illustration that matches the user's desire will be generated. The generated illustration can then be downloaded to the user's smartphone and shared on social media.

[0847] In this way, users can easily create the specific digital content they desire and download or share it.

[0848] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0849] Step 1:

[0850] The user uses a smartphone application to specify the desired illustration or image by entering text. For example, they might enter "an illustration of a cat with a sunset in the background." This input data is then sent to the server.

[0851] Step 2:

[0852] The server analyzes the input data received from the user and generates a prompt for the generative AI. Specifically, based on the input text "An illustration of a cat with a sunset background," it creates the prompt "Create an illustration of a cat with a sunset background." This prompt is then sent to the generative AI.

[0853] Step 3:

[0854] The generative AI generates a generative code based on the received prompt. The generative code contains instructions for generating digital content according to the user's wishes. This generative code is returned to the server.

[0855] Step 4:

[0856] The server receives the generation code and connects it to various generation AIs (image generation AI, music generation AI, voice generation AI, etc.). For example, it sends the generation code to an image generation AI, instructing it to generate an "illustration of a cat with a sunset in the background."

[0857] Step 5:

[0858] The image generation AI generates an illustration based on the user's request based on the generated code, and the generated illustration is returned to the server.

[0859] Step 6:

[0860] The server receives the generated illustrations and provides them to the user, who can then download them or share them on social media via a smartphone application.

[0861] Step 7:

[0862] When a user downloads or shares the generated illustration, the server receives payment through an online payment system, allowing the user to obtain the desired digital content and the server to receive payment.

[0863] Example 2

[0864] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0865] Conventional digital content generation systems have had difficulty efficiently generating content that specifically reflects user preferences. Furthermore, they lacked a means for automatically generating specific instructions to improve the quality of the generated content and user satisfaction. This has created a demand for a system that can quickly provide high-quality digital content that meets user preferences.

[0866] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0867] In this invention, the server includes a means for allowing a customer to input desired content, a means for asking a generative AI questions based on the input desired content and generating generation instructions, and a means for generating a generation code based on the generation instructions. This makes it possible to automatically generate specific generation instructions based on the user's wishes and quickly provide high-quality digital content based on them.

[0868] The "means by which customers can input desired content" refers to an interface that allows users to input the content of the digital content they desire.

[0869] The "means for asking questions to the generative AI and generating generation instructions" is an artificial intelligence system that analyzes the desired content entered by the user and generates specific generation instructions based on that.

[0870] The "means for generating generation code based on generation instructions" refers to a system that generates program code for generating actual digital content based on generation instructions received from the generative AI.

[0871] "Various generative AI" refers to artificial intelligence systems for generating specific types of digital content, such as image generation AI, music generation AI, and voice generation AI.

[0872] "Digital content" refers to media such as music, images, and audio that is expressed in digital form.

[0873] "Natural language processing AI" is an artificial intelligence system that analyzes natural language text entered by the user, understands its meaning, and generates appropriate generation instructions.

[0874] The present invention is a system for efficiently generating digital content desired by a user. A specific embodiment of this system will be described below.

[0875] The user uses the terminal to input the desired digital content. For example, the user might input "an illustration of a cat with a sunset in the background." This input is sent from the terminal to the server as text data.

[0876] The server analyzes the user's wishes and asks the generative AI a question. A natural language processing AI is used as this generative AI. The natural language processing AI analyzes the user's wishes and generates specific generation instructions. For example, it generates instructions such as "Draw a sunset in the background and a cat in the foreground."

[0877] Next, the server generates a generation code based on the generation instructions received from the generation AI. This generation code is a specific program for generating digital content. The generation code is linked to various generation AIs (e.g., image generation AI, music generation AI, voice generation AI, etc.) to generate digital content.

[0878] The generated digital content is sent from the server to the terminal and provided to the user, who can then check the generated digital content and modify or regenerate it as necessary.

[0879] As a concrete example, consider the case where a user requests "an illustration of dogs playing under a blue sky." In this case, the user inputs "an illustration of dogs playing under a blue sky" into their device. The server sends this input to a natural language processing AI, which then generates a generation instruction such as "draw a blue sky as the background and dogs playing in the foreground." Based on this generation instruction, the server generates specific generation code, which it then links to an image generation AI to generate an illustration. The generated illustration is then sent from the server to the device and provided to the user.

[0880] Example prompt sentence:

[0881] User Input: Illustration of dogs playing under a blue sky

[0882] Generative AI instructions: Draw a blue sky in the background with dogs playing in the foreground

[0883] In this way, it becomes possible to quickly provide high-quality digital content based on the user's wishes.

[0884] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0885] Step 1:

[0886] The user inputs their preference

[0887] The user uses the terminal to input the details of the digital content they want. For example, they input "an illustration of a cat with a sunset in the background." This input is saved as text data on the terminal.

[0888] Input: User's desired content (e.g., "An illustration of a cat with a sunset in the background")

[0889] Output: Desired content as text data

[0890] Step 2:

[0891] The device sends the user's wishes to the server

[0892] The terminal transmits the user's input preferences to the server. At this time, the input contents are transmitted as text data.

[0893] Input: Desired content as text data

[0894] Output: Request sent to server

[0895] Step 3:

[0896] The server asks the generative AI a question

[0897] The server then sends the user's request to a generative AI, which uses natural language processing AI. The server then sends the request to the generative AI and asks for specific instructions on how to create the product.

[0898] Input: Your request sent to the server

[0899] Output: The desired content sent to the generative AI

[0900] Step 4:

[0901] Generative AI generates specific generation instructions

[0902] The generative AI analyzes the user's wishes and generates specific instructions, such as "paint a sunset in the background and a cat in the foreground."

[0903] Input: Desired content sent to the generative AI

[0904] Output: Specific production instructions (e.g., "Draw a sunset in the background and a cat in the foreground")

[0905] Step 5:

[0906] The server generates the generated code based on the generation instructions.

[0907] The server generates the actual generation code based on the generation instructions received from the generative AI. This generation code is a specific program for generating digital content.

[0908] Input: Specific generation instructions

[0909] Output: Generated code

[0910] Step 6:

[0911] The server connects the generated code to various generation AIs

[0912] The server links the generated generation code to various generation AIs (e.g., image generation AI, music generation AI, voice generation AI, etc.) to generate digital content.

[0913] Input: Generated code

[0914] Output: Generated digital content

[0915] Step 7:

[0916] The server sends the generated digital content to the terminal.

[0917] The server transmits the generated digital content to the terminal, where the generated content is transmitted as digital data.

[0918] Input: Generated digital content

[0919] Output: Digital content sent to a device

[0920] Step 8:

[0921] The terminal displays the generated digital content to the user.

[0922] The terminal displays the received digital content to the user, who can then check the generated digital content and modify or regenerate it as necessary.

[0923] Input: Digital content sent to your device

[0924] Output: The digital content displayed to the user

[0925] (Application example 2)

[0926] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0927] With conventional digital content generation systems, it was difficult to create specific generation instructions based on the user's wishes, and the generated content often did not meet the user's expectations. Another issue was that the types of generated content were limited, and they were not particularly suited to generating artwork.

[0928] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0929] In this invention, the server includes a means for allowing customers to input their desired items, a means for querying a generative AI based on the input desired items and generating a generation code, a means for linking the generated code to various generative AIs (image generation AI, music generation AI, voice generation AI, etc.) to generate digital products, a means for providing the generated digital products to customers and receiving payment, and a means for generating artwork based on the generated instructions. This makes it possible to create specific generation instructions based on user wishes and generate a wide variety of digital content, especially artwork.

[0930] "Means for customer input" means an interface through which users can enter details of the digital content they wish to generate.

[0931] "Means for asking questions to a generative AI and generating generative code" refers to the process of asking questions to a generative AI based on user input and generating code containing specific generation instructions.

[0932] "Means of linking with various generation AIs to generate digital products" refers to the process of sending the generated code to different generation AIs, such as image generation AI, music generation AI, and voice generation AI, to generate digital content.

[0933] "Means of providing generated digital products to customers and receiving payment" refers to the process of providing generated digital content to users and receiving money or other compensation in return.

[0934] The "means for generating an artwork based on generated instructions" is a process for automatically generating an artwork based on specific generation instructions created by a generative artificial intelligence.

[0935] "Natural language processing AI" is artificial intelligence that has the ability to understand and generate human language.

[0936] "Digital Content" means content expressed in digital form, such as music, images, sounds, artwork, etc.

[0937] The system for implementing the present invention includes a series of processes for generating digital content desired by a user, which will be described in detail below.

[0938] System Configuration

[0939] The system consists of the following main components:

[0940] 1. User Interface: An interface for users to enter details of the digital content they want. This is implemented as a smartphone application.

[0941] 2. Generative AI: A natural language processing AI that asks questions based on user input and generates generative code containing specific generation instructions. In this example, we use OpenAI's GPT-3.

[0942] 3. Various generative AI: AI that receives generated code and generates digital content. This includes image generation AI, music generation AI, and voice generation AI.

[0943] 4. Digital content provision system: A system for providing generated digital content to users and receiving payment for it.

[0944] Program processing

[0945] 1. User Interface: The user enters details of the digital content they want, for example, "an illustration of a cat with a sunset in the background."

[0946] 2. Generative AI: Receives user input and sends prompts to the generative AI. Examples of prompts include:

[0947] Generate detailed instructions for the artwork to be generated based on the user's request: Cat illustration with a sunset in the background

[0948] 3. Generate instructions: The generative AI creates specific instructions and responds. For example, it might generate an instruction such as "Draw a sunset in the background and a cat in the foreground."

[0949] 4. Various generative AI: The generated instructions are sent to various generative AI to generate digital content. In this case, the image-generating AI generates a concrete work of art.

[0950] 5. Digital Content Providing System: Generated digital content is provided to users and payment is received. Users can download the generated artwork.

[0951] Hardware and software used

[0952] Hardware: Smartphones, servers

[0953] Software: Python, OpenAI API, various generative AI (image generation AI, music generation AI, voice generation AI)

[0954] Specific examples

[0955] When a user requests "an illustration of a cat with a sunset in the background" using a smartphone application, the generative AI receives the following prompt:

[0956] Generate detailed instructions for the artwork to be generated based on the user's request: Cat illustration with a sunset in the background

[0957] The generative AI creates specific generation instructions, such as "paint a sunset in the background and a cat in the foreground," and sends them to the image generation AI, which then generates a work of art based on these instructions and provides it to the user.

[0958] In this way, specific creation instructions based on the user's wishes can be created, enabling the creation of a wide variety of digital content, particularly artwork.

[0959] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0960] Step 1:

[0961] A user uses a smartphone to input details of the digital content they want. For example, the desired content might be an illustration of a cat with a sunset in the background. The input data is sent to the server in text format.

[0962] Step 2:

[0963] The server sends a prompt to the generative AI based on the received user request. Specifically, it generates the following prompt:

[0964] Generate detailed instructions for the artwork to be generated based on the user's request: Cat illustration with a sunset in the background

[0965] This prompt sentence is sent to the generation AI to obtain generation instructions.

[0966] Step 3:

[0967] The generative AI creates specific instructions based on the received prompt, such as "Draw a sunset in the background and a cat in the foreground." These instructions are returned to the server in text format.

[0968] Step 4:

[0969] The server sends the generation instructions received from the generative AI to various generation AIs. Here, the generation instructions are sent to the image generation AI. Based on the generation instructions, the image generation AI generates a specific artwork.

[0970] Step 5:

[0971] The image generation AI generates an artwork based on the received generation instructions, and the generated artwork is returned to the server as image data.

[0972] Step 6:

[0973] The server provides the generated artwork to the user. The user can download the generated artwork using a smartphone terminal. The generated artwork is based on the user's wishes and meets the user's expectations.

[0974] In this way, specific creation instructions based on the user's wishes can be created, making it possible to create a wide variety of digital content, particularly artwork.

[0975] Example 3

[0976] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0977] Conventional digital content generation systems have had difficulty in quickly and accurately generating content that meets specific user requests. Furthermore, the methods for providing generated content and receiving payment are limited, resulting in low user convenience. This makes it difficult to respond to diverse user needs, resulting in a decline in user satisfaction.

[0978] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0979] In this invention, the server includes a means for allowing a customer to input desired digital content, a means for generating a prompt sentence in a generation AI model based on the input desired digital content, a means for linking the generated prompt sentence to various generation AIs (image generation AI / music generation AI / voice generation AI, etc.) to generate digital products, and a means for providing the generated digital products to customers and receiving payment. This makes it possible to quickly and accurately generate digital content that meets specific user requests, and to realize a variety of methods for providing the content and receiving payment.

[0980] "Customer" refers to a user who intends to use the system to generate digital content.

[0981] "Digital content" refers to commercial materials expressed in digital form, such as music, images, and audio.

[0982] A "generative AI model" refers to an artificial intelligence model that generates prompt sentences based on user requests and sends instructions to various generative AIs.

[0983] A "prompt sentence" refers to text containing specific instructions that is generated by a generative AI model by analyzing a user's request.

[0984] "Generative AI" refers to artificial intelligence (AI) that generates digital content based on prompts. Examples include image generation AI, music generation AI, and voice generation AI.

[0985] "Digital products" refers to digital content generated by generative AI.

[0986] "Means of provision" refers to the method by which the generated digital materials are provided to customers, including, for example, providing a download link, sending by email, or displaying within an application.

[0987] "Means of Receiving Compensation" refers to the method by which compensation is received from customers for the generated digital products, including, for example, a one-time fee, a monthly membership fee, or advertising revenue.

[0988] The present invention relates to a system for generating and providing digital content desired by a user. A specific embodiment of this system will be described below.

[0989] First, a user accesses the system using a terminal and inputs a request for the digital content they want to generate. For example, a user might input, "I want an illustration of a cat on a sunset background."

[0990] Next, the server receives the user's request and generates a prompt to be sent to the generative AI model. Specifically, the server analyzes the user's request using natural language processing technology and generates the prompt, "Draw a sunset in the background and a cat in the foreground." This prompt is then sent to the generative AI model.

[0991] The server sends the generated prompt to an appropriate generation AI, such as an image generation AI. For example, it sends the image generation AI instructions such as "Draw a sunset in the background and a cat in the foreground." The image generation AI generates the specified illustration based on the received prompt. In this case, the image generation AI uses a deep learning framework such as TensorFlow or PyTorch to generate the image.

[0992] The generated digital product is provided to the user by the server. It can be provided in the form of a download link, sent by email, or displayed within an application. For example, the server sends the user a download link for the generated illustration by email. The user clicks the link in the email to download the illustration.

[0993] Finally, the user pays for the provided digital product. The form of payment can be a fee per creation, a monthly membership fee, advertising revenue, etc. For example, the user pays the fee per creation using a credit card. Once the payment is confirmed, the server allows the user to download the illustration.

[0994] For example, if a user requests "I want an illustration of a cat on a sunset background," the server will send the following prompt to the generative AI model:

[0995] "Paint a sunset in the background and a cat in the foreground"

[0996] Upon receiving this prompt, the image generation AI will generate the specified illustration.

[0997] In this way, it is possible to quickly and accurately generate digital content that meets specific user requests, and realize a variety of methods for providing the content and receiving payment. The flow of the specification process in the third embodiment will be described with reference to FIG.

[0998] Step 1:

[0999] A user accesses the system using a terminal and inputs a request for the digital content they want to generate. For example, a user might input, "I want an illustration of a cat on a sunset background." The input request is sent to the server.

[1000] Input: User request (e.g., "I want an illustration of a cat on a sunset background.")

[1001] Output: The user's request sent to the server

[1002] Step 2:

[1003] The server receives requests sent by users and then uses a natural language processing engine to parse the requests and generate prompts to send to the generative AI model, such as "Draw a sunset in the background and a cat in the foreground."

[1004] Input: User request

[1005] Data processing: Analyzing requirements using a natural language processing engine

[1006] Output: The generated prompt (e.g., "Draw a sunset in the background and a cat in the foreground")

[1007] Step 3:

[1008] The server sends the generated prompt to an appropriate AI, such as an image generation AI. For example, it sends an instruction to the image generation AI to "draw a sunset in the background and a cat in the foreground."

[1009] Input: Generated prompt text

[1010] Output: The prompt sent to the generation AI

[1011] Step 4:

[1012] The image generation AI generates a specified illustration based on the received prompt sentence. In this case, the image generation AI generates the image using deep learning frameworks such as TensorFlow and PyTorch. For example, it generates an illustration with a sunset in the background and a cat in the foreground.

[1013] Input: prompt statement

[1014] Data Computing: Image Generation Using Deep Learning Frameworks

[1015] Output: Generated illustration

[1016] Step 5:

[1017] The server saves the generated illustration and generates a download link for the user, which the server then emails to the user.

[1018] Input: Generated illustration

[1019] Data processing: Generate download links

[1020] Output: Download link sent to user

[1021] Step 6:

[1022] The user clicks on the link in the email to download the illustration. The user enters their credit card information on the download page and pays for the one-time generation fee. The server allows the user to download the illustration once payment is confirmed.

[1023] Input: Download link, credit card information

[1024] Data calculation: Payment confirmation

[1025] Output:Download allowed

[1026] (Application example 3)

[1027] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1028] In conventional digital product generation systems, when generating specific digital content desired by users, there were problems such as the generation AI's instructions being vague and the quality of the generated content being inconsistent. In addition, there were limited ways to provide the generated digital products to users and to receive payment, which made it difficult for users to use.

[1029] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes a means for allowing a customer to input a desired item; a means for querying a generation system AI based on the input desired item and generating a generation code; a means for linking the generated code to various generation AIs (image generation AI, music generation AI, audio generation AI, etc.) to generate digital products; a means for providing the generated digital products to customers and receiving payment; a means for the image generation AI to generate an original artwork based on a prompt entered by the customer and displaying it within the application; a means for sharing the generated artwork via a download link or on social media; and a means for the customer to pay a fee for one generation or to use the service unlimitedly as a monthly membership. This allows users to generate high-quality digital content by entering specific instructions, and to provide and receive payment in a convenient manner.

[1030] "Means for customers to input their wishes" refers to an interface that allows users to input specific details and instructions for the digital content they wish to generate.

[1031] "Means of asking questions to the generative AI and generating generated code" refers to the process of giving appropriate instructions to the generative AI based on the desired content entered by the user, and creating generated code based on those instructions.

[1032] "Means of linking with various generation AIs to generate digital products" refers to the process of passing the generated code to different generation AIs, such as image generation AI, music generation AI, and voice generation AI, and each AI then generates digital content.

[1033] "Means of providing generated digital products to customers and receiving payment" refers to a mechanism for providing generated digital content to users and receiving payment in return.

[1034] "The means by which an image generation AI generates an original work of art based on a prompt entered by a customer and displays it within the application" refers to the process by which an image generation AI generates an original work of art based on specific instructions (prompts) entered by a user and displays the work within the application.

[1035] "Means for sharing the generated artwork via download links or social media" refers to a function that allows users to download the generated artwork or share it on social media.

[1036] "Means where customers pay a fee for one-time generation or unlimited use as a monthly membership" means a fee structure whereby users can pay a fee for each content generated or can generate and use unlimited content as a monthly membership.

[1037] The system for implementing the present invention provides a series of processes for generating digital content desired by a user. Specific embodiments of the system will be described below.

[1038] First, a user accesses a dedicated application using a device such as a smartphone or computer. This application provides an interface where the user can input their desired content. For example, the user can input a prompt such as, "Please draw a landscape with a cat in front of a sunset."

[1039] Next, the server receives the prompt input from the user, asks the generative AI appropriate questions, and generates generative code. This generative code contains specific instructions based on the user's wishes. For example, the OpenAI API can be used as the generative AI.

[1040] The generated code is then linked to various generative AIs, such as image generation AI, music generation AI, and voice generation AI, which then generate digital content according to their respective fields of expertise. For example, an image generation AI can generate original artwork based on a user's prompt.

[1041] The generated digital products are displayed within the application. Users can view the generated artwork, download it via a download link, or share it on social media. Users can also pay a fee for a single creation or subscribe for unlimited use.

[1042] In implementing this system, the following hardware and software are used:

[1043] Hardware: Cloud servers (e.g., Amazon Web Services or Google Cloud Platform)

[1044] Software: Flask (web framework), OpenAI API (generative AI)

[1045] For example, if a user inputs a prompt such as "Generate an illustration of dogs playing under a blue sky and white clouds," the image generation AI will generate an illustration based on that instruction and display it within the application. The user can then download the illustration or share it on social media.

[1046] In this way, users can generate high-quality digital content by inputting specific instructions, and provide and receive payment in a highly convenient manner.

[1047] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1048] Step 1:

[1049] The user accesses the application using a terminal and inputs the desired digital content as a prompt sentence, for example, "Please draw a landscape with a cat in front of a sunset." The input data is sent to the server.

[1050] Step 2:

[1051] The server analyzes the received prompt and generates a generated code to ask the generative AI an appropriate question. This generated code contains specific instructions based on the user's wishes. Natural language processing technology is used to generate the generated code. The input is the prompt and the output is the generated code.

[1052] Step 3:

[1053] The server connects the generated generation code to various generation AIs (image generation AI, music generation AI, voice generation AI, etc.). For example, an image generation AI is given the instruction to "generate a landscape painting of a cat in front of a sunset." The input is the generation code, and the output is the instruction to the generation AI.

[1054] Step 4:

[1055] Each generative AI generates digital content based on the instructions it receives. For example, an image-generating AI generates an image with specified content. The input is the instructions to the generative AI, and the output is the generated digital content (e.g., an image).

[1056] Step 5:

[1057] The server displays the generated digital content within the application, and the user can view the generated artwork. The input is the generated digital content, and the output is the display within the application.

[1058] Step 6:

[1059] Users can download the generated artwork via a download link or share it on social media. The input is the generated digital content, and the output is the download link or sharing on social media.

[1060] Step 7:

[1061] Users can pay a fee for a single generation or subscribe to unlimited monthly usage. The server manages user payment information and applies the appropriate fee structure. The input is the user payment information, and the output is the application of the fee.

[1062] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1063] "Example 1"

[1064] One embodiment of the present invention is a system that incorporates an emotion engine that recognizes user emotions. In this system, the emotion engine recognizes user emotions as a means for the user to input their desired items. Specifically, when a user inputs details of desired digital content through a portal such as a website or application, the emotion engine recognizes the user's emotion and asks a generative AI question based on that emotion. For example, if the user expresses joy, the emotion engine recognizes the emotion and instructs the generative AI to generate digital content related to joy.

[1065] "Example 2"

[1066] In addition, the code generated by the generative AI is linked to various generative AIs (image generation AI, music generation AI, audio generation AI, etc.), and the means of generating digital products also take into account the recognition results of the emotion engine. Specifically, the generative AI generates digital products based on the user's emotions recognized by the emotion engine. For example, if the user expresses joy, the generative AI will generate digital content related to joy, such as brightly colored images and cheerful music.

[1067] "Example 3"

[1068] Furthermore, the method of providing the generated digital product to the user and receiving payment also takes into account the results of the emotion engine's recognition. Specifically, the method of providing the digital product is adjusted based on the user's emotions recognized by the emotion engine. For example, if the user expresses joy, the digital product is immediately provided to the user, and their reaction is obtained as instant feedback. This makes it possible to provide the optimal digital product according to the user's emotions and optimize the payment for it.

[1069] The processing flow of each embodiment will be described below.

[1070] "Example 1"

[1071] Step 1: The user enters details of the digital content they want through a portal such as a website or app.

[1072] Step 2: The emotion engine recognizes the user's emotion.

[1073] Step 3: Based on the emotions recognized by the emotion engine, the generative AI is instructed to generate digital content.

[1074] "Example 2"

[1075] Step 1: The code generated by the generative AI is linked to various generative AIs (image generation AI, music generation AI, audio generation AI, etc.).

[1076] Step 2: Based on the user's emotions recognized by the emotion engine, the generative AI generates digital products.

[1077] "Example 3"

[1078] Step 1: Provide the generated digital product to the user.

[1079] Step 2: Adjust how digital products are presented based on the user's emotions recognized by the emotion engine.

[1080] Step 3: Get instant feedback from users.

[1081] Example 1

[1082] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1083] Conventional digital content generation systems provide a means for users to input their preferences, but do not generate content that takes the user's emotions into consideration. This makes it difficult to provide personalized content that reflects the user's emotions.

[1084] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1085] In this invention, the server includes a means for allowing a customer to input a desired item, a means for asking a generative AI questions based on the input desired item and generating a generated code, a means for linking the generated code to various generative AIs (image generation AI, music generation AI, voice generation AI, etc.) to generate digital products, a means for providing the generated digital products to the customer and receiving payment, a means for recognizing the customer's emotions, and a means for sending a prompt to the generative AI based on the recognized emotions. This enables the generation of more personalized digital content according to the user's emotions.

[1086] "Means for allowing customers to input their desired content" refers to means for providing an interface for users to specifically input the digital content they desire.

[1087] "Means for asking questions to a generative AI and generating generated code" refers to means for asking questions to a generative AI based on user input and creating generated code as a response.

[1088] "Means of linking to various generation AIs to generate digital products" refers to means of linking the generated code to different generation AIs such as image generation AI, music generation AI, and voice generation AI, and using them to generate digital content.

[1089] "Means for providing the generated digital materials to customers and receiving payment" refers to means for providing the generated digital content to users and receiving a fee in return.

[1090] "Means for recognizing customer emotions" refers to means that use technology to analyze and recognize emotions from user input and interactions.

[1091] "Means for sending prompt sentences to a generative AI based on recognized emotions" refers to means for generating appropriate prompt sentences based on the recognized user emotions and sending them to a generative AI.

[1092] The present invention is a system for generating digital content desired by a user, and aims to provide more personalized content by taking into consideration the user's emotions. Specific embodiments of this system will be described below.

[1093] System configuration

[1094] Hardware and Software

[1095] The server provides a portal in the form of a website or mobile application, with an interface where users can enter their preferences. Users can specify their preferences by entering text or selecting from a list of options.

[1096] An emotion engine is software that analyzes emotions from user input and interactions, specifically using Microsoft's Azure Cognitive Services or Google's Cloud Natural Language API.

[1097] Generative AI models such as OpenAI's GPT-4 and Google's BERT are used, which generate digital content based on prompts sent from the server.

[1098] Program processing

[1099] The server receives data when a user accesses the portal and inputs what they want. For example, if a user wants an illustration of a cat with a sunset in the background, they input that information into the portal.

[1100] The server then calls the emotion engine, which analyzes the user's input and interaction data to identify emotions. For example, if the user is feeling "happy," the emotion engine recognizes that emotion.

[1101] The server generates a prompt to send to the generative AI model based on the emotion information obtained from the emotion engine. For example, it creates a prompt such as, "Please generate an illustration of a cat with a sunset in the background. The user is very happy, so please create an illustration with a bright and cheerful atmosphere that reflects that emotion."

[1102] The generative AI model generates digital content based on the prompt it receives and according to the specified conditions. For example, GPT-4 generates a description of an illustration, and the image generation model creates the illustration based on that.

[1103] The server provides the digital content received from the generative AI model to users, who can then view and download the generated illustrations through a portal.

[1104] Specific examples

[1105] For example, if a user requests an "illustration of a cat with a sunset in the background" and expresses the emotion of joy, the emotion engine will recognize the user's emotion of joy and input the following prompt sentence into the generative AI model:

[1106] Example prompt sentence:

[1107] "Generate an illustration of a cat with a sunset in the background. The user is very happy, so please create a bright and cheerful illustration that reflects that emotion."

[1108] Based on this prompt, the generative AI model generates an illustration according to the specified conditions, and the server provides the illustration to the user, who can then view and download the generated illustration through a portal.

[1109] The above is a specific embodiment for carrying out the present invention. This system makes it possible to generate more personalized digital content according to the user's emotions.

[1110] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1111] Step 1:

[1112] A user accesses the portal

[1113] Users access the portal using a web browser or mobile application. The portal provides an interface where users can input their desires. The input includes text boxes and options, which the user uses to specify their desires. For example, they might enter "a picture of a cat with a sunset in the background." The output is the user's desire, sent to the portal.

[1114] Step 2:

[1115] The server receives the user's input

[1116] The server receives the preferences entered by the user into the portal. The input includes the text data entered by the user. The server receives this data and stores it in a database. The output is the saved user preference data.

[1117] Step 3:

[1118] The server invokes the emotion engine

[1119] The server invokes the emotion engine based on the user's input data. The input includes the user's desired data. The server sends an HTTP request and passes the data to the emotion engine. The emotion engine analyzes the user's input and interaction data to identify emotions. The analysis results are returned to the server in JSON format as output.

[1120] Step 4:

[1121] Emotion engine analyzes user emotions

[1122] The emotion engine analyzes user input data and identifies the user's emotion. The input includes the user's desired data. The emotion engine analyzes the emotion using natural language processing technology and identifies the emotion "joy," for example. The emotion analysis result is obtained as the output.

[1123] Step 5:

[1124] The server sends a prompt to the generative AI model

[1125] The server generates a prompt to be sent to the generative AI model based on the analysis results obtained from the emotion engine. The input includes the emotion analysis results and the user's desired data. The server combines this data to create a prompt and sends it to the generative AI model via an HTTP request. The output is the prompt sent to the generative AI model.

[1126] Step 6:

[1127] Generative AI models generate digital content

[1128] The generative AI model generates digital content according to specified conditions based on the received prompt. The input includes the prompt sent from the server. The generative AI model generates, for example, an illustration using natural language processing and image generation techniques. The output is the generated digital content.

[1129] Step 7:

[1130] The server serves the generated content to the user

[1131] The server provides the user with digital content received from the generative AI model. The input includes the generated digital content. The server displays this content to the user through a portal and makes it available in a downloadable format. The output is digital content that the user can access.

[1132] (Application example 1)

[1133] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1134] Conventional digital content generation systems provide a means for users to input their desired content, but do not generate content that takes into account the user's emotions. This makes it difficult to provide more personalized content that reflects the user's emotions. Furthermore, if the generated content does not match the user's emotions, user satisfaction may decrease.

[1135] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1136] In this invention, the server includes a means for allowing a customer to input a desired item, a means for asking a generative AI questions based on the input desired item and generating a generated code, a means for linking the generated code to various generative AIs (image generation AI, music generation AI, voice generation AI, etc.) to generate digital products, a means for providing the generated digital products to customers and receiving payment, and a means for using an emotion engine that recognizes the customer's emotions to send prompts to the generative AI based on the emotions, thereby enabling the generation of personalized digital content according to the user's emotions.

[1137] "Customer" refers to a user who uses the system to input their desired items and receives the generated digital products.

[1138] "Desired Content" refers to the specific details of the digital content you wish to generate that you enter through the system.

[1139] "Generative AI" is an artificial intelligence that asks questions based on the desired item entered and generates a generative code.

[1140] "Generation code" refers to code that is generated by the generative AI based on the desired input, and is used to link with various generative AIs.

[1141] "Various generation AI" refers to artificial intelligence for generating digital products based on generated code, including image generation AI, music generation AI, and voice generation AI.

[1142] "Digital products" refer to digital content generated by various types of generative AI.

[1143] The "emotion engine" is an engine that recognizes the customer's emotions and sends prompts to the generative AI based on those emotions.

[1144] A "prompt" is an instruction sent to the generative AI based on the customer's emotions recognized by the emotion engine.

[1145] A system for implementing this invention is configured as follows: First, a user starts an application using a smartphone and inputs the desired digital content. Input methods include text input and selection from options.

[1146] Next, an emotion engine recognizes emotions from the user's input. This emotion engine analyzes the user's text and voice input to identify emotions such as joy, sadness, surprise, etc. Software such as EmotionRecognizer is used as the emotion engine.

[1147] Once the emotion is recognized, a prompt is generated for the generative AI. The prompt is generated based on the user's desired digital content and the recognized emotion. For example, if the user requests an "illustration of a cat with a sunset background" and the emotion engine recognizes the emotion "joy," the prompt will be "Create a joyful sunset background with a cat illustration."

[1148] The generated prompt is sent to a generative AI model such as the OpenAI API. The generative AI model generates digital content based on the prompt. The generated digital content is then generated through various generative AIs, such as image generation AI, music generation AI, and voice generation AI.

[1149] The generated digital content is provided to the user, who can view and download the generated content through a smartphone application. This makes it possible to generate personalized digital content according to the user's emotions.

[1150] For example, if a user requests an "illustration of a cat with a sunset as the background" and the emotion engine recognizes the emotion "joy," the prompt will be "Create a joyful sunset background with a cat illustration." This prompt will be sent to the generative AI model, and the generated illustration will be provided to the user.

[1151] The hardware used is primarily a smartphone, and the software used includes Python, Flask (web framework), OpenAI API (generative AI model), and EmotionRecognizer (emotion recognition engine).

[1152] Examples of prompts include:

[1153] "Create a joyful sunset background with a cat illustration"

[1154] "Create a sad melody for a rainy day"

[1155] "Create an exciting video about space exploration"

[1156] In this way, digital content can be generated according to the user's emotions.

[1157] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1158] Step 1:

[1159] The user starts the application on the smartphone and inputs the desired digital content.

[1160] Input: Text input of the digital content desired by the user (e.g., "Illustration of a cat with a sunset in the background")

[1161] Output: Text data of the digital content desired by the user

[1162] Step 2:

[1163] The terminal transmits the user's input contents to the emotion engine, and the emotion engine recognizes the user's emotion.

[1164] Input: Text data of the digital content desired by the user

[1165] Output: User's emotion data (e.g., "joy")

[1166] Specific operation: The emotion engine (EmotionRecognizer) analyzes text data and identifies emotions.

[1167] Step 3:

[1168] The server generates a prompt sentence to send to the generative AI based on the emotional data received from the emotion engine and the text data of the digital content desired by the user.

[1169] Input: Text data of the user's desired digital content, user's emotional data

[1170] Output: A prompt to send to the generative AI (e.g., "Create a joyful sunset background with a cat illustration")

[1171] Specific operation: The server generates a prompt sentence based on the emotion data.

[1172] Step 4:

[1173] The server sends a prompt to the generative AI, which then generates the digital content.

[1174] Input: Prompt to be sent to the generative AI

[1175] Output: Generated digital content (e.g. illustration data)

[1176] Specific operation: Generative AI (OpenAI API) generates digital content based on the prompt text.

[1177] Step 5:

[1178] The server provides the generated digital content to the user.

[1179] Input: Generated digital content

[1180] Output: The digital content that is delivered to the user

[1181] Specific operation: The server sends the generated digital content to the user's smartphone, allowing the user to view and download the content through the application.

[1182] Example 2

[1183] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1184] In conventional digital content generation systems, content generated based on user preferences often did not match the user's emotions or detailed preferences. Furthermore, if the generated content did not meet the user's expectations, user satisfaction decreased. Furthermore, it was difficult to generate content that took user emotions into account, making it difficult to meet individual needs.

[1185] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for allowing a customer to input a desired item, a means for querying a generative AI based on the input desired item and generating a generated code, a means for linking the generated code to various generative AIs (image generation AI, music generation AI, voice generation AI, etc.) to generate digital products, and a means for recognizing the customer's emotions using an emotion engine and adjusting the generated code based on the recognition results. This makes it possible to generate high-quality digital content based on the user's wishes and emotions.

[1186] "You" means a user who intends to use the system to generate digital content.

[1187] "Desired thing" refers to the specific content and characteristics of the digital content that the customer wishes to create.

[1188] "Generative AI" is AI that asks questions based on input desired items and generates generative code.

[1189] "Generated code" is code generated by generative artificial intelligence that contains detailed instructions for generating digital content.

[1190] "Various generative artificial intelligence" refers to artificial intelligence for generating specific digital content, such as image generation, music generation, and voice generation.

[1191] "Digital products" are generated digital content, including images, music, audio, etc.

[1192] The "emotion engine" is an engine that recognizes the customer's emotions and reflects the recognition results in the generated code.

[1193] The "recognition result" is information indicating the emotional state of the customer as recognized by the emotion engine.

[1194] This invention is a system for generating digital content based on user wishes. The system includes a means for allowing users to input their wishes, a generative AI, an emotion engine, and various generative AIs.

[1195] Hardware and software used

[1196] Server: Hardware that manages the entire system and executes various AI processes.

[1197] Device: The device on which the User enters their preferences and views the generated digital content, such as a computer or smartphone.

[1198] Generative AI: AI that processes natural language. For example, a natural language processing AI model.

[1199] Emotion engine: Software for recognizing user emotions.

[1200] Various generative artificial intelligence: Artificial intelligence that generates images, music, and voice. For example, image generation artificial intelligence models, music generation artificial intelligence models, and voice generation artificial intelligence models.

[1201] Program processing

[1202] 1. User preference input

[1203] The user enters details of the digital content they want through their device, for example, entering a specific request such as "an illustration of a cat with a sunset in the background."

[1204] 2. Question and instruction generation using generative AI

[1205] The server activates a generative artificial intelligence (AI) and asks additional questions based on the user's preferences. For example, the server might ask the user, "What color do you like your cat to be?"

[1206] The user answers questions through the device, for example, "I like black cats."

[1207] The server uses generative artificial intelligence to generate specific instructions based on the user's answers, such as "paint a sunset in the background and a black cat in the foreground."

[1208] 3. Generate generated code

[1209] The server generates a generation code based on the instructions of the generative AI. This generation code contains detailed instructions for generating digital content. For example, the server generates code containing specific instructions to the image-generating AI, such as "paint a sunset in the background and a black cat in the foreground."

[1210] 4. Use of Emotion Engine

[1211] The server activates the emotion engine to recognize the user's emotion. For example, if the user expresses joy through the device, the emotion engine will provide that information to the server.

[1212] The server provides the emotion engine's recognition results to the generative AI, which then adjusts the generated code, for example, adjusting instructions to generate brightly colored images and happy music based on the emotion of joy.

[1213] 5. Digital product creation

[1214] The server connects the generated code to various AI generators (such as image generators, music generators, and voice generators) to generate digital products. For example, an image generator generates an illustration of a black cat against a sunset.

[1215] The user can view and download the generated digital products through their device.

[1216] Examples and prompts

[1217] Examples:

[1218] If the user wants "an illustration of a cat with a sunset in the background," they would enter the following prompt:

[1219] Example prompt sentence:

[1220] User: I'd like an illustration of a cat with a sunset in the background.

[1221] Generative AI: What's the best color for a cat?

[1222] User: Black cats are good.

[1223] Generative AI: Generates instructions to paint a sunset in the background and a black cat in the foreground.

[1224] Based on this prompt, the generative artificial intelligence generates specific generation instructions and generates digital products taking into account the recognition results of the emotion engine.

[1225] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1226] Step 1: Enter user preferences

[1227] The user enters details of the digital content they want through their device, for example, entering a specific request such as "an illustration of a cat with a sunset in the background."

[1228] Input: Details of the digital content the user desires.

[1229] Output: The user's preference is sent to the server.

[1230] Step 2: Generative AI questions and instructions

[1231] The server activates a generative artificial intelligence (AI) and asks additional questions based on the user's preferences. For example, the server might ask the user, "What color do you like your cat to be?"

[1232] The user answers questions through the device, for example, "I like black cats."

[1233] Input: The user's preference and answers to any follow-up questions.

[1234] Data processing: Generative AI analyzes the user's wishes and responses and generates specific generation instructions.

[1235] Output: Specific production instructions, such as "paint a sunset in the background and a black cat in the foreground."

[1236] Step 3: Generate generated code

[1237] The server generates a generation code based on instructions from the generative artificial intelligence, the generation code including detailed instructions for generating the digital content.

[1238] Input: Specific generation instructions from the generative artificial intelligence.

[1239] Data processing: Based on the generation instructions, the server creates generation codes corresponding to various generation artificial intelligences.

[1240] Output: Specific generation code for the image generation AI: "Draw a sunset in the background and a black cat in the foreground."

[1241] Step 4: Use the Emotion Engine

[1242] The server activates the emotion engine to recognize the user's emotion. For example, if the user expresses joy through the device, the emotion engine will provide that information to the server.

[1243] Input: User emotion data.

[1244] Data calculation: The emotion engine analyzes the user's emotions and provides the results to the generative artificial intelligence.

[1245] Output: The recognition result of the emotion engine (e.g., emotion of joy).

[1246] Step 5: Adjust the generated code

[1247] The server provides the emotion engine's recognition results to the generative AI, which then adjusts the generated code, for example, adjusting instructions to generate brightly colored images and happy music based on the emotion of joy.

[1248] Input: Recognition results and generated code from the emotion engine.

[1249] Data processing: Generative AI adjusts the generated code based on the recognition results.

[1250] Output: Adjusted generated code.

[1251] Step 6: Generate digital products

[1252] The server connects the generated code to various AI generators (such as image generators, music generators, and voice generators) to generate digital products. For example, an image generator generates an illustration of a black cat against a sunset.

[1253] Input: The adjusted generated code.

[1254] Data calculation: Various generative artificial intelligences generate digital content based on generative code.

[1255] Output: The generated digital product (e.g., an illustration of a black cat against a sunset background).

[1256] Step 7: Offer digital products

[1257] The user can view and download the generated digital products through their device.

[1258] Input: The generated digital product.

[1259] Output: The digital product downloaded by the user.

[1260] (Application example 2)

[1261] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1262] Conventional digital content generation systems have the problem that content generated based on user preferences does not take into account the user's emotions, and therefore cannot sufficiently increase user satisfaction. Furthermore, if the generated content does not match the user's emotions, it may not meet the user's expectations, resulting in a decrease in frequency of use.

[1263] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1264] In this invention, the server includes means for allowing customers to input their desired items, means for asking a generative AI questions based on the input desired items and generating a generated code, means for linking the generated code to various generative AIs (image generation AI / music generation AI / voice generation AI, etc.) to generate digital products, means for recognizing the customer's emotions using an emotion engine, means for the generative AI to generate digital products based on the recognized emotions, and means for providing the generated digital products to customers and receiving payment. This makes it possible to generate digital content based on the user's wishes and emotions.

[1265] "Means for customers to input their wishes" refers to an interface that allows users to input their wishes and requests into the system.

[1266] "Means for asking questions to a generative AI and generating generated code" refers to the process of asking questions to a generative AI based on user input and creating generated code from the answers.

[1267] "Means of linking with various generation AIs to generate digital products" refers to the process of sending the generated code to different generation AIs, such as image generation AI, music generation AI, and voice generation AI, to create digital content.

[1268] "Means for recognizing customer emotions using an emotion engine" is a system that analyzes emotions from user input and behavior and recognizes those emotions.

[1269] "Means for generative AI to generate digital products based on recognized emotions" refers to the process by which generative AI creates appropriate digital content based on the user's emotions recognized by the emotion engine.

[1270] "Means for providing generated digital products to customers and receiving payment" refers to a system for providing generated digital content to users and receiving payment in return.

[1271] "Natural language processing AI" is artificial intelligence that has the ability to understand and generate human language.

[1272] "Digital content" refers to content such as images, music, and sound that is electronically generated.

[1273] The present invention is a system for generating and providing digital content based on the wishes and emotions of a user. A specific embodiment of this system is described below.

[1274] System Configuration

[1275] The system consists of the following main components:

[1276] 1. User Interface: The means by which the user inputs their desires. This can be implemented as a smartphone application or a web interface.

[1277] 2. Generative AI: This is artificial intelligence that asks questions based on user input and generates generative code. It uses natural language processing AI.

[1278] 3. Emotion Engine: A system for recognizing emotions from user input and behavior.

[1279] 4. Generative AI: Based on instructions from generative AI, digital content is generated using image generation AI, music generation AI, voice generation AI, etc.

[1280] 5. Provision system: A system for providing generated digital content to users and receiving payment.

[1281] Program processing

[1282] The server receives user requests through a user interface. The generative AI then asks questions based on the user's requests and generates a generative code. This generative code is then sent to various generative AIs to generate digital content.

[1283] The emotion engine recognizes emotions from user input and behavior. Based on the recognized emotion, the generative AI generates appropriate digital content. For example, if a user inputs "I want an illustration of a cat with a sunset background," and the emotion engine recognizes the user's emotion as "joy," the generative AI will generate an image with bright colors.

[1284] The generated digital content is provided to users through a provision system, and payment is received.

[1285] Hardware and software used

[1286] Hardware: Servers, smartphones, PCs

[1287] Software: Natural language processing AI (e.g., OpenAI API), emotion engine, image generation AI, music generation AI, speech generation AI

[1288] Specific examples

[1289] If the user types "I want an illustration of a cat with a sunset in the background," the following is an example of a prompt:

[1290] User's request: I want an illustration of a cat with a sunset in the background.

[1291] User Emotion: Delight

[1292] Generate the generation instructions.

[1293] By sending this prompt to the generative AI, specific generation instructions can be obtained, which the generative AI will then use to generate digital content and provide it to the user.

[1294] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1295] Step 1:

[1296] The user inputs what they want. The user inputs their specific request in text format through the interface of their smartphone or computer. For example, they might input, "I want an illustration of a cat with a sunset in the background." This input is sent to the system.

[1297] Step 2:

[1298] The server receives the user's input and asks the generative AI a question. The server generates a prompt based on the user's wishes and sends it to the generative AI. The generative AI analyzes this prompt and generates specific generation instructions. The input is the user's wishes, and the output is the generation instructions.

[1299] Step 3:

[1300] The server receives generation instructions from the generative AI and sends them to the emotion engine. The emotion engine recognizes emotions from the user's input and actions. For example, it recognizes that the user's input indicates the emotion of "joy." The input is the generation instructions and the user's wishes, and the output is the user's emotions.

[1301] Step 4:

[1302] The server receives the emotion recognition results from the emotion engine and sends them to the generation AI. The generation AI generates appropriate digital content based on the generation instructions and the emotion recognition results. For example, it generates an illustration of a cat with a bright sunset as the background. The inputs are the generation instructions and the emotion recognition results, and the output is the digital content.

[1303] Step 5:

[1304] The server receives the generated digital content and provides it to the user through the provision system. The user can download or view the generated digital content. The input is the digital content, and the output is the provision to the user.

[1305] Step 6:

[1306] The server receives payment from the user. The provision system handles the payment procedures when the user uses digital content. The input is the user's payment information, and the output is receipt of payment.

[1307] Example 3

[1308] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1309] Conventional digital product generation systems do not adjust the delivery method to take user emotions into account, making it difficult to maximize user satisfaction. Furthermore, the delivery method for generated digital products is uniform, making it difficult to respond to individual user needs.

[1310] The identification process by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means. In this invention, the server includes a means for allowing a customer to input a desired item, a means for querying a generative AI based on the input desired item and generating a generated code, a means for linking the generated code to various generative AIs (image generation AI, music generation AI, voice generation AI, etc.) and generating digital products, a means for providing the generated digital products to customers and receiving payment, and a means for recognizing customer emotions using an emotion engine and adjusting the method of providing the digital products based on the emotions. This makes it possible to provide optimal digital products according to the user's emotions and optimize the payment for them.

[1311] "Customer" refers to a user who uses the system to generate and receive digital products.

[1312] "Desired Item" means the information you enter to indicate the content and characteristics of the digital product you wish to create.

[1313] "Generative AI" is an AI that generates a generative code based on the desired input and sends instructions to various generative AIs.

[1314] "Generated code" refers to code generated by a generative artificial intelligence that contains specific instructions for various generative artificial intelligences.

[1315] "Various generative artificial intelligence" is a general term for artificial intelligence used to generate specific digital products, such as image generation, music generation, and voice generation.

[1316] "Digital products" refers to digital content generated by generative artificial intelligence and various types of generative artificial intelligence.

[1317] "Consideration" refers to the remuneration or fees received from customers for the provision of generated digital goods.

[1318] An "emotion engine" is an engine that recognizes customer emotions and adjusts how digital products are delivered based on the results.

[1319] "Delivery method" refers to the means or format by which the generated digital products are provided to customers.

[1320] The present invention relates to a system for generating and providing digital products desired by users. A specific embodiment of this system will be described below.

[1321] System configuration

[1322] This system mainly consists of a server, a terminal, generative AI, various generative AI, and an emotion engine.

[1323] server

[1324] The server receives and analyzes prompts from users. Based on the analysis results, the server sends instructions to the generative AI, receives the generated digital product, and provides it to the user. It also uses an emotion engine to recognize the user's emotions and adjusts the delivery method accordingly.

[1325] Terminal

[1326] The terminal provides an interface for users to input prompt sentences. The terminal is responsible for sending the input prompt sentences to the server. The terminal can be a PC, smartphone, tablet, or other device.

[1327] Generative Artificial Intelligence

[1328] The generative AI analyzes the prompts received from the server and generates specific instructions for various generative AIs. The generative AI analyzes the prompts using natural language processing (NLP) technology.

[1329] Various generative artificial intelligence

[1330] Various generative AIs generate specific digital products based on instructions received from generative AI. Examples include image generation AI, music generation AI, and voice generation AI. These AIs generate digital products using deep learning models (e.g., GAN and VQ-VAE).

[1331] Emotion Engine

[1332] The emotion engine recognizes user emotions and adjusts the way digital products are provided based on the results. The emotion engine analyzes user feedback (e.g., ratings and comments) to recognize emotions.

[1333] Specific examples

[1334] A specific example of operation is shown below.

[1335] 1. The user enters a prompt.

[1336] The user inputs a prompt through the terminal interface, for example, "Draw a sunset in the background and a cat in the foreground."

[1337] 2. The terminal sends a prompt to the server

[1338] The terminal sends the entered prompt sentence to the server as an HTTP POST request.

[1339] 3. The server parses the prompt

[1340] The server analyzes the received prompt using an NLP library (e.g., spaCy or NLTK) and breaks it down into specific instructions such as "Draw a sunset in the background" and "Draw a cat in the foreground."

[1341] 4. The server sends instructions to the generative AI

[1342] The server sends the analysis results in JSON format to the generative artificial intelligence API endpoint.

[1343] 5. The generative AI sends instructions to various generative AIs

[1344] Based on the analysis results, generative AI sends specific instructions to various generative AIs, such as image generation AI, music generation AI, and voice generation AI.

[1345] 6. Various generative AIs generate digital products

[1346] The image generation AI generates illustrations using deep learning models (e.g., GAN or VQ-VAE) based on the instructions it receives.

[1347] 7. The server receives the generated digital product

[1348] The server receives the illustration data returned from the generation AI and temporarily stores it.

[1349] 8. The server provides the digital product to the user.

[1350] The server generates a download link for the saved illustration data and sends the link to the user by email.

[1351] 9. The server receives payment

[1352] The server processes payments from users through a payment system (e.g., Stripe or PayPal).

[1353] 10. The server uses an emotion engine to recognize the user's emotions.

[1354] The server analyzes user feedback (e.g., ratings and comments) using an emotion engine (e.g., IBM Watson Tone Analyzer) to recognize emotions.

[1355] 11. Servers adjust their serving style based on emotions

[1356] The server adjusts the next method of providing digital products based on the results of the emotion engine. For example, if the user expresses joy, the server sets the next delivery to be immediate.

[1357] In this way, a system is realized in which the server, the terminal, and the user cooperate to generate and provide digital products. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1358] Step 1:

[1359] The user enters a prompt statement.

[1360] The user inputs a prompt through the terminal interface, for example, "Draw a sunset in the background and a cat in the foreground." The input prompt is temporarily stored in the terminal's memory.

[1361] Step 2:

[1362] The terminal sends the prompt to the server.

[1363] The terminal sends the entered prompt text to the server as an HTTP POST request. The input data is the prompt text, and the output data is the prompt text sent to the server. Specifically, the terminal converts the prompt text into JSON format and sends it to the server's API endpoint.

[1364] Step 3:

[1365] The server parses the prompt.

[1366] The server parses the received prompt using a natural language processing (NLP) library (e.g., spaCy or NLTK). The input data is the prompt, and the output data is the analysis result. Specifically, it breaks it down into specific instructions such as "Draw a sunset in the background" and "Draw a cat in the foreground."

[1367] Step 4:

[1368] The server sends instructions to the generative artificial intelligence.

[1369] The server sends specific instructions to the generative AI based on the analysis results. The input data is the analysis results, and the output data is the instructions sent to the generative AI. Specifically, the analysis results are sent in JSON format to the API endpoint of the generative AI.

[1370] Step 5:

[1371] The generative AI sends instructions to various generative AIs.

[1372] Based on the received analysis results, the generative AI sends specific instructions to various generative AIs (for example, image generation AI, music generation AI, and voice generation AI). The input data is the analysis results, and the output data is the instructions sent to the various generative AIs. Specifically, the analysis results are sent to the API endpoints of the various generative AIs.

[1373] Step 6:

[1374] Various generative artificial intelligences generate digital products.

[1375] Based on the instructions received, various generative AIs use deep learning models (such as GAN or VQ-VAE) to generate digital products. The input data are instructions from the generative AI, and the output data is the generated digital product. Specifically, image generation AI generates illustrations based on the specified content.

[1376] Step 7:

[1377] The server receives the generated digital product.

[1378] The server receives and temporarily stores digital products generated by various generation AIs. The input data is the generated digital product, and the output data is the digital product stored on the server. Specifically, the generated illustration data is stored in the server's storage.

[1379] Step 8:

[1380] The server provides the digital product to the user.

[1381] The server provides the saved digital product to the user. This can be provided in a variety of ways, such as by providing a download link, sending by email, or displaying within the application. The input data is the digital product saved on the server, and the output data is the digital product provided to the user. Specifically, the generated illustration data is generated as a download link, and the link is sent to the user by email.

[1382] Step 9:

[1383] The server receives the payment.

[1384] The server receives payment for providing the digital product. Payment can take various forms, such as a fee for one generation, a monthly membership fee, or advertising revenue. The input data is payment information from the user, and the output data is the payment received. Specifically, the server processes payment from the user through a payment system (e.g., Stripe or PayPal).

[1385] Step 10:

[1386] The server uses an emotion engine to recognize the user's emotions.

[1387] The server analyzes user feedback (e.g., ratings and comments) using an emotion engine (e.g., IBM Watson Tone Analyzer) to recognize emotions. The input data is the user feedback, and the output data is the recognized emotion. Specifically, the server sends the user's comments to the emotion engine to detect emotions such as joy and satisfaction.

[1388] Step 11:

[1389] The server adjusts the serving method based on the emotion.

[1390] The server adjusts the method of providing digital products based on the recognition results of the emotion engine. The input data is the recognized emotion, and the output data is the adjusted method of providing the digital products. Specifically, if the user expresses the emotion of joy, the server sets the next delivery to be immediate.

[1391] (Application example 3)

[1392] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1393] Conventional digital product generation systems provide content in a uniform manner without considering the user's emotions, which can lead to a decrease in user satisfaction. Furthermore, if the generated content does not match the user's emotions, the user may miss an opportunity to earn compensation. For this reason, a system that realizes a method of providing optimal digital products according to the user's emotions is needed.

[1394] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes a means for allowing a customer to input a desired item, a means for querying a generation system AI based on the input desired item and generating a generated code, a means for linking the generated code to various generation AIs (image generation AI / music generation AI / audio generation AI, etc.) and generating digital products, a means for providing the generated digital products to customers and receiving payment, a means for recognizing the customer's emotions using an emotion engine, and a means for adjusting the method of providing the generated digital products based on the recognized emotions. This makes it possible to provide optimal digital products according to the user's emotions.

[1395] "Means for customers to input their wishes" refers to an interface that allows users to input their wishes and requests into the system.

[1396] "Means for asking questions to generative AI and generating generated code" refers to a function that queries generative AI based on user input and creates generated code as a result.

[1397] "Means of linking with various generation AIs to generate digital products" refers to a function that sends the generated code to various generation AIs such as image generation AI, music generation AI, and audio generation AI to generate digital content.

[1398] "Means of providing generated digital products to customers and receiving payment" refers to the function of providing generated digital content to users and receiving payment in return.

[1399] "Means for recognizing customer emotions using an emotion engine" is a function that uses an engine to analyze and recognize user emotions.

[1400] The "means for adjusting the method of providing generated digital merchandise based on the recognized emotions" is a function that optimizes the method of providing generated digital content according to the user's emotions recognized by the emotion engine.

[1401] A system for implementing this invention includes a means for allowing a user to input what they want, a means for asking a generation AI a question and generating a generated code, a means for linking the generated code to various generation AIs (image generation AI, music generation AI, audio generation AI, etc.) to generate digital products, a means for providing the generated digital products to users and receiving payment, a means for recognizing the user's emotions using an emotion engine, and a means for adjusting the method of providing the generated digital products based on the recognized emotions.

[1402] System configuration

[1403] 1. User Input Interface:

[1404] An interface through which a user inputs their desired input, such as a smartphone app or a web form.

[1405] 2. Generative AI:

[1406] Based on user input, questions are posed to the generative AI, which then generates generative code. For example, a natural language processing engine can be used to analyze the user's wishes and generate appropriate prompts.

[1407] 3. Various generation AI:

[1408] The generated code is then linked to image generation AI, music generation AI, and audio generation AI to generate digital products. For example, OpenAI's DALL-E is used for image generation, OpenAI's Jukedeck for music generation, and Google Cloud Text-to-Speech for audio generation.

[1409] 4. Digital product delivery methods:

[1410] The generated digital products are provided to users in exchange for payment. Methods of providing the products include download links, emails, and in-app displays.

[1411] 5. Emotion Engine:

[1412] It is an engine for recognizing user emotions, for example, using Microsoft Azure's Emotion API.

[1413] 6. Delivery method adjustment means:

[1414] The system adjusts the way the generated digital product is presented based on the recognized emotion. For example, if the user expresses joy, the system immediately presents the digital product and receives feedback on the user's reaction.

[1415] Processing flow

[1416] The server provides an interface for users to input their desired items and sends the inputted preferences to the generation AI. The generation AI generates a generation code based on the user's wishes and connects to various generation AIs. The various generation AIs generate digital products based on the generation code and send it back to the server. The server uses an emotion engine to recognize the user's emotions and selects the optimal delivery method based on those emotions. Finally, the server provides the generated digital products to the user and receives payment.

[1417] Specific examples

[1418] If a user requests an illustration of a sunset and a cat, the generative AI will generate a prompt that reads, "Draw a sunset in the background and a cat in the foreground."

[1419] If the user expresses sadness, the AI ​​will send a prompt to "generate calming and soothing music" and provide a download link for the generated music.

[1420] Prompt Sentence Examples

[1421] Prompt for image generation AI: "Draw a sunset in the background and a cat in the foreground."

[1422] Prompt for Music Generation AI: "Generate calm and soothing music."

[1423] Prompt for speech generation AI: "Generate a message to stay calm"

[1424] The above is an embodiment of the present invention.

[1425] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1426] Step 1:

[1427] The user inputs their desired items. The user inputs their wishes and requests in text format using a smartphone app or web form. The input data is sent to the server.

[1428] Step 2:

[1429] The server sends the desired item received from the user to the generative AI. The generative AI uses a natural language processing engine to analyze the user's request and generate an appropriate prompt. For example, if the user requests an "illustration of a sunset and a cat," the system generates the prompt "Draw a sunset in the background and a cat in the foreground."

[1430] Step 3:

[1431] The server sends the generated prompt to various generation AIs (image generation AI, music generation AI, voice generation AI, etc.). Each generation AI generates digital products based on the prompt. For example, an image generation AI receives the prompt "Draw a sunset in the background and a cat in the foreground" and generates a corresponding illustration.

[1432] Step 4:

[1433] The generated digital product is sent back to the server, which uses an emotion engine to recognize the user's emotions. The emotion engine analyzes the user's facial expressions and voice input to identify their emotions. For example, it uses Microsoft Azure's Emotion API to determine whether the user is expressing joy.

[1434] Step 5:

[1435] The server adjusts how the generated digital product is provided based on the recognized emotion. For example, if the user expresses joy, the generated illustration is instantly displayed in the app and the user's reaction is received as feedback. If the user expresses sadness, calm, soothing music is generated and a download link is provided.

[1436] Step 6:

[1437] The server provides the generated digital products to the user and receives payment. The methods of providing the products vary, including download links, emails, and in-app displays. Based on the user's reactions and feedback, the server optimizes the method of providing the products for future use.

[1438] The above are the specific processing steps for carrying out the present invention.

[1439] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1440] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1441] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[1442] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1443] [Third embodiment]

[1444] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1445] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1446] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1447] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1448] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1449] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1450] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1451] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1452] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1453] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1454] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1455] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1456] "Example 1"

[1457] In one embodiment of the present invention, a portal is provided that allows users to input their desired items. This portal may be implemented in the form of a website or application, and users can specifically input their desired items by entering text or selecting from options. For example, if a user desires "an illustration of a cat with a sunset in the background," the user enters that information.

[1458] "Example 2"

[1459] Next, based on the user's inputted wishes, the generative AI asks questions and generates a generation code. This generative AI can use natural language processing AI such as cat generation AI. The cat generation AI generates detailed instructions for the digital content to be generated based on the user's input. For example, in response to a request for "an illustration of a cat with a sunset in the background," the cat generation AI generates specific generation instructions such as "draw a sunset in the background and a cat in the foreground." "Example 3"

[1460] The generated instructions are linked to various generation AIs (image generation AI, music generation AI, voice generation AI, etc.). These generation AIs generate specific digital products based on instructions from the cat generation AI. For example, the image generation AI generates a specific illustration based on the instruction to "draw a sunset in the background and a cat in the foreground."

[1461] "Example 4"

[1462] Finally, the generated digital product is provided to the user, and payment is received. This can be provided in various forms, such as providing a download link, sending by email, displaying within an application, etc. Payment can be received in various forms, such as a one-time fee, a monthly membership fee, or advertising revenue.

[1463] The processing flow of each embodiment will be described below.

[1464] "Example 1"

[1465] Step 1: A user enters details of the digital content they want through a portal such as a website or application. For example, if they want an "illustration of a cat with a sunset in the background," they can enter that information specifically by entering text or selecting from options.

[1466] "Example 2"

[1467] Step 1: After receiving input from the user, the generative AI (e.g., Cat generative AI) analyzes it.

[1468] Step 2: Based on the analysis results, the generative AI generates detailed instructions for the digital content to be generated. For example, it generates specific instructions such as "paint a sunset in the background and a cat in the foreground."

[1469] "Example 3"

[1470] Step 1: Various generative AIs (image generation AI / music generation AI / audio generation AI, etc.) receive instructions from the generative AI and generate digital content according to the instructions.

[1471] Step 2: For example, the image generation AI generates a specific illustration based on the instruction, "Draw a sunset in the background and a cat in the foreground."

[1472] "Example 4"

[1473] Step 1: The generated digital product is provided to the user. This can be provided in various forms, such as by providing a download link, sending it via email, or displaying it within an application.

[1474] Step 2: Users are compensated in various ways, such as a one-time generation fee, a monthly membership fee, or advertising revenue.

[1475] Example 1

[1476] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1477] With conventional systems, it was difficult to quickly and accurately provide digital content generated based on specific customer input of what they wanted. Furthermore, the quality and variety of the generated content was limited, making it impossible to meet the diverse needs of customers.

[1478] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1479] In this invention, the server includes a means for allowing customers to input their desired items, a means for inputting prompt sentences to a generative AI based on the input desired items to generate generated content, and a means for linking the generated content to various generative AIs (image generation AI, music generation AI, voice generation AI, etc.) to generate digital content. This enables the rapid generation and provision of a variety of high-quality digital content based on the specific wishes of customers.

[1480] "Customer" refers to a user who uses the system to input their desired content and receives the generated digital content.

[1481] "Desired Items" refers to the specific requests and demands that you enter through the system.

[1482] "Generative AI" refers to an artificial intelligence model that takes prompts based on customer preferences and generates generative content.

[1483] A "prompt sentence" is text data input to a generative AI, and contains information that forms the basis of the generated content.

[1484] "Generated content" refers to digital data generated by generative AI based on prompt text.

[1485] "Various generative AI" refers to artificial intelligence models that generate specific forms of digital content (images, music, audio, etc.) based on generated content.

[1486] "Digital content" refers to digital commercial materials such as music, images, and audio generated by generative AI.

[1487] "Consideration" means the fee or remuneration you pay to receive the generated Digital Content.

[1488] MODE FOR CARRYING OUT THE INVENTION

[1489] This invention is a system that allows a customer to input their desired items and provides digital content generated based on the input. A specific embodiment of this system will be described below.

[1490] User operations

[1491] Users access the portal through a web browser or application. The portal provides an interface for users to input their desires. Users use text boxes and options to specify their desires. For example, they might enter "an illustration of a cat with a sunset in the background." Once they've completed their request, they click a submit button.

[1492] Device operation

[1493] The terminal receives the request entered by the user and sends it to the server. Specifically, if the user enters "an illustration of a cat with a sunset in the background," the terminal converts the text data into JSON format and sends a POST request to the server's API endpoint using an HTTP request.

[1494] Server Operations

[1495] The server receives the HTTP request sent from the device and extracts the user's request from the request body. The extracted text data is input as a prompt to the generative AI model. For example, using OpenAI's GPT-4 API, the prompt "Illustration of a cat with a sunset in the background" is sent. The generative AI model generates an illustration based on the prompt and sends the result back to the server.

[1496] Server data return

[1497] The server returns the illustration data received from the generative AI model to the device. Specifically, the generated illustration is included in an HTTP response as binary data and sent to the device. The user can then view the generated illustration through their device. For example, in a web browser, the illustration is displayed as an image tag.

[1498] Specific examples

[1499] A user accesses the portal, enters "illustration of a cat with a sunset as a background," and clicks the submit button. The device converts this text data into JSON format and sends a POST request to the server's API endpoint. The server inputs the received text data as a prompt sentence into a generative AI model (for example, OpenAI's GPT-4). The generative AI model generates an illustration based on the prompt sentence and sends it back to the server. The server includes the generated illustration as binary data in an HTTP response and sends it to the device. The user can view the generated illustration through the device.

[1500] In this way, the user can specifically input what he or she wants and quickly obtain a variety of high-quality digital content based on that request.

[1501] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1502] Step 1:

[1503] Users access the portal through a web browser or application. They use the text boxes and options displayed in the portal's interface to enter their specific requests. For example, they might enter "an illustration of a cat with a sunset in the background." Once they've completed their request, they click a submit button.

[1504] Input: User's request (e.g., "An illustration of a cat with a sunset in the background")

[1505] Output: The user's request is sent to the terminal as text data.

[1506] Step 2:

[1507] The terminal receives the user's input and converts the text data into JSON format, which is then sent as a POST request to the server's API endpoint using an HTTP request.

[1508] Input: User's desired text data (e.g., "Illustration of a cat with a sunset in the background")

[1509] Output: Data converted to JSON format is sent to the server

[1510] Step 3:

[1511] The server receives the HTTP request sent from the device and extracts the user's request from the request body. The extracted text data is input as a prompt to the generative AI model. For example, using OpenAI's GPT-4 API, the prompt "Illustration of a cat with a sunset in the background" is sent. The generative AI model generates an illustration based on the prompt and sends the result back to the server.

[1512] Input: JSON format data (e.g., "Illustration of a cat with a sunset in the background")

[1513] Output: Illustration data generated from the generative AI model

[1514] Step 4:

[1515] The server returns the illustration data received from the generative AI model to the device. Specifically, the generated illustration is included in the HTTP response as binary data and sent to the device.

[1516] Input: Illustration data from a generative AI model

[1517] Output: The illustration as binary data is sent to the terminal.

[1518] Step 5:

[1519] The user can view the generated illustrations through their device. For example, in a web browser, the illustrations are displayed as image tags.

[1520] Input: An illustration of the binary data sent from the server

[1521] Output: Display of illustrations that users can check

[1522] In this way, the user can specifically input what he or she wants and quickly obtain a variety of high-quality digital content based on that request.

[1523] (Application example 1)

[1524] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1525] Conventional digital content generation systems have made it difficult for users to easily generate the specific illustrations and images they desire. Furthermore, they lacked the functionality to allow users to download or share the generated digital materials, limiting the user experience. This made it difficult to meet the diverse needs of users.

[1526] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1527] In this invention, the server includes a means for allowing customers to input their desired items, a means for querying a generation AI based on the input desired items and generating a generation code, a means for linking the generated code to various generation AIs (image generation AI / music generation AI / voice generation AI, etc.) to generate digital products, a means for providing the generated digital products to customers and receiving payment, and a means for downloading or sharing the generated digital products. This makes it possible for users to easily generate specific digital content they desire and download or share it.

[1528] "Means for customers to input their desired content" refers to an interface that allows users to input the specific illustrations, images, and other digital content they desire by entering text or selecting from a list of options.

[1529] The "means of asking a question to a generative AI and generating a generated code" is a process for sending a prompt to a generative AI based on a user's input preference, and obtaining a generated code as a result.

[1530] "Means of linking to various generative AIs to generate digital products" refers to a method of using the generated code to link to various generative AIs, such as image generation AI and music generation AI, to generate digital content that meets the user's wishes.

[1531] "Means for providing generated digital products to customers and receiving payment" refers to a system for providing generated digital content to users and receiving payment in return.

[1532] "Means for downloading or sharing generated digital products" refers to a function that allows users to download generated digital content to their own devices or share it on platforms such as social media.

[1533] "Generating digital products based on prompts using a specific generative AI model" refers to the process of using a specific generative artificial intelligence model to generate digital content based on prompts entered by a user.

[1534] "Digital content such as illustrations, images, music, and audio" refers to all content such as digital illustrations, images, music, and audio generated by generative artificial intelligence.

[1535] A system for implementing this invention includes means for allowing a user to input desired items, means for asking questions to a generation AI to generate a generated code, means for linking the generated code to various generation AIs to generate digital products, means for providing the generated digital products to customers and receiving payment, and means for downloading or sharing the generated digital products.

[1536] System configuration

[1537] The system uses the following hardware and software:

[1538] Hardware

[1539] Server (cloud server or local server)

[1540] User's smartphone

[1541] software

[1542] Flask (Python web framework)

[1543] OpenAI API (generative AI model)

[1544] Data processing and calculation

[1545] 1. User Input

[1546] Using a smartphone application, users can specify the illustration or image they want by entering text, for example, "an illustration of a cat with a sunset in the background."

[1547] 2. Questions for Generative AI

[1548] The server receives user input and sends a prompt to the generative AI, such as "Create an illustration of a cat with a sunset background."

[1549] 3. Generate generated code

[1550] The generative AI generates generative code based on the prompt text. This generative code is linked to various generative AIs (image generation AI, music generation AI, voice generation AI, etc.).

[1551] 4. Digital product creation

[1552] Various generation AIs receive the generated code and generate digital content according to the user's wishes. For example, the image generation AI generates an "illustration of a cat against a sunset background."

[1553] 5. Provision of digital products and receipt of payment

[1554] The generated digital content is provided to users through a server, who can then download it or share it on social media. Payment is made through an online payment system.

[1555] Specific examples

[1556] If the user wants "an illustration of a cat with a sunset in the background," they would enter the prompt text as follows:

[1557] Prompt Sentence Examples

[1558] Create an illustration of a cat with a sunset background

[1559] By sending this prompt to the generative AI, an illustration that matches the user's desire will be generated. The generated illustration can then be downloaded to the user's smartphone and shared on social media.

[1560] In this way, users can easily create the specific digital content they desire and download or share it.

[1561] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1562] Step 1:

[1563] The user uses a smartphone application to specify the desired illustration or image by entering text. For example, they might enter "an illustration of a cat with a sunset in the background." This input data is then sent to the server.

[1564] Step 2:

[1565] The server analyzes the input data received from the user and generates a prompt for the generative AI. Specifically, based on the input text "An illustration of a cat with a sunset background," it creates the prompt "Create an illustration of a cat with a sunset background." This prompt is then sent to the generative AI.

[1566] Step 3:

[1567] The generative AI generates a generative code based on the received prompt. The generative code contains instructions for generating digital content according to the user's wishes. This generative code is returned to the server.

[1568] Step 4:

[1569] The server receives the generation code and connects it to various generation AIs (image generation AI, music generation AI, voice generation AI, etc.). For example, it sends the generation code to an image generation AI, instructing it to generate an "illustration of a cat with a sunset in the background."

[1570] Step 5:

[1571] The image generation AI generates an illustration based on the user's request based on the generated code, and the generated illustration is returned to the server.

[1572] Step 6:

[1573] The server receives the generated illustrations and provides them to the user, who can then download them or share them on social media via a smartphone application.

[1574] Step 7:

[1575] When a user downloads or shares the generated illustration, the server receives payment through an online payment system, allowing the user to obtain the desired digital content and the server to receive payment.

[1576] Example 2

[1577] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1578] Conventional digital content generation systems have had difficulty efficiently generating content that specifically reflects user preferences. Furthermore, they lacked a means for automatically generating specific instructions to improve the quality of the generated content and user satisfaction. This has created a demand for a system that can quickly provide high-quality digital content that meets user preferences.

[1579] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1580] In this invention, the server includes a means for allowing a customer to input desired content, a means for asking a generative AI questions based on the input desired content and generating generation instructions, and a means for generating a generation code based on the generation instructions. This makes it possible to automatically generate specific generation instructions based on the user's wishes and quickly provide high-quality digital content based on them.

[1581] The "means by which customers can input desired content" refers to an interface that allows users to input the content of the digital content they desire.

[1582] The "means for asking questions to the generative AI and generating generation instructions" is an artificial intelligence system that analyzes the desired content entered by the user and generates specific generation instructions based on that.

[1583] The "means for generating generation code based on generation instructions" refers to a system that generates program code for generating actual digital content based on generation instructions received from the generative AI.

[1584] "Various generative AI" refers to artificial intelligence systems for generating specific types of digital content, such as image generation AI, music generation AI, and voice generation AI.

[1585] "Digital content" refers to media such as music, images, and audio that is expressed in digital form.

[1586] "Natural language processing AI" is an artificial intelligence system that analyzes natural language text entered by the user, understands its meaning, and generates appropriate generation instructions.

[1587] The present invention is a system for efficiently generating digital content desired by a user. A specific embodiment of this system will be described below.

[1588] The user uses the terminal to input the desired digital content. For example, the user might input "an illustration of a cat with a sunset in the background." This input is sent from the terminal to the server as text data.

[1589] The server analyzes the user's wishes and asks the generative AI a question. A natural language processing AI is used as this generative AI. The natural language processing AI analyzes the user's wishes and generates specific generation instructions. For example, it generates instructions such as "Draw a sunset in the background and a cat in the foreground."

[1590] Next, the server generates a generation code based on the generation instructions received from the generation AI. This generation code is a specific program for generating digital content. The generation code is linked to various generation AIs (e.g., image generation AI, music generation AI, voice generation AI, etc.) to generate digital content.

[1591] The generated digital content is sent from the server to the terminal and provided to the user, who can then check the generated digital content and modify or regenerate it as necessary.

[1592] As a concrete example, consider the case where a user requests "an illustration of dogs playing under a blue sky." In this case, the user inputs "an illustration of dogs playing under a blue sky" into their device. The server sends this input to a natural language processing AI, which then generates a generation instruction such as "draw a blue sky as the background and dogs playing in the foreground." Based on this generation instruction, the server generates specific generation code, which it then links to an image generation AI to generate an illustration. The generated illustration is then sent from the server to the device and provided to the user.

[1593] Example prompt sentence:

[1594] User Input: Illustration of dogs playing under a blue sky

[1595] Generative AI instructions: Draw a blue sky in the background with dogs playing in the foreground

[1596] In this way, it becomes possible to quickly provide high-quality digital content based on the user's wishes.

[1597] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1598] Step 1:

[1599] The user inputs their preference

[1600] The user uses the terminal to input the details of the digital content they want. For example, they input "an illustration of a cat with a sunset in the background." This input is saved as text data on the terminal.

[1601] Input: User's desired content (e.g., "An illustration of a cat with a sunset in the background")

[1602] Output: Desired content as text data

[1603] Step 2:

[1604] The device sends the user's wishes to the server

[1605] The terminal transmits the user's input preferences to the server. At this time, the input contents are transmitted as text data.

[1606] Input: Desired content as text data

[1607] Output: Request sent to server

[1608] Step 3:

[1609] The server asks the generative AI a question

[1610] The server then sends the user's request to a generative AI, which uses natural language processing AI. The server then sends the request to the generative AI and asks for specific instructions on how to create the product.

[1611] Input: Your request sent to the server

[1612] Output: The desired content sent to the generative AI

[1613] Step 4:

[1614] Generative AI generates specific generation instructions

[1615] The generative AI analyzes the user's wishes and generates specific instructions, such as "paint a sunset in the background and a cat in the foreground."

[1616] Input: Desired content sent to the generative AI

[1617] Output: Specific production instructions (e.g., "Draw a sunset in the background and a cat in the foreground")

[1618] Step 5:

[1619] The server generates the generated code based on the generation instructions.

[1620] The server generates the actual generation code based on the generation instructions received from the generative AI. This generation code is a specific program for generating digital content.

[1621] Input: Specific generation instructions

[1622] Output: Generated code

[1623] Step 6:

[1624] The server connects the generated code to various generation AIs

[1625] The server links the generated generation code to various generation AIs (e.g., image generation AI, music generation AI, voice generation AI, etc.) to generate digital content.

[1626] Input: Generated code

[1627] Output: Generated digital content

[1628] Step 7:

[1629] The server sends the generated digital content to the terminal.

[1630] The server transmits the generated digital content to the terminal, where the generated content is transmitted as digital data.

[1631] Input: Generated digital content

[1632] Output: Digital content sent to a device

[1633] Step 8:

[1634] The terminal displays the generated digital content to the user.

[1635] The terminal displays the received digital content to the user, who can then check the generated digital content and modify or regenerate it as necessary.

[1636] Input: Digital content sent to your device

[1637] Output: The digital content displayed to the user

[1638] (Application example 2)

[1639] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1640] With conventional digital content generation systems, it was difficult to create specific generation instructions based on the user's wishes, and the generated content often did not meet the user's expectations. Another issue was that the types of generated content were limited, and they were not particularly suited to generating artwork.

[1641] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1642] In this invention, the server includes a means for allowing customers to input their desired items, a means for querying a generative AI based on the input desired items and generating a generation code, a means for linking the generated code to various generative AIs (image generation AI, music generation AI, voice generation AI, etc.) to generate digital products, a means for providing the generated digital products to customers and receiving payment, and a means for generating artwork based on the generated instructions. This makes it possible to create specific generation instructions based on user wishes and generate a wide variety of digital content, especially artwork.

[1643] "Means for customer input" means an interface through which users can enter details of the digital content they wish to generate.

[1644] "Means for asking questions to a generative AI and generating generative code" refers to the process of asking questions to a generative AI based on user input and generating code containing specific generation instructions.

[1645] "Means of linking with various generation AIs to generate digital products" refers to the process of sending the generated code to different generation AIs, such as image generation AI, music generation AI, and voice generation AI, to generate digital content.

[1646] "Means of providing generated digital products to customers and receiving payment" refers to the process of providing generated digital content to users and receiving money or other compensation in return.

[1647] The "means for generating an artwork based on generated instructions" is a process for automatically generating an artwork based on specific generation instructions created by a generative artificial intelligence.

[1648] "Natural language processing AI" is artificial intelligence that has the ability to understand and generate human language.

[1649] "Digital Content" means content expressed in digital form, such as music, images, sounds, artwork, etc.

[1650] The system for implementing the present invention includes a series of processes for generating digital content desired by a user, which will be described in detail below.

[1651] System Configuration

[1652] The system consists of the following main components:

[1653] 1. User Interface: An interface for users to enter details of the digital content they want. This is implemented as a smartphone application.

[1654] 2. Generative AI: A natural language processing AI that asks questions based on user input and generates generative code containing specific generation instructions. In this example, we use OpenAI's GPT-3.

[1655] 3. Various generative AI: AI that receives generated code and generates digital content. This includes image generation AI, music generation AI, and voice generation AI.

[1656] 4. Digital content provision system: A system for providing generated digital content to users and receiving payment for it.

[1657] Program processing

[1658] 1. User Interface: The user enters details of the digital content they want, for example, "an illustration of a cat with a sunset in the background."

[1659] 2. Generative AI: Receives user input and sends prompts to the generative AI. Examples of prompts include:

[1660] Generate detailed instructions for the artwork to be generated based on the user's request: Cat illustration with a sunset in the background

[1661] 3. Generate instructions: The generative AI creates specific instructions and responds. For example, it might generate an instruction such as "Draw a sunset in the background and a cat in the foreground."

[1662] 4. Various generative AI: The generated instructions are sent to various generative AI to generate digital content. In this case, the image-generating AI generates a concrete work of art.

[1663] 5. Digital Content Providing System: Generated digital content is provided to users and payment is received. Users can download the generated artwork.

[1664] Hardware and software used

[1665] Hardware: Smartphones, servers

[1666] Software: Python, OpenAI API, various generative AI (image generation AI, music generation AI, voice generation AI)

[1667] Specific examples

[1668] When a user requests "an illustration of a cat with a sunset in the background" using a smartphone application, the generative AI receives the following prompt:

[1669] Generate detailed instructions for the artwork to be generated based on the user's request: Cat illustration with a sunset in the background

[1670] The generative AI creates specific generation instructions, such as "paint a sunset in the background and a cat in the foreground," and sends them to the image generation AI, which then generates a work of art based on these instructions and provides it to the user.

[1671] In this way, specific creation instructions based on the user's wishes can be created, enabling the creation of a wide variety of digital content, particularly artwork.

[1672] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1673] Step 1:

[1674] A user uses a smartphone to input details of the digital content they want. For example, the desired content might be an illustration of a cat with a sunset in the background. The input data is sent to the server in text format.

[1675] Step 2:

[1676] The server sends a prompt to the generative AI based on the received user request. Specifically, it generates the following prompt:

[1677] Generate detailed instructions for the artwork to be generated based on the user's request: Cat illustration with a sunset in the background

[1678] This prompt sentence is sent to the generation AI to obtain generation instructions.

[1679] Step 3:

[1680] The generative AI creates specific instructions based on the received prompt, such as "Draw a sunset in the background and a cat in the foreground." These instructions are returned to the server in text format.

[1681] Step 4:

[1682] The server sends the generation instructions received from the generative AI to various generation AIs. Here, the generation instructions are sent to the image generation AI. Based on the generation instructions, the image generation AI generates a specific artwork.

[1683] Step 5:

[1684] The image generation AI generates an artwork based on the received generation instructions, and the generated artwork is returned to the server as image data.

[1685] Step 6:

[1686] The server provides the generated artwork to the user. The user can download the generated artwork using a smartphone terminal. The generated artwork is based on the user's wishes and meets the user's expectations.

[1687] In this way, specific creation instructions based on the user's wishes can be created, making it possible to create a wide variety of digital content, particularly artwork.

[1688] Example 3

[1689] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1690] Conventional digital content generation systems have had difficulty in quickly and accurately generating content that meets specific user requests. Furthermore, the methods for providing generated content and receiving payment are limited, resulting in low user convenience. This makes it difficult to respond to diverse user needs, resulting in a decline in user satisfaction.

[1691] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1692] In this invention, the server includes a means for allowing a customer to input desired digital content, a means for generating a prompt sentence in a generation AI model based on the input desired digital content, a means for linking the generated prompt sentence to various generation AIs (image generation AI / music generation AI / voice generation AI, etc.) to generate digital products, and a means for providing the generated digital products to customers and receiving payment. This makes it possible to quickly and accurately generate digital content that meets specific user requests, and to realize a variety of methods for providing the content and receiving payment.

[1693] "Customer" refers to a user who intends to use the system to generate digital content.

[1694] "Digital content" refers to commercial materials expressed in digital form, such as music, images, and audio.

[1695] A "generative AI model" refers to an artificial intelligence model that generates prompt sentences based on user requests and sends instructions to various generative AIs.

[1696] A "prompt sentence" refers to text containing specific instructions that is generated by a generative AI model by analyzing a user's request.

[1697] "Generative AI" refers to artificial intelligence (AI) that generates digital content based on prompts. Examples include image generation AI, music generation AI, and voice generation AI.

[1698] "Digital products" refers to digital content generated by generative AI.

[1699] "Means of provision" refers to the method by which the generated digital materials are provided to customers, including, for example, providing a download link, sending by email, or displaying within an application.

[1700] "Means of Receiving Compensation" refers to the method by which compensation is received from customers for the generated digital products, including, for example, a one-time fee, a monthly membership fee, or advertising revenue.

[1701] The present invention relates to a system for generating and providing digital content desired by a user. A specific embodiment of this system will be described below.

[1702] First, a user accesses the system using a terminal and inputs a request for the digital content they want to generate. For example, a user might input, "I want an illustration of a cat on a sunset background."

[1703] Next, the server receives the user's request and generates a prompt to be sent to the generative AI model. Specifically, the server analyzes the user's request using natural language processing technology and generates the prompt, "Draw a sunset in the background and a cat in the foreground." This prompt is then sent to the generative AI model.

[1704] The server sends the generated prompt to an appropriate generation AI, such as an image generation AI. For example, it sends the image generation AI instructions such as "Draw a sunset in the background and a cat in the foreground." The image generation AI generates the specified illustration based on the received prompt. In this case, the image generation AI uses a deep learning framework such as TensorFlow or PyTorch to generate the image.

[1705] The generated digital product is provided to the user by the server. It can be provided in the form of a download link, sent by email, or displayed within an application. For example, the server sends the user a download link for the generated illustration by email. The user clicks the link in the email to download the illustration.

[1706] Finally, the user pays for the provided digital product. The form of payment can be a fee per creation, a monthly membership fee, advertising revenue, etc. For example, the user pays the fee per creation using a credit card. Once the payment is confirmed, the server allows the user to download the illustration.

[1707] For example, if a user requests "I want an illustration of a cat on a sunset background," the server will send the following prompt to the generative AI model:

[1708] "Paint a sunset in the background and a cat in the foreground"

[1709] Upon receiving this prompt, the image generation AI will generate the specified illustration.

[1710] In this way, it is possible to quickly and accurately generate digital content that meets specific user requests, and realize a variety of methods for providing the content and receiving payment. The flow of the specification process in the third embodiment will be described with reference to FIG.

[1711] Step 1:

[1712] A user accesses the system using a terminal and inputs a request for the digital content they want to generate. For example, a user might input, "I want an illustration of a cat on a sunset background." The input request is sent to the server.

[1713] Input: User request (e.g., "I want an illustration of a cat on a sunset background.")

[1714] Output: The user's request sent to the server

[1715] Step 2:

[1716] The server receives requests sent by users and then uses a natural language processing engine to parse the requests and generate prompts to send to the generative AI model, such as "Draw a sunset in the background and a cat in the foreground."

[1717] Input: User request

[1718] Data processing: Analyzing requirements using a natural language processing engine

[1719] Output: The generated prompt (e.g., "Draw a sunset in the background and a cat in the foreground")

[1720] Step 3:

[1721] The server sends the generated prompt to an appropriate AI, such as an image generation AI. For example, it sends an instruction to the image generation AI to "draw a sunset in the background and a cat in the foreground."

[1722] Input: Generated prompt text

[1723] Output: The prompt sent to the generation AI

[1724] Step 4:

[1725] The image generation AI generates a specified illustration based on the received prompt sentence. In this case, the image generation AI generates the image using deep learning frameworks such as TensorFlow and PyTorch. For example, it generates an illustration with a sunset in the background and a cat in the foreground.

[1726] Input: prompt statement

[1727] Data Computing: Image Generation Using Deep Learning Frameworks

[1728] Output: Generated illustration

[1729] Step 5:

[1730] The server saves the generated illustration and generates a download link for the user, which the server then emails to the user.

[1731] Input: Generated illustration

[1732] Data processing: Generate download links

[1733] Output: Download link sent to user

[1734] Step 6:

[1735] The user clicks on the link in the email to download the illustration. The user enters their credit card information on the download page and pays for the one-time generation fee. The server allows the user to download the illustration once payment is confirmed.

[1736] Input: Download link, credit card information

[1737] Data calculation: Payment confirmation

[1738] Output:Download allowed

[1739] (Application example 3)

[1740] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1741] In conventional digital product generation systems, when generating specific digital content desired by users, there were problems such as the generation AI's instructions being vague and the quality of the generated content being inconsistent. In addition, there were limited ways to provide the generated digital products to users and to receive payment, which made it difficult for users to use.

[1742] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes a means for allowing a customer to input a desired item; a means for querying a generation system AI based on the input desired item and generating a generation code; a means for linking the generated code to various generation AIs (image generation AI, music generation AI, audio generation AI, etc.) to generate digital products; a means for providing the generated digital products to customers and receiving payment; a means for the image generation AI to generate an original artwork based on a prompt entered by the customer and displaying it within the application; a means for sharing the generated artwork via a download link or on social media; and a means for the customer to pay a fee for one generation or to use the service unlimitedly as a monthly membership. This allows users to generate high-quality digital content by entering specific instructions, and to provide and receive payment in a convenient manner.

[1743] "Means for customers to input their wishes" refers to an interface that allows users to input specific details and instructions for the digital content they wish to generate.

[1744] "Means of asking questions to the generative AI and generating generated code" refers to the process of giving appropriate instructions to the generative AI based on the desired content entered by the user, and creating generated code based on those instructions.

[1745] "Means of linking with various generation AIs to generate digital products" refers to the process of passing the generated code to different generation AIs, such as image generation AI, music generation AI, and voice generation AI, and each AI then generates digital content.

[1746] "Means of providing generated digital products to customers and receiving payment" refers to a mechanism for providing generated digital content to users and receiving payment in return.

[1747] "The means by which an image generation AI generates an original work of art based on a prompt entered by a customer and displays it within the application" refers to the process by which an image generation AI generates an original work of art based on specific instructions (prompts) entered by a user and displays the work within the application.

[1748] "Means for sharing the generated artwork via download links or social media" refers to a function that allows users to download the generated artwork or share it on social media.

[1749] "Means where customers pay a fee for one-time generation or unlimited use as a monthly membership" means a fee structure whereby users can pay a fee for each content generated or can generate and use unlimited content as a monthly membership.

[1750] The system for implementing the present invention provides a series of processes for generating digital content desired by a user. Specific embodiments of the system will be described below.

[1751] First, a user accesses a dedicated application using a device such as a smartphone or computer. This application provides an interface where the user can input their desired content. For example, the user can input a prompt such as, "Please draw a landscape with a cat in front of a sunset."

[1752] Next, the server receives the prompt input from the user, asks the generative AI appropriate questions, and generates generative code. This generative code contains specific instructions based on the user's wishes. For example, the OpenAI API can be used as the generative AI.

[1753] The generated code is then linked to various generative AIs, such as image generation AI, music generation AI, and voice generation AI, which then generate digital content according to their respective fields of expertise. For example, an image generation AI can generate original artwork based on a user's prompt.

[1754] The generated digital products are displayed within the application. Users can view the generated artwork, download it via a download link, or share it on social media. Users can also pay a fee for a single creation or subscribe for unlimited use.

[1755] In implementing this system, the following hardware and software are used:

[1756] Hardware: Cloud servers (e.g., Amazon Web Services or Google Cloud Platform)

[1757] Software: Flask (web framework), OpenAI API (generative AI)

[1758] For example, if a user inputs a prompt such as "Generate an illustration of dogs playing under a blue sky and white clouds," the image generation AI will generate an illustration based on that instruction and display it within the application. The user can then download the illustration or share it on social media.

[1759] In this way, users can generate high-quality digital content by inputting specific instructions, and provide and receive payment in a highly convenient manner.

[1760] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1761] Step 1:

[1762] The user accesses the application using a terminal and inputs the desired digital content as a prompt sentence, for example, "Please draw a landscape with a cat in front of a sunset." The input data is sent to the server.

[1763] Step 2:

[1764] The server analyzes the received prompt and generates a generated code to ask the generative AI an appropriate question. This generated code contains specific instructions based on the user's wishes. Natural language processing technology is used to generate the generated code. The input is the prompt and the output is the generated code.

[1765] Step 3:

[1766] The server connects the generated generation code to various generation AIs (image generation AI, music generation AI, voice generation AI, etc.). For example, an image generation AI is given the instruction to "generate a landscape painting of a cat in front of a sunset." The input is the generation code, and the output is the instruction to the generation AI.

[1767] Step 4:

[1768] Each generative AI generates digital content based on the instructions it receives. For example, an image-generating AI generates an image with specified content. The input is the instructions to the generative AI, and the output is the generated digital content (e.g., an image).

[1769] Step 5:

[1770] The server displays the generated digital content within the application, and the user can view the generated artwork. The input is the generated digital content, and the output is the display within the application.

[1771] Step 6:

[1772] Users can download the generated artwork via a download link or share it on social media. The input is the generated digital content, and the output is the download link or sharing on social media.

[1773] Step 7:

[1774] Users can pay a fee for a single generation or subscribe to unlimited monthly usage. The server manages user payment information and applies the appropriate fee structure. The input is the user payment information, and the output is the application of the fee.

[1775] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1776] "Example 1"

[1777] One embodiment of the present invention is a system that incorporates an emotion engine that recognizes user emotions. In this system, the emotion engine recognizes user emotions as a means for the user to input their desired items. Specifically, when a user inputs details of desired digital content through a portal such as a website or application, the emotion engine recognizes the user's emotion and asks a generative AI question based on that emotion. For example, if the user expresses joy, the emotion engine recognizes the emotion and instructs the generative AI to generate digital content related to joy.

[1778] "Example 2"

[1779] In addition, the code generated by the generative AI is linked to various generative AIs (image generation AI, music generation AI, audio generation AI, etc.), and the means of generating digital products also take into account the recognition results of the emotion engine. Specifically, the generative AI generates digital products based on the user's emotions recognized by the emotion engine. For example, if the user expresses joy, the generative AI will generate digital content related to joy, such as brightly colored images and cheerful music.

[1780] "Example 3"

[1781] Furthermore, the method of providing the generated digital product to the user and receiving payment also takes into account the results of the emotion engine's recognition. Specifically, the method of providing the digital product is adjusted based on the user's emotions recognized by the emotion engine. For example, if the user expresses joy, the digital product is immediately provided to the user, and their reaction is obtained as instant feedback. This makes it possible to provide the optimal digital product according to the user's emotions and optimize the payment for it.

[1782] The processing flow of each embodiment will be described below.

[1783] "Example 1"

[1784] Step 1: The user enters details of the digital content they want through a portal such as a website or app.

[1785] Step 2: The emotion engine recognizes the user's emotion.

[1786] Step 3: Based on the emotions recognized by the emotion engine, the generative AI is instructed to generate digital content.

[1787] "Example 2"

[1788] Step 1: The code generated by the generative AI is linked to various generative AIs (image generation AI, music generation AI, audio generation AI, etc.).

[1789] Step 2: Based on the user's emotions recognized by the emotion engine, the generative AI generates digital products.

[1790] "Example 3"

[1791] Step 1: Provide the generated digital product to the user.

[1792] Step 2: Adjust how digital products are presented based on the user's emotions recognized by the emotion engine.

[1793] Step 3: Get instant feedback from users.

[1794] Example 1

[1795] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1796] Conventional digital content generation systems provide a means for users to input their preferences, but do not generate content that takes the user's emotions into consideration. This makes it difficult to provide personalized content that reflects the user's emotions.

[1797] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1798] In this invention, the server includes a means for allowing a customer to input a desired item, a means for asking a generative AI questions based on the input desired item and generating a generated code, a means for linking the generated code to various generative AIs (image generation AI, music generation AI, voice generation AI, etc.) to generate digital products, a means for providing the generated digital products to the customer and receiving payment, a means for recognizing the customer's emotions, and a means for sending a prompt to the generative AI based on the recognized emotions. This enables the generation of more personalized digital content according to the user's emotions.

[1799] "Means for allowing customers to input their desired content" refers to means for providing an interface for users to specifically input the digital content they desire.

[1800] "Means for asking questions to a generative AI and generating generated code" refers to means for asking questions to a generative AI based on user input and creating generated code as a response.

[1801] "Means of linking to various generation AIs to generate digital products" refers to means of linking the generated code to different generation AIs such as image generation AI, music generation AI, and voice generation AI, and using them to generate digital content.

[1802] "Means for providing the generated digital materials to customers and receiving payment" refers to means for providing the generated digital content to users and receiving a fee in return.

[1803] "Means for recognizing customer emotions" refers to means that use technology to analyze and recognize emotions from user input and interactions.

[1804] "Means for sending prompt sentences to a generative AI based on recognized emotions" refers to means for generating appropriate prompt sentences based on the recognized user emotions and sending them to a generative AI.

[1805] The present invention is a system for generating digital content desired by a user, and aims to provide more personalized content by taking into consideration the user's emotions. Specific embodiments of this system will be described below.

[1806] System configur...

Claims

1. A means for customers to input what they want; a means for inputting a prompt sentence to a generative AI based on the desired item input to the inputting means, and generating generative content; A means for linking the content generated by the means for generating generated content to various generation AIs to generate digital content; a means for providing the digital content generated by the means for generating digital content to the customer and receiving a payment; A system including:

2. The system of claim 1 , wherein the generative AI is a specific generative AI model.

3. 2. The system according to claim 1, wherein the generated digital content is music, image, or voice digital content.

Images