System

Abstract

A system is provided.SOLUTION: A system for making available in combination a plurality of generative artificial intelligence tools that are provided free of charge or at a reduced cost, comprising: registration and login means; means for selecting a generative artificial intelligence tool; data entry means for a user to enter input data and configuration parameters; means for performing a generative process based on the input data and configuration parameters; and means for making the generated product available for display and download.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In today's business environment, a single generative AI or text mining tool alone cannot adequately address many business challenges. In particular, there is a demand for diverse outputs that can be obtained by combining image and audio generation functions. However, high-performance multimodal generative AI that provides such functions is expensive and poses a high technical hurdle for non-engineers, making it difficult to utilize in a wide range of business applications. [Means for solving the problem]

[0005] To solve this problem, we provide a system that enables the use of multiple generative AI tools that are offered free of charge or at low cost. This system includes a registration and login means, a means for selecting a generative AI tool, a data input means for the user to input input data and setting parameters, a means for executing the generative process based on the input data and setting parameters, and a means for displaying and downloading the generated results. This allows even non-engineers to easily use various generative AI functions, generate various outputs, and utilize the system in their work.

[0006] "Registration and Login Procedure" refers to the process by which a User provides their information to the System and creates an account, and the process by which the User uses that account to access the System.

[0007] A "generative artificial intelligence tool" refers to an algorithm or program that generates a specific output (e.g., text, image, audio, etc.) based on data input by a user.

[0008] "Selection means" refers to UI components and operating procedures that allow a user to select the generative artificial intelligence tool they wish to use through a user interface.

[0009] "Data input means" refers to an interface through which a user provides the necessary input data and setting parameters to the generation artificial intelligence tool.

[0010] "Means for executing a generative process" refers to functionality for a generative artificial intelligence tool to execute a process that generates a predetermined output based on data and configuration parameters entered by a user.

[0011] "Means for displaying and making available for download" refers to functionality for displaying the generated output on a user interface and allowing users to download the data to their own terminals. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0013] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0014] First, the terms used in the following description will be explained.

[0015] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0016] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0017] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0018] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0019] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0020] [First embodiment]

[0021] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0022] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0023] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0024] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0025] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0026] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0027] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0028] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0029] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0030] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0031] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0032] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0033] The present invention relates to a system that enables the combination and use of multiple generative AI tools that are offered free or at low cost. This system allows even non-engineers to easily use multiple generative AI tools (e.g., text generation, image generation, speech generation, etc.) to generate output that is useful for business.

[0034] The entire system consists of the following main components: a means for registration and login, a means for selecting a generation artificial intelligence tool, a means for inputting data and setting parameters, a means for executing the generation process, and a means for displaying and downloading the product.

[0035] First, a user accesses the system and creates and authenticates an account using the registration and login methods. Specifically, the user accesses the registration screen on their terminal and enters the required information (name, password, email address, etc.). The terminal sends this information to the server, and the server creates a new user record in the database based on the received information. The user then activates their account through a confirmation email sent to the email address provided during registration. Similarly, when logging in, the email address and password entered by the user are verified, and a session ID is issued if successful.

[0036] Next, the user selects the generative AI tool they want to use from the dashboard screen. The device sends the user's selection information to the server, and the server returns the front-end component and setting information corresponding to the selected generative AI tool to the device.

[0037] The user uses a data input method to input the necessary information depending on the selected generation AI tool. For example, if a text generation AI is selected, the user inputs the topic and keywords of the text to be generated. The user also selects setting parameters such as the output format (e.g., short or long text) and quality parameters. The device temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[0038] Based on the received data and setting parameters, the server sends a request to the API of the corresponding generation AI tool to execute the generation process. The generation AI tool (e.g., text generation AI) creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained results and sends data to be displayed on the user's device. The device displays the generated data on the result screen, allowing the user to check and download the product.

[0039] For example, if a user wants to generate a "product review text," they log in, select the text generation AI from the dashboard, and enter the "product name" and "points they want to include in the review." They then set the output format to "detailed review" and click the generate button after completing the settings. The server calls the generation AI tool with the specified information and generates a detailed review text. The generated text is sent back from the server to the device, where the user can review it and download it if necessary.

[0040] In this way, the entire system provides users with an intuitive and easy-to-use interface, and makes it possible to effectively utilize multiple generative AI tools to generate output that is useful for business. This allows even non-engineers to easily use high-performance generative AI technology and achieve business improvements with reduced financial burden.

[0041] The processing flow will be explained below.

[0042] Step 1:

[0043] The user enters the required information (name, password, email address, etc.) on the registration screen and clicks the Register button.

[0044] Terminal: Sends the entered information to the server in JSON format.

[0045] Step 2:

[0046] The server verifies the received information and creates a new user record in the database.

[0047] Server: Checks if the entered email address is unique and creates a new user record in the database if there are no issues. Sends a success message and a confirmation email to the user.

[0048] Step 3:

[0049] The user clicks the link in the confirmation email to activate their account.

[0050] Server: When the confirmation link is clicked, update the status of the corresponding user record to "valid".

[0051] Step 4:

[0052] The user enters their email address and password on the login screen and clicks the Login button.

[0053] On your device: Send your login information to the server.

[0054] Server: Verifies the received information, and if authentication is successful, generates a session ID and returns it to the terminal.

[0055] Step 5:

[0056] The user selects the generative AI tool (e.g., text generation AI) they want to use from the dashboard screen.

[0057] Terminal: Sends the user's selection information to the server.

[0058] Step 6:

[0059] The server returns to the terminal a front-end component corresponding to the selected generating artificial intelligence tool.

[0060] Server: Sends UI components and initial settings according to the selected tool to the device.

[0061] Step 7:

[0062] Depending on the generation AI tool selected by the user, input the necessary information (e.g., topics and keywords for text generation).

[0063] Terminal: Temporarily saves the entered information and displays a screen for selecting additional configuration parameters (e.g. output format, quality parameters, etc.).

[0064] Step 8:

[0065] The user selects the configuration parameters and clicks the generate button.

[0066] Terminal: Sends input information and configuration parameters to the server in JSON format.

[0067] Step 9:

[0068] Based on the data and parameters received by the server, the corresponding generative AI tool is launched.

[0069] Server: Parses the JSON data and sends a request to the corresponding AI tool API.

[0070] Step 10:

[0071] A generative artificial intelligence tool creates a product based on specified conditions.

[0072] AI tool: Creates text, images, audio, and other products based on the received data and parameters, and sends the results back to the server.

[0073] Step 11:

[0074] The server temporarily stores the results received from the AI ​​tool and sends the data to the user's device for display.

[0075] Server: Sends a response back to the device containing the location of the artifact and metadata.

[0076] Step 12:

[0077] The user checks the products displayed on the results screen.

[0078] Terminal: Display the generated data on the results screen.

[0079] Step 13:

[0080] The user downloads the products as needed.

[0081] On the device: Sends a download request to the server and saves the result in the download folder.

[0082] Step 14:

[0083] The server monitors the user's usage and calculates the charges.

[0084] Server: Records each production request and calculates a monthly fee based on frequency of use and type of production.

[0085] Step 15:

[0086] The server generates billing information and sends it to the user.

[0087] Server: Generates invoices and sends them to the user's registered email address, and stores the invoice information in a database.

[0088] Example 1

[0089] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0090] Currently, many individuals and companies are trying to improve their business efficiency by using generative AI tools. However, these tools are expensive and require advanced technical knowledge to use. This makes it difficult for non-engineers and small and medium-sized enterprises to easily use these technologies. Another issue is that it is difficult to combine multiple generative AI tools and use them efficiently.

[0091] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0092] In this invention, the server includes means for registering and authenticating a user's account, means for returning information corresponding to the generation AI tool selected by the user to the terminal, means for executing the generation process based on input data and setting parameters, and means for displaying and downloading the generated product to the user terminal. This allows even non-engineers to easily use multiple generation AI tools provided free of charge or at low cost, significantly improving work efficiency without complex operations or advanced knowledge.

[0093] "Means of registering and authenticating a user's account" is the process by which a user accesses the system, enters required information such as name, password, and email address, and the server receives this and creates a new user record in the database.

[0094] "Means for returning information corresponding to the generation AI tool selected by the user to the terminal" refers to the process in which the user selects the generation AI tool they wish to use on the dashboard screen, the server receives the selection information, and then sends the corresponding front-end component and setting information to the user's terminal.

[0095] The "means of executing the generation process based on input data and setting parameters" refers to the process in which the server receives the data and setting parameters entered by the user, sends a request to the API of the corresponding generation AI tool to execute the generation process, and the server temporarily stores the generated results.

[0096] "Means for displaying and enabling the generated product to be downloaded to a user terminal" refers to the process by which the server sends the product results returned from the generation AI tool to the user terminal, allowing the user to check and download the product on the result screen.

[0097] A "generative AI tool" is a technology that performs text generation, image generation, voice generation, etc., and is an AI technology that automatically creates products based on data entered by the user.

[0098] To implement the invention, the system includes the following major hardware and software components: The server registers and authenticates the user's account, returns information corresponding to the user's selected AI tool to the terminal, executes the generation process based on the input data and setting parameters, and makes the generated product available for display and download on the user's terminal. The user accesses the system using the terminal and performs various operations.

[0099] Hardware and Software Components

[0100] 1. Server: Registers and authenticates user information, sends requests to the AI ​​generation tool's API, and temporarily stores the generated results. Configuration examples include a Linux-based server and a database management system (MySQL or PostgreSQL).

[0101] 2. Terminal: A device (PC, smartphone, tablet, etc.) that a user operates and displays the user interface using a web browser.

[0102] 3. Generative AI tools: Generative AI tools such as text generation AI, image generation AI, and voice generation AI. They are often provided as APIs and perform automatic generation based on specific generation conditions.

[0103] Processing flow and specific examples

[0104] The system's processing flow is designed so that the server, terminal, and user components function in coordination.

[0105] Account Registration and Verification

[0106] User: Accesses the registration screen on the device and enters information such as name, password, and email address.

[0107] Terminal: Sends user input to the server.

[0108] Server: Stores the received information in a database and sends a confirmation email.

[0109] Users: Click the link in the confirmation email to activate their account.

[0110] User: Enter your email address and password on the login screen.

[0111] Server: Validates the input information and issues a session ID.

[0112] Choosing a Generative AI Tool

[0113] User: Select the generative AI tool you want to use on the dashboard screen.

[0114] Terminal: Sends the user's selection to the server.

[0115] Server: Sends the necessary information for the selected AI tool back to the device.

[0116] Entering Data and Configuration Parameters

[0117] User: Enters the required information into the selected generative AI tool, for example, topics and keywords for text generation.

[0118] Terminal: The entered information and configuration parameters are temporarily saved and sent to the server in JSON format.

[0119] Running the generation process

[0120] Server: Sends requests to the generative AI tool's API based on the received data and configuration parameters.

[0121] Generative AI tool: Creates a product based on specified conditions and returns the results to the server.

[0122] Server: Temporarily stores the generated data and sends it to the device.

[0123] Verify and download the product

[0124] Terminal: Display the results on the results screen.

[0125] User: Review the artifacts and download them if necessary.

[0126] Examples and prompts

[0127] As a concrete example, the steps to generate a "product review text" are shown below.

[0128] 1. User: Log in to the system and select the text generation AI from the dashboard.

[0129] 2. User: Enter the "Product Name" and "Points you want to include in your review."

[0130] 3. User: Set the output format as "Detailed Review" and click the "Generate" button.

[0131] 4. Server: Calls the generative AI tool with the specified information and generates a detailed review text.

[0132] 5. Terminal: Display the generated review text.

[0133] 6. User: After checking, download the review text if necessary.

[0134] Example prompt sentence:

[0135] Product Name: Smartphone XYZ

[0136] Points to include in the review: Battery life, camera performance, price

[0137] Output Formats: A Detailed Review

[0138] Tool used: Text generation AI

[0139] This allows users to intuitively operate the system and easily combine and use a variety of generative AI tools. It is designed so that even non-engineers can obtain highly accurate output quickly and at low cost.

[0140] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0141] Step 1: User Account Registration

[0142] User: Accesses the registration screen on the device and enters the required information, such as name, password, and email address.

[0143] Input: Name, Password, Email Address

[0144] Specific behavior: The user fills in the form in their browser and clicks the "Register" button.

[0145] Terminal: Sends the information entered by the user to the server.

[0146] Input: Information entered by the user

[0147] Specific operation: The input information is temporarily saved and sent to the server via an HTTP request.

[0148] Server: Stores the received information in a database and sends a confirmation email.

[0149] Input: User information received from the device

[0150] Data processing: Save the received information as a new user record in the database

[0151] Output: Send confirmation email

[0152] Specific behavior: The user record is saved in the database and a confirmation email is sent via the mail server.

[0153] Step 2: User Account Verification

[0154] Users: Click the link in the confirmation email they receive to activate their account.

[0155] Input: Link in confirmation email

[0156] Specific action: Click on the confirmation link in your browser.

[0157] Server: Receives the link and updates the corresponding user record to activate the account.

[0158] Input: A request for a verification link from the user

[0159] Data processing: Update the user record status to "Active"

[0160] Output: Activation complete response

[0161] What happens: Updates the user status in the database and displays a confirmation message in the browser.

[0162] Step 3: User Login

[0163] User: Access the login screen on the device and enter your email address and password.

[0164] Input: Email address, Password

[0165] Specific action: Enter your email address and password in the form and click the "Login" button.

[0166] Terminal: Sends the information entered by the user to the server.

[0167] Input: The login information entered by the user

[0168] Specific operation: The input information is temporarily saved and sent to the server via an HTTP request.

[0169] Server: Validates the email address and password and, if successful, issues a session ID.

[0170] Input: Login information received from the device

[0171] Data calculation: Email address and password verification

[0172] Output: Session ID

[0173] Specific operation: User information is compared with the database, and if it matches, a session ID is generated and sent back to the terminal.

[0174] Step 4: Selecting a generative AI tool

[0175] User: Select the generative AI tool you want to use on the dashboard screen.

[0176] Input: Tool selection

[0177] Specific behavior: A user selects a generative AI tool from a drop-down list or button on the dashboard.

[0178] Terminal: Sends the user's selection information to the server.

[0179] Input: Tool selection information

[0180] Specific operation: The selected information is temporarily saved and sent to the server via an HTTP request.

[0181] Server: Returns information corresponding to the selected generation AI tool to the device.

[0182] Input: User selection information

[0183] Data Calculation: Identifying the corresponding front-end component

[0184] Output: Front-end components and configuration information

[0185] Specific behavior: Front-end components and configuration information are returned to the device in HTML or JSON format.

[0186] Step 5: Entering data and configuration parameters

[0187] User: Enter the required information (e.g., topics and keywords) into the selected generative AI tool and set the output format and quality parameters.

[0188] Input: Required information (topics, keywords), output format, quality parameters

[0189] Specific actions: Enter the required information into the form, set the parameters, and click the "Submit" button.

[0190] Terminal: The entered information and configuration parameters are temporarily saved and sent to the server in JSON format.

[0191] Input: User-entered data and configuration parameters

[0192] Specific operation: The data is temporarily saved, converted to JSON format, and sent to the server.

[0193] Step 6: Run the generation process

[0194] Server: Sends requests to the generative AI tool's API based on the received data and configuration parameters.

[0195] Input: Data received from the terminal and configuration parameters

[0196] Data Calculation: Making API Requests

[0197] Specific operation: Generates an API request and sends it to the generative AI tool.

[0198] Generative AI tool: Creates a product based on specified conditions and returns the results to the server.

[0199] Input: API request parameters

[0200] Data transformation: Condition-based generative processes

[0201] Output: Generated result

[0202] Specific operation: Creates a product according to the specified conditions and returns the result to the server.

[0203] Server: Temporarily stores the generated data and sends the generated results to the terminal.

[0204] Input: Generated results from a generative AI tool

[0205] Data processing: Convert to JSON format

[0206] Output: Sends generated results to the terminal

[0207] Specific operation: The generated results are temporarily saved and sent to the terminal in JSON format.

[0208] Step 7: Verify and download the product

[0209] Terminal: Display the results on the results screen.

[0210] Input: Generated result received from the server

[0211] Specific operation: Generates HTML to display the data on the results screen.

[0212] User: Review the artifacts and download them if necessary.

[0213] Input: Displayed product

[0214] Specific operations: Check the generated output and click the "Download" button.

[0215] (Application example 1)

[0216] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0217] Existing online shopping sites often make it difficult for users to obtain detailed information when selecting products, and product reviews and descriptions are often insufficient. Furthermore, image and audio information may be lacking, which can discourage users from purchasing. Furthermore, suggestions for related products are insufficient, which can lead to users missing useful products. Therefore, there is a need for a system that allows users to quickly and easily obtain detailed reviews, images, audio descriptions, and suggestions for related products when selecting products.

[0218] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0219] In this invention, the server is a system that combines and enables the use of multiple generative artificial intelligence tools that are offered free of charge or at low cost, and includes a registration and login means, a generative artificial intelligence tool selection means, a data input means for a user to input input data and setting parameters, a means for executing a generation process based on the input data and setting parameters, a means for displaying and making the generated product available for download, a means including a generative artificial intelligence tool for automatically generating product information reviews, descriptions, images, and related product suggestions, and a user interface means for displaying information generated using the generative artificial intelligence tool to the user, thereby enabling the user to quickly and easily obtain detailed reviews, images, audio descriptions, and related product suggestions when selecting a product.

[0220] "Registration and Login Facility" means the facility by which a User accesses the System and creates and authenticates an Account.

[0221] "Means for selecting generative AI tools" is a function that allows users to select the generative AI tool they want to use.

[0222] The "data input means" is a function that allows the user to input data and setting parameters required for the generation process.

[0223] A "means for executing a generative process" is a function for executing a generative artificial intelligence tool based on input data and configuration parameters.

[0224] "Means for displaying and making the output available for download" refers to a function that allows users to view the generated output and download it if necessary.

[0225] "Generative artificial intelligence tools for automatically generating product information reviews, descriptions, images, and related product suggestions" refers to various generative AI tools used to automatically generate product-related reviews, descriptions, images, and related product suggestions.

[0226] The "user interface means" is an interface for displaying the generated information to the user.

[0227] This invention relates to a system that combines and enables the use of multiple generative AI tools that are provided free or at low cost. When a user selects a product, this system uses the generative AI tools to automatically provide product reviews, descriptions, images, and even suggestions for related products. This allows users to obtain more detailed and attractive product information, aiming to increase their desire to purchase.

[0228] The system is implemented as an application installed on a smartphone, and its specific functions include creating product reviews using text generation AI, generating product images using image generation AI, generating audio product explanations using voice generation AI, and suggesting related products using related product suggestion AI.

[0229] System-wide program overview

[0230] When a user accesses the application, they first create and authenticate an account using the registration and login methods. If this is successful, they can select the AI ​​generation tool they want to use from the dashboard screen. The user enters the required information for the selected AI generation tool and runs the generation process. The generated product is then displayed and the user can download it.

[0231] Hardware and software used

[0232] The system is implemented using the following hardware and software:

[0233] Hardware: Smartphones, servers (cloud servers and on-premise servers)

[0234] software:

[0235] API Server: Hosts the APIs of the provided generative AI tools, specifically built using Django or Flask.

[0236] Database: Stores user information and generated data. Specifically, PostgreSQL or MySQL is used.

[0237] Front-end: A smartphone application developed with React Native or Flutter.

[0238] Backend: Server (developed with Django or Flask)

[0239] Data processing and calculation

[0240] 1. Registration and Login: A user visits a registration screen and enters their name, password, email address, etc. This information is sent to the server, and a new user record is created in the database. Upon login, the server validates the email address and password entered by the user, and if successful, issues a session ID.

[0241] 2. Selecting a generative AI tool and entering data: The user selects a generative AI tool from the dashboard and sends the selection information to the server. The server returns the component corresponding to the selected generative AI tool to the terminal, and the user enters the required information.

[0242] 3. Execution of the generation process: Based on the input data and configuration parameters, the server sends a request to the API of the corresponding generation AI tool to execute the generation process. The generated results are sent back to the server and then displayed on the user's device.

[0243] 4. View and download results: The generated products can be viewed by the user and downloaded if necessary.

[0244] Specific examples

[0245] For example, suppose a user selects "Smartphone X" and enters the keywords "high-resolution camera" and "long battery life." The system uses this information to generate a detailed product review. An example prompt might be, "Generate a review for Smartphone X. The key features are the high-resolution camera and long battery life." The generated review might read, "Smartphone X has an excellent high-resolution camera, making it easy to take beautiful photos. What's more, its long-lasting battery life allows for worry-free use all day long."

[0246] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0247] Step 1:

[0248] A user accesses a smartphone app and creates and authenticates an account using the registration and login methods. The data entered is a name, password, and email address. The input data is sent to the server, which creates a new user record in the database. The user then activates the account using the confirmation email sent to them. Similarly, when logging in, the server verifies the email address and password entered by the user, and if successful, returns a session ID to the device.

[0249] Step 2:

[0250] The user selects the generative AI tool (text generation AI, image generation AI, voice generation AI, etc.) they want to use using the generative AI tool selection means on the dashboard screen. The selection information is sent to the server, and the server returns the front-end component and setting information corresponding to the selected generative AI tool to the terminal.

[0251] Step 3:

[0252] The user inputs the data required for the output they want to generate (e.g., product name, points they want to include in the review) and setting parameters (output format and quality parameters) into the selected generation AI tool. The input data and setting parameters are converted to JSON format on the device and sent to the server.

[0253] Step 4:

[0254] The server sends a request to the API of the corresponding AI tool based on the received data and configuration parameters. The server temporarily stores the results returned by the AI ​​tool. The results may include review text, generated product images, audio descriptions, etc.

[0255] Step 5:

[0256] The server sends the generated information back to the device, where it is displayed on a confirmation screen. The user can then review the generated information and download it as needed. Specifically, the system displays product reviews, images, and audio descriptions generated using the generative AI tool.

[0257] Step 6:

[0258] The terminal provides a user interface for displaying the product to the user, who can then download it, regenerate it, or see suggestions for related products.

[0259] Specifically, if a user wants to generate a detailed review of "Smartphone X," they input the prompt, "Generate a review of Smartphone X. Key features include a high-resolution camera and a long battery life." The system then invokes a generation AI tool based on the input data, which generates a detailed review, related images, and audio description, and provides them to the user.

[0260] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0261] This invention relates to a system that combines multiple generative AI tools that are available free or at low cost, and an emotion engine that recognizes user emotions. This system allows even non-engineers to easily use multiple generative AI tools (e.g., text generation, image generation, voice generation, etc.) to generate output that corresponds to the user's emotions.

[0262] The entire system consists of the following main components:

[0263] Registration and login methods

[0264] Selection methods for generative artificial intelligence tools

[0265] A data entry means for the user to enter input data and setting parameters

[0266] A means to run the generation process based on input data and configuration parameters

[0267] A means to make the generated artifacts viewable and downloadable

[0268] Emotion engine that recognizes user emotions

[0269] First, a user accesses the system and creates and authenticates an account using the registration and login methods. Specifically, the user accesses the registration screen on their terminal and enters the required information (name, password, email address, etc.). The terminal sends this information to the server, and the server creates a new user record in the database based on the received information. The user then activates their account through a confirmation email sent to the email address provided during registration. Similarly, when logging in, the email address and password entered by the user are verified, and a session ID is issued if successful.

[0270] Next, the user selects the generative AI tool they want to use from the dashboard screen. The device sends the user's selection information to the server, and the server returns the front-end component and setting information corresponding to the selected generative AI tool to the device.

[0271] The user uses a data input method to input the necessary information depending on the selected generation AI tool. For example, if a text generation AI is selected, the user inputs the topic and keywords of the text to be generated. The user also selects setting parameters such as the output format (e.g., short or long text) and quality parameters. The device temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[0272] The emotion engine analyzes user input data and voice and facial expression data obtained during actual user interactions to recognize the user's emotions. Based on this recognition result, it automatically generates additional parameters to optimize the output of the generative AI tool. For example, if the emotion engine recognizes that the user is feeling stressed, it will adjust the tone of the generated text or make the colors of images more subdued.

[0273] Based on the received data and additional configuration parameters, the server sends a request to the API of the corresponding generative AI tool to execute the generation process. The generative AI tool (e.g., text generation AI) creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained result and sends data to be displayed on the user's device. The device displays the generated data on the result screen, allowing the user to check and download the product.

[0274] For example, if a user wants to generate a "product review," they log in, select the text generation AI from the dashboard, and enter the "product name" and "points they want to include in the review." During this time, the emotion engine recognizes emotions from the user's voice and facial expressions, and if it detects, for example, "positive emotion," it generates a review text in a tone and style based on that emotion. The generated review text is sent back from the server to the device, where the user can review it and download it if necessary.

[0275] In this way, a system with an embedded emotion engine can provide customized results based on the user's emotions, enabling more appropriate and effective output. The system provides an interface that is intuitive even for non-engineers, and effectively utilizes multiple generative AI tools and emotion recognition functions to improve work efficiency.

[0276] The processing flow will be explained below.

[0277] Step 1:

[0278] The user enters the required information (name, password, email address, etc.) on the registration screen and clicks the Register button.

[0279] Terminal: Sends the entered information to the server in JSON format.

[0280] Step 2:

[0281] The server verifies the received information and creates a new user record in the database.

[0282] Server: Checks if the entered email address is unique and creates a new user record in the database if there are no issues. Sends a success message and a confirmation email to the user.

[0283] Step 3:

[0284] The user clicks the link in the confirmation email to activate their account.

[0285] Server: When the confirmation link is clicked, update the status of the corresponding user record to "valid".

[0286] Step 4:

[0287] The user enters their email address and password on the login screen and clicks the Login button.

[0288] On your device: Send your login information to the server.

[0289] Server: Verifies the received information, and if authentication is successful, generates a session ID and returns it to the terminal.

[0290] Step 5:

[0291] The user selects the generative AI tool (e.g., text generation AI) they want to use from the dashboard screen.

[0292] Terminal: Sends the user's selection information to the server.

[0293] Step 6:

[0294] The server returns to the terminal a front-end component and configuration information corresponding to the selected generating artificial intelligence tool.

[0295] Server: Sends UI components and initial settings according to the selected tool to the device.

[0296] Step 7:

[0297] Depending on the generation AI tool selected by the user, input the necessary information (e.g., topics and keywords for text generation).

[0298] Terminal: The input information is temporarily stored, and the emotion engine analyzes the user's input data as well as the voice and facial expression data obtained during actual user interaction.

[0299] Step 8:

[0300] The emotion engine recognizes the user's emotions and automatically generates additional setting parameters based on the results.

[0301] Emotion engine: Analyzes emotion recognition results and makes appropriate adjustments to reflect them in the output.

[0302] Step 9:

[0303] The user confirms the configuration parameters and clicks the generate button.

[0304] Terminal: Sends input information and automatically generated configuration parameters to the server in JSON format.

[0305] Step 10:

[0306] Based on the data and parameters received by the server, the corresponding generative AI tool is launched.

[0307] Server: Parses the JSON data and sends a request to the corresponding AI tool API.

[0308] Step 11:

[0309] A generative artificial intelligence tool creates a product based on specified conditions.

[0310] AI tool: Creates text, images, audio, and other products based on the received data and parameters, and sends the results back to the server.

[0311] Step 12:

[0312] The server temporarily stores the results received from the AI ​​tool and sends the data to the user's device for display.

[0313] Server: Sends a response back to the device containing the location of the artifact and metadata.

[0314] Step 13:

[0315] The user checks the products displayed on the results screen.

[0316] Terminal: Display the generated data on the results screen.

[0317] Step 14:

[0318] The user downloads the products as needed.

[0319] On the device: Sends a download request to the server and saves the result in the download folder.

[0320] Step 15:

[0321] The server monitors the user's usage and calculates the charges.

[0322] Server: Records each production request and calculates a monthly fee based on frequency of use and type of production.

[0323] Step 16:

[0324] The server generates billing information and sends it to the user.

[0325] Server: Generates invoices and sends them to the user's registered email address, and stores the invoice information in a database.

[0326] Example 2

[0327] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0328] While systems exist for effectively utilizing free or low-cost generative AI tools, they struggle to provide products that respond to user emotions. Furthermore, they lack the functionality to provide an intuitive interface for users and optimize the quality of products based on user emotions. Therefore, a system that effectively combines multiple generative AI tools while taking user emotions into account is needed.

[0329] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0330] In this invention, the server includes a registration and login means, a generation artificial intelligence tool selection means, a data input means, an emotion recognition means, an additional parameter generation means, a generation process execution means, and a display and download means, which enable the server to identify a user's emotion and provide a product based thereon.

[0331] "Registration and Login Facility" means the facility by which a User accesses the System and creates and authenticates his / her account.

[0332] The "means for selecting a generating AI tool" is a function that provides an interface for a user to select the tool that the user wants to use from among a plurality of generating AI tools.

[0333] "Data input means" is a function that provides an interface for inputting setting parameters and input data of information generated by a user into the system.

[0334] "Emotion recognition means" is a technology for analyzing the user's voice and facial expression data and identifying the user's emotions.

[0335] The "additional parameter generation means" is a function that generates parameters for optimizing the quality and characteristics of the product based on the emotion data acquired by the emotion recognition means.

[0336] The "generative process execution means" is a function that uses a generative artificial intelligence tool to create a product based on data and setting parameters input by the user.

[0337] The "display and download means" is a function that displays the generated product on the user terminal and allows the user to download it.

[0338] MODE FOR CARRYING OUT THE INVENTION

[0339] This invention relates to a system that combines multiple generative AI tools that are available free or at low cost, and an emotion engine that recognizes user emotions. This system allows even non-engineers to easily use multiple generative AI tools (e.g., text generation, image generation, voice generation, etc.) to generate output that corresponds to the user's emotions.

[0340] The entire system consists of the following main components:

[0341] Registration and login methods

[0342] Selection methods for generative artificial intelligence tools

[0343] A data entry means for the user to enter input data and setting parameters

[0344] Emotion recognition means for identifying user emotions

[0345] A means of generating additional parameters based on the output of the emotion recognition means

[0346] A means to run the generation process based on input data and configuration parameters

[0347] A means to make the generated artifacts viewable and downloadable

[0348] First, a user accesses the system and creates and authenticates an account using the registration and login methods. Specifically, the user accesses the registration screen on their device and enters the required information (name, password, email address, etc.). The device sends this information to the server, which then creates a new user record in the database based on the received information. The user then activates their account through a confirmation email sent to the email address provided during registration.

[0349] Next, the user verifies the entered email address and password to log in. If successful, the server issues a session ID and redirects the user to the dashboard screen. From the dashboard screen, the user selects the generative AI tool they want to use. The device sends the user's selection information to the server, and the server returns the front-end component and configuration information corresponding to the selected generative AI tool to the device.

[0350] The user uses a data input method to input the necessary information depending on the selected generation AI tool. For example, if a text generation AI is selected, the user inputs the topic and keywords of the text to be generated. The user also selects setting parameters such as the output format (e.g., short or long text) and quality parameters. The device temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[0351] The emotion recognition means analyzes user input data and voice and facial expression data acquired during actual user interactions to identify the user's emotions. Based on this recognition result, additional parameters are automatically generated to optimize the output of the emotion recognition means. For example, if the emotion recognition means recognizes that the user is feeling stressed, adjustments are made such as softening the tone of the generated text or calming the colors of images.

[0352] Based on the received data and additional configuration parameters, the server sends a request to the API of the corresponding generative AI tool to execute the generation process. The generative AI tool (e.g., text generation AI) creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained result and sends data to be displayed on the user's device. The device displays the generated data on the result screen, allowing the user to check and download the product.

[0353] As a specific example, if a user wants to generate a "product review text," they log in, select the text generation AI from the dashboard, and enter the "product name" and "points they want to include in the review." Meanwhile, the emotion recognition means recognizes emotions from the user's voice and facial expressions, and if it detects, for example, "positive emotion," the review text is generated in a tone and style based on that emotion. The generated review text is sent back from the server to the device, where the user can review it and download it if necessary.

[0354] An example prompt might be, "Please generate a product review. The product name is a 'high-performance smartphone', and the points you would like to include in your review are battery life, camera quality, and aesthetics."

[0355] In this way, a system incorporating emotion recognition means can provide customized products according to the user's emotions, enabling the generation of more appropriate and effective output. This system provides an interface that is intuitive even for non-engineers, and effectively utilizes multiple generative AI tools and emotion recognition functions to improve work efficiency.

[0356] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0357] Step 1:

[0358] User: Accesses the system and enters information such as name, password, and email address on the registration screen. The entered information is sent to the server via the terminal.

[0359] Server: Creates a new user record in the database based on the received information. The server sends a confirmation email to the user's email address.

[0360] Input: Information that a user enters, such as a name, password, or email address.

[0361] Output: A new user record is created in the database and a confirmation email is sent.

[0362] Specific operation: When the user clicks the "Submit" button, the device sends the input information to the server, which receives the information, creates a new record, and sends a confirmation email.

[0363] Step 2:

[0364] User: Open the confirmation email sent to your email address, click the account activation link, and then enter your email address and password on the login screen to log in.

[0365] Server: Validates the login information, and if successful, issues a session ID and redirects the user to the dashboard.

[0366] Enter your email address and password.

[0367] Output: Issue a session ID and transition to the dashboard screen.

[0368] Specific behavior: When a user clicks the account activation link and then clicks the "Login button" on the login screen, the server verifies the email address and password combination. If successful, it generates a session ID and redirects the user to the dashboard screen.

[0369] Step 3:

[0370] User: Select the generative AI tool you want to use on the dashboard screen.

[0371] Terminal: Sends the user's selection information to the server.

[0372] Server: Returns the front-end component and configuration information corresponding to the selected generative AI tool to the device.

[0373] Input: User-generated AI tool selection information.

[0374] Output: Front-end components and configuration information sent back to the terminal.

[0375] Specific operation: When a user clicks the "Text Generation AI" button on the dashboard, the device sends the selection information to the server, which then returns the appropriate front-end component to the device based on the selection information received.

[0376] Step 4:

[0377] User: If you select text generation AI, you can enter the "topic of the text you want to generate" and "keywords." You can also set the output format (short text, long text, etc.) and quality parameters.

[0378] Terminal: Temporarily stores the information and configuration parameters entered by the user and sends them to the server in JSON format.

[0379] Input: User-entered information such as text topics, keywords, output format, and quality parameters.

[0380] Output: Temporarily saved data in JSON format.

[0381] Specific operation: When the user clicks the "Submit" button, the device temporarily saves the input information, converts it to JSON format, and sends it to the server.

[0382] Step 5:

[0383] Emotion recognition means: Analyzes user input data and voice and facial expression data obtained during actual user interactions to identify the user's emotions.

[0384] Server: Generates and stores additional parameters based on the output of the emotion recognition means.

[0385] Input: User voice and facial expression data.

[0386] Output: Additional parameters.

[0387] How it works: While the user is entering data, the emotion recognition unit analyzes the user's voice and facial expressions in real time to identify the emotion. The server generates the necessary additional parameters based on the results.

[0388] Step 6:

[0389] Server: Based on the received data and additional configuration parameters, it sends a request to the API of the generative AI tool to execute the generation process.

[0390] Generative AI tool: Creates a product based on specified conditions and sends the results back to the server.

[0391] Input: User configuration and additional parameters.

[0392] Output: The generated artifact.

[0393] Specific operation: The server sends a request to the generation AI tool using the configuration parameters and additional parameters. The generation AI tool creates a product and sends it back to the server.

[0394] Step 7:

[0395] Server: Temporarily stores the generated results and sends the display data to the user's device.

[0396] Terminal: Displays the generated data on a results screen for the user to review and download.

[0397] Input: The generated artifact.

[0398] Output: Display of results and downloadable data.

[0399] Specific operation: The server receives the generated results and temporarily stores them. It then sends the display data to the user's device. The device displays the generated results on the results screen, allowing the user to click the "Confirm" or "Download" button.

[0400] (Application example 2)

[0401] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0402] Conventional generative intelligence tools create products based on user-entered data and setting parameters, but do not take the user's emotions into consideration. As a result, they are unable to provide optimal output tailored to the user's emotional state, and the generated content may not match the user's needs or emotions. There was a need to provide a system that would solve this problem and improve the user experience.

[0403] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for combining and enabling the use of multiple generative intelligent tools provided free of charge or at low cost, a registration and login means, a means for selecting a generative intelligent tool, a data input means for the user to input input data and setting parameters, a means for executing a generation process based on the input data and setting parameters, a means for displaying and downloading the generated product, and an emotion recognition means for recognizing the user's emotions and optimizing the output content according to the emotions. This makes it possible to generate optimal content according to the user's emotions.

[0404] "Multiple generative intelligence tools provided free or at low cost" refers to a group of tools that are accessible to general consumers free of charge or at low cost and have a variety of generative intelligence functions, such as text generation, image generation, and speech generation.

[0405] "Registration and login means" means a means that allows a user to create and authenticate an account by entering information required to access the system (such as name, password, email address, etc.).

[0406] The "means for selecting a generative intelligent tool" is a means for providing an interface or function for a user to select a generative intelligent tool that the user wants to use.

[0407] The "data input means" is a means that provides a function for a user to input input data and setting parameters required to execute a generation process.

[0408] A "means for executing a generative process" is a system or function for running a generative intelligence tool based on user-entered data and configuration parameters to create a specified product.

[0409] "Means for displaying and enabling download of the generated product" refers to means for presenting the generated product to the user and providing a function that allows the user to view and save it.

[0410] "Emotion recognition means" refers to a technology or system that analyzes a user's facial expression, voice, or input text, etc., to recognize their emotion, and has the function of optimizing the content and tone of the generated output based on the recognized emotion.

[0411] This invention relates to a system that combines multiple generative intelligence tools that are available free or at low cost, and also combines emotion recognition means that recognizes user emotions. This system allows even non-engineers to easily use multiple generative intelligence tools (e.g., text generation, image generation, voice generation, etc.) to generate content that corresponds to the user's emotions.

[0412] The entire system consists of the following main components:

[0413] Registration and login methods

[0414] Selection methods for generative intelligence tools

[0415] A data entry means for the user to enter input data and setting parameters

[0416] A means to run the generation process based on input data and configuration parameters

[0417] A means to make the generated artifacts viewable and downloadable

[0418] Emotion recognition means for recognizing user emotions

[0419] A user accesses the system and creates and authenticates an account using the registration and login methods. First, the user accesses the registration screen on their terminal and enters the required information (name, password, email address, etc.). The terminal sends this information to the server, and the server creates a new user record in the database based on the received information. The user then activates their account through a confirmation email sent to the email address provided during registration. Similarly, when logging in, the email address and password entered by the user are verified, and a session ID is issued if successful.

[0420] Next, the user selects the generative intelligence tool he / she wants to use from the dashboard screen, and the terminal transmits the user's selection information to the server, and the server returns the front-end component and setting information corresponding to the selected generative intelligence tool to the terminal.

[0421] The user uses a data input means to input the necessary information depending on the generative intelligence tool they have selected. For example, if they select sentence generation intelligence, they input the topic and keywords of the sentence they want to generate. They also select setting parameters such as the output format (e.g., short sentences, long sentences) and quality parameters. The terminal temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[0422] The emotion recognition means analyzes user input data and voice and facial expression data acquired during actual user interactions to recognize the user's emotions. Based on this recognition result, additional parameters are automatically generated to optimize the output of the generative intelligence tool. For example, if the emotion recognition means recognizes that the user is feeling stressed, adjustments will be made, such as softening the tone of the generated text or making the colors of images more subdued.

[0423] Based on the received data and additional configuration parameters, the server sends a request to the API of the corresponding generative intelligence tool to execute the generation process. The generative intelligence tool (e.g., a sentence generation AI) creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained result and sends data to be displayed on the user's device. The device displays the generated data on the result screen, allowing the user to check and download the product.

[0424] For example, if a user wants to generate a "relaxing image," they log in, select the image generation AI from the dashboard, and enter a "relaxing theme" and "natural scenery." During this time, the emotion recognition means recognizes emotions from the user's voice and facial expressions, and if it detects "stress," for example, an image is generated with a tone and theme based on that emotion. The generated image is sent back to the device from the server, where the user can review it and download it if necessary.

[0425] In this way, a system incorporating emotion recognition means can provide customized products according to the user's emotions and generate more appropriate and effective output. This system provides an interface that can be used intuitively even by non-engineers, and effectively utilizes multiple generative intelligence tools and emotion recognition functions to improve work efficiency.

[0426] Example prompt sentence:

[0427] "I'm so stressed today, I want to see some images that will help me relax."

[0428] "I don't know how to write a business email. I want objective and positive sentences."

[0429] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0430] Step 1:

[0431] A user uses a terminal to access the system through registration and login procedures. The user enters the required information (such as name, password, and email address) and sends it to the server. The server creates a new user record in the database based on the received information and sends a confirmation email. The user receives the confirmation email and activates their account. When logging in, the email address and password entered by the user are verified, and a session ID is issued if successful.

[0432] Input: Name, Password, Email Address

[0433] Output: User record, session ID

[0434] Step 2:

[0435] The user accesses the dashboard screen and selects the generative intelligence tool they want to use. The terminal sends the user's selection information to the server, and the server returns the front-end component and setting information corresponding to the selected generative intelligence tool to the terminal.

[0436] Input: Selection information of the generative intelligence tool

[0437] Output: Front-end components, configuration information

[0438] Step 3:

[0439] The user uses a data input means to input the necessary information depending on the generative intelligence tool they have selected. For example, if they select sentence generation intelligence, they input the topic and keywords of the sentence they want to generate. They also select setting parameters such as the output format and quality parameters. The device temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[0440] Input: Topic, Keywords, Configuration Parameters

[0441] Output: Input data in JSON format

[0442] Step 4:

[0443] The emotion recognition means analyzes user input data and voice and facial expression data acquired during actual user interactions to recognize the user's emotions. Based on this recognition result, additional parameters are automatically generated to optimize the output of the generative intelligence tool. For example, if the emotion recognition means recognizes that the user is feeling stressed, the tone of the generated text may be softened or the colors of the images may be made more subdued.

[0444] Input: User's voice, facial expression data

[0445] Output: Additional parameters

[0446] Step 5:

[0447] Based on the received data and additional configuration parameters, the server sends a request to the API of the corresponding generative intelligence tool to execute the generation process. The generative intelligence tool creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained result and sends the data to be displayed on the user's device.

[0448] Input: Input data, additional parameters

[0449] Output: product

[0450] Step 6:

[0451] The terminal displays the generated data on a results screen, allowing the user to review and download the product.

[0452] Input:Product

[0453] Output: Display of the result screen, download status of the generated product

[0454] For example, if a user wants to generate a "relaxing image," they log in, select the image generation AI from the dashboard, and enter a "relaxing theme" and "natural scenery." During this time, the emotion recognition means recognizes emotions from the user's voice and facial expressions, and if it detects "stress," for example, an image is generated with a tone and theme based on that emotion. The generated image is then sent back from the server to the device, where the user can review it and download it if necessary.

[0455] Example prompt sentence:

[0456] "I'm so stressed today, I want to see some images that will help me relax."

[0457] "I don't know how to write a business email. I want objective and positive sentences."

[0458] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0459] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0460] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0461] [Second embodiment]

[0462] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0463] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0464] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0465] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0466] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0467] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0468] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0469] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0470] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0471] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0472] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0473] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0474] The present invention relates to a system that enables the combination and use of multiple generative AI tools that are offered free or at low cost. This system allows even non-engineers to easily use multiple generative AI tools (e.g., text generation, image generation, speech generation, etc.) to generate output that is useful for business.

[0475] The entire system consists of the following main components: a means for registration and login, a means for selecting a generation artificial intelligence tool, a means for inputting data and setting parameters, a means for executing the generation process, and a means for displaying and downloading the product.

[0476] First, a user accesses the system and creates and authenticates an account using the registration and login methods. Specifically, the user accesses the registration screen on their terminal and enters the required information (name, password, email address, etc.). The terminal sends this information to the server, and the server creates a new user record in the database based on the received information. The user then activates their account through a confirmation email sent to the email address provided during registration. Similarly, when logging in, the email address and password entered by the user are verified, and a session ID is issued if successful.

[0477] Next, the user selects the generative AI tool they want to use from the dashboard screen. The device sends the user's selection information to the server, and the server returns the front-end component and setting information corresponding to the selected generative AI tool to the device.

[0478] The user uses a data input method to input the necessary information depending on the selected generation AI tool. For example, if a text generation AI is selected, the user inputs the topic and keywords of the text to be generated. The user also selects setting parameters such as the output format (e.g., short or long text) and quality parameters. The device temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[0479] Based on the received data and setting parameters, the server sends a request to the API of the corresponding generation AI tool to execute the generation process. The generation AI tool (e.g., text generation AI) creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained results and sends data to be displayed on the user's device. The device displays the generated data on the result screen, allowing the user to check and download the product.

[0480] For example, if a user wants to generate a "product review text," they log in, select the text generation AI from the dashboard, and enter the "product name" and "points they want to include in the review." They then set the output format to "detailed review" and click the generate button after completing the settings. The server calls the generation AI tool with the specified information and generates a detailed review text. The generated text is sent back from the server to the device, where the user can review it and download it if necessary.

[0481] In this way, the entire system provides users with an intuitive and easy-to-use interface, and makes it possible to effectively utilize multiple generative AI tools to generate output that is useful for business. This allows even non-engineers to easily use high-performance generative AI technology and achieve business improvements with reduced financial burden.

[0482] The processing flow will be explained below.

[0483] Step 1:

[0484] The user enters the required information (name, password, email address, etc.) on the registration screen and clicks the Register button.

[0485] Terminal: Sends the entered information to the server in JSON format.

[0486] Step 2:

[0487] The server verifies the received information and creates a new user record in the database.

[0488] Server: Checks if the entered email address is unique and creates a new user record in the database if there are no issues. Sends a success message and a confirmation email to the user.

[0489] Step 3:

[0490] The user clicks the link in the confirmation email to activate their account.

[0491] Server: When the confirmation link is clicked, update the status of the corresponding user record to "valid".

[0492] Step 4:

[0493] The user enters their email address and password on the login screen and clicks the Login button.

[0494] On your device: Send your login information to the server.

[0495] Server: Verifies the received information, and if authentication is successful, generates a session ID and returns it to the terminal.

[0496] Step 5:

[0497] The user selects the generative AI tool (e.g., text generation AI) they want to use from the dashboard screen.

[0498] Terminal: Sends the user's selection information to the server.

[0499] Step 6:

[0500] The server returns to the terminal a front-end component corresponding to the selected generating artificial intelligence tool.

[0501] Server: Sends UI components and initial settings according to the selected tool to the device.

[0502] Step 7:

[0503] Depending on the generation AI tool selected by the user, input the necessary information (e.g., topics and keywords for text generation).

[0504] Terminal: Temporarily saves the entered information and displays a screen for selecting additional configuration parameters (e.g. output format, quality parameters, etc.).

[0505] Step 8:

[0506] The user selects the configuration parameters and clicks the generate button.

[0507] Terminal: Sends input information and configuration parameters to the server in JSON format.

[0508] Step 9:

[0509] Based on the data and parameters received by the server, the corresponding generative AI tool is launched.

[0510] Server: Parses the JSON data and sends a request to the corresponding AI tool API.

[0511] Step 10:

[0512] A generative artificial intelligence tool creates a product based on specified conditions.

[0513] AI tool: Creates text, images, audio, and other products based on the received data and parameters, and sends the results back to the server.

[0514] Step 11:

[0515] The server temporarily stores the results received from the AI ​​tool and sends the data to the user's device for display.

[0516] Server: Sends a response back to the device containing the location of the artifact and metadata.

[0517] Step 12:

[0518] The user checks the products displayed on the results screen.

[0519] Terminal: Display the generated data on the results screen.

[0520] Step 13:

[0521] The user downloads the products as needed.

[0522] On the device: Sends a download request to the server and saves the result in the download folder.

[0523] Step 14:

[0524] The server monitors the user's usage and calculates the charges.

[0525] Server: Records each production request and calculates a monthly fee based on frequency of use and type of production.

[0526] Step 15:

[0527] The server generates billing information and sends it to the user.

[0528] Server: Generates invoices and sends them to the user's registered email address, and stores the invoice information in a database.

[0529] Example 1

[0530] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0531] Currently, many individuals and companies are trying to improve their business efficiency by using generative AI tools. However, these tools are expensive and require advanced technical knowledge to use. This makes it difficult for non-engineers and small and medium-sized enterprises to easily use these technologies. Another issue is that it is difficult to combine multiple generative AI tools and use them efficiently.

[0532] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0533] In this invention, the server includes means for registering and authenticating a user's account, means for returning information corresponding to the generation AI tool selected by the user to the terminal, means for executing the generation process based on input data and setting parameters, and means for displaying and downloading the generated product to the user terminal. This allows even non-engineers to easily use multiple generation AI tools provided free of charge or at low cost, significantly improving work efficiency without complex operations or advanced knowledge.

[0534] "Means of registering and authenticating a user's account" is the process by which a user accesses the system, enters required information such as name, password, and email address, and the server receives this and creates a new user record in the database.

[0535] "Means for returning information corresponding to the generation AI tool selected by the user to the terminal" refers to the process in which the user selects the generation AI tool they wish to use on the dashboard screen, the server receives the selection information, and then sends the corresponding front-end component and setting information to the user's terminal.

[0536] The "means of executing the generation process based on input data and setting parameters" refers to the process in which the server receives the data and setting parameters entered by the user, sends a request to the API of the corresponding generation AI tool to execute the generation process, and the server temporarily stores the generated results.

[0537] "Means for displaying and enabling the generated product to be downloaded to a user terminal" refers to the process by which the server sends the product results returned from the generation AI tool to the user terminal, allowing the user to check and download the product on the result screen.

[0538] A "generative AI tool" is a technology that performs text generation, image generation, voice generation, etc., and is an AI technology that automatically creates products based on data entered by the user.

[0539] To implement the invention, the system includes the following major hardware and software components: The server registers and authenticates the user's account, returns information corresponding to the user's selected AI tool to the terminal, executes the generation process based on the input data and setting parameters, and makes the generated product available for display and download on the user's terminal. The user accesses the system using the terminal and performs various operations.

[0540] Hardware and Software Components

[0541] 1. Server: Registers and authenticates user information, sends requests to the AI ​​generation tool's API, and temporarily stores the generated results. Configuration examples include a Linux-based server and a database management system (MySQL or PostgreSQL).

[0542] 2. Terminal: A device (PC, smartphone, tablet, etc.) that a user operates and displays the user interface using a web browser.

[0543] 3. Generative AI tools: Generative AI tools such as text generation AI, image generation AI, and voice generation AI. They are often provided as APIs and perform automatic generation based on specific generation conditions.

[0544] Processing flow and specific examples

[0545] The system's processing flow is designed so that the server, terminal, and user components function in coordination.

[0546] Account Registration and Verification

[0547] User: Accesses the registration screen on the device and enters information such as name, password, and email address.

[0548] Terminal: Sends user input to the server.

[0549] Server: Stores the received information in a database and sends a confirmation email.

[0550] Users: Click the link in the confirmation email to activate their account.

[0551] User: Enter your email address and password on the login screen.

[0552] Server: Validates the input information and issues a session ID.

[0553] Choosing a Generative AI Tool

[0554] User: Select the generative AI tool you want to use on the dashboard screen.

[0555] Terminal: Sends the user's selection to the server.

[0556] Server: Sends the necessary information for the selected AI tool back to the device.

[0557] Entering Data and Configuration Parameters

[0558] User: Enters the required information into the selected generative AI tool, for example, topics and keywords for text generation.

[0559] Terminal: The entered information and configuration parameters are temporarily saved and sent to the server in JSON format.

[0560] Running the generation process

[0561] Server: Sends requests to the generative AI tool's API based on the received data and configuration parameters.

[0562] Generative AI tool: Creates a product based on specified conditions and returns the results to the server.

[0563] Server: Temporarily stores the generated data and sends it to the device.

[0564] Verify and download the product

[0565] Terminal: Display the results on the results screen.

[0566] User: Review the artifacts and download them if necessary.

[0567] Examples and prompts

[0568] As a concrete example, the steps to generate a "product review text" are shown below.

[0569] 1. User: Log in to the system and select the text generation AI from the dashboard.

[0570] 2. User: Enter the "Product Name" and "Points you want to include in your review."

[0571] 3. User: Set the output format as "Detailed Review" and click the "Generate" button.

[0572] 4. Server: Calls the generative AI tool with the specified information and generates a detailed review text.

[0573] 5. Terminal: Display the generated review text.

[0574] 6. User: After checking, download the review text if necessary.

[0575] Example prompt sentence:

[0576] Product Name: Smartphone XYZ

[0577] Points to include in the review: Battery life, camera performance, price

[0578] Output Formats: A Detailed Review

[0579] Tool used: Text generation AI

[0580] This allows users to intuitively operate the system and easily combine and use a variety of generative AI tools. It is designed so that even non-engineers can obtain highly accurate output quickly and at low cost.

[0581] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0582] Step 1: User Account Registration

[0583] User: Accesses the registration screen on the device and enters the required information, such as name, password, and email address.

[0584] Input: Name, Password, Email Address

[0585] Specific behavior: The user fills in the form in their browser and clicks the "Register" button.

[0586] Terminal: Sends the information entered by the user to the server.

[0587] Input: Information entered by the user

[0588] Specific operation: The input information is temporarily saved and sent to the server via an HTTP request.

[0589] Server: Stores the received information in a database and sends a confirmation email.

[0590] Input: User information received from the device

[0591] Data processing: Save the received information as a new user record in the database

[0592] Output: Send confirmation email

[0593] Specific behavior: The user record is saved in the database and a confirmation email is sent via the mail server.

[0594] Step 2: User Account Verification

[0595] Users: Click the link in the confirmation email they receive to activate their account.

[0596] Input: Link in confirmation email

[0597] Specific action: Click on the confirmation link in your browser.

[0598] Server: Receives the link and updates the corresponding user record to activate the account.

[0599] Input: A request for a verification link from the user

[0600] Data processing: Update the user record status to "Active"

[0601] Output: Activation complete response

[0602] What happens: Updates the user status in the database and displays a confirmation message in the browser.

[0603] Step 3: User Login

[0604] User: Access the login screen on the device and enter your email address and password.

[0605] Input: Email address, Password

[0606] Specific action: Enter your email address and password in the form and click the "Login" button.

[0607] Terminal: Sends the information entered by the user to the server.

[0608] Input: The login information entered by the user

[0609] Specific operation: The input information is temporarily saved and sent to the server via an HTTP request.

[0610] Server: Validates the email address and password and, if successful, issues a session ID.

[0611] Input: Login information received from the device

[0612] Data calculation: Email address and password verification

[0613] Output: Session ID

[0614] Specific operation: User information is compared with the database, and if it matches, a session ID is generated and sent back to the terminal.

[0615] Step 4: Selecting a generative AI tool

[0616] User: Select the generative AI tool you want to use on the dashboard screen.

[0617] Input: Tool selection

[0618] Specific behavior: A user selects a generative AI tool from a drop-down list or button on the dashboard.

[0619] Terminal: Sends the user's selection information to the server.

[0620] Input: Tool selection information

[0621] Specific operation: The selected information is temporarily saved and sent to the server via an HTTP request.

[0622] Server: Returns information corresponding to the selected generation AI tool to the device.

[0623] Input: User selection information

[0624] Data Calculation: Identifying the corresponding front-end component

[0625] Output: Front-end components and configuration information

[0626] Specific behavior: Front-end components and configuration information are returned to the device in HTML or JSON format.

[0627] Step 5: Entering data and configuration parameters

[0628] User: Enter the required information (e.g., topics and keywords) into the selected generative AI tool and set the output format and quality parameters.

[0629] Input: Required information (topics, keywords), output format, quality parameters

[0630] Specific actions: Enter the required information into the form, set the parameters, and click the "Submit" button.

[0631] Terminal: The entered information and configuration parameters are temporarily saved and sent to the server in JSON format.

[0632] Input: User-entered data and configuration parameters

[0633] Specific operation: The data is temporarily saved, converted to JSON format, and sent to the server.

[0634] Step 6: Run the generation process

[0635] Server: Sends requests to the generative AI tool's API based on the received data and configuration parameters.

[0636] Input: Data received from the terminal and configuration parameters

[0637] Data Calculation: Making API Requests

[0638] Specific operation: Generates an API request and sends it to the generative AI tool.

[0639] Generative AI tool: Creates a product based on specified conditions and returns the results to the server.

[0640] Input: API request parameters

[0641] Data transformation: Condition-based generative processes

[0642] Output: Generated result

[0643] Specific operation: Creates a product according to the specified conditions and returns the result to the server.

[0644] Server: Temporarily stores the generated data and sends the generated results to the terminal.

[0645] Input: Generated results from a generative AI tool

[0646] Data processing: Convert to JSON format

[0647] Output: Sends generated results to the terminal

[0648] Specific operation: The generated results are temporarily saved and sent to the terminal in JSON format.

[0649] Step 7: Verify and download the product

[0650] Terminal: Display the results on the results screen.

[0651] Input: Generated result received from the server

[0652] Specific operation: Generates HTML to display the data on the results screen.

[0653] User: Review the artifacts and download them if necessary.

[0654] Input: Displayed product

[0655] Specific operations: Check the generated output and click the "Download" button.

[0656] (Application example 1)

[0657] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0658] Existing online shopping sites often make it difficult for users to obtain detailed information when selecting products, and product reviews and descriptions are often insufficient. Furthermore, image and audio information may be lacking, which can discourage users from purchasing. Furthermore, suggestions for related products are insufficient, which can lead to users missing useful products. Therefore, there is a need for a system that allows users to quickly and easily obtain detailed reviews, images, audio descriptions, and suggestions for related products when selecting products.

[0659] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0660] In this invention, the server is a system that combines and enables the use of multiple generative artificial intelligence tools that are offered free of charge or at low cost, and includes a registration and login means, a generative artificial intelligence tool selection means, a data input means for a user to input input data and setting parameters, a means for executing a generation process based on the input data and setting parameters, a means for displaying and making the generated product available for download, a means including a generative artificial intelligence tool for automatically generating product information reviews, descriptions, images, and related product suggestions, and a user interface means for displaying information generated using the generative artificial intelligence tool to the user, thereby enabling the user to quickly and easily obtain detailed reviews, images, audio descriptions, and related product suggestions when selecting a product.

[0661] "Registration and Login Facility" means the facility by which a User accesses the System and creates and authenticates an Account.

[0662] "Means for selecting generative AI tools" is a function that allows users to select the generative AI tool they want to use.

[0663] The "data input means" is a function that allows the user to input data and setting parameters required for the generation process.

[0664] A "means for executing a generative process" is a function for executing a generative artificial intelligence tool based on input data and configuration parameters.

[0665] "Means for displaying and making the output available for download" refers to a function that allows users to view the generated output and download it if necessary.

[0666] "Generative artificial intelligence tools for automatically generating product information reviews, descriptions, images, and related product suggestions" refers to various generative AI tools used to automatically generate product-related reviews, descriptions, images, and related product suggestions.

[0667] The "user interface means" is an interface for displaying the generated information to the user.

[0668] This invention relates to a system that combines and enables the use of multiple generative AI tools that are provided free or at low cost. When a user selects a product, this system uses the generative AI tools to automatically provide product reviews, descriptions, images, and even suggestions for related products. This allows users to obtain more detailed and attractive product information, aiming to increase their desire to purchase.

[0669] The system is implemented as an application installed on a smartphone, and its specific functions include creating product reviews using text generation AI, generating product images using image generation AI, generating audio product explanations using voice generation AI, and suggesting related products using related product suggestion AI.

[0670] System-wide program overview

[0671] When a user accesses the application, they first create and authenticate an account using the registration and login methods. If this is successful, they can select the AI ​​generation tool they want to use from the dashboard screen. The user enters the required information for the selected AI generation tool and runs the generation process. The generated product is then displayed and the user can download it.

[0672] Hardware and software used

[0673] The system is implemented using the following hardware and software:

[0674] Hardware: Smartphones, servers (cloud servers and on-premise servers)

[0675] software:

[0676] API Server: Hosts the APIs of the provided generative AI tools, specifically built using Django or Flask.

[0677] Database: Stores user information and generated data. Specifically, PostgreSQL or MySQL is used.

[0678] Front-end: A smartphone application developed with React Native or Flutter.

[0679] Backend: Server (developed with Django or Flask)

[0680] Data processing and calculation

[0681] 1. Registration and Login: A user visits a registration screen and enters their name, password, email address, etc. This information is sent to the server, and a new user record is created in the database. Upon login, the server validates the email address and password entered by the user, and if successful, issues a session ID.

[0682] 2. Selecting a generative AI tool and entering data: The user selects a generative AI tool from the dashboard and sends the selection information to the server. The server returns the component corresponding to the selected generative AI tool to the terminal, and the user enters the required information.

[0683] 3. Execution of the generation process: Based on the input data and configuration parameters, the server sends a request to the API of the corresponding generation AI tool to execute the generation process. The generated results are sent back to the server and then displayed on the user's device.

[0684] 4. View and download results: The generated products can be viewed by the user and downloaded if necessary.

[0685] Specific examples

[0686] For example, suppose a user selects "Smartphone X" and enters the keywords "high-resolution camera" and "long battery life." The system uses this information to generate a detailed product review. An example prompt might be, "Generate a review for Smartphone X. The key features are the high-resolution camera and long battery life." The generated review might read, "Smartphone X has an excellent high-resolution camera, making it easy to take beautiful photos. What's more, its long-lasting battery life allows for worry-free use all day long."

[0687] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0688] Step 1:

[0689] A user accesses a smartphone app and creates and authenticates an account using the registration and login methods. The data entered is a name, password, and email address. The input data is sent to the server, which creates a new user record in the database. The user then activates the account using the confirmation email sent to them. Similarly, when logging in, the server verifies the email address and password entered by the user, and if successful, returns a session ID to the device.

[0690] Step 2:

[0691] The user selects the generative AI tool (text generation AI, image generation AI, voice generation AI, etc.) they want to use using the generative AI tool selection means on the dashboard screen. The selection information is sent to the server, and the server returns the front-end component and setting information corresponding to the selected generative AI tool to the terminal.

[0692] Step 3:

[0693] The user inputs the data required for the output they want to generate (e.g., product name, points they want to include in the review) and setting parameters (output format and quality parameters) into the selected generation AI tool. The input data and setting parameters are converted to JSON format on the device and sent to the server.

[0694] Step 4:

[0695] The server sends a request to the API of the corresponding AI tool based on the received data and configuration parameters. The server temporarily stores the results returned by the AI ​​tool. The results may include review text, generated product images, audio descriptions, etc.

[0696] Step 5:

[0697] The server sends the generated information back to the device, where it is displayed on a confirmation screen. The user can then review the generated information and download it as needed. Specifically, the system displays product reviews, images, and audio descriptions generated using the generative AI tool.

[0698] Step 6:

[0699] The terminal provides a user interface for displaying the product to the user, who can then download it, regenerate it, or see suggestions for related products.

[0700] Specifically, if a user wants to generate a detailed review of "Smartphone X," they input the prompt, "Generate a review of Smartphone X. Key features include a high-resolution camera and a long battery life." The system then invokes a generation AI tool based on the input data, which generates a detailed review, related images, and audio description, and provides them to the user.

[0701] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0702] This invention relates to a system that combines multiple generative AI tools that are available free or at low cost, and an emotion engine that recognizes user emotions. This system allows even non-engineers to easily use multiple generative AI tools (e.g., text generation, image generation, voice generation, etc.) to generate output that corresponds to the user's emotions.

[0703] The entire system consists of the following main components:

[0704] Registration and login methods

[0705] Selection methods for generative artificial intelligence tools

[0706] A data entry means for the user to enter input data and setting parameters

[0707] A means to run the generation process based on input data and configuration parameters

[0708] A means to make the generated artifacts viewable and downloadable

[0709] Emotion engine that recognizes user emotions

[0710] First, a user accesses the system and creates and authenticates an account using the registration and login methods. Specifically, the user accesses the registration screen on their terminal and enters the required information (name, password, email address, etc.). The terminal sends this information to the server, and the server creates a new user record in the database based on the received information. The user then activates their account through a confirmation email sent to the email address provided during registration. Similarly, when logging in, the email address and password entered by the user are verified, and a session ID is issued if successful.

[0711] Next, the user selects the generative AI tool they want to use from the dashboard screen. The device sends the user's selection information to the server, and the server returns the front-end component and setting information corresponding to the selected generative AI tool to the device.

[0712] The user uses a data input method to input the necessary information depending on the selected generation AI tool. For example, if a text generation AI is selected, the user inputs the topic and keywords of the text to be generated. The user also selects setting parameters such as the output format (e.g., short or long text) and quality parameters. The device temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[0713] The emotion engine analyzes user input data and voice and facial expression data obtained during actual user interactions to recognize the user's emotions. Based on this recognition result, it automatically generates additional parameters to optimize the output of the generative AI tool. For example, if the emotion engine recognizes that the user is feeling stressed, it will adjust the tone of the generated text or make the colors of images more subdued.

[0714] Based on the received data and additional configuration parameters, the server sends a request to the API of the corresponding generative AI tool to execute the generation process. The generative AI tool (e.g., text generation AI) creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained result and sends data to be displayed on the user's device. The device displays the generated data on the result screen, allowing the user to check and download the product.

[0715] For example, if a user wants to generate a "product review," they log in, select the text generation AI from the dashboard, and enter the "product name" and "points they want to include in the review." During this time, the emotion engine recognizes emotions from the user's voice and facial expressions, and if it detects, for example, "positive emotion," it generates a review text in a tone and style based on that emotion. The generated review text is sent back from the server to the device, where the user can review it and download it if necessary.

[0716] In this way, a system with an embedded emotion engine can provide customized results based on the user's emotions, enabling more appropriate and effective output. The system provides an interface that is intuitive even for non-engineers, and effectively utilizes multiple generative AI tools and emotion recognition functions to improve work efficiency.

[0717] The processing flow will be explained below.

[0718] Step 1:

[0719] The user enters the required information (name, password, email address, etc.) on the registration screen and clicks the Register button.

[0720] Terminal: Sends the entered information to the server in JSON format.

[0721] Step 2:

[0722] The server verifies the received information and creates a new user record in the database.

[0723] Server: Checks if the entered email address is unique and creates a new user record in the database if there are no issues. Sends a success message and a confirmation email to the user.

[0724] Step 3:

[0725] The user clicks the link in the confirmation email to activate their account.

[0726] Server: When the confirmation link is clicked, update the status of the corresponding user record to "valid".

[0727] Step 4:

[0728] The user enters their email address and password on the login screen and clicks the Login button.

[0729] On your device: Send your login information to the server.

[0730] Server: Verifies the received information, and if authentication is successful, generates a session ID and returns it to the terminal.

[0731] Step 5:

[0732] The user selects the generative AI tool (e.g., text generation AI) they want to use from the dashboard screen.

[0733] Terminal: Sends the user's selection information to the server.

[0734] Step 6:

[0735] The server returns to the terminal a front-end component and configuration information corresponding to the selected generating artificial intelligence tool.

[0736] Server: Sends UI components and initial settings according to the selected tool to the device.

[0737] Step 7:

[0738] Depending on the generation AI tool selected by the user, input the necessary information (e.g., topics and keywords for text generation).

[0739] Terminal: The input information is temporarily stored, and the emotion engine analyzes the user's input data as well as the voice and facial expression data obtained during actual user interaction.

[0740] Step 8:

[0741] The emotion engine recognizes the user's emotions and automatically generates additional setting parameters based on the results.

[0742] Emotion engine: Analyzes emotion recognition results and makes appropriate adjustments to reflect them in the output.

[0743] Step 9:

[0744] The user confirms the configuration parameters and clicks the generate button.

[0745] Terminal: Sends input information and automatically generated configuration parameters to the server in JSON format.

[0746] Step 10:

[0747] Based on the data and parameters received by the server, the corresponding generative AI tool is launched.

[0748] Server: Parses the JSON data and sends a request to the corresponding AI tool API.

[0749] Step 11:

[0750] A generative artificial intelligence tool creates a product based on specified conditions.

[0751] AI tool: Creates text, images, audio, and other products based on the received data and parameters, and sends the results back to the server.

[0752] Step 12:

[0753] The server temporarily stores the results received from the AI ​​tool and sends the data to the user's device for display.

[0754] Server: Sends a response back to the device containing the location of the artifact and metadata.

[0755] Step 13:

[0756] The user checks the products displayed on the results screen.

[0757] Terminal: Display the generated data on the results screen.

[0758] Step 14:

[0759] The user downloads the products as needed.

[0760] On the device: Sends a download request to the server and saves the result in the download folder.

[0761] Step 15:

[0762] The server monitors the user's usage and calculates the charges.

[0763] Server: Records each production request and calculates a monthly fee based on frequency of use and type of production.

[0764] Step 16:

[0765] The server generates billing information and sends it to the user.

[0766] Server: Generates invoices and sends them to the user's registered email address, and stores the invoice information in a database.

[0767] Example 2

[0768] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0769] While systems exist for effectively utilizing free or low-cost generative AI tools, they struggle to provide products that respond to user emotions. Furthermore, they lack the functionality to provide an intuitive interface for users and optimize the quality of products based on user emotions. Therefore, a system that effectively combines multiple generative AI tools while taking user emotions into account is needed.

[0770] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0771] In this invention, the server includes a registration and login means, a generation artificial intelligence tool selection means, a data input means, an emotion recognition means, an additional parameter generation means, a generation process execution means, and a display and download means, which enable the server to identify a user's emotion and provide a product based thereon.

[0772] "Registration and Login Facility" means the facility by which a User accesses the System and creates and authenticates his / her account.

[0773] The "means for selecting a generating AI tool" is a function that provides an interface for a user to select the tool that the user wants to use from among a plurality of generating AI tools.

[0774] "Data input means" is a function that provides an interface for inputting setting parameters and input data of information generated by a user into the system.

[0775] "Emotion recognition means" is a technology for analyzing the user's voice and facial expression data and identifying the user's emotions.

[0776] The "additional parameter generation means" is a function that generates parameters for optimizing the quality and characteristics of the product based on the emotion data acquired by the emotion recognition means.

[0777] The "generative process execution means" is a function that uses a generative artificial intelligence tool to create a product based on data and setting parameters input by the user.

[0778] The "display and download means" is a function that displays the generated product on the user terminal and allows the user to download it.

[0779] MODE FOR CARRYING OUT THE INVENTION

[0780] This invention relates to a system that combines multiple generative AI tools that are available free or at low cost, and an emotion engine that recognizes user emotions. This system allows even non-engineers to easily use multiple generative AI tools (e.g., text generation, image generation, voice generation, etc.) to generate output that corresponds to the user's emotions.

[0781] The entire system consists of the following main components:

[0782] Registration and login methods

[0783] Selection methods for generative artificial intelligence tools

[0784] A data entry means for the user to enter input data and setting parameters

[0785] Emotion recognition means for identifying user emotions

[0786] A means of generating additional parameters based on the output of the emotion recognition means

[0787] A means to run the generation process based on input data and configuration parameters

[0788] A means to make the generated artifacts viewable and downloadable

[0789] First, a user accesses the system and creates and authenticates an account using the registration and login methods. Specifically, the user accesses the registration screen on their device and enters the required information (name, password, email address, etc.). The device sends this information to the server, which then creates a new user record in the database based on the received information. The user then activates their account through a confirmation email sent to the email address provided during registration.

[0790] Next, the user verifies the entered email address and password to log in. If successful, the server issues a session ID and redirects the user to the dashboard screen. From the dashboard screen, the user selects the generative AI tool they want to use. The device sends the user's selection information to the server, and the server returns the front-end component and configuration information corresponding to the selected generative AI tool to the device.

[0791] The user uses a data input method to input the necessary information depending on the selected generation AI tool. For example, if a text generation AI is selected, the user inputs the topic and keywords of the text to be generated. The user also selects setting parameters such as the output format (e.g., short or long text) and quality parameters. The device temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[0792] The emotion recognition means analyzes user input data and voice and facial expression data acquired during actual user interactions to identify the user's emotions. Based on this recognition result, additional parameters are automatically generated to optimize the output of the emotion recognition means. For example, if the emotion recognition means recognizes that the user is feeling stressed, adjustments are made such as softening the tone of the generated text or calming the colors of images.

[0793] Based on the received data and additional configuration parameters, the server sends a request to the API of the corresponding generative AI tool to execute the generation process. The generative AI tool (e.g., text generation AI) creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained result and sends data to be displayed on the user's device. The device displays the generated data on the result screen, allowing the user to check and download the product.

[0794] As a specific example, if a user wants to generate a "product review text," they log in, select the text generation AI from the dashboard, and enter the "product name" and "points they want to include in the review." Meanwhile, the emotion recognition means recognizes emotions from the user's voice and facial expressions, and if it detects, for example, "positive emotion," the review text is generated in a tone and style based on that emotion. The generated review text is sent back from the server to the device, where the user can review it and download it if necessary.

[0795] An example prompt might be, "Please generate a product review. The product name is a 'high-performance smartphone', and the points you would like to include in your review are battery life, camera quality, and aesthetics."

[0796] In this way, a system incorporating emotion recognition means can provide customized products according to the user's emotions, enabling the generation of more appropriate and effective output. This system provides an interface that is intuitive even for non-engineers, and effectively utilizes multiple generative AI tools and emotion recognition functions to improve work efficiency.

[0797] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0798] Step 1:

[0799] User: Accesses the system and enters information such as name, password, and email address on the registration screen. The entered information is sent to the server via the terminal.

[0800] Server: Creates a new user record in the database based on the received information. The server sends a confirmation email to the user's email address.

[0801] Input: Information that a user enters, such as a name, password, or email address.

[0802] Output: A new user record is created in the database and a confirmation email is sent.

[0803] Specific operation: When the user clicks the "Submit" button, the device sends the input information to the server, which receives the information, creates a new record, and sends a confirmation email.

[0804] Step 2:

[0805] User: Open the confirmation email sent to your email address, click the account activation link, and then enter your email address and password on the login screen to log in.

[0806] Server: Validates the login information, and if successful, issues a session ID and redirects the user to the dashboard.

[0807] Enter your email address and password.

[0808] Output: Issue a session ID and transition to the dashboard screen.

[0809] Specific behavior: When a user clicks the account activation link and then clicks the "Login button" on the login screen, the server verifies the email address and password combination. If successful, it generates a session ID and redirects the user to the dashboard screen.

[0810] Step 3:

[0811] User: Select the generative AI tool you want to use on the dashboard screen.

[0812] Terminal: Sends the user's selection information to the server.

[0813] Server: Returns the front-end component and configuration information corresponding to the selected generative AI tool to the device.

[0814] Input: User-generated AI tool selection information.

[0815] Output: Front-end components and configuration information sent back to the terminal.

[0816] Specific operation: When a user clicks the "Text Generation AI" button on the dashboard, the device sends the selection information to the server, which then returns the appropriate front-end component to the device based on the selection information received.

[0817] Step 4:

[0818] User: If you select text generation AI, you can enter the "topic of the text you want to generate" and "keywords." You can also set the output format (short text, long text, etc.) and quality parameters.

[0819] Terminal: Temporarily stores the information and configuration parameters entered by the user and sends them to the server in JSON format.

[0820] Input: User-entered information such as text topics, keywords, output format, and quality parameters.

[0821] Output: Temporarily saved data in JSON format.

[0822] Specific operation: When the user clicks the "Submit" button, the device temporarily saves the input information, converts it to JSON format, and sends it to the server.

[0823] Step 5:

[0824] Emotion recognition means: Analyzes user input data and voice and facial expression data obtained during actual user interactions to identify the user's emotions.

[0825] Server: Generates and stores additional parameters based on the output of the emotion recognition means.

[0826] Input: User voice and facial expression data.

[0827] Output: Additional parameters.

[0828] How it works: While the user is entering data, the emotion recognition unit analyzes the user's voice and facial expressions in real time to identify the emotion. The server generates the necessary additional parameters based on the results.

[0829] Step 6:

[0830] Server: Based on the received data and additional configuration parameters, it sends a request to the API of the generative AI tool to execute the generation process.

[0831] Generative AI tool: Creates a product based on specified conditions and sends the results back to the server.

[0832] Input: User configuration and additional parameters.

[0833] Output: The generated artifact.

[0834] Specific operation: The server sends a request to the generation AI tool using the configuration parameters and additional parameters. The generation AI tool creates a product and sends it back to the server.

[0835] Step 7:

[0836] Server: Temporarily stores the generated results and sends the display data to the user's device.

[0837] Terminal: Displays the generated data on a results screen for the user to review and download.

[0838] Input: The generated artifact.

[0839] Output: Display of results and downloadable data.

[0840] Specific operation: The server receives the generated results and temporarily stores them. It then sends the display data to the user's device. The device displays the generated results on the results screen, allowing the user to click the "Confirm" or "Download" button.

[0841] (Application example 2)

[0842] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0843] Conventional generative intelligence tools create products based on user-entered data and setting parameters, but do not take the user's emotions into consideration. As a result, they are unable to provide optimal output tailored to the user's emotional state, and the generated content may not match the user's needs or emotions. There was a need to provide a system that would solve this problem and improve the user experience.

[0844] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for combining and enabling the use of multiple generative intelligent tools provided free of charge or at low cost, a registration and login means, a means for selecting a generative intelligent tool, a data input means for the user to input input data and setting parameters, a means for executing a generation process based on the input data and setting parameters, a means for displaying and downloading the generated product, and an emotion recognition means for recognizing the user's emotions and optimizing the output content according to the emotions. This makes it possible to generate optimal content according to the user's emotions.

[0845] "Multiple generative intelligence tools provided free or at low cost" refers to a group of tools that are accessible to general consumers free of charge or at low cost and have a variety of generative intelligence functions, such as text generation, image generation, and speech generation.

[0846] "Registration and login means" means a means that allows a user to create and authenticate an account by entering information required to access the system (such as name, password, email address, etc.).

[0847] The "means for selecting a generative intelligent tool" is a means for providing an interface or function for a user to select a generative intelligent tool that the user wants to use.

[0848] The "data input means" is a means that provides a function for a user to input input data and setting parameters required to execute a generation process.

[0849] A "means for executing a generative process" is a system or function for running a generative intelligence tool based on user-entered data and configuration parameters to create a specified product.

[0850] "Means for displaying and enabling download of the generated product" refers to means for presenting the generated product to the user and providing a function that allows the user to view and save it.

[0851] "Emotion recognition means" refers to a technology or system that analyzes a user's facial expression, voice, or input text, etc., to recognize their emotion, and has the function of optimizing the content and tone of the generated output based on the recognized emotion.

[0852] This invention relates to a system that combines multiple generative intelligence tools that are available free or at low cost, and also combines emotion recognition means that recognizes user emotions. This system allows even non-engineers to easily use multiple generative intelligence tools (e.g., text generation, image generation, voice generation, etc.) to generate content that corresponds to the user's emotions.

[0853] The entire system consists of the following main components:

[0854] Registration and login methods

[0855] Selection methods for generative intelligence tools

[0856] A data entry means for the user to enter input data and setting parameters

[0857] A means to run the generation process based on input data and configuration parameters

[0858] A means to make the generated artifacts viewable and downloadable

[0859] Emotion recognition means for recognizing user emotions

[0860] A user accesses the system and creates and authenticates an account using the registration and login methods. First, the user accesses the registration screen on their terminal and enters the required information (name, password, email address, etc.). The terminal sends this information to the server, and the server creates a new user record in the database based on the received information. The user then activates their account through a confirmation email sent to the email address provided during registration. Similarly, when logging in, the email address and password entered by the user are verified, and a session ID is issued if successful.

[0861] Next, the user selects the generative intelligence tool he / she wants to use from the dashboard screen, and the terminal transmits the user's selection information to the server, and the server returns the front-end component and setting information corresponding to the selected generative intelligence tool to the terminal.

[0862] The user uses a data input means to input the necessary information depending on the generative intelligence tool they have selected. For example, if they select sentence generation intelligence, they input the topic and keywords of the sentence they want to generate. They also select setting parameters such as the output format (e.g., short sentences, long sentences) and quality parameters. The terminal temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[0863] The emotion recognition means analyzes user input data and voice and facial expression data acquired during actual user interactions to recognize the user's emotions. Based on this recognition result, additional parameters are automatically generated to optimize the output of the generative intelligence tool. For example, if the emotion recognition means recognizes that the user is feeling stressed, adjustments will be made, such as softening the tone of the generated text or making the colors of images more subdued.

[0864] Based on the received data and additional configuration parameters, the server sends a request to the API of the corresponding generative intelligence tool to execute the generation process. The generative intelligence tool (e.g., a sentence generation AI) creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained result and sends data to be displayed on the user's device. The device displays the generated data on the result screen, allowing the user to check and download the product.

[0865] For example, if a user wants to generate a "relaxing image," they log in, select the image generation AI from the dashboard, and enter a "relaxing theme" and "natural scenery." During this time, the emotion recognition means recognizes emotions from the user's voice and facial expressions, and if it detects "stress," for example, an image is generated with a tone and theme based on that emotion. The generated image is sent back to the device from the server, where the user can review it and download it if necessary.

[0866] In this way, a system incorporating emotion recognition means can provide customized products according to the user's emotions and generate more appropriate and effective output. This system provides an interface that can be used intuitively even by non-engineers, and effectively utilizes multiple generative intelligence tools and emotion recognition functions to improve work efficiency.

[0867] Example prompt sentence:

[0868] "I'm so stressed today, I want to see some images that will help me relax."

[0869] "I don't know how to write a business email. I want objective and positive sentences."

[0870] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0871] Step 1:

[0872] A user uses a terminal to access the system through registration and login procedures. The user enters the required information (such as name, password, and email address) and sends it to the server. The server creates a new user record in the database based on the received information and sends a confirmation email. The user receives the confirmation email and activates their account. When logging in, the email address and password entered by the user are verified, and a session ID is issued if successful.

[0873] Input: Name, Password, Email Address

[0874] Output: User record, session ID

[0875] Step 2:

[0876] The user accesses the dashboard screen and selects the generative intelligence tool they want to use. The terminal sends the user's selection information to the server, and the server returns the front-end component and setting information corresponding to the selected generative intelligence tool to the terminal.

[0877] Input: Selection information of the generative intelligence tool

[0878] Output: Front-end components, configuration information

[0879] Step 3:

[0880] The user uses a data input means to input the necessary information depending on the generative intelligence tool they have selected. For example, if they select sentence generation intelligence, they input the topic and keywords of the sentence they want to generate. They also select setting parameters such as the output format and quality parameters. The device temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[0881] Input: Topic, Keywords, Configuration Parameters

[0882] Output: Input data in JSON format

[0883] Step 4:

[0884] The emotion recognition means analyzes user input data and voice and facial expression data acquired during actual user interactions to recognize the user's emotions. Based on this recognition result, additional parameters are automatically generated to optimize the output of the generative intelligence tool. For example, if the emotion recognition means recognizes that the user is feeling stressed, the tone of the generated text may be softened or the colors of the images may be made more subdued.

[0885] Input: User's voice, facial expression data

[0886] Output: Additional parameters

[0887] Step 5:

[0888] Based on the received data and additional configuration parameters, the server sends a request to the API of the corresponding generative intelligence tool to execute the generation process. The generative intelligence tool creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained result and sends the data to be displayed on the user's device.

[0889] Input: Input data, additional parameters

[0890] Output: product

[0891] Step 6:

[0892] The terminal displays the generated data on a results screen, allowing the user to review and download the product.

[0893] Input:Product

[0894] Output: Display of the result screen, download status of the generated product

[0895] For example, if a user wants to generate a "relaxing image," they log in, select the image generation AI from the dashboard, and enter a "relaxing theme" and "natural scenery." During this time, the emotion recognition means recognizes emotions from the user's voice and facial expressions, and if it detects "stress," for example, an image is generated with a tone and theme based on that emotion. The generated image is then sent back from the server to the device, where the user can review it and download it if necessary.

[0896] Example prompt sentence:

[0897] "I'm so stressed today, I want to see some images that will help me relax."

[0898] "I don't know how to write a business email. I want objective and positive sentences."

[0899] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0900] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0901] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0902] [Third embodiment]

[0903] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0904] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0905] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0906] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0907] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0908] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0909] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0910] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0911] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0912] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0913] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0914] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0915] The present invention relates to a system that enables the combination and use of multiple generative AI tools that are offered free or at low cost. This system allows even non-engineers to easily use multiple generative AI tools (e.g., text generation, image generation, speech generation, etc.) to generate output that is useful for business.

[0916] The entire system consists of the following main components: a means for registration and login, a means for selecting a generation artificial intelligence tool, a means for inputting data and setting parameters, a means for executing the generation process, and a means for displaying and downloading the product.

[0917] First, a user accesses the system and creates and authenticates an account using the registration and login methods. Specifically, the user accesses the registration screen on their terminal and enters the required information (name, password, email address, etc.). The terminal sends this information to the server, and the server creates a new user record in the database based on the received information. The user then activates their account through a confirmation email sent to the email address provided during registration. Similarly, when logging in, the email address and password entered by the user are verified, and a session ID is issued if successful.

[0918] Next, the user selects the generative AI tool they want to use from the dashboard screen. The device sends the user's selection information to the server, and the server returns the front-end component and setting information corresponding to the selected generative AI tool to the device.

[0919] The user uses a data input method to input the necessary information depending on the selected generation AI tool. For example, if a text generation AI is selected, the user inputs the topic and keywords of the text to be generated. The user also selects setting parameters such as the output format (e.g., short or long text) and quality parameters. The device temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[0920] Based on the received data and setting parameters, the server sends a request to the API of the corresponding generation AI tool to execute the generation process. The generation AI tool (e.g., text generation AI) creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained results and sends data to be displayed on the user's device. The device displays the generated data on the result screen, allowing the user to check and download the product.

[0921] For example, if a user wants to generate a "product review text," they log in, select the text generation AI from the dashboard, and enter the "product name" and "points they want to include in the review." They then set the output format to "detailed review" and click the generate button after completing the settings. The server calls the generation AI tool with the specified information and generates a detailed review text. The generated text is sent back from the server to the device, where the user can review it and download it if necessary.

[0922] In this way, the entire system provides users with an intuitive and easy-to-use interface, and makes it possible to effectively utilize multiple generative AI tools to generate output that is useful for business. This allows even non-engineers to easily use high-performance generative AI technology and achieve business improvements with reduced financial burden.

[0923] The processing flow will be explained below.

[0924] Step 1:

[0925] The user enters the required information (name, password, email address, etc.) on the registration screen and clicks the Register button.

[0926] Terminal: Sends the entered information to the server in JSON format.

[0927] Step 2:

[0928] The server verifies the received information and creates a new user record in the database.

[0929] Server: Checks if the entered email address is unique and creates a new user record in the database if there are no issues. Sends a success message and a confirmation email to the user.

[0930] Step 3:

[0931] The user clicks the link in the confirmation email to activate their account.

[0932] Server: When the confirmation link is clicked, update the status of the corresponding user record to "valid".

[0933] Step 4:

[0934] The user enters their email address and password on the login screen and clicks the Login button.

[0935] On your device: Send your login information to the server.

[0936] Server: Verifies the received information, and if authentication is successful, generates a session ID and returns it to the terminal.

[0937] Step 5:

[0938] The user selects the generative AI tool (e.g., text generation AI) they want to use from the dashboard screen.

[0939] Terminal: Sends the user's selection information to the server.

[0940] Step 6:

[0941] The server returns to the terminal a front-end component corresponding to the selected generating artificial intelligence tool.

[0942] Server: Sends UI components and initial settings according to the selected tool to the device.

[0943] Step 7:

[0944] Depending on the generation AI tool selected by the user, input the necessary information (e.g., topics and keywords for text generation).

[0945] Terminal: Temporarily saves the entered information and displays a screen for selecting additional configuration parameters (e.g. output format, quality parameters, etc.).

[0946] Step 8:

[0947] The user selects the configuration parameters and clicks the generate button.

[0948] Terminal: Sends input information and configuration parameters to the server in JSON format.

[0949] Step 9:

[0950] Based on the data and parameters received by the server, the corresponding generative AI tool is launched.

[0951] Server: Parses the JSON data and sends a request to the corresponding AI tool API.

[0952] Step 10:

[0953] A generative artificial intelligence tool creates a product based on specified conditions.

[0954] AI tool: Creates text, images, audio, and other products based on the received data and parameters, and sends the results back to the server.

[0955] Step 11:

[0956] The server temporarily stores the results received from the AI ​​tool and sends the data to the user's device for display.

[0957] Server: Sends a response back to the device containing the location of the artifact and metadata.

[0958] Step 12:

[0959] The user checks the products displayed on the results screen.

[0960] Terminal: Display the generated data on the results screen.

[0961] Step 13:

[0962] The user downloads the products as needed.

[0963] On the device: Sends a download request to the server and saves the result in the download folder.

[0964] Step 14:

[0965] The server monitors the user's usage and calculates the charges.

[0966] Server: Records each production request and calculates a monthly fee based on frequency of use and type of production.

[0967] Step 15:

[0968] The server generates billing information and sends it to the user.

[0969] Server: Generates invoices and sends them to the user's registered email address, and stores the invoice information in a database.

[0970] Example 1

[0971] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0972] Currently, many individuals and companies are trying to improve their business efficiency by using generative AI tools. However, these tools are expensive and require advanced technical knowledge to use. This makes it difficult for non-engineers and small and medium-sized enterprises to easily use these technologies. Another issue is that it is difficult to combine multiple generative AI tools and use them efficiently.

[0973] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0974] In this invention, the server includes means for registering and authenticating a user's account, means for returning information corresponding to the generation AI tool selected by the user to the terminal, means for executing the generation process based on input data and setting parameters, and means for displaying and downloading the generated product to the user terminal. This allows even non-engineers to easily use multiple generation AI tools provided free of charge or at low cost, significantly improving work efficiency without complex operations or advanced knowledge.

[0975] "Means of registering and authenticating a user's account" is the process by which a user accesses the system, enters required information such as name, password, and email address, and the server receives this and creates a new user record in the database.

[0976] "Means for returning information corresponding to the generation AI tool selected by the user to the terminal" refers to the process in which the user selects the generation AI tool they wish to use on the dashboard screen, the server receives the selection information, and then sends the corresponding front-end component and setting information to the user's terminal.

[0977] The "means of executing the generation process based on input data and setting parameters" refers to the process in which the server receives the data and setting parameters entered by the user, sends a request to the API of the corresponding generation AI tool to execute the generation process, and the server temporarily stores the generated results.

[0978] "Means for displaying and enabling the generated product to be downloaded to a user terminal" refers to the process by which the server sends the product results returned from the generation AI tool to the user terminal, allowing the user to check and download the product on the result screen.

[0979] A "generative AI tool" is a technology that performs text generation, image generation, voice generation, etc., and is an AI technology that automatically creates products based on data entered by the user.

[0980] To implement the invention, the system includes the following major hardware and software components: The server registers and authenticates the user's account, returns information corresponding to the user's selected AI tool to the terminal, executes the generation process based on the input data and setting parameters, and makes the generated product available for display and download on the user's terminal. The user accesses the system using the terminal and performs various operations.

[0981] Hardware and Software Components

[0982] 1. Server: Registers and authenticates user information, sends requests to the AI ​​generation tool's API, and temporarily stores the generated results. Configuration examples include a Linux-based server and a database management system (MySQL or PostgreSQL).

[0983] 2. Terminal: A device (PC, smartphone, tablet, etc.) that a user operates and displays the user interface using a web browser.

[0984] 3. Generative AI tools: Generative AI tools such as text generation AI, image generation AI, and voice generation AI. They are often provided as APIs and perform automatic generation based on specific generation conditions.

[0985] Processing flow and specific examples

[0986] The system's processing flow is designed so that the server, terminal, and user components function in coordination.

[0987] Account Registration and Verification

[0988] User: Accesses the registration screen on the device and enters information such as name, password, and email address.

[0989] Terminal: Sends user input to the server.

[0990] Server: Stores the received information in a database and sends a confirmation email.

[0991] Users: Click the link in the confirmation email to activate their account.

[0992] User: Enter your email address and password on the login screen.

[0993] Server: Validates the input information and issues a session ID.

[0994] Choosing a Generative AI Tool

[0995] User: Select the generative AI tool you want to use on the dashboard screen.

[0996] Terminal: Sends the user's selection to the server.

[0997] Server: Sends the necessary information for the selected AI tool back to the device.

[0998] Entering Data and Configuration Parameters

[0999] User: Enters the required information into the selected generative AI tool, for example, topics and keywords for text generation.

[1000] Terminal: The entered information and configuration parameters are temporarily saved and sent to the server in JSON format.

[1001] Running the generation process

[1002] Server: Sends requests to the generative AI tool's API based on the received data and configuration parameters.

[1003] Generative AI tool: Creates a product based on specified conditions and returns the results to the server.

[1004] Server: Temporarily stores the generated data and sends it to the device.

[1005] Verify and download the product

[1006] Terminal: Display the results on the results screen.

[1007] User: Review the artifacts and download them if necessary.

[1008] Examples and prompts

[1009] As a concrete example, the steps to generate a "product review text" are shown below.

[1010] 1. User: Log in to the system and select the text generation AI from the dashboard.

[1011] 2. User: Enter the "Product Name" and "Points you want to include in your review."

[1012] 3. User: Set the output format as "Detailed Review" and click the "Generate" button.

[1013] 4. Server: Calls the generative AI tool with the specified information and generates a detailed review text.

[1014] 5. Terminal: Display the generated review text.

[1015] 6. User: After checking, download the review text if necessary.

[1016] Example prompt sentence:

[1017] Product Name: Smartphone XYZ

[1018] Points to include in the review: Battery life, camera performance, price

[1019] Output Formats: A Detailed Review

[1020] Tool used: Text generation AI

[1021] This allows users to intuitively operate the system and easily combine and use a variety of generative AI tools. It is designed so that even non-engineers can obtain highly accurate output quickly and at low cost.

[1022] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1023] Step 1: User Account Registration

[1024] User: Accesses the registration screen on the device and enters the required information, such as name, password, and email address.

[1025] Input: Name, Password, Email Address

[1026] Specific behavior: The user fills in the form in their browser and clicks the "Register" button.

[1027] Terminal: Sends the information entered by the user to the server.

[1028] Input: Information entered by the user

[1029] Specific operation: The input information is temporarily saved and sent to the server via an HTTP request.

[1030] Server: Stores the received information in a database and sends a confirmation email.

[1031] Input: User information received from the device

[1032] Data processing: Save the received information as a new user record in the database

[1033] Output: Send confirmation email

[1034] Specific behavior: The user record is saved in the database and a confirmation email is sent via the mail server.

[1035] Step 2: User Account Verification

[1036] Users: Click the link in the confirmation email they receive to activate their account.

[1037] Input: Link in confirmation email

[1038] Specific action: Click on the confirmation link in your browser.

[1039] Server: Receives the link and updates the corresponding user record to activate the account.

[1040] Input: A request for a verification link from the user

[1041] Data processing: Update the user record status to "Active"

[1042] Output: Activation complete response

[1043] What happens: Updates the user status in the database and displays a confirmation message in the browser.

[1044] Step 3: User Login

[1045] User: Access the login screen on the device and enter your email address and password.

[1046] Input: Email address, Password

[1047] Specific action: Enter your email address and password in the form and click the "Login" button.

[1048] Terminal: Sends the information entered by the user to the server.

[1049] Input: The login information entered by the user

[1050] Specific operation: The input information is temporarily saved and sent to the server via an HTTP request.

[1051] Server: Validates the email address and password and, if successful, issues a session ID.

[1052] Input: Login information received from the device

[1053] Data calculation: Email address and password verification

[1054] Output: Session ID

[1055] Specific operation: User information is compared with the database, and if it matches, a session ID is generated and sent back to the terminal.

[1056] Step 4: Selecting a generative AI tool

[1057] User: Select the generative AI tool you want to use on the dashboard screen.

[1058] Input: Tool selection

[1059] Specific behavior: A user selects a generative AI tool from a drop-down list or button on the dashboard.

[1060] Terminal: Sends the user's selection information to the server.

[1061] Input: Tool selection information

[1062] Specific operation: The selected information is temporarily saved and sent to the server via an HTTP request.

[1063] Server: Returns information corresponding to the selected generation AI tool to the device.

[1064] Input: User selection information

[1065] Data Calculation: Identifying the corresponding front-end component

[1066] Output: Front-end components and configuration information

[1067] Specific behavior: Front-end components and configuration information are returned to the device in HTML or JSON format.

[1068] Step 5: Entering data and configuration parameters

[1069] User: Enter the required information (e.g., topics and keywords) into the selected generative AI tool and set the output format and quality parameters.

[1070] Input: Required information (topics, keywords), output format, quality parameters

[1071] Specific actions: Enter the required information into the form, set the parameters, and click the "Submit" button.

[1072] Terminal: The entered information and configuration parameters are temporarily saved and sent to the server in JSON format.

[1073] Input: User-entered data and configuration parameters

[1074] Specific operation: The data is temporarily saved, converted to JSON format, and sent to the server.

[1075] Step 6: Run the generation process

[1076] Server: Sends requests to the generative AI tool's API based on the received data and configuration parameters.

[1077] Input: Data received from the terminal and configuration parameters

[1078] Data Calculation: Making API Requests

[1079] Specific operation: Generates an API request and sends it to the generative AI tool.

[1080] Generative AI tool: Creates a product based on specified conditions and returns the results to the server.

[1081] Input: API request parameters

[1082] Data transformation: Condition-based generative processes

[1083] Output: Generated result

[1084] Specific operation: Creates a product according to the specified conditions and returns the result to the server.

[1085] Server: Temporarily stores the generated data and sends the generated results to the terminal.

[1086] Input: Generated results from a generative AI tool

[1087] Data processing: Convert to JSON format

[1088] Output: Sends generated results to the terminal

[1089] Specific operation: The generated results are temporarily saved and sent to the terminal in JSON format.

[1090] Step 7: Verify and download the product

[1091] Terminal: Display the results on the results screen.

[1092] Input: Generated result received from the server

[1093] Specific operation: Generates HTML to display the data on the results screen.

[1094] User: Review the artifacts and download them if necessary.

[1095] Input: Displayed product

[1096] Specific operations: Check the generated output and click the "Download" button.

[1097] (Application example 1)

[1098] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1099] Existing online shopping sites often make it difficult for users to obtain detailed information when selecting products, and product reviews and descriptions are often insufficient. Furthermore, image and audio information may be lacking, which can discourage users from purchasing. Furthermore, suggestions for related products are insufficient, which can lead to users missing useful products. Therefore, there is a need for a system that allows users to quickly and easily obtain detailed reviews, images, audio descriptions, and suggestions for related products when selecting products.

[1100] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1101] In this invention, the server is a system that combines and enables the use of multiple generative artificial intelligence tools that are offered free of charge or at low cost, and includes a registration and login means, a generative artificial intelligence tool selection means, a data input means for a user to input input data and setting parameters, a means for executing a generation process based on the input data and setting parameters, a means for displaying and making the generated product available for download, a means including a generative artificial intelligence tool for automatically generating product information reviews, descriptions, images, and related product suggestions, and a user interface means for displaying information generated using the generative artificial intelligence tool to the user, thereby enabling the user to quickly and easily obtain detailed reviews, images, audio descriptions, and related product suggestions when selecting a product.

[1102] "Registration and Login Facility" means the facility by which a User accesses the System and creates and authenticates an Account.

[1103] "Means for selecting generative AI tools" is a function that allows users to select the generative AI tool they want to use.

[1104] The "data input means" is a function that allows the user to input data and setting parameters required for the generation process.

[1105] A "means for executing a generative process" is a function for executing a generative artificial intelligence tool based on input data and configuration parameters.

[1106] "Means for displaying and making the output available for download" refers to a function that allows users to view the generated output and download it if necessary.

[1107] "Generative artificial intelligence tools for automatically generating product information reviews, descriptions, images, and related product suggestions" refers to various generative AI tools used to automatically generate product-related reviews, descriptions, images, and related product suggestions.

[1108] The "user interface means" is an interface for displaying the generated information to the user.

[1109] This invention relates to a system that combines and enables the use of multiple generative AI tools that are provided free or at low cost. When a user selects a product, this system uses the generative AI tools to automatically provide product reviews, descriptions, images, and even suggestions for related products. This allows users to obtain more detailed and attractive product information, aiming to increase their desire to purchase.

[1110] The system is implemented as an application installed on a smartphone, and its specific functions include creating product reviews using text generation AI, generating product images using image generation AI, generating audio product explanations using voice generation AI, and suggesting related products using related product suggestion AI.

[1111] System-wide program overview

[1112] When a user accesses the application, they first create and authenticate an account using the registration and login methods. If this is successful, they can select the AI ​​generation tool they want to use from the dashboard screen. The user enters the required information for the selected AI generation tool and runs the generation process. The generated product is then displayed and the user can download it.

[1113] Hardware and software used

[1114] The system is implemented using the following hardware and software:

[1115] Hardware: Smartphones, servers (cloud servers and on-premise servers)

[1116] software:

[1117] API Server: Hosts the APIs of the provided generative AI tools, specifically built using Django or Flask.

[1118] Database: Stores user information and generated data. Specifically, PostgreSQL or MySQL is used.

[1119] Front-end: A smartphone application developed with React Native or Flutter.

[1120] Backend: Server (developed with Django or Flask)

[1121] Data processing and calculation

[1122] 1. Registration and Login: A user visits a registration screen and enters their name, password, email address, etc. This information is sent to the server, and a new user record is created in the database. Upon login, the server validates the email address and password entered by the user, and if successful, issues a session ID.

[1123] 2. Selecting a generative AI tool and entering data: The user selects a generative AI tool from the dashboard and sends the selection information to the server. The server returns the component corresponding to the selected generative AI tool to the terminal, and the user enters the required information.

[1124] 3. Execution of the generation process: Based on the input data and configuration parameters, the server sends a request to the API of the corresponding generation AI tool to execute the generation process. The generated results are sent back to the server and then displayed on the user's device.

[1125] 4. View and download results: The generated products can be viewed by the user and downloaded if necessary.

[1126] Specific examples

[1127] For example, suppose a user selects "Smartphone X" and enters the keywords "high-resolution camera" and "long battery life." The system uses this information to generate a detailed product review. An example prompt might be, "Generate a review for Smartphone X. The key features are the high-resolution camera and long battery life." The generated review might read, "Smartphone X has an excellent high-resolution camera, making it easy to take beautiful photos. What's more, its long-lasting battery life allows for worry-free use all day long."

[1128] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1129] Step 1:

[1130] A user accesses a smartphone app and creates and authenticates an account using the registration and login methods. The data entered is a name, password, and email address. The input data is sent to the server, which creates a new user record in the database. The user then activates the account using the confirmation email sent to them. Similarly, when logging in, the server verifies the email address and password entered by the user, and if successful, returns a session ID to the device.

[1131] Step 2:

[1132] The user selects the generative AI tool (text generation AI, image generation AI, voice generation AI, etc.) they want to use using the generative AI tool selection means on the dashboard screen. The selection information is sent to the server, and the server returns the front-end component and setting information corresponding to the selected generative AI tool to the terminal.

[1133] Step 3:

[1134] The user inputs the data required for the output they want to generate (e.g., product name, points they want to include in the review) and setting parameters (output format and quality parameters) into the selected generation AI tool. The input data and setting parameters are converted to JSON format on the device and sent to the server.

[1135] Step 4:

[1136] The server sends a request to the API of the corresponding AI tool based on the received data and configuration parameters. The server temporarily stores the results returned by the AI ​​tool. The results may include review text, generated product images, audio descriptions, etc.

[1137] Step 5:

[1138] The server sends the generated information back to the device, where it is displayed on a confirmation screen. The user can then review the generated information and download it as needed. Specifically, the system displays product reviews, images, and audio descriptions generated using the generative AI tool.

[1139] Step 6:

[1140] The terminal provides a user interface for displaying the product to the user, who can then download it, regenerate it, or see suggestions for related products.

[1141] Specifically, if a user wants to generate a detailed review of "Smartphone X," they input the prompt, "Generate a review of Smartphone X. Key features include a high-resolution camera and a long battery life." The system then invokes a generation AI tool based on the input data, which generates a detailed review, related images, and audio description, and provides them to the user.

[1142] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1143] This invention relates to a system that combines multiple generative AI tools that are available free or at low cost, and an emotion engine that recognizes user emotions. This system allows even non-engineers to easily use multiple generative AI tools (e.g., text generation, image generation, voice generation, etc.) to generate output that corresponds to the user's emotions.

[1144] The entire system consists of the following main components:

[1145] Registration and login methods

[1146] Selection methods for generative artificial intelligence tools

[1147] A data entry means for the user to enter input data and setting parameters

[1148] A means to run the generation process based on input data and configuration parameters

[1149] A means to make the generated artifacts viewable and downloadable

[1150] Emotion engine that recognizes user emotions

[1151] First, a user accesses the system and creates and authenticates an account using the registration and login methods. Specifically, the user accesses the registration screen on their terminal and enters the required information (name, password, email address, etc.). The terminal sends this information to the server, and the server creates a new user record in the database based on the received information. The user then activates their account through a confirmation email sent to the email address provided during registration. Similarly, when logging in, the email address and password entered by the user are verified, and a session ID is issued if successful.

[1152] Next, the user selects the generative AI tool they want to use from the dashboard screen. The device sends the user's selection information to the server, and the server returns the front-end component and setting information corresponding to the selected generative AI tool to the device.

[1153] The user uses a data input method to input the necessary information depending on the selected generation AI tool. For example, if a text generation AI is selected, the user inputs the topic and keywords of the text to be generated. The user also selects setting parameters such as the output format (e.g., short or long text) and quality parameters. The device temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[1154] The emotion engine analyzes user input data and voice and facial expression data obtained during actual user interactions to recognize the user's emotions. Based on this recognition result, it automatically generates additional parameters to optimize the output of the generative AI tool. For example, if the emotion engine recognizes that the user is feeling stressed, it will adjust the tone of the generated text or make the colors of images more subdued.

[1155] Based on the received data and additional configuration parameters, the server sends a request to the API of the corresponding generative AI tool to execute the generation process. The generative AI tool (e.g., text generation AI) creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained result and sends data to be displayed on the user's device. The device displays the generated data on the result screen, allowing the user to check and download the product.

[1156] For example, if a user wants to generate a "product review," they log in, select the text generation AI from the dashboard, and enter the "product name" and "points they want to include in the review." During this time, the emotion engine recognizes emotions from the user's voice and facial expressions, and if it detects, for example, "positive emotion," it generates a review text in a tone and style based on that emotion. The generated review text is sent back from the server to the device, where the user can review it and download it if necessary.

[1157] In this way, a system with an embedded emotion engine can provide customized results based on the user's emotions, enabling more appropriate and effective output. The system provides an interface that is intuitive even for non-engineers, and effectively utilizes multiple generative AI tools and emotion recognition functions to improve work efficiency.

[1158] The processing flow will be explained below.

[1159] Step 1:

[1160] The user enters the required information (name, password, email address, etc.) on the registration screen and clicks the Register button.

[1161] Terminal: Sends the entered information to the server in JSON format.

[1162] Step 2:

[1163] The server verifies the received information and creates a new user record in the database.

[1164] Server: Checks if the entered email address is unique and creates a new user record in the database if there are no issues. Sends a success message and a confirmation email to the user.

[1165] Step 3:

[1166] The user clicks the link in the confirmation email to activate their account.

[1167] Server: When the confirmation link is clicked, update the status of the corresponding user record to "valid".

[1168] Step 4:

[1169] The user enters their email address and password on the login screen and clicks the Login button.

[1170] On your device: Send your login information to the server.

[1171] Server: Verifies the received information, and if authentication is successful, generates a session ID and returns it to the terminal.

[1172] Step 5:

[1173] The user selects the generative AI tool (e.g., text generation AI) they want to use from the dashboard screen.

[1174] Terminal: Sends the user's selection information to the server.

[1175] Step 6:

[1176] The server returns to the terminal a front-end component and configuration information corresponding to the selected generating artificial intelligence tool.

[1177] Server: Sends UI components and initial settings according to the selected tool to the device.

[1178] Step 7:

[1179] Depending on the generation AI tool selected by the user, input the necessary information (e.g., topics and keywords for text generation).

[1180] Terminal: The input information is temporarily stored, and the emotion engine analyzes the user's input data as well as the voice and facial expression data obtained during actual user interaction.

[1181] Step 8:

[1182] The emotion engine recognizes the user's emotions and automatically generates additional setting parameters based on the results.

[1183] Emotion engine: Analyzes emotion recognition results and makes appropriate adjustments to reflect them in the output.

[1184] Step 9:

[1185] The user confirms the configuration parameters and clicks the generate button.

[1186] Terminal: Sends input information and automatically generated configuration parameters to the server in JSON format.

[1187] Step 10:

[1188] Based on the data and parameters received by the server, the corresponding generative AI tool is launched.

[1189] Server: Parses the JSON data and sends a request to the corresponding AI tool API.

[1190] Step 11:

[1191] A generative artificial intelligence tool creates a product based on specified conditions.

[1192] AI tool: Creates text, images, audio, and other products based on the received data and parameters, and sends the results back to the server.

[1193] Step 12:

[1194] The server temporarily stores the results received from the AI ​​tool and sends the data to the user's device for display.

[1195] Server: Sends a response back to the device containing the location of the artifact and metadata.

[1196] Step 13:

[1197] The user checks the products displayed on the results screen.

[1198] Terminal: Display the generated data on the results screen.

[1199] Step 14:

[1200] The user downloads the products as needed.

[1201] On the device: Sends a download request to the server and saves the result in the download folder.

[1202] Step 15:

[1203] The server monitors the user's usage and calculates the charges.

[1204] Server: Records each production request and calculates a monthly fee based on frequency of use and type of production.

[1205] Step 16:

[1206] The server generates billing information and sends it to the user.

[1207] Server: Generates invoices and sends them to the user's registered email address, and stores the invoice information in a database.

[1208] Example 2

[1209] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1210] While systems exist for effectively utilizing free or low-cost generative AI tools, they struggle to provide products that respond to user emotions. Furthermore, they lack the functionality to provide an intuitive interface for users and optimize the quality of products based on user emotions. Therefore, a system that effectively combines multiple generative AI tools while taking user emotions into account is needed.

[1211] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1212] In this invention, the server includes a registration and login means, a generation artificial intelligence tool selection means, a data input means, an emotion recognition means, an additional parameter generation means, a generation process execution means, and a display and download means, which enable the server to identify a user's emotion and provide a product based thereon.

[1213] "Registration and Login Facility" means the facility by which a User accesses the System and creates and authenticates his / her account.

[1214] The "means for selecting a generating AI tool" is a function that provides an interface for a user to select the tool that the user wants to use from among a plurality of generating AI tools.

[1215] "Data input means" is a function that provides an interface for inputting setting parameters and input data of information generated by a user into the system.

[1216] "Emotion recognition means" is a technology for analyzing the user's voice and facial expression data and identifying the user's emotions.

[1217] The "additional parameter generation means" is a function that generates parameters for optimizing the quality and characteristics of the product based on the emotion data acquired by the emotion recognition means.

[1218] The "generative process execution means" is a function that uses a generative artificial intelligence tool to create a product based on data and setting parameters input by the user.

[1219] The "display and download means" is a function that displays the generated product on the user terminal and allows the user to download it.

[1220] MODE FOR CARRYING OUT THE INVENTION

[1221] This invention relates to a system that combines multiple generative AI tools that are available free or at low cost, and an emotion engine that recognizes user emotions. This system allows even non-engineers to easily use multiple generative AI tools (e.g., text generation, image generation, voice generation, etc.) to generate output that corresponds to the user's emotions.

[1222] The entire system consists of the following main components:

[1223] Registration and login methods

[1224] Selection methods for generative artificial intelligence tools

[1225] A data entry means for the user to enter input data and setting parameters

[1226] Emotion recognition means for identifying user emotions

[1227] A means of generating additional parameters based on the output of the emotion recognition means

[1228] A means to run the generation process based on input data and configuration parameters

[1229] A means to make the generated artifacts viewable and downloadable

[1230] First, a user accesses the system and creates and authenticates an account using the registration and login methods. Specifically, the user accesses the registration screen on their device and enters the required information (name, password, email address, etc.). The device sends this information to the server, which then creates a new user record in the database based on the received information. The user then activates their account through a confirmation email sent to the email address provided during registration.

[1231] Next, the user verifies the entered email address and password to log in. If successful, the server issues a session ID and redirects the user to the dashboard screen. From the dashboard screen, the user selects the generative AI tool they want to use. The device sends the user's selection information to the server, and the server returns the front-end component and configuration information corresponding to the selected generative AI tool to the device.

[1232] The user uses a data input method to input the necessary information depending on the selected generation AI tool. For example, if a text generation AI is selected, the user inputs the topic and keywords of the text to be generated. The user also selects setting parameters such as the output format (e.g., short or long text) and quality parameters. The device temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[1233] The emotion recognition means analyzes user input data and voice and facial expression data acquired during actual user interactions to identify the user's emotions. Based on this recognition result, additional parameters are automatically generated to optimize the output of the emotion recognition means. For example, if the emotion recognition means recognizes that the user is feeling stressed, adjustments are made such as softening the tone of the generated text or calming the colors of images.

[1234] Based on the received data and additional configuration parameters, the server sends a request to the API of the corresponding generative AI tool to execute the generation process. The generative AI tool (e.g., text generation AI) creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained result and sends data to be displayed on the user's device. The device displays the generated data on the result screen, allowing the user to check and download the product.

[1235] As a specific example, if a user wants to generate a "product review text," they log in, select the text generation AI from the dashboard, and enter the "product name" and "points they want to include in the review." Meanwhile, the emotion recognition means recognizes emotions from the user's voice and facial expressions, and if it detects, for example, "positive emotion," the review text is generated in a tone and style based on that emotion. The generated review text is sent back from the server to the device, where the user can review it and download it if necessary.

[1236] An example prompt might be, "Please generate a product review. The product name is a 'high-performance smartphone', and the points you would like to include in your review are battery life, camera quality, and aesthetics."

[1237] In this way, a system incorporating emotion recognition means can provide customized products according to the user's emotions, enabling the generation of more appropriate and effective output. This system provides an interface that is intuitive even for non-engineers, and effectively utilizes multiple generative AI tools and emotion recognition functions to improve work efficiency.

[1238] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1239] Step 1:

[1240] User: Accesses the system and enters information such as name, password, and email address on the registration screen. The entered information is sent to the server via the terminal.

[1241] Server: Creates a new user record in the database based on the received information. The server sends a confirmation email to the user's email address.

[1242] Input: Information that a user enters, such as a name, password, or email address.

[1243] Output: A new user record is created in the database and a confirmation email is sent.

[1244] Specific operation: When the user clicks the "Submit" button, the device sends the input information to the server, which receives the information, creates a new record, and sends a confirmation email.

[1245] Step 2:

[1246] User: Open the confirmation email sent to your email address, click the account activation link, and then enter your email address and password on the login screen to log in.

[1247] Server: Validates the login information, and if successful, issues a session ID and redirects the user to the dashboard.

[1248] Enter your email address and password.

[1249] Output: Issue a session ID and transition to the dashboard screen.

[1250] Specific behavior: When a user clicks the account activation link and then clicks the "Login button" on the login screen, the server verifies the email address and password combination. If successful, it generates a session ID and redirects the user to the dashboard screen.

[1251] Step 3:

[1252] User: Select the generative AI tool you want to use on the dashboard screen.

[1253] Terminal: Sends the user's selection information to the server.

[1254] Server: Returns the front-end component and configuration information corresponding to the selected generative AI tool to the device.

[1255] Input: User-generated AI tool selection information.

[1256] Output: Front-end components and configuration information sent back to the terminal.

[1257] Specific operation: When a user clicks the "Text Generation AI" button on the dashboard, the device sends the selection information to the server, which then returns the appropriate front-end component to the device based on the selection information received.

[1258] Step 4:

[1259] User: If you select text generation AI, you can enter the "topic of the text you want to generate" and "keywords." You can also set the output format (short text, long text, etc.) and quality parameters.

[1260] Terminal: Temporarily stores the information and configuration parameters entered by the user and sends them to the server in JSON format.

[1261] Input: User-entered information such as text topics, keywords, output format, and quality parameters.

[1262] Output: Temporarily saved data in JSON format.

[1263] Specific operation: When the user clicks the "Submit" button, the device temporarily saves the input information, converts it to JSON format, and sends it to the server.

[1264] Step 5:

[1265] Emotion recognition means: Analyzes user input data and voice and facial expression data obtained during actual user interactions to identify the user's emotions.

[1266] Server: Generates and stores additional parameters based on the output of the emotion recognition means.

[1267] Input: User voice and facial expression data.

[1268] Output: Additional parameters.

[1269] How it works: While the user is entering data, the emotion recognition unit analyzes the user's voice and facial expressions in real time to identify the emotion. The server generates the necessary additional parameters based on the results.

[1270] Step 6:

[1271] Server: Based on the received data and additional configuration parameters, it sends a request to the API of the generative AI tool to execute the generation process.

[1272] Generative AI tool: Creates a product based on specified conditions and sends the results back to the server.

[1273] Input: User configuration and additional parameters.

[1274] Output: The generated artifact.

[1275] Specific operation: The server sends a request to the generation AI tool using the configuration parameters and additional parameters. The generation AI tool creates a product and sends it back to the server.

[1276] Step 7:

[1277] Server: Temporarily stores the generated results and sends the display data to the user's device.

[1278] Terminal: Displays the generated data on a results screen for the user to review and download.

[1279] Input: The generated artifact.

[1280] Output: Display of results and downloadable data.

[1281] Specific operation: The server receives the generated results and temporarily stores them. It then sends the display data to the user's device. The device displays the generated results on the results screen, allowing the user to click the "Confirm" or "Download" button.

[1282] (Application example 2)

[1283] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1284] Conventional generative intelligence tools create products based on user-entered data and setting parameters, but do not take the user's emotions into consideration. As a result, they are unable to provide optimal output tailored to the user's emotional state, and the generated content may not match the user's needs or emotions. There was a need to provide a system that would solve this problem and improve the user experience.

[1285] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for combining and enabling the use of multiple generative intelligent tools provided free of charge or at low cost, a registration and login means, a means for selecting a generative intelligent tool, a data input means for the user to input input data and setting parameters, a means for executing a generation process based on the input data and setting parameters, a means for displaying and downloading the generated product, and an emotion recognition means for recognizing the user's emotions and optimizing the output content according to the emotions. This makes it possible to generate optimal content according to the user's emotions.

[1286] "Multiple generative intelligence tools provided free or at low cost" refers to a group of tools that are accessible to general consumers free of charge or at low cost and have a variety of generative intelligence functions, such as text generation, image generation, and speech generation.

[1287] "Registration and login means" means a means that allows a user to create and authenticate an account by entering information required to access the system (such as name, password, email address, etc.).

[1288] The "means for selecting a generative intelligent tool" is a means for providing an interface or function for a user to select a generative intelligent tool that the user wants to use.

[1289] The "data input means" is a means that provides a function for a user to input input data and setting parameters required to execute a generation process.

[1290] A "means for executing a generative process" is a system or function for running a generative intelligence tool based on user-entered data and configuration parameters to create a specified product.

[1291] "Means for displaying and enabling download of the generated product" refers to means for presenting the generated product to the user and providing a function that allows the user to view and save it.

[1292] "Emotion recognition means" refers to a technology or system that analyzes a user's facial expression, voice, or input text, etc., to recognize their emotion, and has the function of optimizing the content and tone of the generated output based on the recognized emotion.

[1293] This invention relates to a system that combines multiple generative intelligence tools that are available free or at low cost, and also combines emotion recognition means that recognizes user emotions. This system allows even non-engineers to easily use multiple generative intelligence tools (e.g., text generation, image generation, voice generation, etc.) to generate content that corresponds to the user's emotions.

[1294] The entire system consists of the following main components:

[1295] Registration and login methods

[1296] Selection methods for generative intelligence tools

[1297] A data entry means for the user to enter input data and setting parameters

[1298] A means to run the generation process based on input data and configuration parameters

[1299] A means to make the generated artifacts viewable and downloadable

[1300] Emotion recognition means for recognizing user emotions

[1301] A user accesses the system and creates and authenticates an account using the registration and login methods. First, the user accesses the registration screen on their terminal and enters the required information (name, password, email address, etc.). The terminal sends this information to the server, and the server creates a new user record in the database based on the received information. The user then activates their account through a confirmation email sent to the email address provided during registration. Similarly, when logging in, the email address and password entered by the user are verified, and a session ID is issued if successful.

[1302] Next, the user selects the generative intelligence tool he / she wants to use from the dashboard screen, and the terminal transmits the user's selection information to the server, and the server returns the front-end component and setting information corresponding to the selected generative intelligence tool to the terminal.

[1303] The user uses a data input means to input the necessary information depending on the generative intelligence tool they have selected. For example, if they select sentence generation intelligence, they input the topic and keywords of the sentence they want to generate. They also select setting parameters such as the output format (e.g., short sentences, long sentences) and quality parameters. The terminal temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[1304] The emotion recognition means analyzes user input data and voice and facial expression data acquired during actual user interactions to recognize the user's emotions. Based on this recognition result, additional parameters are automatically generated to optimize the output of the generative intelligence tool. For example, if the emotion recognition means recognizes that the user is feeling stressed, adjustments will be made, such as softening the tone of the generated text or making the colors of images more subdued.

[1305] Based on the received data and additional configuration parameters, the server sends a request to the API of the corresponding generative intelligence tool to execute the generation process. The generative intelligence tool (e.g., a sentence generation AI) creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained result and sends data to be displayed on the user's device. The device displays the generated data on the result screen, allowing the user to check and download the product.

[1306] For example, if a user wants to generate a "relaxing image," they log in, select the image generation AI from the dashboard, and enter a "relaxing theme" and "natural scenery." During this time, the emotion recognition means recognizes emotions from the user's voice and facial expressions, and if it detects "stress," for example, an image is generated with a tone and theme based on that emotion. The generated image is sent back to the device from the server, where the user can review it and download it if necessary.

[1307] In this way, a system incorporating emotion recognition means can provide customized products according to the user's emotions and generate more appropriate and effective output. This system provides an interface that can be used intuitively even by non-engineers, and effectively utilizes multiple generative intelligence tools and emotion recognition functions to improve work efficiency.

[1308] Example prompt sentence:

[1309] "I'm so stressed today, I want to see some images that will help me relax."

[1310] "I don't know how to write a business email. I want objective and positive sentences."

[1311] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1312] Step 1:

[1313] A user uses a terminal to access the system through registration and login procedures. The user enters the required information (such as name, password, and email address) and sends it to the server. The server creates a new user record in the database based on the received information and sends a confirmation email. The user receives the confirmation email and activates their account. When logging in, the email address and password entered by the user are verified, and a session ID is issued if successful.

[1314] Input: Name, Password, Email Address

[1315] Output: User record, session ID

[1316] Step 2:

[1317] The user accesses the dashboard screen and selects the generative intelligence tool they want to use. The terminal sends the user's selection information to the server, and the server returns the front-end component and setting information corresponding to the selected generative intelligence tool to the terminal.

[1318] Input: Selection information of the generative intelligence tool

[1319] Output: Front-end components, configuration information

[1320] Step 3:

[1321] The user uses a data input means to input the necessary information depending on the generative intelligence tool they have selected. For example, if they select sentence generation intelligence, they input the topic and keywords of the sentence they want to generate. They also select setting parameters such as the output format and quality parameters. The device temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[1322] Input: Topic, Keywords, Configuration Parameters

[1323] Output: Input data in JSON format

[1324] Step 4:

[1325] The emotion recognition means analyzes user input data and voice and facial expression data acquired during actual user interactions to recognize the user's emotions. Based on this recognition result, additional parameters are automatically generated to optimize the output of the generative intelligence tool. For example, if the emotion recognition means recognizes that the user is feeling stressed, the tone of the generated text may be softened or the colors of the images may be made more subdued.

[1326] Input: User's voice, facial expression data

[1327] Output: Additional parameters

[1328] Step 5:

[1329] Based on the received data and additional configuration parameters, the server sends a request to the API of the corresponding generative intelligence tool to execute the generation process. The generative intelligence tool creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained result and sends the data to be displayed on the user's device.

[1330] Input: Input data, additional parameters

[1331] Output: product

[1332] Step 6:

[1333] The terminal displays the generated data on a results screen, allowing the user to review and download the product.

[1334] Input:Product

[1335] Output: Display of the result screen, download status of the generated product

[1336] For example, if a user wants to generate a "relaxing image," they log in, select the image generation AI from the dashboard, and enter a "relaxing theme" and "natural scenery." During this time, the emotion recognition means recognizes emotions from the user's voice and facial expressions, and if it detects "stress," for example, an image is generated with a tone and theme based on that emotion. The generated image is then sent back from the server to the device, where the user can review it and download it if necessary.

[1337] Example prompt sentence:

[1338] "I'm so stressed today, I want to see some images that will help me relax."

[1339] "I don't know how to write a business email. I want objective and positive sentences."

[1340] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1341] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1342] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1343] [Fourth embodiment]

[1344] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1345] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1346] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1347] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1348] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1349] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1350] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1351] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1352] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1353] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1354] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1355] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1356] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1357] The present invention relates to a system that enables the combination and use of multiple generative AI tools that are offered free or at low cost. This system allows even non-engineers to easily use multiple generative AI tools (e.g., text generation, image generation, speech generation, etc.) to generate output that is useful for business.

[1358] The entire system consists of the following main components: a means for registration and login, a means for selecting a generation artificial intelligence tool, a means for inputting data and setting parameters, a means for executing the generation process, and a means for displaying and downloading the product.

[1359] First, a user accesses the system and creates and authenticates an account using the registration and login methods. Specifically, the user accesses the registration screen on their terminal and enters the required information (name, password, email address, etc.). The terminal sends this information to the server, and the server creates a new user record in the database based on the received information. The user then activates their account through a confirmation email sent to the email address provided during registration. Similarly, when logging in, the email address and password entered by the user are verified, and a session ID is issued if successful.

[1360] Next, the user selects the generative AI tool they want to use from the dashboard screen. The device sends the user's selection information to the server, and the server returns the front-end component and setting information corresponding to the selected generative AI tool to the device.

[1361] The user uses a data input method to input the necessary information depending on the selected generation AI tool. For example, if a text generation AI is selected, the user inputs the topic and keywords of the text to be generated. The user also selects setting parameters such as the output format (e.g., short or long text) and quality parameters. The device temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[1362] Based on the received data and setting parameters, the server sends a request to the API of the corresponding generation AI tool to execute the generation process. The generation AI tool (e.g., text generation AI) creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained results and sends data to be displayed on the user's device. The device displays the generated data on the result screen, allowing the user to check and download the product.

[1363] For example, if a user wants to generate a "product review text," they log in, select the text generation AI from the dashboard, and enter the "product name" and "points they want to include in the review." They then set the output format to "detailed review" and click the generate button after completing the settings. The server calls the generation AI tool with the specified information and generates a detailed review text. The generated text is sent back from the server to the device, where the user can review it and download it if necessary.

[1364] In this way, the entire system provides users with an intuitive and easy-to-use interface, and makes it possible to effectively utilize multiple generative AI tools to generate output that is useful for business. This allows even non-engineers to easily use high-performance generative AI technology and achieve business improvements with reduced financial burden.

[1365] The processing flow will be explained below.

[1366] Step 1:

[1367] The user enters the required information (name, password, email address, etc.) on the registration screen and clicks the Register button.

[1368] Terminal: Sends the entered information to the server in JSON format.

[1369] Step 2:

[1370] The server verifies the received information and creates a new user record in the database.

[1371] Server: Checks if the entered email address is unique and creates a new user record in the database if there are no issues. Sends a success message and a confirmation email to the user.

[1372] Step 3:

[1373] The user clicks the link in the confirmation email to activate their account.

[1374] Server: When the confirmation link is clicked, update the status of the corresponding user record to "valid".

[1375] Step 4:

[1376] The user enters their email address and password on the login screen and clicks the Login button.

[1377] On your device: Send your login information to the server.

[1378] Server: Verifies the received information, and if authentication is successful, generates a session ID and returns it to the terminal.

[1379] Step 5:

[1380] The user selects the generative AI tool (e.g., text generation AI) they want to use from the dashboard screen.

[1381] Terminal: Sends the user's selection information to the server.

[1382] Step 6:

[1383] The server returns to the terminal a front-end component corresponding to the selected generating artificial intelligence tool.

[1384] Server: Sends UI components and initial settings according to the selected tool to the device.

[1385] Step 7:

[1386] Depending on the generation AI tool selected by the user, input the necessary information (e.g., topics and keywords for text generation).

[1387] Terminal: Temporarily saves the entered information and displays a screen for selecting additional configuration parameters (e.g. output format, quality parameters, etc.).

[1388] Step 8:

[1389] The user selects the configuration parameters and clicks the generate button.

[1390] Terminal: Sends input information and configuration parameters to the server in JSON format.

[1391] Step 9:

[1392] Based on the data and parameters received by the server, the corresponding generative AI tool is launched.

[1393] Server: Parses the JSON data and sends a request to the corresponding AI tool API.

[1394] Step 10:

[1395] A generative artificial intelligence tool creates a product based on specified conditions.

[1396] AI tool: Creates text, images, audio, and other products based on the received data and parameters, and sends the results back to the server.

[1397] Step 11:

[1398] The server temporarily stores the results received from the AI ​​tool and sends the data to the user's device for display.

[1399] Server: Sends a response back to the device containing the location of the artifact and metadata.

[1400] Step 12:

[1401] The user checks the products displayed on the results screen.

[1402] Terminal: Display the generated data on the results screen.

[1403] Step 13:

[1404] The user downloads the products as needed.

[1405] On the device: Sends a download request to the server and saves the result in the download folder.

[1406] Step 14:

[1407] The server monitors the user's usage and calculates the charges.

[1408] Server: Records each production request and calculates a monthly fee based on frequency of use and type of production.

[1409] Step 15:

[1410] The server generates billing information and sends it to the user.

[1411] Server: Generates invoices and sends them to the user's registered email address, and stores the invoice information in a database.

[1412] Example 1

[1413] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1414] Currently, many individuals and companies are trying to improve their business efficiency by using generative AI tools. However, these tools are expensive and require advanced technical knowledge to use. This makes it difficult for non-engineers and small and medium-sized enterprises to easily use these technologies. Another issue is that it is difficult to combine multiple generative AI tools and use them efficiently.

[1415] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1416] In this invention, the server includes means for registering and authenticating a user's account, means for returning information corresponding to the generation AI tool selected by the user to the terminal, means for executing the generation process based on input data and setting parameters, and means for displaying and downloading the generated product to the user terminal. This allows even non-engineers to easily use multiple generation AI tools provided free of charge or at low cost, significantly improving work efficiency without complex operations or advanced knowledge.

[1417] "Means of registering and authenticating a user's account" is the process by which a user accesses the system, enters required information such as name, password, and email address, and the server receives this and creates a new user record in the database.

[1418] "Means for returning information corresponding to the generation AI tool selected by the user to the terminal" refers to the process in which the user selects the generation AI tool they wish to use on the dashboard screen, the server receives the selection information, and then sends the corresponding front-end component and setting information to the user's terminal.

[1419] The "means of executing the generation process based on input data and setting parameters" refers to the process in which the server receives the data and setting parameters entered by the user, sends a request to the API of the corresponding generation AI tool to execute the generation process, and the server temporarily stores the generated results.

[1420] "Means for displaying and enabling the generated product to be downloaded to a user terminal" refers to the process by which the server sends the product results returned from the generation AI tool to the user terminal, allowing the user to check and download the product on the result screen.

[1421] A "generative AI tool" is a technology that performs text generation, image generation, voice generation, etc., and is an AI technology that automatically creates products based on data entered by the user.

[1422] To implement the invention, the system includes the following major hardware and software components: The server registers and authenticates the user's account, returns information corresponding to the user's selected AI tool to the terminal, executes the generation process based on the input data and setting parameters, and makes the generated product available for display and download on the user's terminal. The user accesses the system using the terminal and performs various operations.

[1423] Hardware and Software Components

[1424] 1. Server: Registers and authenticates user information, sends requests to the AI ​​generation tool's API, and temporarily stores the generated results. Configuration examples include a Linux-based server and a database management system (MySQL or PostgreSQL).

[1425] 2. Terminal: A device (PC, smartphone, tablet, etc.) that a user operates and displays the user interface using a web browser.

[1426] 3. Generative AI tools: Generative AI tools such as text generation AI, image generation AI, and voice generation AI. They are often provided as APIs and perform automatic generation based on specific generation conditions.

[1427] Processing flow and specific examples

[1428] The system's processing flow is designed so that the server, terminal, and user components function in coordination.

[1429] Account Registration and Verification

[1430] User: Accesses the registration screen on the device and enters information such as name, password, and email address.

[1431] Terminal: Sends user input to the server.

[1432] Server: Stores the received information in a database and sends a confirmation email.

[1433] Users: Click the link in the confirmation email to activate their account.

[1434] User: Enter your email address and password on the login screen.

[1435] Server: Validates the input information and issues a session ID.

[1436] Choosing a Generative AI Tool

[1437] User: Select the generative AI tool you want to use on the dashboard screen.

[1438] Terminal: Sends the user's selection to the server.

[1439] Server: Sends the necessary information for the selected AI tool back to the device.

[1440] Entering Data and Configuration Parameters

[1441] User: Enters the required information into the selected generative AI tool, for example, topics and keywords for text generation.

[1442] Terminal: The entered information and configuration parameters are temporarily saved and sent to the server in JSON format.

[1443] Running the generation process

[1444] Server: Sends requests to the generative AI tool's API based on the received data and configuration parameters.

[1445] Generative AI tool: Creates a product based on specified conditions and returns the results to the server.

[1446] Server: Temporarily stores the generated data and sends it to the device.

[1447] Verify and download the product

[1448] Terminal: Display the results on the results screen.

[1449] User: Review the artifacts and download them if necessary.

[1450] Examples and prompts

[1451] As a concrete example, the steps to generate a "product review text" are shown below.

[1452] 1. User: Log in to the system and select the text generation AI from the dashboard.

[1453] 2. User: Enter the "Product Name" and "Points you want to include in your review."

[1454] 3. User: Set the output format as "Detailed Review" and click the "Generate" button.

[1455] 4. Server: Calls the generative AI tool with the specified information and generates a detailed review text.

[1456] 5. Terminal: Display the generated review text.

[1457] 6. User: After checking, download the review text if necessary.

[1458] Example prompt sentence:

[1459] Product Name: Smartphone XYZ

[1460] Points to include in the review: Battery life, camera performance, price

[1461] Output Formats: A Detailed Review

[1462] Tool used: Text generation AI

[1463] This allows users to intuitively operate the system and easily combine and use a variety of generative AI tools. It is designed so that even non-engineers can obtain highly accurate output quickly and at low cost.

[1464] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1465] Step 1: User Account Registration

[1466] User: Accesses the registration screen on the device and enters the required information, such as name, password, and email address.

[1467] Input: Name, Password, Email Address

[1468] Specific behavior: The user fills in the form in their browser and clicks the "Register" button.

[1469] Terminal: Sends the information entered by the user to the server.

[1470] Input: Information entered by the user

[1471] Specific operation: The input information is temporarily saved and sent to the server via an HTTP request.

[1472] Server: Stores the received information in a database and sends a confirmation email.

[1473] Input: User information received from the device

[1474] Data processing: Save the received information as a new user record in the database

[1475] Output: Send confirmation email

[1476] Specific behavior: The user record is saved in the database and a confirmation email is sent via the mail server.

[1477] Step 2: User Account Verification

[1478] Users: Click the link in the confirmation email they receive to activate their account.

[1479] Input: Link in confirmation email

[1480] Specific action: Click on the confirmation link in your browser.

[1481] Server: Receives the link and updates the corresponding user record to activate the account.

[1482] Input: A request for a verification link from the user

[1483] Data processing: Update the user record status to "Active"

[1484] Output: Activation complete response

[1485] What happens: Updates the user status in the database and displays a confirmation message in the browser.

[1486] Step 3: User Login

[1487] User: Access the login screen on the device and enter your email address and password.

[1488] Input: Email address, Password

[1489] Specific action: Enter your email address and password in the form and click the "Login" button.

[1490] Terminal: Sends the information entered by the user to the server.

[1491] Input: The login information entered by the user

[1492] Specific operation: The input information is temporarily saved and sent to the server via an HTTP request.

[1493] Server: Validates the email address and password and, if successful, issues a session ID.

[1494] Input: Login information received from the device

[1495] Data calculation: Email address and password verification

[1496] Output: Session ID

[1497] Specific operation: User information is compared with the database, and if it matches, a session ID is generated and sent back to the terminal.

[1498] Step 4: Selecting a generative AI tool

[1499] User: Select the generative AI tool you want to use on the dashboard screen.

[1500] Input: Tool selection

[1501] Specific behavior: A user selects a generative AI tool from a drop-down list or button on the dashboard.

[1502] Terminal: Sends the user's selection information to the server.

[1503] Input: Tool selection information

[1504] Specific operation: The selected information is temporarily saved and sent to the server via an HTTP request.

[1505] Server: Returns information corresponding to the selected generation AI tool to the device.

[1506] Input: User selection information

[1507] Data Calculation: Identifying the corresponding front-end component

[1508] Output: Front-end components and configuration information

[1509] Specific behavior: Front-end components and configuration information are returned to the device in HTML or JSON format.

[1510] Step 5: Entering data and configuration parameters

[1511] User: Enter the required information (e.g., topics and keywords) into the selected generative AI tool and set the output format and quality parameters.

[1512] Input: Required information (topics, keywords), output format, quality parameters

[1513] Specific actions: Enter the required information into the form, set the parameters, and click the "Submit" button.

[1514] Terminal: The entered information and configuration parameters are temporarily saved and sent to the server in JSON format.

[1515] Input: User-entered data and configuration parameters

[1516] Specific operation: The data is temporarily saved, converted to JSON format, and sent to the server.

[1517] Step 6: Run the generation process

[1518] Server: Sends requests to the generative AI tool's API based on the received data and configuration parameters.

[1519] Input: Data received from the terminal and configuration parameters

[1520] Data Calculation: Making API Requests

[1521] Specific operation: Generates an API request and sends it to the generative AI tool.

[1522] Generative AI tool: Creates a product based on specified conditions and returns the results to the server.

[1523] Input: API request parameters

[1524] Data transformation: Condition-based generative processes

[1525] Output: Generated result

[1526] Specific operation: Creates a product according to the specified conditions and returns the result to the server.

[1527] Server: Temporarily stores the generated data and sends the generated results to the terminal.

[1528] Input: Generated results from a generative AI tool

[1529] Data processing: Convert to JSON format

[1530] Output: Sends generated results to the terminal

[1531] Specific operation: The generated results are temporarily saved and sent to the terminal in JSON format.

[1532] Step 7: Verify and download the product

[1533] Terminal: Display the results on the results screen.

[1534] Input: Generated result received from the server

[1535] Specific operation: Generates HTML to display the data on the results screen.

[1536] User: Review the artifacts and download them if necessary.

[1537] Input: Displayed product

[1538] Specific operations: Check the generated output and click the "Download" button.

[1539] (Application example 1)

[1540] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1541] Existing online shopping sites often make it difficult for users to obtain detailed information when selecting products, and product reviews and descriptions are often insufficient. Furthermore, image and audio information may be lacking, which can discourage users from purchasing. Furthermore, suggestions for related products are insufficient, which can lead to users missing useful products. Therefore, there is a need for a system that allows users to quickly and easily obtain detailed reviews, images, audio descriptions, and suggestions for related products when selecting products.

[1542] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1543] In this invention, the server is a system that combines and enables the use of multiple generative artificial intelligence tools that are offered free of charge or at low cost, and includes a registration and login means, a generative artificial intelligence tool selection means, a data input means for a user to input input data and setting parameters, a means for executing a generation process based on the input data and setting parameters, a means for displaying and making the generated product available for download, a means including a generative artificial intelligence tool for automatically generating product information reviews, descriptions, images, and related product suggestions, and a user interface means for displaying information generated using the generative artificial intelligence tool to the user, thereby enabling the user to quickly and easily obtain detailed reviews, images, audio descriptions, and related product suggestions when selecting a product.

[1544] "Registration and Login Facility" means the facility by which a User accesses the System and creates and authenticates an Account.

[1545] "Means for selecting generative AI tools" is a function that allows users to select the generative AI tool they want to use.

[1546] The "data input means" is a function that allows the user to input data and setting parameters required for the generation process.

[1547] A "means for executing a generative process" is a function for executing a generative artificial intelligence tool based on input data and configuration parameters.

[1548] "Means for displaying and making the output available for download" refers to a function that allows users to view the generated output and download it if necessary.

[1549] "Generative artificial intelligence tools for automatically generating product information reviews, descriptions, images, and related product suggestions" refers to various generative AI tools used to automatically generate product-related reviews, descriptions, images, and related product suggestions.

[1550] The "user interface means" is an interface for displaying the generated information to the user.

[1551] This invention relates to a system that combines and enables the use of multiple generative AI tools that are provided free or at low cost. When a user selects a product, this system uses the generative AI tools to automatically provide product reviews, descriptions, images, and even suggestions for related products. This allows users to obtain more detailed and attractive product information, aiming to increase their desire to purchase.

[1552] The system is implemented as an application installed on a smartphone, and its specific functions include creating product reviews using text generation AI, generating product images using image generation AI, generating audio product explanations using voice generation AI, and suggesting related products using related product suggestion AI.

[1553] System-wide program overview

[1554] When a user accesses the application, they first create and authenticate an account using the registration and login methods. If this is successful, they can select the AI ​​generation tool they want to use from the dashboard screen. The user enters the required information for the selected AI generation tool and runs the generation process. The generated product is then displayed and the user can download it.

[1555] Hardware and software used

[1556] The system is implemented using the following hardware and software:

[1557] Hardware: Smartphones, servers (cloud servers and on-premise servers)

[1558] software:

[1559] API Server: Hosts the APIs of the provided generative AI tools, specifically built using Django or Flask.

[1560] Database: Stores user information and generated data. Specifically, PostgreSQL or MySQL is used.

[1561] Front-end: A smartphone application developed with React Native or Flutter.

[1562] Backend: Server (developed with Django or Flask)

[1563] Data processing and calculation

[1564] 1. Registration and Login: A user visits a registration screen and enters their name, password, email address, etc. This information is sent to the server, and a new user record is created in the database. Upon login, the server validates the email address and password entered by the user, and if successful, issues a session ID.

[1565] 2. Selecting a generative AI tool and entering data: The user selects a generative AI tool from the dashboard and sends the selection information to the server. The server returns the component corresponding to the selected generative AI tool to the terminal, and the user enters the required information.

[1566] 3. Execution of the generation process: Based on the input data and configuration parameters, the server sends a request to the API of the corresponding generation AI tool to execute the generation process. The generated results are sent back to the server and then displayed on the user's device.

[1567] 4. View and download results: The generated products can be viewed by the user and downloaded if necessary.

[1568] Specific examples

[1569] For example, suppose a user selects "Smartphone X" and enters the keywords "high-resolution camera" and "long battery life." The system uses this information to generate a detailed product review. An example prompt might be, "Generate a review for Smartphone X. The key features are the high-resolution camera and long battery life." The generated review might read, "Smartphone X has an excellent high-resolution camera, making it easy to take beautiful photos. What's more, its long-lasting battery life allows for worry-free use all day long."

[1570] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1571] Step 1:

[1572] A user accesses a smartphone app and creates and authenticates an account using the registration and login methods. The data entered is a name, password, and email address. The input data is sent to the server, which creates a new user record in the database. The user then activates the account using the confirmation email sent to them. Similarly, when logging in, the server verifies the email address and password entered by the user, and if successful, returns a session ID to the device.

[1573] Step 2:

[1574] The user selects the generative AI tool (text generation AI, image generation AI, voice generation AI, etc.) they want to use using the generative AI tool selection means on the dashboard screen. The selection information is sent to the server, and the server returns the front-end component and setting information corresponding to the selected generative AI tool to the terminal.

[1575] Step 3:

[1576] The user inputs the data required for the output they want to generate (e.g., product name, points they want to include in the review) and setting parameters (output format and quality parameters) into the selected generation AI tool. The input data and setting parameters are converted to JSON format on the device and sent to the server.

[1577] Step 4:

[1578] The server sends a request to the API of the corresponding AI tool based on the received data and configuration parameters. The server temporarily stores the results returned by the AI ​​tool. The results may include review text, generated product images, audio descriptions, etc.

[1579] Step 5:

[1580] The server sends the generated information back to the device, where it is displayed on a confirmation screen. The user can then review the generated information and download it as needed. Specifically, the system displays product reviews, images, and audio descriptions generated using the generative AI tool.

[1581] Step 6:

[1582] The terminal provides a user interface for displaying the product to the user, who can then download it, regenerate it, or see suggestions for related products.

[1583] Specifically, if a user wants to generate a detailed review of "Smartphone X," they input the prompt, "Generate a review of Smartphone X. Key features include a high-resolution camera and a long battery life." The system then invokes a generation AI tool based on the input data, which generates a detailed review, related images, and audio description, and provides them to the user.

[1584] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1585] This invention relates to a system that combines multiple generative AI tools that are available free or at low cost, and an emotion engine that recognizes user emotions. This system allows even non-engineers to easily use multiple generative AI tools (e.g., text generation, image generation, voice generation, etc.) to generate output that corresponds to the user's emotions.

[1586] The entire system consists of the following main components:

[1587] Registration and login methods

[1588] Selection methods for generative artificial intelligence tools

[1589] A data entry means for the user to enter input data and setting parameters

[1590] A means to run the generation process based on input data and configuration parameters

[1591] A means to make the generated artifacts viewable and downloadable

[1592] Emotion engine that recognizes user emotions

[1593] First, a user accesses the system and creates and authenticates an account using the registration and login methods. Specifically, the user accesses the registration screen on their terminal and enters the required information (name, password, email address, etc.). The terminal sends this information to the server, and the server creates a new user record in the database based on the received information. The user then activates their account through a confirmation email sent to the email address provided during registration. Similarly, when logging in, the email address and password entered by the user are verified, and a session ID is issued if successful.

[1594] Next, the user selects the generative AI tool they want to use from the dashboard screen. The device sends the user's selection information to the server, and the server returns the front-end component and setting information corresponding to the selected generative AI tool to the device.

[1595] The user uses a data input method to input the necessary information depending on the selected generation AI tool. For example, if a text generation AI is selected, the user inputs the topic and keywords of the text to be generated. The user also selects setting parameters such as the output format (e.g., short or long text) and quality parameters. The device temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[1596] The emotion engine analyzes user input data and voice and facial expression data obtained during actual user interactions to recognize the user's emotions. Based on this recognition result, it automatically generates additional parameters to optimize the output of the generative AI tool. For example, if the emotion engine recognizes that the user is feeling stressed, it will adjust the tone of the generated text or make the colors of images more subdued.

[1597] Based on the received data and additional configuration parameters, the server sends a request to the API of the corresponding generative AI tool to execute the generation process. The generative AI tool (e.g., text generation AI) creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained result and sends data to be displayed on the user's device. The device displays the generated data on the result screen, allowing the user to check and download the product.

[1598] For example, if a user wants to generate a "product review," they log in, select the text generation AI from the dashboard, and enter the "product name" and "points they want to include in the review." During this time, the emotion engine recognizes emotions from the user's voice and facial expressions, and if it detects, for example, "positive emotion," it generates a review text in a tone and style based on that emotion. The generated review text is sent back from the server to the device, where the user can review it and download it if necessary.

[1599] In this way, a system with an embedded emotion engine can provide customized results based on the user's emotions, enabling more appropriate and effective output. The system provides an interface that is intuitive even for non-engineers, and effectively utilizes multiple generative AI tools and emotion recognition functions to improve work efficiency.

[1600] The processing flow will be explained below.

[1601] Step 1:

[1602] The user enters the required information (name, password, email address, etc.) on the registration screen and clicks the Register button.

[1603] Terminal: Sends the entered information to the server in JSON format.

[1604] Step 2:

[1605] The server verifies the received information and creates a new user record in the database.

[1606] Server: Checks if the entered email address is unique and creates a new user record in the database if there are no issues. Sends a success message and a confirmation email to the user.

[1607] Step 3:

[1608] The user clicks the link in the confirmation email to activate their account.

[1609] Server: When the confirmation link is clicked, update the status of the corresponding user record to "valid".

[1610] Step 4:

[1611] The user enters their email address and password on the login screen and clicks the Login button.

[1612] On your device: Send your login information to the server.

[1613] Server: Verifies the received information, and if authentication is successful, generates a session ID and returns it to the terminal.

[1614] Step 5:

[1615] The user selects the generative AI tool (e.g., text generation AI) they want to use from the dashboard screen.

[1616] Terminal: Sends the user's selection information to the server.

[1617] Step 6:

[1618] The server returns to the terminal a front-end component and configuration information corresponding to the selected generating artificial intelligence tool.

[1619] Server: Sends UI components and initial settings according to the selected tool to the device.

[1620] Step 7:

[1621] Depending on the generation AI tool selected by the user, input the necessary information (e.g., topics and keywords for text generation).

[1622] Terminal: The input information is temporarily stored, and the emotion engine analyzes the user's input data as well as the voice and facial expression data obtained during actual user interaction.

[1623] Step 8:

[1624] The emotion engine recognizes the user's emotions and automatically generates additional setting parameters based on the results.

[1625] Emotion engine: Analyzes emotion recognition results and makes appropriate adjustments to reflect them in the output.

[1626] Step 9:

[1627] The user confirms the configuration parameters and clicks the generate button.

[1628] Terminal: Sends input information and automatically generated configuration parameters to the server in JSON format.

[1629] Step 10:

[1630] Based on the data and parameters received by the server, the corresponding generative AI tool is launched.

[1631] Server: Parses the JSON data and sends a request to the corresponding AI tool API.

[1632] Step 11:

[1633] A generative artificial intelligence tool creates a product based on specified conditions.

[1634] AI tool: Creates text, images, audio, and other products based on the received data and parameters, and sends the results back to the server.

[1635] Step 12:

[1636] The server temporarily stores the results received from the AI ​​tool and sends the data to the user's device for display.

[1637] Server: Sends a response back to the device containing the location of the artifact and metadata.

[1638] Step 13:

[1639] The user checks the products displayed on the results screen.

[1640] Terminal: Display the generated data on the results screen.

[1641] Step 14:

[1642] The user downloads the products as needed.

[1643] On the device: Sends a download request to the server and saves the result in the download folder.

[1644] Step 15:

[1645] The server monitors the user's usage and calculates the charges.

[1646] Server: Records each production request and calculates a monthly fee based on frequency of use and type of production.

[1647] Step 16:

[1648] The server generates billing information and sends it to the user.

[1649] Server: Generates invoices and sends them to the user's registered email address, and stores the invoice information in a database.

[1650] Example 2

[1651] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1652] While systems exist for effectively utilizing free or low-cost generative AI tools, they struggle to provide products that respond to user emotions. Furthermore, they lack the functionality to provide an intuitive interface for users and optimize the quality of products based on user emotions. Therefore, a system that effectively combines multiple generative AI tools while taking user emotions into account is needed.

[1653] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1654] In this invention, the server includes a registration and login means, a generation artificial intelligence tool selection means, a data input means, an emotion recognition means, an additional parameter generation means, a generation process execution means, and a display and download means, which enable the server to identify a user's emotion and provide a product based thereon.

[1655] "Registration and Login Facility" means the facility by which a User accesses the System and creates and authenticates his / her account.

[1656] The "means for selecting a generating AI tool" is a function that provides an interface for a user to select the tool that the user wants to use from among a plurality of generating AI tools.

[1657] "Data input means" is a function that provides an interface for inputting setting parameters and input data of information generated by a user into the system.

[1658] "Emotion recognition means" is a technology for analyzing the user's voice and facial expression data and identifying the user's emotions.

[1659] The "additional parameter generation means" is a function that generates parameters for optimizing the quality and characteristics of the product based on the emotion data acquired by the emotion recognition means.

[1660] The "generative process execution means" is a function that uses a generative artificial intelligence tool to create a product based on data and setting parameters input by the user.

[1661] The "display and download means" is a function that displays the generated product on the user terminal and allows the user to download it.

[1662] MODE FOR CARRYING OUT THE INVENTION

[1663] This invention relates to a system that combines multiple generative AI tools that are available free or at low cost, and an emotion engine that recognizes user emotions. This system allows even non-engineers to easily use multiple generative AI tools (e.g., text generation, image generation, voice generation, etc.) to generate output that corresponds to the user's emotions.

[1664] The entire system consists of the following main components:

[1665] Registration and login methods

[1666] Selection methods for generative artificial intelligence tools

[1667] A data entry means for the user to enter input data and setting parameters

[1668] Emotion recognition means for identifying user emotions

[1669] A means of generating additional parameters based on the output of the emotion recognition means

[1670] A means to run the generation process based on input data and configuration parameters

[1671] A means to make the generated artifacts viewable and downloadable

[1672] First, a user accesses the system and creates and authenticates an account using the registration and login methods. Specifically, the user accesses the registration screen on their device and enters the required information (name, password, email address, etc.). The device sends this information to the server, which then creates a new user record in the database based on the received information. The user then activates their account through a confirmation email sent to the email address provided during registration.

[1673] Next, the user verifies the entered email address and password to log in. If successful, the server issues a session ID and redirects the user to the dashboard screen. From the dashboard screen, the user selects the generative AI tool they want to use. The device sends the user's selection information to the server, and the server returns the front-end component and configuration information corresponding to the selected generative AI tool to the device.

[1674] The user uses a data input method to input the necessary information depending on the selected generation AI tool. For example, if a text generation AI is selected, the user inputs the topic and keywords of the text to be generated. The user also selects setting parameters such as the output format (e.g., short or long text) and quality parameters. The device temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[1675] The emotion recognition means analyzes user input data and voice and facial expression data acquired during actual user interactions to identify the user's emotions. Based on this recognition result, additional parameters are automatically generated to optimize the output of the emotion recognition means. For example, if the emotion recognition means recognizes that the user is feeling stressed, adjustments are made such as softening the tone of the generated text or calming the colors of images.

[1676] Based on the received data and additional configuration parameters, the server sends a request to the API of the corresponding generative AI tool to execute the generation process. The generative AI tool (e.g., text generation AI) creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained result and sends data to be displayed on the user's device. The device displays the generated data on the result screen, allowing the user to check and download the product.

[1677] As a specific example, if a user wants to generate a "product review text," they log in, select the text generation AI from the dashboard, and enter the "product name" and "points they want to include in the review." Meanwhile, the emotion recognition means recognizes emotions from the user's voice and facial expressions, and if it detects, for example, "positive emotion," the review text is generated in a tone and style based on that emotion. The generated review text is sent back from the server to the device, where the user can review it and download it if necessary.

[1678] An example prompt might be, "Please generate a product review. The product name is a 'high-performance smartphone', and the points you would like to include in your review are battery life, camera quality, and aesthetics."

[1679] In this way, a system incorporating emotion recognition means can provide customized products according to the user's emotions, enabling the generation of more appropriate and effective output. This system provides an interface that is intuitive even for non-engineers, and effectively utilizes multiple generative AI tools and emotion recognition functions to improve work efficiency.

[1680] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1681] Step 1:

[1682] User: Accesses the system and enters information such as name, password, and email address on the registration screen. The entered information is sent to the server via the terminal.

[1683] Server: Creates a new user record in the database based on the received information. The server sends a confirmation email to the user's email address.

[1684] Input: Information that a user enters, such as a name, password, or email address.

[1685] Output: A new user record is created in the database and a confirmation email is sent.

[1686] Specific operation: When the user clicks the "Submit" button, the device sends the input information to the server, which receives the information, creates a new record, and sends a confirmation email.

[1687] Step 2:

[1688] User: Open the confirmation email sent to your email address, click the account activation link, and then enter your email address and password on the login screen to log in.

[1689] Server: Validates the login information, and if successful, issues a session ID and redirects the user to the dashboard.

[1690] Enter your email address and password.

[1691] Output: Issue a session ID and transition to the dashboard screen.

[1692] Specific behavior: When a user clicks the account activation link and then clicks the "Login button" on the login screen, the server verifies the email address and password combination. If successful, it generates a session ID and redirects the user to the dashboard screen.

[1693] Step 3:

[1694] User: Select the generative AI tool you want to use on the dashboard screen.

[1695] Terminal: Sends the user's selection information to the server.

[1696] Server: Returns the front-end component and configuration information corresponding to the selected generative AI tool to the device.

[1697] Input: User-generated AI tool selection information.

[1698] Output: Front-end components and configuration information sent back to the terminal.

[1699] Specific operation: When a user clicks the "Text Generation AI" button on the dashboard, the device sends the selection information to the server, which then returns the appropriate front-end component to the device based on the selection information received.

[1700] Step 4:

[1701] User: If you select text generation AI, you can enter the "topic of the text you want to generate" and "keywords." You can also set the output format (short text, long text, etc.) and quality parameters.

[1702] Terminal: Temporarily stores the information and configuration parameters entered by the user and sends them to the server in JSON format.

[1703] Input: User-entered information such as text topics, keywords, output format, and quality parameters.

[1704] Output: Temporarily saved data in JSON format.

[1705] Specific operation: When the user clicks the "Submit" button, the device temporarily saves the input information, converts it to JSON format, and sends it to the server.

[1706] Step 5:

[1707] Emotion recognition means: Analyzes user input data and voice and facial expression data obtained during actual user interactions to identify the user's emotions.

[1708] Server: Generates and stores additional parameters based on the output of the emotion recognition means.

[1709] Input: User voice and facial expression data.

[1710] Output: Additional parameters.

[1711] How it works: While the user is entering data, the emotion recognition unit analyzes the user's voice and facial expressions in real time to identify the emotion. The server generates the necessary additional parameters based on the results.

[1712] Step 6:

[1713] Server: Based on the received data and additional configuration parameters, it sends a request to the API of the generative AI tool to execute the generation process.

[1714] Generative AI tool: Creates a product based on specified conditions and sends the results back to the server.

[1715] Input: User configuration and additional parameters.

[1716] Output: The generated artifact.

[1717] Specific operation: The server sends a request to the generation AI tool using the configuration parameters and additional parameters. The generation AI tool creates a product and sends it back to the server.

[1718] Step 7:

[1719] Server: Temporarily stores the generated results and sends the display data to the user's device.

[1720] Terminal: Displays the generated data on a results screen for the user to review and download.

[1721] Input: The generated artifact.

[1722] Output: Display of results and downloadable data.

[1723] Specific operation: The server receives the generated results and temporarily stores them. It then sends the display data to the user's device. The device displays the generated results on the results screen, allowing the user to click the "Confirm" or "Download" button.

[1724] (Application example 2)

[1725] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1726] Conventional generative intelligence tools create products based on user-entered data and setting parameters, but do not take the user's emotions into consideration. As a result, they are unable to provide optimal output tailored to the user's emotional state, and the generated content may not match the user's needs or emotions. There was a need to provide a system that would solve this problem and improve the user experience.

[1727] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for combining and enabling the use of multiple generative intelligent tools provided free of charge or at low cost, a registration and login means, a means for selecting a generative intelligent tool, a data input means for the user to input input data and setting parameters, a means for executing a generation process based on the input data and setting parameters, a means for displaying and downloading the generated product, and an emotion recognition means for recognizing the user's emotions and optimizing the output content according to the emotions. This makes it possible to generate optimal content according to the user's emotions.

[1728] "Multiple generative intelligence tools provided free or at low cost" refers to a group of tools that are accessible to general consumers free of charge or at low cost and have a variety of generative intelligence functions, such as text generation, image generation, and speech generation.

[1729] "Registration and login means" means a means that allows a user to create and authenticate an account by entering information required to access the system (such as name, password, email address, etc.).

[1730] The "means for selecting a generative intelligent tool" is a means for providing an interface or function for a user to select a generative intelligent tool that the user wants to use.

[1731] The "data input means" is a means that provides a function for a user to input input data and setting parameters required to execute a generation process.

[1732] A "means for executing a generative process" is a system or function for running a generative intelligence tool based on user-entered data and configuration parameters to create a specified product.

[1733] "Means for displaying and enabling download of the generated product" refers to means for presenting the generated product to the user and providing a function that allows the user to view and save it.

[1734] "Emotion recognition means" refers to a technology or system that analyzes a user's facial expression, voice, or input text, etc., to recognize their emotion, and has the function of optimizing the content and tone of the generated output based on the recognized emotion.

[1735] This invention relates to a system that combines multiple generative intelligence tools that are available free or at low cost, and also combines emotion recognition means that recognizes user emotions. This system allows even non-engineers to easily use multiple generative intelligence tools (e.g., text generation, image generation, voice generation, etc.) to generate content that corresponds to the user's emotions.

[1736] The entire system consists of the following main components:

[1737] Registration and login methods

[1738] Selection methods for generative intelligence tools

[1739] A data entry means for the user to enter input data and setting parameters

[1740] A means to run the generation process based on input data and configuration parameters

[1741] A means to make the generated artifacts viewable and downloadable

[1742] Emotion recognition means for recognizing user emotions

[1743] A user accesses the system and creates and authenticates an account using the registration and login methods. First, the user accesses the registration screen on their terminal and enters the required information (name, password, email address, etc.). The terminal sends this information to the server, and the server creates a new user record in the database based on the received information. The user then activates their account through a confirmation email sent to the email address provided during registration. Similarly, when logging in, the email address and password entered by the user are verified, and a session ID is issued if successful.

[1744] Next, the user selects the generative intelligence tool he / she wants to use from the dashboard screen, and the terminal transmits the user's selection information to the server, and the server returns the front-end component and setting information corresponding to the selected generative intelligence tool to the terminal.

[1745] The user uses a data input means to input the necessary information depending on the generative intelligence tool they have selected. For example, if they select sentence generation intelligence, they input the topic and keywords of the sentence they want to generate. They also select setting parameters such as the output format (e.g., short sentences, long sentences) and quality parameters. The terminal temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[1746] The emotion recognition means analyzes user input data and voice and facial expression data acquired during actual user interactions to recognize the user's emotions. Based on this recognition result, additional parameters are automatically generated to optimize the output of the generative intelligence tool. For example, if the emotion recognition means recognizes that the user is feeling stressed, adjustments will be made, such as softening the tone of the generated text or making the colors of images more subdued.

[1747] Based on the received data and additional configuration parameters, the server sends a request to the API of the corresponding generative intelligence tool to execute the generation process. The generative intelligence tool (e.g., a sentence generation AI) creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained result and sends data to be displayed on the user's device. The device displays the generated data on the result screen, allowing the user to check and download the product.

[1748] For example, if a user wants to generate a "relaxing image," they log in, select the image generation AI from the dashboard, and enter a "relaxing theme" and "natural scenery." During this time, the emotion recognition means recognizes emotions from the user's voice and facial expressions, and if it detects "stress," for example, an image is generated with a tone and theme based on that emotion. The generated image is sent back to the device from the server, where the user can review it and download it if necessary.

[1749] In this way, a system incorporating emotion recognition means can provide customized products according to the user's emotions and generate more appropriate and effective output. This system provides an interface that can be used intuitively even by non-engineers, and effectively utilizes multiple generative intelligence tools and emotion recognition functions to improve work efficiency.

[1750] Example prompt sentence:

[1751] "I'm so stressed today, I want to see some images that will help me relax."

[1752] "I don't know how to write a business email. I want objective and positive sentences."

[1753] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1754] Step 1:

[1755] A user uses a terminal to access the system through registration and login procedures. The user enters the required information (such as name, password, and email address) and sends it to the server. The server creates a new user record in the database based on the received information and sends a confirmation email. The user receives the confirmation email and activates their account. When logging in, the email address and password entered by the user are verified, and a session ID is issued if successful.

[1756] Input: Name, Password, Email Address

[1757] Output: User record, session ID

[1758] Step 2:

[1759] The user accesses the dashboard screen and selects the generative intelligence tool they want to use. The terminal sends the user's selection information to the server, and the server returns the front-end component and setting information corresponding to the selected generative intelligence tool to the terminal.

[1760] Input: Selection information of the generative intelligence tool

[1761] Output: Front-end components, configuration information

[1762] Step 3:

[1763] The user uses a data input means to input the necessary information depending on the generative intelligence tool they have selected. For example, if they select sentence generation intelligence, they input the topic and keywords of the sentence they want to generate. They also select setting parameters such as the output format and quality parameters. The device temporarily stores the information and setting parameters entered by the user and sends them to the server in JSON format.

[1764] Input: Topic, Keywords, Configuration Parameters

[1765] Output: Input data in JSON format

[1766] Step 4:

[1767] The emotion recognition means analyzes user input data and voice and facial expression data acquired during actual user interactions to recognize the user's emotions. Based on this recognition result, additional parameters are automatically generated to optimize the output of the generative intelligence tool. For example, if the emotion recognition means recognizes that the user is feeling stressed, the tone of the generated text may be softened or the colors of the images may be made more subdued.

[1768] Input: User's voice, facial expression data

[1769] Output: Additional parameters

[1770] Step 5:

[1771] Based on the received data and additional configuration parameters, the server sends a request to the API of the corresponding generative intelligence tool to execute the generation process. The generative intelligence tool creates a product based on the specified conditions and returns the result to the server. The server temporarily stores the obtained result and sends the data to be displayed on the user's device.

[1772] Input: Input data, additional parameters

[1773] Output: product

[1774] Step 6:

[1775] The terminal displays the generated data on a results screen, allowing the user to review and download the product.

[1776] Input:Product

[1777] Output: Display of the result screen, download status of the generated product

[1778] For example, if a user wants to generate a "relaxing image," they log in, select the image generation AI from the dashboard, and enter a "relaxing theme" and "natural scenery." During this time, the emotion recognition means recognizes emotions from the user's voice and facial expressions, and if it detects "stress," for example, an image is generated with a tone and theme based on that emotion. The generated image is then sent back from the server to the device, where the user can review it and download it if necessary.

[1779] Example prompt sentence:

[1780] "I'm so stressed today, I want to see some images that will help me relax."

[1781] "I don't know how to write a business email. I want objective and positive sentences."

[1782] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1783] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1784] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1785] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1786] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1787] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1788] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1789] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1790] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1791] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1792] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1793] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1794] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1795] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1796] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1797] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1798] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1799] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1800] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. Th...

Claims

1. A system that enables the use of multiple generative artificial intelligence tools that are provided free of charge or at low cost, Registration and login means; A means for selecting a generative artificial intelligence tool; data input means for allowing a user to input input data and setting parameters; means for executing a generation process based on input data and configuration parameters; means for making the generated product available for viewing and download; A system including:

2. 2. The system according to claim 1, wherein the artificial intelligence tool is any one or all of an artificial intelligence for generating text, an artificial intelligence for generating images, and an artificial intelligence for generating voices.

3. 2. The system according to claim 1, wherein data is exchanged between a plurality of artificial intelligence generating tools when the generating process is executed based on user input data and setting parameters.

Images